-- Logs begin at Tue 2022-08-30 15:19:38 UTC, end at Tue 2022-08-30 17:51:28 UTC. -- Aug 30 15:53:22.030558 n-d-830883-28 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 15:53:22.039436 n-d-830883-28 devstack@n-api.service[106300]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 15:53:22 2022] *** Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: nodename: n-d-830883-28 Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: machine: x86_64 Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: clock source: unix Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: pcre jit disabled Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: detected number of CPU cores: 4 Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: current working directory: / Aug 30 15:53:22.041199 n-d-830883-28 devstack@n-api.service[106300]: detected binary path: /usr/bin/uwsgi-core Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: your processes number limit is 47680 Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: your memory page size is 4096 bytes Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: detected max file descriptor number: 2048 Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: lock engine: pthread robust mutexes Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: thunder lock: enabled Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 15:53:22.041906 n-d-830883-28 devstack@n-api.service[106300]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 15:53:22.080536 n-d-830883-28 devstack@n-api.service[106300]: Python main interpreter initialized at 0x55a41897a9c0 Aug 30 15:53:22.080536 n-d-830883-28 devstack@n-api.service[106300]: python threads support enabled Aug 30 15:53:22.080536 n-d-830883-28 devstack@n-api.service[106300]: your server socket listen backlog is limited to 100 connections Aug 30 15:53:22.080536 n-d-830883-28 devstack@n-api.service[106300]: your mercy for graceful operations on workers is 90 seconds Aug 30 15:53:22.080864 n-d-830883-28 devstack@n-api.service[106300]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 15:53:22.080953 n-d-830883-28 devstack@n-api.service[106300]: *** Operational MODE: preforking *** Aug 30 15:53:22.081189 n-d-830883-28 devstack@n-api.service[106300]: *** uWSGI is running in multiple interpreter mode *** Aug 30 15:53:22.081189 n-d-830883-28 devstack@n-api.service[106300]: spawned uWSGI master process (pid: 106300) Aug 30 15:53:22.081372 n-d-830883-28 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 15:53:22.082163 n-d-830883-28 devstack@n-api.service[106300]: spawned uWSGI worker 1 (pid: 106301, cores: 1) Aug 30 15:53:22.082271 n-d-830883-28 devstack@n-api.service[106300]: spawned uWSGI worker 2 (pid: 106302, cores: 1) Aug 30 15:53:22.082387 n-d-830883-28 devstack@n-api.service[106300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 15:53:22.757650 n-d-830883-28 devstack@n-api.service[106301]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:53:22.758262 n-d-830883-28 devstack@n-api.service[106302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:53:23.859544 n-d-830883-28 devstack@n-api.service[106302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:53:23.859544 n-d-830883-28 devstack@n-api.service[106302]: from cryptography.utils import int_from_bytes Aug 30 15:53:23.860287 n-d-830883-28 devstack@n-api.service[106302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:53:23.860287 n-d-830883-28 devstack@n-api.service[106302]: from cryptography.utils import int_from_bytes Aug 30 15:53:23.861398 n-d-830883-28 devstack@n-api.service[106301]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:53:23.861398 n-d-830883-28 devstack@n-api.service[106301]: from cryptography.utils import int_from_bytes Aug 30 15:53:23.861834 n-d-830883-28 devstack@n-api.service[106301]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:53:23.861834 n-d-830883-28 devstack@n-api.service[106301]: from cryptography.utils import int_from_bytes Aug 30 15:53:26.373707 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:53:26.374269 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:53:26.374507 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:53:26.374868 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:53:26.375124 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:53:26.375510 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.375830 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.376148 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.376464 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.376791 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.377099 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.377413 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.377499 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:53:26.377859 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:53:26.377957 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.378046 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.378212 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:53:26.378337 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.378597 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:53:26.378703 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.378856 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:53:26.378943 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-830883-28 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379222 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379315 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379525 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379623 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379833 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.379930 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380147 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380234 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380448 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380539 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380768 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.380855 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.381071 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.381170 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.381388 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.381565 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.381730 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.382910 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383113 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383329 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383511 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383511 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383836 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-830883-28 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.383836 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.384187 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.384411 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.384598 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.384786 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.384943 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.385121 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.385349 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.385539 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.386370 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.386600 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.386788 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.386986 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.387188 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.387188 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-830883-28 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.387507 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.387725 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.387928 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388079 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388302 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388459 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388587 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388817 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.388959 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389121 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389248 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389377 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389514 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389648 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389803 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.389929 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390052 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390182 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390333 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390482 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390617 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390752 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.390886 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-830883-28 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391011 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391207 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391335 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391466 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391599 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391726 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391849 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.391971 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392102 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392236 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392360 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392496 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392636 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392762 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392885 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.392885 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393139 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393277 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393410 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393534 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393657 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393829 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.393988 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394120 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394249 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394388 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394526 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394652 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394776 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.394901 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395038 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395162 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395302 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395427 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395550 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395673 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395795 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.395928 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396053 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396176 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396298 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396412 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396534 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396671 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396796 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.396933 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397059 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397181 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397304 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397438 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397563 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397686 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397809 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.397932 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398066 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398199 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398386 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398515 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398645 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398645 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398887 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.398887 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399123 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399254 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399378 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399500 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399633 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399766 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.399889 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400059 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400198 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400362 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400499 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400674 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400808 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.400977 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.401104 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.401316 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.401445 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.401621 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.401935 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402062 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402261 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402424 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402663 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402802 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.402927 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403064 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403189 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403327 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403486 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403614 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403801 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.403928 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404099 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404243 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404399 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404533 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404699 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404827 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.404994 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405122 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405294 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405423 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405594 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405722 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.405894 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406030 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406193 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406375 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406527 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406655 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406795 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.406919 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407092 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407220 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407395 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407531 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407693 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407820 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.407994 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408122 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408300 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408439 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408604 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408732 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.408902 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409036 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409200 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409337 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409498 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409627 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409794 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.409922 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410095 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410229 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410417 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410544 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410716 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.410855 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411016 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411152 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411316 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411442 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411617 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411745 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.411919 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412121 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412249 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412376 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412507 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412632 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412804 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.412941 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413099 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413227 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413399 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413537 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413699 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413834 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.413999 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414126 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414330 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414475 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414607 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414741 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.414900 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415028 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415197 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415325 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415496 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415633 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415793 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.415929 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.416092 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.416228 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.416383 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.416520 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.416694 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.417313 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.417526 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.417662 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.417830 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418118 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418246 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418441 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418569 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418753 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.418890 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.419068 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.419202 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.419375 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.419509 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.419682 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.419818 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.419990 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.420119 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.420298 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.420438 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.420602 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.420731 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.420907 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.421034 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.421207 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.421333 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.421517 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.421644 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.421832 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.421958 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.422137 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.422264 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.422449 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.422573 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.422756 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.422891 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.423065 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.423206 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:53:26.423378 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.423505 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.423702 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.423829 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424012 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424152 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424323 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424451 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424635 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424763 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.424940 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425076 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425251 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425405 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425569 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425697 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.425878 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426015 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426178 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426335 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426524 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426652 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426835 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.426972 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427145 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427273 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427460 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427594 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427774 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.427909 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428080 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428207 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428386 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428516 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428694 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.428824 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429006 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429140 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429315 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429482 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429616 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429740 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.429919 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430048 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430226 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430371 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430567 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430696 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.430872 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431006 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431176 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431304 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431480 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431611 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431789 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.431917 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.432094 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.432239 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.432435 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.433115 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.433277 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.433498 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.433627 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.433894 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434022 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434201 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434350 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434538 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434687 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.434895 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435033 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435168 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435300 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435432 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435556 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435714 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.435852 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436013 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436141 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436311 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436440 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436614 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436751 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.436912 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437047 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437226 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437364 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437550 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437680 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437853 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.437982 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438178 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438370 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438511 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438637 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438796 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.438934 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439102 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439243 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439408 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439536 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439708 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.439836 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440015 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440157 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440320 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440448 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440616 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440754 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.440916 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441046 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441225 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441362 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441521 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441648 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441837 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.441965 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442135 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442262 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442460 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442590 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442769 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.442900 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443075 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443206 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443379 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443507 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443684 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443814 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.443989 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444118 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444290 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444430 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444600 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444728 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.444903 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445029 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445206 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445343 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445528 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445660 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445827 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.445954 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446129 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446266 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446478 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446608 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446782 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.446918 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447079 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447220 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447384 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447513 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447684 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447812 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.447982 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.448141 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.448320 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.448457 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.448671 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.448896 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449037 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449228 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449364 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449544 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449679 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449856 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.449994 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450186 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450344 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450531 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450672 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450837 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.450973 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451136 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451263 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451440 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451604 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451750 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.451876 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452070 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452197 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452370 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452498 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452673 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452801 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.452978 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453107 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453282 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453410 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453590 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453728 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.453895 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454023 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454198 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454363 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454525 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454830 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.454957 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455134 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455263 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455455 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455592 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455765 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.455893 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456069 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456197 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456364 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456511 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456646 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456771 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.456976 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457113 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457281 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457409 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457600 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457727 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.457918 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458046 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458223 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458420 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458548 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458672 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.458881 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459016 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459196 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459324 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459506 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459634 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459815 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.459953 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460122 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460256 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460427 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460553 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460730 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.460867 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461038 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461175 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461343 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461470 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461650 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461785 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.461962 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462098 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462267 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462414 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462605 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462745 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.462907 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463035 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463220 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463348 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463546 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463718 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.463905 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464191 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464319 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464506 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464644 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464832 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.464960 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465162 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465291 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465470 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465612 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465782 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.465919 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466101 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466231 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466482 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466620 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466789 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.466917 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467099 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467222 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467402 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467533 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467704 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.467840 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468010 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468138 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468321 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468454 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468628 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468754 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.468933 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469059 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469233 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469364 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469542 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469670 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469844 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.469972 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.470144 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.470282 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.470719 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.470845 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471013 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471143 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471330 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471475 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471625 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471749 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.471943 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472082 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472251 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472387 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472549 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472676 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472849 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.472987 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473154 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473289 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473461 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473589 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473761 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.473900 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474060 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474197 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474383 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474514 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474688 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474828 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.474998 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475136 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475303 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475431 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475607 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475737 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.475917 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476053 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476219 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476346 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476528 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476659 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476835 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.476962 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477139 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477269 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477443 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477571 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477749 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.477876 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478054 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478182 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478380 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478512 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478683 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478812 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.478984 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.479124 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.479284 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.479915 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.480120 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.480313 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.480449 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.480718 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.480847 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481024 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481153 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481323 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481452 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481630 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481769 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.481949 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482079 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482294 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482529 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482671 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482856 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.482995 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483165 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483293 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483481 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483611 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483820 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.483968 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484131 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484259 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484442 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484580 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484752 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.484880 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485056 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485185 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485355 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485502 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485660 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485788 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.485960 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486091 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486258 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486456 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486583 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486706 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.486876 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487003 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487175 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487316 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487474 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487737 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.487865 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488063 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488201 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488376 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488604 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488733 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.488910 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489046 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489214 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489414 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489554 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489681 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489806 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.489961 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490090 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490274 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490427 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490603 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490743 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.490912 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491040 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491217 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491357 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491521 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491650 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491833 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.491955 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492137 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492267 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492441 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492578 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492745 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.492873 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493054 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493183 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493357 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493494 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493661 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493797 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.493961 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494090 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494263 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494422 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494600 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494738 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.494902 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.495585 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.495753 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496015 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496143 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496352 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496489 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496651 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496779 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.496958 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497095 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497260 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497398 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497565 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497685 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.497869 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498005 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498165 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498295 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498497 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498625 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498799 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.498943 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499111 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499240 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499414 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499542 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499713 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.499851 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500009 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500146 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500314 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500443 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500617 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500759 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.500915 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501044 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501222 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501358 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501520 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501663 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501836 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.501970 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502135 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502263 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502457 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502587 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502755 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.502884 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503062 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503190 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503369 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503496 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503664 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503791 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.503970 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504096 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504274 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504403 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504573 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504699 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.504871 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505010 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505170 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505310 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505467 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505594 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505765 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.505906 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506070 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506198 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506391 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506519 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506704 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.506845 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507001 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507136 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507309 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507437 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507609 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507744 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.507910 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508037 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508210 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508338 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508516 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508643 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508812 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.508939 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509111 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509240 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509411 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509534 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509711 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.509847 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510013 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510138 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510327 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510471 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510666 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510803 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.510967 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.511222 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.511460 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.511588 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.511727 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.511890 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512016 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512177 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512308 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512495 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512622 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512802 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.512942 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513113 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513242 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513417 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513546 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513722 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.513856 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514023 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514152 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514346 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514479 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514648 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514777 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.514949 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515078 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515250 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515378 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515552 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515690 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515850 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.515977 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516150 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516280 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516464 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516603 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516768 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.516902 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517071 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517197 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517373 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517575 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517704 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517834 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.517995 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518123 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518295 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518470 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518621 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518749 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.518926 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519062 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519231 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519361 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519537 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519667 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519843 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.519971 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520148 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520278 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520447 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520574 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520751 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.520877 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521056 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521193 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521360 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521497 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521658 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521785 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.521960 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522089 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522280 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522433 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522609 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522852 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.522983 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523177 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523305 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523484 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523612 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523784 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.523918 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524089 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524224 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524387 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524515 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524691 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524828 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.524991 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525119 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525300 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525426 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525608 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525737 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.525915 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.526044 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.526350 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.526532 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.526655 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.526968 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527106 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527271 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527386 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527581 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527703 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.527881 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528013 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528198 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528326 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528509 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528639 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528813 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.528942 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529138 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529266 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529433 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529562 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529736 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.529865 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530037 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530173 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530357 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530487 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530667 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530795 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.530970 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531109 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531303 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531438 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531625 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531753 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.531926 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532068 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532242 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532364 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532572 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532702 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.532880 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533018 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533191 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533328 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533502 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533630 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533803 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.533933 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534210 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534427 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534556 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534686 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534842 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.534971 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535154 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535282 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535452 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535586 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535752 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.535879 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536055 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536183 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536376 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536513 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536675 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536810 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.536976 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537111 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537279 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537418 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537578 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537706 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.537887 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538015 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538206 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538352 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538539 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538682 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538858 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.538988 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.539237 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.539371 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.539570 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.539707 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.539876 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540005 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540191 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540319 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540510 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540650 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540810 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.540951 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.541107 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.541236 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.541411 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.541555 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.541714 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.542370 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.542542 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.542744 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.542909 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543183 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543312 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543516 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543646 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543832 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.543970 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544150 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544278 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544448 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544583 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544747 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.544887 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545065 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545203 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545363 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545493 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545679 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545818 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.545985 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546115 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546319 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546451 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546647 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546788 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.546947 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547076 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547265 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547394 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547569 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547706 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547867 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.547996 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548164 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548300 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548461 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548599 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548794 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.548922 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549091 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549219 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549405 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549533 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549715 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.549843 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550022 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550164 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550346 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550477 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550651 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550780 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.550951 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551089 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551271 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551400 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551572 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551702 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.551891 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552027 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552196 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552326 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552493 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552621 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552798 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.552935 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553095 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553233 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553393 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553522 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553690 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553820 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.553992 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554135 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554289 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554436 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554606 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554749 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.554885 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555010 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555206 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555336 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555505 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555636 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555821 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.555950 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556125 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556262 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556424 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556561 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556723 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.556861 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.557019 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.557198 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.557356 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.558124 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.558263 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.558595 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.558723 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.558903 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559040 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559223 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559352 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559535 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559674 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559846 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.559976 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560156 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560291 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560465 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560593 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560770 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.560897 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561078 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561206 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561382 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561520 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561685 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561814 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.561986 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562119 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562316 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562459 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562626 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562752 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.562949 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563145 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563274 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563469 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563599 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563779 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.563908 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564089 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564217 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564398 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564527 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564707 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.564844 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565015 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565226 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565354 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565479 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565602 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565736 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.565907 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566043 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566214 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566410 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566562 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566690 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.566879 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567021 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567197 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567326 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567509 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567635 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567825 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.567955 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568129 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568256 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568438 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568566 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568747 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.568876 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569066 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569206 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569383 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569601 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569740 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.569936 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570066 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570258 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570409 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570603 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570731 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.570913 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571044 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571226 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571362 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571541 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571715 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571844 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.571968 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572152 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572282 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572479 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572607 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572761 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.572899 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.573108 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.573255 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.573592 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.573720 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.573928 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574117 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574247 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574501 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574641 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574827 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.574958 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575153 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575283 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575473 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575668 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575805 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.575982 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576140 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576313 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576443 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576636 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576765 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.576956 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577092 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577271 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577402 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577583 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577718 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.577906 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578043 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578208 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578377 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578534 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578663 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578841 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.578979 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579146 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579274 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579445 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579574 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579764 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.579901 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580070 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580198 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580394 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580641 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580770 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.580967 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581096 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581273 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581410 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581636 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581801 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.581953 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.582152 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.582490 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.582635 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.582807 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.582947 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583128 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583263 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583443 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583581 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583749 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.583890 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584068 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584202 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584370 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584497 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584674 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584817 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.584987 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585116 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585289 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585423 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585586 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585716 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.585887 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586017 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586188 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586342 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586519 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586647 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586819 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.586949 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587121 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587257 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587419 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587556 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587736 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.587864 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.588036 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.588266 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.588404 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.588612 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.588761 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.589040 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.589167 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.589592 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.589719 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.589905 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590033 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590210 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590354 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590539 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590670 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590848 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.590977 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591148 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591276 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591456 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591592 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591756 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.591892 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592066 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592194 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592366 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592495 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592697 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.592823 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593006 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593146 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593313 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593446 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593615 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593741 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.593914 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594051 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594214 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594372 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594544 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594670 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.594864 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.595002 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.595165 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.595301 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.595721 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.595850 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596032 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596170 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596340 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596476 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596647 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.596874 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597012 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597208 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597338 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597529 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597650 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597830 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.597966 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598139 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598267 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598456 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598580 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598762 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.598902 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599069 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599195 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599391 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599528 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599701 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.599838 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600011 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600138 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600311 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600433 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600615 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600743 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.600919 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601052 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601225 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601351 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601531 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601659 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601837 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.601964 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602141 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602267 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602498 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602628 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602753 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.602877 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603051 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603333 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603471 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603648 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603775 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.603956 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.604086 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.604779 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.604914 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.605213 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.605351 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.605532 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.605728 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.605874 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606045 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606182 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606376 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606509 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606706 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.606847 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607021 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607157 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607337 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607474 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607645 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607774 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.607955 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608082 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608266 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608393 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608568 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608710 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.608875 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609011 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609191 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609320 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609506 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609636 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609815 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.609944 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610124 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610262 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610456 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610578 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610768 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.610897 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611075 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611216 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611386 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611523 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611691 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.611826 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612019 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612157 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612335 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612463 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612650 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612779 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.612965 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613103 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613264 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613391 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613564 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613699 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.613863 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614001 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614166 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614294 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614501 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614630 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614804 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.614934 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615102 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615232 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615400 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615539 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615705 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.615833 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616002 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616139 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616299 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616437 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616598 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616727 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.616894 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617023 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617196 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617338 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617492 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617621 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617788 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.617917 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618084 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618228 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618388 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618548 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618693 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.618882 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619021 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619224 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619363 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619541 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619680 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.619838 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620030 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620169 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620348 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620546 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620790 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.620952 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621090 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621286 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621415 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621618 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621746 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.621932 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622070 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622257 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622428 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622589 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622727 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.622905 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623035 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623206 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623333 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623514 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623653 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623809 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.623939 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624112 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624240 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624418 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624585 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624726 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.624851 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625007 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625137 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625309 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625447 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625610 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625776 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.625902 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626027 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626200 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626365 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626545 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626682 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626849 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.626975 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627138 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627279 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627440 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627569 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627740 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.627869 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628041 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628179 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628368 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628495 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628682 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628812 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.628989 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629120 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629313 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629450 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629615 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629742 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.629909 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630039 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630214 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630394 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630544 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630673 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630849 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.630980 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631158 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631287 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631461 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631663 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631792 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.631919 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632067 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632196 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632381 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632522 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632692 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.632821 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633003 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633132 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633308 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633448 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633617 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633743 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.633939 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634067 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634262 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634430 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634591 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634722 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.634917 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.635047 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.635233 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.635364 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.636062 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.636234 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.636438 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.636743 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.636880 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.637014 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:53:26.637142 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.637422 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.637736 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.638050 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.638394 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.638710 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.639022 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.639339 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.639657 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.639970 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.640288 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.640605 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.640934 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.641262 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.641572 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.641900 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.642224 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.642596 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.642913 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.643257 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.643586 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.643900 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.644211 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.644515 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:53:26.644761 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:53:26.790095 n-d-830883-28 devstack@n-api.service[106302]: INFO dbcounter [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Registered counter for database nova_api Aug 30 15:53:26.800523 n-d-830883-28 devstack@n-api.service[106301]: INFO dbcounter [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Registered counter for database nova_api Aug 30 15:53:26.814784 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_db.sqlalchemy.engines [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.820660 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_db.sqlalchemy.engines [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.821506 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writer thread running {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:26.827558 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writer thread running {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:26.878513 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.context [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=106302) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:53:26.882719 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:53:26.883195 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:53:26.884748 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:53:26.885484 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:53:26.885974 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:53:26.886277 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.context [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=106301) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:53:26.887962 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:53:26.889919 n-d-830883-28 devstack@n-api.service[106302]: INFO dbcounter [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Registered counter for database nova_cell0 Aug 30 15:53:26.890134 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:53:26.890682 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:53:26.893316 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:53:26.894068 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:53:26.894161 n-d-830883-28 devstack@n-api.service[106302]: INFO dbcounter [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Registered counter for database nova_cell1 Aug 30 15:53:26.894545 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:53:26.896605 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_concurrency.lockutils [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:53:26.898594 n-d-830883-28 devstack@n-api.service[106301]: INFO dbcounter [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Registered counter for database nova_cell0 Aug 30 15:53:26.902168 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_db.sqlalchemy.engines [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.903873 n-d-830883-28 devstack@n-api.service[106301]: INFO dbcounter [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Registered counter for database nova_cell1 Aug 30 15:53:26.904747 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_db.sqlalchemy.engines [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.910081 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writer thread running {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:26.911555 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writer thread running {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:26.913061 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_db.sqlalchemy.engines [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.914771 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_db.sqlalchemy.engines [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:26.921230 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writer thread running {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:26.924021 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writer thread running {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:27.055580 n-d-830883-28 devstack@n-api.service[106302]: INFO dbcounter [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Registered counter for database nova_cell0 Aug 30 15:53:27.064219 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_db.sqlalchemy.engines [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:27.068513 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writer thread running {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:27.070361 n-d-830883-28 devstack@n-api.service[106301]: INFO dbcounter [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Registered counter for database nova_cell0 Aug 30 15:53:27.077423 n-d-830883-28 devstack@n-api.service[106301]: DEBUG oslo_db.sqlalchemy.engines [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:53:27.081676 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writer thread running {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:53:27.409697 n-d-830883-28 devstack@n-api.service[106302]: WARNING keystonemiddleware.auth_token [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:53:27.413683 n-d-830883-28 devstack@n-api.service[106301]: WARNING keystonemiddleware.auth_token [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:53:27.417454 n-d-830883-28 devstack@n-api.service[106302]: WARNING keystonemiddleware.auth_token [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:53:27.421563 n-d-830883-28 devstack@n-api.service[106301]: WARNING keystonemiddleware.auth_token [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:53:27.760238 n-d-830883-28 devstack@n-api.service[106302]: WARNING keystonemiddleware.auth_token [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:53:27.764436 n-d-830883-28 devstack@n-api.service[106301]: WARNING keystonemiddleware.auth_token [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:53:27.766321 n-d-830883-28 devstack@n-api.service[106302]: WARNING keystonemiddleware.auth_token [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:53:27.770383 n-d-830883-28 devstack@n-api.service[106301]: WARNING keystonemiddleware.auth_token [None req-5205fbdc-61f8-4bf6-878a-b6cdc01d6e74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:53:27.771518 n-d-830883-28 devstack@n-api.service[106302]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a41897a9c0 pid: 106302 (default app) Aug 30 15:53:27.773553 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:27.774764 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Aug 30 15:53:27.775192 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Tue Aug 30 15:53:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:27.775609 n-d-830883-28 devstack@n-api.service[106301]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a41897a9c0 pid: 106301 (default app) Aug 30 15:54:46.391777 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:46.392793 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 30 15:54:46.393188 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:46.405526 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_api:SELECT=3 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:46.407201 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_cell1:SELECT=3 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:46.407946 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_cell0:SELECT=3 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:46.409443 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:47.275527 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-b403c194-a41a-46e9-acc6-86476fc47219 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:47.307839 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-b403c194-a41a-46e9-acc6-86476fc47219 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907640 Aug 30 15:54:47.308569 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 15:54:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:54:49.709289 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:49.710164 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-10701348-7e90-4783-9564-fa18efb23dbe None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 30 15:54:49.710648 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:50.152349 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4c96ed1c-9f16-45ea-b720-be927fcc203f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:50.201720 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4c96ed1c-9f16-45ea-b720-be927fcc203f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485008 Aug 30 15:54:50.206444 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:54:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:54:50.424780 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-b87a5d99-6b0e-48ff-9599-c0dd8f524702 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:50.431872 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_api:SELECT=3 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:50.432727 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_cell1:SELECT=3 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:50.433613 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_cell0:SELECT=3 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:50.434292 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:50.497501 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-b87a5d99-6b0e-48ff-9599-c0dd8f524702 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286726 Aug 30 15:54:50.498082 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1336 bytes} [Tue Aug 30 15:54:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:54:52.895877 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4c96ed1c-9f16-45ea-b720-be927fcc203f admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:52.896885 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4c96ed1c-9f16-45ea-b720-be927fcc203f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 30 15:54:52.897591 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:54:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:53.623735 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-f91106f2-aa8f-4fc8-ad50-e1a309a7e771 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:53.661712 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-f91106f2-aa8f-4fc8-ad50-e1a309a7e771 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757645 Aug 30 15:54:53.662575 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:54:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 15:54:53.675140 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-35ac1d65-6135-4386-b538-72456baef4e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:53.720796 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-35ac1d65-6135-4386-b538-72456baef4e7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049297 Aug 30 15:54:53.729146 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1336 bytes} [Tue Aug 30 15:54:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:54:56.401201 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-f91106f2-aa8f-4fc8-ad50-e1a309a7e771 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:56.402213 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-f91106f2-aa8f-4fc8-ad50-e1a309a7e771 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 30 15:54:56.402650 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:56.893024 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-13ff08ae-f302-4e5a-8a53-6f925146d099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "swap": 0, "disk": 10}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:56.915621 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-13ff08ae-f302-4e5a-8a53-6f925146d099 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505236 Aug 30 15:54:56.929309 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-afdfec7a-a00d-4307-937b-d2333a7e741e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:56.934946 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:54:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:54:56.963400 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-afdfec7a-a00d-4307-937b-d2333a7e741e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038352 Aug 30 15:54:56.971612 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1336 bytes} [Tue Aug 30 15:54:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:54:59.547967 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-13ff08ae-f302-4e5a-8a53-6f925146d099 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:59.549007 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-13ff08ae-f302-4e5a-8a53-6f925146d099 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Aug 30 15:54:59.549978 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:59.976347 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-123d19f2-b34d-4dcd-9b89-72b390f574dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:54:59.996077 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-123d19f2-b34d-4dcd-9b89-72b390f574dc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440346 Aug 30 15:54:59.996959 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:54:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 15:55:00.008931 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-c6995fa3-7855-467a-8dc2-3f5c8c192ab5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:00.033031 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-c6995fa3-7855-467a-8dc2-3f5c8c192ab5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027920 Aug 30 15:55:00.033597 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1336 bytes} [Tue Aug 30 15:55:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:55:02.463954 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-123d19f2-b34d-4dcd-9b89-72b390f574dc admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:02.465718 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-123d19f2-b34d-4dcd-9b89-72b390f574dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002331 Aug 30 15:55:02.466915 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:03.001615 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:03.032334 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558284 Aug 30 15:55:03.033543 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:03.053270 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-fd1721dc-64de-4b6a-9216-822450fcae44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:03.107848 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-fd1721dc-64de-4b6a-9216-822450fcae44 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060050 Aug 30 15:55:03.108793 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1336 bytes} [Tue Aug 30 15:55:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:55:05.516675 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:05.517693 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 30 15:55:05.518248 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:06.010631 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-7a9d154d-e7c8-452e-b6a6-c9a8516a1a59 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:06.035778 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-7a9d154d-e7c8-452e-b6a6-c9a8516a1a59 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.511010 Aug 30 15:55:06.036420 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 15:55:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:08.552890 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:08.554591 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-e1d53f70-0bf8-4032-acee-32e696889545 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Aug 30 15:55:08.554999 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:55:09.005666 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-13b521c1-c737-479e-8606-548ce436bbbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:09.030249 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-13b521c1-c737-479e-8606-548ce436bbbe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468736 Aug 30 15:55:09.031141 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:09.044596 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-880274e0-5c7e-43d1-ab76-d5983ccd55b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:09.070487 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-880274e0-5c7e-43d1-ab76-d5983ccd55b7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029656 Aug 30 15:55:09.071127 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1333 bytes} [Tue Aug 30 15:55:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:55:11.416070 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-13b521c1-c737-479e-8606-548ce436bbbe admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:11.417161 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-13b521c1-c737-479e-8606-548ce436bbbe admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 30 15:55:11.417568 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:11.874761 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-8b6a9fdc-69b2-4bf6-bda9-345361ffc8ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:11.893695 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-8b6a9fdc-69b2-4bf6-bda9-345361ffc8ad admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469954 Aug 30 15:55:11.894252 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:11.907416 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-027b36b7-d826-4e8c-8867-beff46eb629c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:11.936097 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-027b36b7-d826-4e8c-8867-beff46eb629c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032524 Aug 30 15:55:11.936798 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1333 bytes} [Tue Aug 30 15:55:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:55:14.308287 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-8b6a9fdc-69b2-4bf6-bda9-345361ffc8ad admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:14.309308 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-8b6a9fdc-69b2-4bf6-bda9-345361ffc8ad admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 30 15:55:14.309705 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:14.713656 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-104e0a6b-c6d4-407e-bcae-b635eccc708b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "id": "3"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:14.734648 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-104e0a6b-c6d4-407e-bcae-b635eccc708b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418569 Aug 30 15:55:14.735124 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:14.747638 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-ca58f484-b397-4690-80d9-2067bc1befd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:14.772401 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-ca58f484-b397-4690-80d9-2067bc1befd9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027869 Aug 30 15:55:14.773375 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1333 bytes} [Tue Aug 30 15:55:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:55:17.136900 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-104e0a6b-c6d4-407e-bcae-b635eccc708b admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:17.137919 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-104e0a6b-c6d4-407e-bcae-b635eccc708b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 30 15:55:17.138351 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:17.495025 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-710e3488-02fc-4c41-b91d-bd5a7895f9a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:17.500622 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:17.516316 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-710e3488-02fc-4c41-b91d-bd5a7895f9a2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.371865 Aug 30 15:55:17.516899 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:17.529147 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-63daaede-4dcb-44c4-ac32-79ef88c055e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:17.555512 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-63daaede-4dcb-44c4-ac32-79ef88c055e0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029975 Aug 30 15:55:17.556107 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1333 bytes} [Tue Aug 30 15:55:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:55:20.009374 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-710e3488-02fc-4c41-b91d-bd5a7895f9a2 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:20.010417 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-710e3488-02fc-4c41-b91d-bd5a7895f9a2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 15:55:20.010818 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:20.457575 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "disk": 160, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:20.477164 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460122 Aug 30 15:55:20.477838 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1283 bytes} [Tue Aug 30 15:55:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:20.489914 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-5df8e9b6-203f-4e51-aace-607dbb0ecc99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:20.514639 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-5df8e9b6-203f-4e51-aace-607dbb0ecc99 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028365 Aug 30 15:55:20.515439 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1333 bytes} [Tue Aug 30 15:55:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:55:44.137040 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:44.138047 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 30 15:55:44.138479 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:44.149279 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:44.526443 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-dc841d1d-0b1d-488b-88e6-1695950777c8 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:44.546601 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-dc841d1d-0b1d-488b-88e6-1695950777c8 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402157 Aug 30 15:55:44.547134 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 15:55:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:45.600047 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:45.601061 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-bd52d6b7-835c-43f6-a34f-7eb5a92b9911 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002697 Aug 30 15:55:45.601457 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:46.147377 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-42e96f67-c7f9-45c0-a274-9c9b117c563d admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:46.152917 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.wsgi [None req-42e96f67-c7f9-45c0-a274-9c9b117c563d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-42e96f67-c7f9-45c0-a274-9c9b117c563d admin admin] Request method failure captured: Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Accept: application/json Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Accept-Encoding: gzip, deflate Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Connection: keep-alive Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Content-Length: 0 Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Host: 10.222.0.47 Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: Openstack-System-Scope: None Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: User-Agent: python-novaclient Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Auth-Token: gAAAAABjDjMBPidCFftJQPFxFRSk9ejjUF4f6mmJ_WugwfmFogFJfWGixfRj5XC0xinPMU3hUGiaexaR0mAgGCEvhHV7IhvF2uoEIOwjYOc0VFQ0_BhncnDyAi9GrKQjxQdE1Nm_7aPfP7gt2Fb5qtO2oBEZifHj2vxq_ixMWrf997q7wKKbL1U Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Id: None Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Name: None Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Identity-Status: Confirmed Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Is-Admin-Project: True Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Id: default Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Name: Default Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Name: admin Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Role: reader,member,admin Aug 30 15:55:46.156116 n-d-830883-28 devstack@n-api.service[106301]: X-Roles: reader,member,admin Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant: admin Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Name: admin Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-User: admin Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Id: default Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Name: Default Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: X-User-Name: admin Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: method: > Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: exception: Flavor 42 could not be found. Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: action_args: {'id': '42'} Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:46.157930 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:46.159003 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.160396 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-42e96f67-c7f9-45c0-a274-9c9b117c563d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:46.161738 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-42e96f67-c7f9-45c0-a274-9c9b117c563d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393992 Aug 30 15:55:46.161738 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 15:55:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:46.167044 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-dcba52a4-d8f0-4ddc-b5df-fdd3cc56d643 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:46.171093 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:55:46.190266 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-dcba52a4-d8f0-4ddc-b5df-fdd3cc56d643 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026742 Aug 30 15:55:46.190813 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:46.206283 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-e2b2b5bd-c2a5-4de2-b8f1-9786e43b35bf admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:46.230520 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-e2b2b5bd-c2a5-4de2-b8f1-9786e43b35bf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028932 Aug 30 15:55:46.231063 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:46.242969 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-b9677478-2377-4554-aa89-972d1bf0dc97 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:46.248968 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.wsgi [None req-b9677478-2377-4554-aa89-972d1bf0dc97 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-b9677478-2377-4554-aa89-972d1bf0dc97 admin admin] Request method failure captured: Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Accept: application/json Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Accept-Encoding: gzip, deflate Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Connection: keep-alive Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Content-Length: 0 Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Host: 10.222.0.47 Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: Openstack-System-Scope: None Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: User-Agent: python-novaclient Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Auth-Token: gAAAAABjDjMBPidCFftJQPFxFRSk9ejjUF4f6mmJ_WugwfmFogFJfWGixfRj5XC0xinPMU3hUGiaexaR0mAgGCEvhHV7IhvF2uoEIOwjYOc0VFQ0_BhncnDyAi9GrKQjxQdE1Nm_7aPfP7gt2Fb5qtO2oBEZifHj2vxq_ixMWrf997q7wKKbL1U Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Id: None Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Name: None Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Identity-Status: Confirmed Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Is-Admin-Project: True Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Id: default Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Name: Default Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Name: admin Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Role: reader,member,admin Aug 30 15:55:46.252301 n-d-830883-28 devstack@n-api.service[106302]: X-Roles: reader,member,admin Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant: admin Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Name: admin Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-User: admin Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Id: default Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Name: Default Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: X-User-Name: admin Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: method: > Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: exception: Flavor 42 could not be found. Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: action_args: {'id': '42'} Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:46.253803 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:46.254850 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:46.257341 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-b9677478-2377-4554-aa89-972d1bf0dc97 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:46.258688 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-b9677478-2377-4554-aa89-972d1bf0dc97 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016705 Aug 30 15:55:46.258688 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 15:55:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:47.222541 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-e2b2b5bd-c2a5-4de2-b8f1-9786e43b35bf admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:47.223527 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-e2b2b5bd-c2a5-4de2-b8f1-9786e43b35bf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 30 15:55:47.224504 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:47.740431 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-c0473e9e-cc84-4f7b-9add-24c4d3f26c03 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:47.745838 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.wsgi [None req-c0473e9e-cc84-4f7b-9add-24c4d3f26c03 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-c0473e9e-cc84-4f7b-9add-24c4d3f26c03 admin admin] Request method failure captured: Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Accept: application/json Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Accept-Encoding: gzip, deflate Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Connection: keep-alive Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Content-Length: 0 Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Host: 10.222.0.47 Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: Openstack-System-Scope: None Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: User-Agent: python-novaclient Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Auth-Token: gAAAAABjDjMDq9zwzBoVzR2rd2ye0n-Z5_MUJxFiaVC00I-T8wpszVlSQJen6Os39AC8k6UWwMOvLC90eV8r6Lw4L_Wbs_TGf_F23Qwu0OuY1YwR7SVgnns_JwowtD7ffJ7yHUjDHgyPW96sZt1G8nBWjYpS9dh7iuHzNwJfCCzjfO3HOg_pJ9A Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Id: None Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Name: None Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Identity-Status: Confirmed Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Is-Admin-Project: True Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Id: default Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Name: Default Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Name: admin Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Role: reader,member,admin Aug 30 15:55:47.747365 n-d-830883-28 devstack@n-api.service[106302]: X-Roles: reader,member,admin Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant: admin Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Name: admin Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-User: admin Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Id: default Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Name: Default Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: X-User-Name: admin Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: method: > Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: exception: Flavor 84 could not be found. Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: action_args: {'id': '84'} Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:47.748962 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:47.749944 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.751521 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-c0473e9e-cc84-4f7b-9add-24c4d3f26c03 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:47.752789 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-c0473e9e-cc84-4f7b-9add-24c4d3f26c03 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389334 Aug 30 15:55:47.752789 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 15:55:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:47.759323 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-92e23ab9-5f36-48e0-b84d-7c674b0f1740 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:47.775032 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-92e23ab9-5f36-48e0-b84d-7c674b0f1740 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020321 Aug 30 15:55:47.775566 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:55:47.785141 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-726949e6-aed4-4283-a561-9eab32d5b424 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:47.801032 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-726949e6-aed4-4283-a561-9eab32d5b424 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019485 Aug 30 15:55:47.801596 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:47.811685 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-410f186f-720d-4d8e-b99e-8b2e1928006d admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:47.817032 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.wsgi [None req-410f186f-720d-4d8e-b99e-8b2e1928006d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-410f186f-720d-4d8e-b99e-8b2e1928006d admin admin] Request method failure captured: Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Accept: application/json Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Accept-Encoding: gzip, deflate Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Connection: keep-alive Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Content-Length: 0 Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Host: 10.222.0.47 Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: Openstack-System-Scope: None Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: User-Agent: python-novaclient Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Auth-Token: gAAAAABjDjMDq9zwzBoVzR2rd2ye0n-Z5_MUJxFiaVC00I-T8wpszVlSQJen6Os39AC8k6UWwMOvLC90eV8r6Lw4L_Wbs_TGf_F23Qwu0OuY1YwR7SVgnns_JwowtD7ffJ7yHUjDHgyPW96sZt1G8nBWjYpS9dh7iuHzNwJfCCzjfO3HOg_pJ9A Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Id: None Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Name: None Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Identity-Status: Confirmed Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Is-Admin-Project: True Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Id: default Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Name: Default Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Name: admin Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Role: reader,member,admin Aug 30 15:55:47.819524 n-d-830883-28 devstack@n-api.service[106301]: X-Roles: reader,member,admin Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant: admin Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Name: admin Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-User: admin Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Id: default Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Name: Default Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: X-User-Name: admin Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: method: > Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: exception: Flavor 84 could not be found. Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: action_args: {'id': '84'} Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:47.820856 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:47.821660 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:47.822878 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-410f186f-720d-4d8e-b99e-8b2e1928006d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:47.824517 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-410f186f-720d-4d8e-b99e-8b2e1928006d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012864 Aug 30 15:55:47.824517 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 15:55:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:48.793600 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-726949e6-aed4-4283-a561-9eab32d5b424 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:48.794682 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-726949e6-aed4-4283-a561-9eab32d5b424 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 30 15:55:48.795079 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:49.318845 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-c9e1f08e-736c-491c-bc46-27bb54810642 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:49.324550 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.wsgi [None req-c9e1f08e-736c-491c-bc46-27bb54810642 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-c9e1f08e-736c-491c-bc46-27bb54810642 admin admin] Request method failure captured: Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Accept: application/json Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Accept-Encoding: gzip, deflate Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Connection: keep-alive Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Content-Length: 0 Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Host: 10.222.0.47 Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: Openstack-System-Scope: None Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: User-Agent: python-novaclient Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Auth-Token: gAAAAABjDjMEDBPdATaXEMORTC68cnhMcLINHIuTGX3IEeAx8RcDo5U7U7yZzIenMv09vQzm8-hETwMHNM53fFZ2F6OWn7IoSJJCDzjX62HThaniXBx4CL4G6fnrcMo3Odg-2xHLgyO5RX4jst1em7ZEwyHOVP-K7JNM8N9g2GwpovBdbKBaebA Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Id: None Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Domain-Name: None Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Identity-Status: Confirmed Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Is-Admin-Project: True Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Id: default Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Domain-Name: Default Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Project-Name: admin Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Role: reader,member,admin Aug 30 15:55:49.326051 n-d-830883-28 devstack@n-api.service[106301]: X-Roles: reader,member,admin Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant: admin Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-Tenant-Name: admin Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-User: admin Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Id: default Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-User-Domain-Name: Default Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: X-User-Name: admin Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: method: > Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: exception: Flavor 451 could not be found. Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: action_args: {'id': '451'} Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:49.327500 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:49.328459 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.329873 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-c9e1f08e-736c-491c-bc46-27bb54810642 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:49.331167 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-c9e1f08e-736c-491c-bc46-27bb54810642 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392581 Aug 30 15:55:49.331167 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 15:55:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:55:49.337337 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-5d16cbe5-065e-42fb-a148-393c2515b630 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:49.352268 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-5d16cbe5-065e-42fb-a148-393c2515b630 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018785 Aug 30 15:55:49.352776 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:49.361896 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:49.377333 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018925 Aug 30 15:55:49.377831 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Aug 30 15:55:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:55:49.387643 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-a0f6361c-a600-4555-9f09-55aef58b552e admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:49.392777 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.wsgi [None req-a0f6361c-a600-4555-9f09-55aef58b552e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-a0f6361c-a600-4555-9f09-55aef58b552e admin admin] Request method failure captured: Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Accept: application/json Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Accept-Encoding: gzip, deflate Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Connection: keep-alive Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Content-Length: 0 Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Host: 10.222.0.47 Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Openstack-Api-Version: compute 2.90 Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: Openstack-System-Scope: None Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: User-Agent: python-novaclient Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Auth-Token: gAAAAABjDjMEDBPdATaXEMORTC68cnhMcLINHIuTGX3IEeAx8RcDo5U7U7yZzIenMv09vQzm8-hETwMHNM53fFZ2F6OWn7IoSJJCDzjX62HThaniXBx4CL4G6fnrcMo3Odg-2xHLgyO5RX4jst1em7ZEwyHOVP-K7JNM8N9g2GwpovBdbKBaebA Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Id: None Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Domain-Name: None Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Identity-Status: Confirmed Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Is-Admin-Project: True Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Id: default Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Domain-Name: Default Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Project-Name: admin Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Role: reader,member,admin Aug 30 15:55:49.394253 n-d-830883-28 devstack@n-api.service[106302]: X-Roles: reader,member,admin Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/32ffe29c228f4d19aafc48c10a091e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/32ffe29c228f4d19aafc48c10a091e7c"}]}] Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant: admin Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Id: 32ffe29c228f4d19aafc48c10a091e7c Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-Tenant-Name: admin Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-User: admin Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Id: default Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-User-Domain-Name: Default Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-User-Id: a97dd2048cae41c0b664232f90d8d99e Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: X-User-Name: admin Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: method: > Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: exception: Flavor 451 could not be found. Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: action_args: {'id': '451'} Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:55:49.396056 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:49.397284 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: ERROR nova.api.openstack.wsgi Aug 30 15:55:49.398675 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-a0f6361c-a600-4555-9f09-55aef58b552e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:55:49.399919 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-a0f6361c-a600-4555-9f09-55aef58b552e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011443 Aug 30 15:55:49.399919 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 15:55:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 15:55:50.356365 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:50.357441 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 30 15:55:50.357841 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:50.880182 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-84992d7a-7c1d-4522-b0ee-209e8b48ec94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:50.901338 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-84992d7a-7c1d-4522-b0ee-209e8b48ec94 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406109 Aug 30 15:55:50.901905 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Aug 30 15:55:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:51.876563 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:51.877599 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 15:55:51.877996 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:52.398631 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-f6515152-3003-4db2-91bc-66f531152fd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:52.417723 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-f6515152-3003-4db2-91bc-66f531152fd9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400805 Aug 30 15:55:52.418271 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Aug 30 15:55:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:53.379403 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:53.380413 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 30 15:55:53.380815 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:53.894928 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-b9a01787-7d66-4a71-81bf-371b84f205d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:53.915411 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-b9a01787-7d66-4a71-81bf-371b84f205d4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.396977 Aug 30 15:55:53.915951 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Aug 30 15:55:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:54.880532 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:54.881563 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 30 15:55:54.882583 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:55.404103 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-f575295c-40f0-4d91-a75f-1354add9400c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:55:55.423089 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-f575295c-40f0-4d91-a75f-1354add9400c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403689 Aug 30 15:55:55.423635 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Aug 30 15:55:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:55:56.387894 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:56.388895 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 30 15:55:56.389287 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 15:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:55:56.919973 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-453b1149-96a6-4adb-99f5-9b63f1d95ba3 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:55:56.940200 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-453b1149-96a6-4adb-99f5-9b63f1d95ba3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413878 Aug 30 15:55:56.940727 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Tue Aug 30 15:55:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:56:50.330717 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.331732 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-4e0de45e-ffb7-4426-a47d-414315ccc5f7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 15:56:50.332135 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 931 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:56:50.343112 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:56:50.728945 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-bdfbf576-bda2-4244-819a-adc407c40266 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.750161 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-bdfbf576-bda2-4244-819a-adc407c40266 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411753 Aug 30 15:56:50.750662 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:56:50.772722 n-d-830883-28 devstack@n-api.service[106301]: DEBUG dbcounter [-] [106301] Writing DB stats nova_api:SELECT=14 {{(pid=106301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:56:50.776734 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-b8c44ffc-ecd1-4daa-aece-f8849c242d0e admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.784907 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-b8c44ffc-ecd1-4daa-aece-f8849c242d0e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014488 Aug 30 15:56:50.785478 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1283 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:56:50.798855 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-0ce09d6c-5638-4775-8b54-3888c0a3de9e admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.806884 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-0ce09d6c-5638-4775-8b54-3888c0a3de9e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011626 Aug 30 15:56:50.807402 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1286 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:56:50.818914 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.826352 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011053 Aug 30 15:56:50.826861 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1286 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:56:50.839066 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-1b393ae2-39ba-4db8-a74f-f2d4d8cc30cf admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:56:50.846850 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-1b393ae2-39ba-4db8-a74f-f2d4d8cc30cf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011731 Aug 30 15:56:50.847353 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1283 bytes} [Tue Aug 30 15:56:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:16.621879 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:16.622926 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 16:02:16.623330 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 16:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:16.766526 n-d-830883-28 devstack@n-api.service[106302]: DEBUG dbcounter [-] [106302] Writing DB stats nova_api:SELECT=6 {{(pid=106302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:16.905393 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:16.909451 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:16.909935 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:16.910450 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:16.911164 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:16.911617 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:16.912039 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:16.952969 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-67b8a689-7bec-434c-988e-2f7d1afc3ebe admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.187954 Aug 30 16:02:16.953549 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 16:02:16 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:17.777727 n-d-830883-28 devstack@n-api.service[106301]: DEBUG nova.api.openstack.wsgi [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] Calling method '>' {{(pid=106301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:17.778753 n-d-830883-28 devstack@n-api.service[106301]: INFO nova.api.openstack.requestlog [None req-1c079dca-6846-4237-b5ac-31315fa3ecb3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 30 16:02:17.779144 n-d-830883-28 devstack@n-api.service[106301]: [pid: 106301|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Aug 30 16:02:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:17.976222 n-d-830883-28 devstack@n-api.service[106302]: DEBUG nova.api.openstack.wsgi [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Calling method '>' {{(pid=106302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:17.979682 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:17.980156 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:17.980580 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:17.981318 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:17.981758 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:17.982173 n-d-830883-28 devstack@n-api.service[106302]: DEBUG oslo_concurrency.lockutils [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:18.004913 n-d-830883-28 devstack@n-api.service[106302]: INFO nova.api.openstack.requestlog [None req-76bcc1d9-78a1-4434-a764-971bde5c6469 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.084906 Aug 30 16:02:18.005463 n-d-830883-28 devstack@n-api.service[106302]: [pid: 106302|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 16:02:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:04.694093 n-d-830883-28 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 16:03:04.695219 n-d-830883-28 devstack@n-api.service[106300]: Tue Aug 30 16:03:04 2022 - graceful shutdown triggered... Aug 30 16:03:04.695730 n-d-830883-28 devstack@n-api.service[106301]: Gracefully killing worker 1 (pid: 106301)... Aug 30 16:03:04.696133 n-d-830883-28 devstack@n-api.service[106302]: Gracefully killing worker 2 (pid: 106302)... Aug 30 16:03:05.696370 n-d-830883-28 devstack@n-api.service[106300]: worker 1 buried after 1 seconds Aug 30 16:03:05.696927 n-d-830883-28 devstack@n-api.service[106300]: worker 2 buried after 1 seconds Aug 30 16:03:05.696927 n-d-830883-28 devstack@n-api.service[106300]: goodbye to uWSGI. Aug 30 16:03:05.697906 n-d-830883-28 systemd[1]: devstack@n-api.service: Succeeded. Aug 30 16:03:05.698514 n-d-830883-28 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 16:03:05.702025 n-d-830883-28 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 16:03:05.716319 n-d-830883-28 devstack@n-api.service[122334]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 16:03:05 2022] *** Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: nodename: n-d-830883-28 Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: machine: x86_64 Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: clock source: unix Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: pcre jit disabled Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: detected number of CPU cores: 4 Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: current working directory: / Aug 30 16:03:05.738014 n-d-830883-28 devstack@n-api.service[122334]: detected binary path: /usr/bin/uwsgi-core Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: your processes number limit is 47680 Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: your memory page size is 4096 bytes Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: detected max file descriptor number: 2048 Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: lock engine: pthread robust mutexes Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: thunder lock: enabled Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 16:03:05.738832 n-d-830883-28 devstack@n-api.service[122334]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 16:03:05.783138 n-d-830883-28 devstack@n-api.service[122334]: Python main interpreter initialized at 0x5586747aa9c0 Aug 30 16:03:05.783138 n-d-830883-28 devstack@n-api.service[122334]: python threads support enabled Aug 30 16:03:05.783138 n-d-830883-28 devstack@n-api.service[122334]: your server socket listen backlog is limited to 100 connections Aug 30 16:03:05.783138 n-d-830883-28 devstack@n-api.service[122334]: your mercy for graceful operations on workers is 90 seconds Aug 30 16:03:05.783597 n-d-830883-28 devstack@n-api.service[122334]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 16:03:05.783597 n-d-830883-28 devstack@n-api.service[122334]: *** Operational MODE: preforking *** Aug 30 16:03:05.783831 n-d-830883-28 devstack@n-api.service[122334]: *** uWSGI is running in multiple interpreter mode *** Aug 30 16:03:05.783831 n-d-830883-28 devstack@n-api.service[122334]: spawned uWSGI master process (pid: 122334) Aug 30 16:03:05.784035 n-d-830883-28 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 16:03:05.793576 n-d-830883-28 devstack@n-api.service[122334]: spawned uWSGI worker 1 (pid: 122351, cores: 1) Aug 30 16:03:05.793576 n-d-830883-28 devstack@n-api.service[122334]: spawned uWSGI worker 2 (pid: 122352, cores: 1) Aug 30 16:03:05.793576 n-d-830883-28 devstack@n-api.service[122334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 16:03:06.451566 n-d-830883-28 devstack@n-api.service[122352]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:03:06.458098 n-d-830883-28 devstack@n-api.service[122351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 16:03:07.629656 n-d-830883-28 devstack@n-api.service[122351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:03:07.629656 n-d-830883-28 devstack@n-api.service[122351]: from cryptography.utils import int_from_bytes Aug 30 16:03:07.630438 n-d-830883-28 devstack@n-api.service[122351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:03:07.630438 n-d-830883-28 devstack@n-api.service[122351]: from cryptography.utils import int_from_bytes Aug 30 16:03:07.631189 n-d-830883-28 devstack@n-api.service[122352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:03:07.631189 n-d-830883-28 devstack@n-api.service[122352]: from cryptography.utils import int_from_bytes Aug 30 16:03:07.631683 n-d-830883-28 devstack@n-api.service[122352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 16:03:07.631683 n-d-830883-28 devstack@n-api.service[122352]: from cryptography.utils import int_from_bytes Aug 30 16:03:10.055994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:03:10.056678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:03:10.056774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:03:10.057153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:03:10.057413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:03:10.057806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.058240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.058594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.058914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.059393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.059708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.060034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.060358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.060691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.060956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.061277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.061603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-830883-28 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.061928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.062239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.062580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.062900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.063205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.063530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.063836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.064338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.064784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.065092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.065409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.065821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.066046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.066379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.066704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.067013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.067335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.067644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.068037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-830883-28 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.068355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.068668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.068983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.069394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.069705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.070014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.070358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.070696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.071002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.071310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 16:03:10.071725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.071805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 16:03:10.071884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.071971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.072099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 16:03:10.072264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.072471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 16:03:10.072579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.072737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 16:03:10.072832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.073112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.073218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.073432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.074862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.075958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.076955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-830883-28 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.077994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.078993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.079137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.079326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.079428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.079658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.079761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.080978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.081944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.082072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.082606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.082721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.082948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.083997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-830883-28 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.084934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.085940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.086935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.087960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.088879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.089076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.089804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.089936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.090034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.090131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.090765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.090863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.090957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.091870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.092947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.093965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.094919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.095899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.096794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.097944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.098977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.099895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.100798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.101940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.102910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.103009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.103225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.103328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.103539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.103632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.103854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.103954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.104165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.104266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.104482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.104590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.104843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.105002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.105524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.105738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.105829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.105912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.105912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.106172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.106281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.106452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.106580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.106719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.106808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.106910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.107057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.107157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.107364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.107456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.107691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.107801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.108018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.108111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.108330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.108431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.108641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.108750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.108951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.109051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.109264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.109364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.109590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.109691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.109909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.110001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.110220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.110332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.110576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.110678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.110890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.110983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.111203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.111295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.111527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.111627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.111841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.112021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.112150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.112248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.112464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.112555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.112768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.112868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.113079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.113178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.113403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.113502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.113714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.113813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.114022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.114113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.114352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.114448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.114681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.114791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.115001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.115104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.115313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.115412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.115622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.115721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.115931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.116077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.116235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.116327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.116561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.116698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.116875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.116976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.117190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.117288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.117503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.117608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.117813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.117904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.118131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.118231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 16:03:10.118470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.118581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.118785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.118878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.119816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.120019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.120110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.120334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.120989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.121514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.121631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.121725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.121865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.122975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.123931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.124864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.125810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.126990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.127933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.128978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.129938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.130942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.131888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.132809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.133923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.134953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.135897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.136754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.137964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.138216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.138520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.138615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.138901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.139160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.139254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.139539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.139735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.139863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.140179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.140378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.140499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.140818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.140986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.141136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.141463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.141554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.141781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.141886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.142876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.143834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.144827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.145996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.146988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.147945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.148995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.149943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.150925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.151980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.152913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.153850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.154965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.155995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.156986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.157947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.158913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.159936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.160956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.161944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.162099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.162349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.162527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.162664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.162981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.163921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.164864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.165826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.166985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.167138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.167332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.167822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.167978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.168996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.169256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.169350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.169579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.169673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.169912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.170995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.171208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.171520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.171829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.172969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.173926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.174230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.174346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.174563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.174882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.175857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.176089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.176196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.176399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.176544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.176707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.177978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.178202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.178334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.178571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.178672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.178915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.179007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.179295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.179602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.179929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.180847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.181797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.182787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.183497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.184942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.185991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.186937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.187862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.188795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.189944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.190986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.191903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.192868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.193977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.194916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.195803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.196963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.197918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.198045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.198230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.198411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.198628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.199760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.199928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.200990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.201941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.202930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.203046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.203199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.203975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.204992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.205951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.206919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.207013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.207486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.207595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.207798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.207900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.208829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.209963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.210994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.211958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.212915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.213866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.214067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.214226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.214880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.215996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.216940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.217883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.218834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.219976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.220913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.221956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.222956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.223916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.224951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.225900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.226905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.227878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.228798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.229977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.230967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.231925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.232882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.233852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.234963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.235932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.236912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.237896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.238876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.239975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.240934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.241992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.242192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.242284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.242617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.242714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.242931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.243849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.244983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.245141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.245316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.246984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.247874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.248831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.249789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.250927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.251901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.252847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.253782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.254985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.255930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.256987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.257939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.258915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.259842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.260802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.261070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.262901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.263943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.264897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.265830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.266784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.267947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.268959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.269210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.269479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.269579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.269831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.269934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.270907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.271868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.272808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.273929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.274950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.275881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.296964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.297292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.297474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.297703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.297876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.299065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.299065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.299744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.299976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.300219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.300459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.300616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.300792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.301546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.301715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.301886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.302048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.302833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.302833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.303865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.303865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.304177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.304312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.304443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.304572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.304704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.305336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.305514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.305649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.305779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.305909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.306986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.307822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.308447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.308447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.308920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.309925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.310914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.311922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.312931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.313934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.314951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.315998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.316990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.317863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.318908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.319957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.320931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.321915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.322958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.323166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.323278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.323390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.323508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.324961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.325483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.325603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.325603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.325804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.325916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.326955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.327902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.328923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.329996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.330926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.331953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.332884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.333961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.334927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.335999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.336898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.337917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.338898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.339881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.340315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.341922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.342758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.343552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.344341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.345142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.346881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.346881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.346881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.346881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.346881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.347622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.347622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.347622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.347960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.348230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.348567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.348900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.349219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.349553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.349885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.350242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.350590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.350943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.351282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.351602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.351920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.352232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 16:03:10.352482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 16:03:10.390440 n-d-830883-28 devstack@n-api.service[122351]: INFO dbcounter [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Registered counter for database nova_api Aug 30 16:03:10.413682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_db.sqlalchemy.engines [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.415259 n-d-830883-28 devstack@n-api.service[122352]: INFO dbcounter [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Registered counter for database nova_api Aug 30 16:03:10.420599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writer thread running {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.436236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.443586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writer thread running {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.478463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.context [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122351) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:03:10.483297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.483769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.485406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.486135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.486615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.488651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.490683 n-d-830883-28 devstack@n-api.service[122351]: INFO dbcounter [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Registered counter for database nova_cell0 Aug 30 16:03:10.494696 n-d-830883-28 devstack@n-api.service[122351]: INFO dbcounter [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Registered counter for database nova_cell1 Aug 30 16:03:10.502072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.context [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122352) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 16:03:10.502346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_db.sqlalchemy.engines [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.504517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_db.sqlalchemy.engines [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.506232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.506739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.508314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.509056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.509508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.509598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writer thread running {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.511665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.513899 n-d-830883-28 devstack@n-api.service[122352]: INFO dbcounter [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Registered counter for database nova_cell0 Aug 30 16:03:10.514972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writer thread running {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.518046 n-d-830883-28 devstack@n-api.service[122352]: INFO dbcounter [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Registered counter for database nova_cell1 Aug 30 16:03:10.525408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.529459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.532400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writer thread running {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.663060 n-d-830883-28 devstack@n-api.service[122351]: INFO dbcounter [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Registered counter for database nova_cell0 Aug 30 16:03:10.671306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_db.sqlalchemy.engines [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.676776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writer thread running {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.679633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writer thread running {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.689306 n-d-830883-28 devstack@n-api.service[122352]: INFO dbcounter [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Registered counter for database nova_cell0 Aug 30 16:03:10.696451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 16:03:10.701228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writer thread running {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 16:03:10.997162 n-d-830883-28 devstack@n-api.service[122351]: WARNING keystonemiddleware.auth_token [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:03:11.004497 n-d-830883-28 devstack@n-api.service[122351]: WARNING keystonemiddleware.auth_token [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:03:11.025295 n-d-830883-28 devstack@n-api.service[122352]: WARNING keystonemiddleware.auth_token [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:03:11.033195 n-d-830883-28 devstack@n-api.service[122352]: WARNING keystonemiddleware.auth_token [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:03:11.348076 n-d-830883-28 devstack@n-api.service[122351]: WARNING keystonemiddleware.auth_token [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:03:11.354035 n-d-830883-28 devstack@n-api.service[122351]: WARNING keystonemiddleware.auth_token [None req-fab08629-0a7b-4508-9577-ce4255e754c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:03:11.359861 n-d-830883-28 devstack@n-api.service[122351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586747aa9c0 pid: 122351 (default app) Aug 30 16:03:11.379024 n-d-830883-28 devstack@n-api.service[122352]: WARNING keystonemiddleware.auth_token [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 16:03:11.384958 n-d-830883-28 devstack@n-api.service[122352]: WARNING keystonemiddleware.auth_token [None req-0a9a4b45-a733-475b-8bbf-23cbd0c9e867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 16:03:11.390239 n-d-830883-28 devstack@n-api.service[122352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586747aa9c0 pid: 122352 (default app) Aug 30 16:03:53.232027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.232864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.233558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.234268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.446678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.447502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.448428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.449702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:54.296011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:54.297732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.298218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.298684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.299416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.299877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.300305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.343672 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6957ceb-18f0-4f57-9433-bce33a944116 tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.117425 Aug 30 16:03:54.344462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1/1] 10.222.0.47 () {58 vars in 1164 bytes} [Tue Aug 30 16:03:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:54.372245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '.version_select at 0x7fd35e72c280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:54.378917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122352) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 16:03:54.379642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.380111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.380540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.406848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.407916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.408802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.422451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.422933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.423532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.429836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c0880a91-af9a-4253-a6df-7846e5fbf5db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.988498 Aug 30 16:03:54.430443 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:03:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:54.527880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Calling method '.version_select at 0x7fd35e61ec10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:54.538105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122351) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 16:03:54.539049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.539528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.540098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.567774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.568773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.569357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.585520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.586000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.586465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.592785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4365e26e-c390-43f1-a5fa-a6ee600d0013 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.247136 Aug 30 16:03:54.593379 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1208 bytes} [Tue Aug 30 16:03:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:54.629282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65b7af7b-4f44-45bc-8c79-fafeb3a33650 tempest-AZAdminNegativeTestJSON-1242612952 tempest-AZAdminNegativeTestJSON-1242612952-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:54.631794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65b7af7b-4f44-45bc-8c79-fafeb3a33650 tempest-AZAdminNegativeTestJSON-1242612952 tempest-AZAdminNegativeTestJSON-1242612952-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3a93fa0bd2164827865086ecbc6d9401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd16dcbe7a01b4b2fae438e91eda9b1fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65b7af7b-4f44-45bc-8c79-fafeb3a33650 tempest-AZAdminNegativeTestJSON-1242612952 tempest-AZAdminNegativeTestJSON-1242612952-project] Request method failure captured: Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTnA5ry4WybN04dCxuuuEHJAhcF8Y7VWaOJXBFXz0Jz2NEfTk5ub2C-auLeD6ksKbJLu32Z_K6sBqCnmyoUUOwGwTCkLiPeP90dMSii258wLCnWaN4zqX9-Bm9WQCzhpJ7ihrToh1AR45ikeL2euQlJ_kDj3f6ftChW_F6LjHlx-tA Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d16dcbe7a01b4b2fae438e91eda9b1fc Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1242612952 Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:03:54.635713 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16dcbe7a01b4b2fae438e91eda9b1fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d16dcbe7a01b4b2fae438e91eda9b1fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d16dcbe7a01b4b2fae438e91eda9b1fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d16dcbe7a01b4b2fae438e91eda9b1fc"}]}] Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AZAdminNegativeTestJSON-1242612952 Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d16dcbe7a01b4b2fae438e91eda9b1fc Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1242612952 Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AZAdminNegativeTestJSON-1242612952-project Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3a93fa0bd2164827865086ecbc6d9401 Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AZAdminNegativeTestJSON-1242612952-project Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 16:03:54.637259 n-d-830883-28 devstack@n-api.service[122352]: action_args: {} Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:03:54.637939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 16:03:54.638860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:54.640585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65b7af7b-4f44-45bc-8c79-fafeb3a33650 tempest-AZAdminNegativeTestJSON-1242612952 tempest-AZAdminNegativeTestJSON-1242612952-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:54.641739 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65b7af7b-4f44-45bc-8c79-fafeb3a33650 tempest-AZAdminNegativeTestJSON-1242612952 tempest-AZAdminNegativeTestJSON-1242612952-project] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.206273 Aug 30 16:03:54.642345 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:03:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:03:54.729004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2127757019", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:54.849290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35e596f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:54.854149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.855452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.855914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.856642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:54.857095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:54.857667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:54.900521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e67088c7-4830-4a0c-9276-27fec539d785 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.256979 Aug 30 16:03:54.901098 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:03:54 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.099896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a5fcc22-b3e2-4d76-a3ba-236cc51f8e22 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2074968970", "id": 1816719555, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:55.162327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a5fcc22-b3e2-4d76-a3ba-236cc51f8e22 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.260096 Aug 30 16:03:55.163854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4/6] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:54 2022] POST /compute/v2.1/flavors => generated 431 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.169573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:55.171808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.172589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.173397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.174501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.175183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.175769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.204217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bad3659e-0a82-44df-b964-2c3bb6b43d3d tempest-AZAdminV2TestJSON-908602695 tempest-AZAdminV2TestJSON-908602695-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.039143 Aug 30 16:03:55.205087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 5/7] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:03:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.209881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6ba4b20-ea02-4769-bdd9-97324eb6beb8 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-895521817", "name": "tempest-test_aggregate-1774880998"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:55.247773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-f6ba4b20-ea02-4769-bdd9-97324eb6beb8 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid 7b2e7af5-cb7d-434e-baff-ef92315c0e09 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:03:55.328919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6ba4b20-ea02-4769-bdd9-97324eb6beb8 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.122707 Aug 30 16:03:55.330070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 6/8] 10.222.0.47 () {60 vars in 1165 bytes} [Tue Aug 30 16:03:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.335709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35e4fde50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:55.340200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.341158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.341929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.342996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.343636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.344069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.376651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d0c72cb-452b-4099-a3fd-5591235b1215 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.045166 Aug 30 16:03:55.377481 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 7/9] 10.222.0.47 () {58 vars in 1139 bytes} [Tue Aug 30 16:03:55 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.382159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21ae8eae-0640-4813-b05c-a20fee0440cc tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b57de643ce644558b474a26e808dce3"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:55.487502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:03:55.817335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:03:55.817686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:03:55.818155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:03:55.818809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:03:55.819228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:03:55.833917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.834433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.834859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.835564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.836006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.836417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.872030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Getting quotas for project 43bcbf72c458489ea74fb75f81ed9a27. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:55.879212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Getting quotas for user 5a4688d4c394426abfbb02cdff4f7b4a and project 43bcbf72c458489ea74fb75f81ed9a27. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:55.893282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:03:55.896544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:03:55.965045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21ae8eae-0640-4813-b05c-a20fee0440cc tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1816719555/action" status: 200 len: 97 microversion: 2.1 time: 0.584854 Aug 30 16:03:55.969477 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 8/10] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:55 2022] POST /compute/v2.1/flavors/1816719555/action => generated 97 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:55.977624 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48ad83cf-5d12-4e03-9810-7e05ef12e601 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374039 Aug 30 16:03:55.986338 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3/11] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:03:55.990285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e852138-241b-4772-acd4-de441cccae2e tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:55.994201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35e506ca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:56.000054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:56.001021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:56.002088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:56.003390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:56.004267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:56.004878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:56.022602 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e852138-241b-4772-acd4-de441cccae2e tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.051877 Aug 30 16:03:56.024966 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 9/12] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:03:55 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:56.118546 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecf51fe9-d930-4a2c-9605-4c356e3c02d6 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.128659 Aug 30 16:03:56.122351 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 4/13] 10.222.0.47 () {58 vars in 1145 bytes} [Tue Aug 30 16:03:55 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:56.141147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71883ebc-84fe-48d2-a6d2-4b4132b94cf5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:56.141880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-71883ebc-84fe-48d2-a6d2-4b4132b94cf5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:56.278402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e8f835a-9017-4933-83d2-b6f3e52852d5 tempest-FlavorsAccessTestJSON-1178283234 tempest-FlavorsAccessTestJSON-1178283234-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:56.286096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71883ebc-84fe-48d2-a6d2-4b4132b94cf5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:56.318241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71883ebc-84fe-48d2-a6d2-4b4132b94cf5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1220 microversion: 2.1 time: 0.194519 Aug 30 16:03:56.318951 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 5/14] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:56 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:56.320963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e8f835a-9017-4933-83d2-b6f3e52852d5 tempest-FlavorsAccessTestJSON-1178283234 tempest-FlavorsAccessTestJSON-1178283234-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.294780 Aug 30 16:03:56.322087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 10/15] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:56 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:56.336919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf92c30f-7b66-4a5a-93ad-b4e48396d927 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:56.342061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d10aa13-0f87-4adf-85a4-c46edf8ebb15 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b57de643ce644558b474a26e808dce3"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:56.382996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf92c30f-7b66-4a5a-93ad-b4e48396d927 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:56.383627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf92c30f-7b66-4a5a-93ad-b4e48396d927 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:56.384068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf92c30f-7b66-4a5a-93ad-b4e48396d927 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:56.881901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d10aa13-0f87-4adf-85a4-c46edf8ebb15 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1816719555/action" status: 200 len: 21 microversion: 2.1 time: 0.544297 Aug 30 16:03:56.883316 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 11/16] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:56 2022] POST /compute/v2.1/flavors/1816719555/action => generated 21 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:57.271056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-496a10e8-c31b-43a2-8a99-5434007cce26 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-934707835", "id": 1997490900, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:57.299683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf92c30f-7b66-4a5a-93ad-b4e48396d927 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.979470 Aug 30 16:03:57.301227 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 6/17] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:03:56 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:57.304780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-496a10e8-c31b-43a2-8a99-5434007cce26 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.420398 Aug 30 16:03:57.305795 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 12/18] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:56 2022] POST /compute/v2.1/flavors => generated 438 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:57.307270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6749b556-51e7-4b78-86ca-fc2126c66fd0 tempest-FlavorsAccessTestJSON-1178283234 tempest-FlavorsAccessTestJSON-1178283234-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:57.326278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c777955-4a48-49e6-8b6d-870f1aa3ef15 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:57.343948 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6749b556-51e7-4b78-86ca-fc2126c66fd0 tempest-FlavorsAccessTestJSON-1178283234 tempest-FlavorsAccessTestJSON-1178283234-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041318 Aug 30 16:03:57.344577 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 7/19] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:57.349849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d872edc8-8ab5-40fb-bc40-5b54caa823e5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:57.350757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d872edc8-8ab5-40fb-bc40-5b54caa823e5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:57.420839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d872edc8-8ab5-40fb-bc40-5b54caa823e5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:57.427886 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d872edc8-8ab5-40fb-bc40-5b54caa823e5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1220 microversion: 2.1 time: 0.082155 Aug 30 16:03:57.429105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 8/20] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:57 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:57.433880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59ca380a-9bfc-4cb7-92d1-1144aea29810 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:57.475336 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59ca380a-9bfc-4cb7-92d1-1144aea29810 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1816719555" status: 202 len: 0 microversion: 2.1 time: 0.044989 Aug 30 16:03:57.476152 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 9/21] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:03:57 2022] DELETE /compute/v2.1/flavors/1816719555 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:57.585250 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c777955-4a48-49e6-8b6d-870f1aa3ef15 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1997490900/action" status: 200 len: 97 microversion: 2.1 time: 0.267537 Aug 30 16:03:57.596288 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 13/22] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:57 2022] POST /compute/v2.1/flavors/1997490900/action => generated 97 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:57.605238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f757745e-fcf1-4e1e-8c8e-0e8b9951c801 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:57.671985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f757745e-fcf1-4e1e-8c8e-0e8b9951c801 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073916 Aug 30 16:03:57.672982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 14/23] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:57.686880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3bb10dd-6bcc-48a9-b5c4-fa7938f96945 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:57.791185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-391657313", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "availability_zone": "tempest-test_az-895521817"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:57.817642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:57.819812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:57.820543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:57.822990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:57.824399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:57.825076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:57.910185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:03:58.085975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e3bb10dd-6bcc-48a9-b5c4-fa7938f96945 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3bb10dd-6bcc-48a9-b5c4-fa7938f96945 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Request method failure captured: Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/flavors/1997490900/action HTTP/1.1 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 67 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTrJZ4dPfndnVxKtVUY4mbI_9byvg5xRoY4XtRzYvqdkHx0OWXzudGDvKH4J5wwst3Vk0BzR3N5bUEdnpY0nkNlJnpBaq-VieBv-oZrI__ltvgEfCu_eq7q-Cj5FkslcQLwBnWKYckNmY67rYmj4pcVjMC_K0NZ-VaW2Ppchn7M9S4 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:03:58.105712 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}] Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 1487245cc6ce4513989170eb74783b5a Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} Aug 30 16:03:58.106809 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: exception: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1997490900', 'body': {'addTenantAccess': {'tenant': '480cdb186a0746e0bb33ce837e793832'}}} Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:03:58.107578 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-480cdb186a0746e0bb33ce837e793832' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:03:58.108473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:03:58.109356 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:03:58.110287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-480cdb186a0746e0bb33ce837e793832' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 16, 3, 58, 77357), 'updated_at': None, 'flavor_id': 16, 'project_id': '480cdb186a0746e0bb33ce837e793832'}] Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:58.111160 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:58.112010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:03:58.112905 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:03:58.113939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. Aug 30 16:03:58.113939 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.115212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3bb10dd-6bcc-48a9-b5c4-fa7938f96945 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 480cdb186a0746e0bb33ce837e793832 combination. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:58.116209 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3bb10dd-6bcc-48a9-b5c4-fa7938f96945 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1997490900/action" status: 409 len: 152 microversion: 2.1 time: 0.442027 Aug 30 16:03:58.116805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 15/24] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:57 2022] POST /compute/v2.1/flavors/1997490900/action => generated 152 bytes in 443 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:03:58.122171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5dd12069-b16f-43c4-9973-4134368b51d1 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1284331360", "id": 702544357, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:58.158207 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5dd12069-b16f-43c4-9973-4134368b51d1 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.040341 Aug 30 16:03:58.159789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 16/25] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:58 2022] POST /compute/v2.1/flavors => generated 428 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:58.164892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1737ab4b-168e-4092-82a2-7f3e7a1f9049 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:58.183396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:03:58.183934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:03:58.184413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:03:58.185142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:03:58.185558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:03:58.195548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:58.196089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:58.196604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:58.197491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:58.198350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:58.199155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:58.226756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Getting quotas for project ab8add0a924a4f3bafd3a0b931743b47. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:58.234413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Getting quotas for user 7eb204af25914228922ff1aaf286fd81 and project ab8add0a924a4f3bafd3a0b931743b47. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:58.250893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:03:58.253304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:03:58.316465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a77a30bd-5b99-4d81-9c46-95edf5812986 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839111 Aug 30 16:03:58.323203 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 10/26] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:03:58.325998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b958b09-8f3e-4853-b95e-a60d69c40f77 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.363227 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b958b09-8f3e-4853-b95e-a60d69c40f77 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/702544357/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.041795 Aug 30 16:03:58.364819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 11/27] 10.222.0.47 () {58 vars in 1206 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/flavors/702544357/os-flavor-access => generated 21 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:58.370059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ac71906-c2bb-48b4-96f9-525d3d26b042 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.371438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ac71906-c2bb-48b4-96f9-525d3d26b042 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:58.439967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ac71906-c2bb-48b4-96f9-525d3d26b042 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:58.450067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ac71906-c2bb-48b4-96f9-525d3d26b042 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1241 microversion: 2.1 time: 0.083129 Aug 30 16:03:58.451016 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 12/28] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:58.467549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70b25d9c-c0e7-43b1-861e-a2941f286247 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.498165 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70b25d9c-c0e7-43b1-861e-a2941f286247 tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/702544357" status: 202 len: 0 microversion: 2.1 time: 0.045671 Aug 30 16:03:58.498910 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 13/29] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:03:58 2022] DELETE /compute/v2.1/flavors/702544357 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:58.509356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.510201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:58.540407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:58.541949 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1737ab4b-168e-4092-82a2-7f3e7a1f9049 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1997490900/action" status: 200 len: 21 microversion: 2.1 time: 0.380918 Aug 30 16:03:58.543939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:58.544742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:58.545814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:58.546509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:58.547155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:58.548635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 17/30] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:58 2022] POST /compute/v2.1/flavors/1997490900/action => generated 21 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:03:58.561716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-650d0681-c681-4e92-98a5-f39eb1cd0f1b tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.607057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-650d0681-c681-4e92-98a5-f39eb1cd0f1b tempest-FlavorsAccessTestJSON-786068345 tempest-FlavorsAccessTestJSON-786068345-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052055 Aug 30 16:03:58.608104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 18/31] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:58.618242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38ff825d-7317-4b6b-96b7-cb7c38b701ff tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.660395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38ff825d-7317-4b6b-96b7-cb7c38b701ff tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1997490900" status: 202 len: 0 microversion: 2.1 time: 0.050900 Aug 30 16:03:58.665262 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 19/32] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:03:58 2022] DELETE /compute/v2.1/flavors/1997490900 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:58.677918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-363abbf9-613f-436a-913f-7474394a3a09 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.735130 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-363abbf9-613f-436a-913f-7474394a3a09 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068008 Aug 30 16:03:58.750940 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 20/33] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:58.757005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d4b8042-5f3f-4ae6-a111-afa3b7c33c63 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1462072879", "id": 1522889812, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:58.789926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d4b8042-5f3f-4ae6-a111-afa3b7c33c63 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.036037 Aug 30 16:03:58.800336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 21/34] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:58 2022] POST /compute/v2.1/flavors => generated 438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:03:58.805809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca4386f3-0ead-47a5-b8b3-e02f61605ee9 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.820568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ca4386f3-0ead-47a5-b8b3-e02f61605ee9 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca4386f3-0ead-47a5-b8b3-e02f61605ee9 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Request method failure captured: Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/flavors/1522889812/os-flavor-access HTTP/1.1 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTrJZ4dPfndnVxKtVUY4mbI_9byvg5xRoY4XtRzYvqdkHx0OWXzudGDvKH4J5wwst3Vk0BzR3N5bUEdnpY0nkNlJnpBaq-VieBv-oZrI__ltvgEfCu_eq7q-Cj5FkslcQLwBnWKYckNmY67rYmj4pcVjMC_K0NZ-VaW2Ppchn7M9S4 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:03:58.825641 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}] Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 1487245cc6ce4513989170eb74783b5a Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: exception: Access list not available for public flavors. Aug 30 16:03:58.826832 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '1522889812'} Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 30 16:03:58.827549 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:03:58.829855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca4386f3-0ead-47a5-b8b3-e02f61605ee9 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:58.832084 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca4386f3-0ead-47a5-b8b3-e02f61605ee9 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/1522889812/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.029145 Aug 30 16:03:58.838022 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 22/35] 10.222.0.47 () {58 vars in 1209 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/flavors/1522889812/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:03:58.846183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a48a679-07fb-4302-b10e-545e84c23001 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.873095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a48a679-07fb-4302-b10e-545e84c23001 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1522889812" status: 202 len: 0 microversion: 2.1 time: 0.033040 Aug 30 16:03:58.878569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 23/36] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:03:58 2022] DELETE /compute/v2.1/flavors/1522889812 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:58.887373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4868df25-93c9-460c-9627-41ec9998c70d tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:58.916446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:58.930858 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4868df25-93c9-460c-9627-41ec9998c70d tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050153 Aug 30 16:03:58.949462 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 24/37] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:58.956318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e63efa8-b64a-451f-9058-3d1ee34f8c0c tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-61047755", "id": 1396984011, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:58.969728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:58.971335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-50260b60-8ca4-4d95-9ab3-9a8e3e6acd3a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1280 microversion: 2.1 time: 0.469781 Aug 30 16:03:58.972052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 14/38] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:58 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1280 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:59.012395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e63efa8-b64a-451f-9058-3d1ee34f8c0c tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.061298 Aug 30 16:03:59.021893 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 25/39] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:58 2022] POST /compute/v2.1/flavors => generated 437 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:59.471323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1980c870-65bc-443b-aeef-bc5bd9c487b9 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:59.472047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1980c870-65bc-443b-aeef-bc5bd9c487b9 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:59.584036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5df5784b-d60e-47e7-b665-eabdce807257 tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:59.595266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5df5784b-d60e-47e7-b665-eabdce807257 tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7014e06f6e3a4e628446ed7197585876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480cdb186a0746e0bb33ce837e793832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5df5784b-d60e-47e7-b665-eabdce807257 tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Request method failure captured: Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/flavors/1396984011/action HTTP/1.1 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 67 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjTqvd0TGeyOacy1BKkyMecwW9QByP0EtFJWj2EFjSa8UcAHc1MWxPmtrRjB9pW92krZ-ukuxtcfLURNl_hfD2NzwJQUJz8eRzkePGb0TDdyDgW1OpyvRHS1aL3eOwbxW2P8jQ2DhV3cCtxW2IClpUW55qWpfFRoTqB74376KgZu8Zw Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 480cdb186a0746e0bb33ce837e793832 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:03:59.601868 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480cdb186a0746e0bb33ce837e793832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480cdb186a0746e0bb33ce837e793832"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480cdb186a0746e0bb33ce837e793832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480cdb186a0746e0bb33ce837e793832"}]}] Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 480cdb186a0746e0bb33ce837e793832 Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsAccessNegativeTestJSON-560921191-project Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7014e06f6e3a4e628446ed7197585876 Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-560921191-project Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} Aug 30 16:03:59.603177 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1396984011', 'body': {'addTenantAccess': {'tenant': '480cdb186a0746e0bb33ce837e793832'}}} Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:03:59.604007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 16:03:59.606257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:03:59.610004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5df5784b-d60e-47e7-b665-eabdce807257 tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:59.611166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5df5784b-d60e-47e7-b665-eabdce807257 tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] 10.222.0.47 "POST /compute/v2.1/flavors/1396984011/action" status: 403 len: 130 microversion: 2.1 time: 0.589071 Aug 30 16:03:59.612825 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 15/40] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:03:59 2022] POST /compute/v2.1/flavors/1396984011/action => generated 130 bytes in 592 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:03:59.630941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-670fa0f1-29ea-4278-a671-cef2f971817b tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:59.656337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:59.681691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-670fa0f1-29ea-4278-a671-cef2f971817b tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1396984011" status: 202 len: 0 microversion: 2.1 time: 0.062788 Aug 30 16:03:59.683393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 16/41] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:03:59 2022] DELETE /compute/v2.1/flavors/1396984011 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:59.692816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0615606a-fb1f-4b46-bfd0-288e090c3384 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:59.749529 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0615606a-fb1f-4b46-bfd0-288e090c3384 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060496 Aug 30 16:03:59.750598 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 17/42] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:03:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:59.772264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d4f2393-90ac-4bb7-89e7-7b03357d0590 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2108150191", "id": 6352600, "os-flavor-access:is_public": "False"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:59.822833 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d4f2393-90ac-4bb7-89e7-7b03357d0590 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.054860 Aug 30 16:03:59.825495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 18/43] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:59 2022] POST /compute/v2.1/flavors => generated 430 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:59.851201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebcc597c-813b-46bd-ba69-f2cb580e68ac tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:00.306660 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebcc597c-813b-46bd-ba69-f2cb580e68ac tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/6352600/action" status: 200 len: 94 microversion: 2.1 time: 0.469557 Aug 30 16:04:00.308290 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 19/44] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:03:59 2022] POST /compute/v2.1/flavors/6352600/action => generated 94 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:00.316978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:00.318896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:00.330509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:00.331701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:00.332351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:00.333769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:00.335014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:00.335716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:00.481656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:00.506824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc98402a-a58b-4f5f-9113-6441c456135b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1278 microversion: 2.1 time: 0.194485 Aug 30 16:04:00.511979 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 20/45] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:00 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:00.540672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd737359-e86c-4391-9148-843d35ffbb6d tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:00.578362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd737359-e86c-4391-9148-843d35ffbb6d tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7014e06f6e3a4e628446ed7197585876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480cdb186a0746e0bb33ce837e793832', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd737359-e86c-4391-9148-843d35ffbb6d tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Request method failure captured: Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/flavors/6352600/action HTTP/1.1 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 70 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjTqvd0TGeyOacy1BKkyMecwW9QByP0EtFJWj2EFjSa8UcAHc1MWxPmtrRjB9pW92krZ-ukuxtcfLURNl_hfD2NzwJQUJz8eRzkePGb0TDdyDgW1OpyvRHS1aL3eOwbxW2P8jQ2DhV3cCtxW2IClpUW55qWpfFRoTqB74376KgZu8Zw Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 480cdb186a0746e0bb33ce837e793832 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:00.583094 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480cdb186a0746e0bb33ce837e793832"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_480cdb186a0746e0bb33ce837e793832"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/480cdb186a0746e0bb33ce837e793832"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/480cdb186a0746e0bb33ce837e793832"}]}] Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 480cdb186a0746e0bb33ce837e793832 Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-560921191 Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsAccessNegativeTestJSON-560921191-project Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7014e06f6e3a4e628446ed7197585876 Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-560921191-project Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: {"removeTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} Aug 30 16:04:00.584928 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6352600', 'body': {'removeTenantAccess': {'tenant': '480cdb186a0746e0bb33ce837e793832'}}} Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can( Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:00.585609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 16:04:00.586600 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:00.587515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd737359-e86c-4391-9148-843d35ffbb6d tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:00.594621 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd737359-e86c-4391-9148-843d35ffbb6d tempest-FlavorsAccessNegativeTestJSON-560921191 tempest-FlavorsAccessNegativeTestJSON-560921191-project] 10.222.0.47 "POST /compute/v2.1/flavors/6352600/action" status: 403 len: 133 microversion: 2.1 time: 0.060418 Aug 30 16:04:00.595504 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 21/46] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:00 2022] POST /compute/v2.1/flavors/6352600/action => generated 133 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:00.612305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-706c53ac-678f-404c-97de-c3b965b285bd tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "480cdb186a0746e0bb33ce837e793832"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:00.662296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1980c870-65bc-443b-aeef-bc5bd9c487b9 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:00.701095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1980c870-65bc-443b-aeef-bc5bd9c487b9 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1241 microversion: 2.1 time: 1.233629 Aug 30 16:04:00.701677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 26/47] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:59 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1241 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:00.999830 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-706c53ac-678f-404c-97de-c3b965b285bd tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/6352600/action" status: 200 len: 21 microversion: 2.1 time: 0.394914 Aug 30 16:04:01.002564 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 22/48] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:00 2022] POST /compute/v2.1/flavors/6352600/action => generated 21 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:01.018986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d7c13e9-b76c-48df-a175-312f84204a4d tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:01.077333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d7c13e9-b76c-48df-a175-312f84204a4d tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/6352600" status: 202 len: 0 microversion: 2.1 time: 0.067965 Aug 30 16:04:01.077928 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 27/49] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:01 2022] DELETE /compute/v2.1/flavors/6352600 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:01.088383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aaa40761-461f-4437-b244-a6af79c01810 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:01.223622 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aaa40761-461f-4437-b244-a6af79c01810 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.128053 Aug 30 16:04:01.225589 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 23/50] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:04:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:01.257709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-866ffd52-e63c-466e-894b-aa4ba9a93fd4 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-923489551", "id": 1876336625, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:01.299370 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-866ffd52-e63c-466e-894b-aa4ba9a93fd4 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.047321 Aug 30 16:04:01.312752 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 28/51] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:01.326979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14da2e97-2b53-4f4c-82bf-9600446f0a70 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e68cde40c3a849888d00310eaba02629"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:01.536146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:01.536980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:01.556707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:01.557224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:01.562553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:01.563503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:01.564257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:01.565751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:02.055128 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-14da2e97-2b53-4f4c-82bf-9600446f0a70 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] HTTP exception thrown: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14da2e97-2b53-4f4c-82bf-9600446f0a70 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Request method failure captured: Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/flavors/1876336625/action HTTP/1.1 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 70 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjTrJZ4dPfndnVxKtVUY4mbI_9byvg5xRoY4XtRzYvqdkHx0OWXzudGDvKH4J5wwst3Vk0BzR3N5bUEdnpY0nkNlJnpBaq-VieBv-oZrI__ltvgEfCu_eq7q-Cj5FkslcQLwBnWKYckNmY67rYmj4pcVjMC_K0NZ-VaW2Ppchn7M9S4 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:02.067893 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1aac0a2908494efeba28ccdeb08b6b0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1aac0a2908494efeba28ccdeb08b6b0f"}]}] Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1aac0a2908494efeba28ccdeb08b6b0f Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872 Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 1487245cc6ce4513989170eb74783b5a Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: {"removeTenantAccess": {"tenant": "e68cde40c3a849888d00310eaba02629"}} Aug 30 16:04:02.069328 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: exception: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1876336625', 'body': {'removeTenantAccess': {'tenant': 'e68cde40c3a849888d00310eaba02629'}}} Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 30 16:04:02.070098 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:02.071334 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. Aug 30 16:04:02.072475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:02.076405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14da2e97-2b53-4f4c-82bf-9600446f0a70 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Returning 404 to user: Flavor access not found for 21 / e68cde40c3a849888d00310eaba02629 combination. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:02.079530 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14da2e97-2b53-4f4c-82bf-9600446f0a70 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/1876336625/action" status: 404 len: 124 microversion: 2.1 time: 0.755837 Aug 30 16:04:02.082703 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 24/52] 10.222.0.47 () {60 vars in 1200 bytes} [Tue Aug 30 16:04:01 2022] POST /compute/v2.1/flavors/1876336625/action => generated 124 bytes in 762 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:02.107390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:02.131995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:02.163033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:02.163647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:02.167507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:02.184772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:02.190344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:02.192238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:02.432341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:02.449944 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28607592-a61d-46d9-9262-f7f6c73a1074 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1295 microversion: 2.1 time: 0.364308 Aug 30 16:04:02.455167 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 25/53] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:02 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1295 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:02.625008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-600a9062-dae3-4f09-99b0-8f0f15b38bc5 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1285605183", "id": 1649973121, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:02.678002 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-600a9062-dae3-4f09-99b0-8f0f15b38bc5 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.220826 Aug 30 16:04:02.689271 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 26/54] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:04:02 2022] POST /compute/v2.1/flavors => generated 449 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:02.694841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e816fa7-e45d-475f-8ece-f28ec9549d66 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:02.724916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e816fa7-e45d-475f-8ece-f28ec9549d66 tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1876336625" status: 202 len: 0 microversion: 2.1 time: 0.033351 Aug 30 16:04:02.726055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 27/55] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:04:02 2022] DELETE /compute/v2.1/flavors/1876336625 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:02.871154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:02.900084 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a098e23-f753-44ab-b307-1774ce06ee85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 1.368063 Aug 30 16:04:02.919618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 29/56] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:01 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:02.940597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fdeea556-9ec3-466c-a1d5-19067845e03e tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:02.994834 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fdeea556-9ec3-466c-a1d5-19067845e03e tempest-FlavorsAccessNegativeTestJSON-1124004872 tempest-FlavorsAccessNegativeTestJSON-1124004872-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.073505 Aug 30 16:04:02.997873 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:04:02 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:03.103561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38d97191-df79-4fc2-af71-93497fa3749d tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.128649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38d97191-df79-4fc2-af71-93497fa3749d tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] 10.222.0.47 "GET /compute/v2.1/flavors/1649973121" status: 200 len: 449 microversion: 2.55 time: 0.400048 Aug 30 16:04:03.145386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11662b2d-c6c2-4d5c-840c-0ea19b00d9d0 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] Action: 'update', calling method: .version_select at 0x7fd35eaeb940>, body: {"flavor": {"description": "new"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:03.152422 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 28/58] 10.222.0.47 () {60 vars in 1199 bytes} [Tue Aug 30 16:04:02 2022] GET /compute/v2.1/flavors/1649973121 => generated 449 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:03.292733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11662b2d-c6c2-4d5c-840c-0ea19b00d9d0 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/1649973121" status: 200 len: 450 microversion: 2.55 time: 0.139316 Aug 30 16:04:03.309949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb718030-a928-40d6-941c-5857b977d6c8 tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.317076 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 31/59] 10.222.0.47 () {62 vars in 1219 bytes} [Tue Aug 30 16:04:03 2022] PUT /compute/v2.1/flavors/1649973121 => generated 450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:03.338359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb718030-a928-40d6-941c-5857b977d6c8 tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.033828 Aug 30 16:04:03.339359 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 29/60] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:04:03 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:03.359308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-390f8434-d064-40ca-bda7-7989af8239a6 tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.444430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-390f8434-d064-40ca-bda7-7989af8239a6 tempest-FlavorsV255TestJSON-918212771 tempest-FlavorsV255TestJSON-918212771-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.085361 Aug 30 16:04:03.454338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1166 bytes} [Tue Aug 30 16:04:03 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:03.467219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e1d7816-8af5-47c4-b8c8-8dc998688217 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.476223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.476860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:03.503404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:03.504249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:03.505478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:03.506567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:03.507236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:03.507835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:03.528528 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e1d7816-8af5-47c4-b8c8-8dc998688217 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1649973121" status: 202 len: 0 microversion: 2.55 time: 0.065500 Aug 30 16:04:03.540519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 30/62] 10.222.0.47 () {60 vars in 1202 bytes} [Tue Aug 30 16:04:03 2022] DELETE /compute/v2.1/flavors/1649973121 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:03.565192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2477cfda-4ffa-4151-929e-12b716b5fa84 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.661947 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2477cfda-4ffa-4151-929e-12b716b5fa84 tempest-FlavorsV255TestJSON-402982676 tempest-FlavorsV255TestJSON-402982676-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.117921 Aug 30 16:04:03.683626 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 31/63] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:04:03 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:03.799115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:03.817520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-508f6fd1-34b0-48c7-bf3c-0309d9474203 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1295 microversion: 2.1 time: 0.337984 Aug 30 16:04:03.820559 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:03 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1295 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:03.926293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:03.927125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:03.940199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:03.941283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:03.949959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:03.951746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:03.953821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:03.959886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:04.845161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:04.846417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:04.855710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:04.859030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:04.861188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:04.863482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:04.868668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:04.871402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:05.354839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.428768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:05.450082 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbcb3f5b-6def-4429-88f0-7afd6c33fef0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 1.527375 Aug 30 16:04:05.451308 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:03 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:05.789430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:05.798784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6956cba1-e8af-4c77-9369-6ccbe3a57c66 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.958757 Aug 30 16:04:05.810811 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 34/66] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:04 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:06.473036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.473773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.484024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.489869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.491474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.493608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.498637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.499044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.702125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4dcf21-2252-439b-83be-876742bbe816", "tag": "90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:06.739922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.744006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.745670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.830201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Creating event network-changed:90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67 for instance 5e4dcf21-2252-439b-83be-876742bbe816 on n-h2-830883-28 Aug 30 16:04:06.834548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:04:06.837111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15a06594-c370-4357-b97e-f943deff5cb2 req-f9d2a434-0c20-4199-841f-807e9374dea3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:04:06.843370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.843920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.844452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.845197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.845657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.856719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.913393 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.rpcapi [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Aug 30 16:04:06.914580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] Releasing lock "compute-rpcapi-router" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:04:06.981797 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3d96541-c564-4791-874a-5b0980d13029 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.671585 Aug 30 16:04:06.985546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 33/67] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:07.004162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:07.016035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:07.048172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.049653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.052131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.062370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.064188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.069275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.220901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:07.232082 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e733807-7bed-4c23-85c2-1e5ed204b069 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.764815 Aug 30 16:04:07.240158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 35/68] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:06 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:07.878467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:07.907519 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d705802b-5f93-448c-877a-de2deb01f838 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.920460 Aug 30 16:04:07.913310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 34/69] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:06 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:08.264448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:08.265099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:08.287608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.288237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.288557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.289274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.289787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.290168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.939287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:08.939287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:08.940401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=18 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:08.951602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.955365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.956266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.957873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.960533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.961165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.446619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:09.459793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7b566d60-d859-45ef-bc48-0ec137f38fe6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 1.200386 Aug 30 16:04:09.463300 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 36/70] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:08 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:10.507993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:10.523237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db3bef01-51e2-4146-8e97-683e7b6db6f3 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 1.589592 Aug 30 16:04:10.528019 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 35/71] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:08 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:10.532960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:10.537680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:10.560020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.560860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.562460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.563337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.566831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.575088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.680755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:10.859686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-895e6101-c6df-4169-a89e-31bb45b624ef tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1382068125", "ram": 512, "vcpus": 1, "disk": 10, "id": 814178517, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:10.915998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-895e6101-c6df-4169-a89e-31bb45b624ef tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.767813 Aug 30 16:04:10.920831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:10.930892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7556bc7-eb98-4cd0-8d33-6899fc521e9d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:10.991143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:11.006040 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eaf9a555-875d-4201-9398-d05c410bc8f9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.475312 Aug 30 16:04:11.006680 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 36/73] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:10 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:11.070735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e7556bc7-eb98-4cd0-8d33-6899fc521e9d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.143709 Aug 30 16:04:11.076476 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:04:10 2022] POST /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.290709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0a83e0-14c1-4f54-9a16-4db2ef240b39", "tag": "2c669711-bbf2-4325-988c-6c352854fb78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:11.336645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.350874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.352781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.420949 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Creating event network-changed:2c669711-bbf2-4325-988c-6c352854fb78 for instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 on n-h1-830883-28 Aug 30 16:04:11.424437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:04:11.425749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd6f9210-9cfe-4676-970e-676df57a0488 req-819fff44-c515-47ea-b77d-8ef0ad3b158c service nova] Acquired lock "compute-rpcapi-router" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:04:11.427984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.431990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.433440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.434853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.435586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.438247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.466209 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.compute.rpcapi [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Aug 30 16:04:11.467379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] Releasing lock "compute-rpcapi-router" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:04:11.517526 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb63890d-2990-4ec9-a8f2-973004a7c437 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233049 Aug 30 16:04:11.521446 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 39/75] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:11.554122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.555155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:11.574774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.581210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.583615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.590150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.591608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.594010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.610836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0bfa1968-dacf-4f11-9906-ea82f15139dc tempest-FlavorsExtraSpecsTestJSON-291661429 tempest-FlavorsExtraSpecsTestJSON-291661429-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.624316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0bfa1968-dacf-4f11-9906-ea82f15139dc tempest-FlavorsExtraSpecsTestJSON-291661429 tempest-FlavorsExtraSpecsTestJSON-291661429-project] 10.222.0.47 "GET /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.546196 Aug 30 16:04:11.631677 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 37/76] 10.222.0.47 () {58 vars in 1200 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.637902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b39f3ce-3434-47eb-9c7f-2b5bec5a5c3f tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:11.670229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b39f3ce-3434-47eb-9c7f-2b5bec5a5c3f tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036876 Aug 30 16:04:11.671168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 38/77] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:04:11 2022] POST /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.684140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb00fff5-499c-4a7d-a8ef-fbbbc6d382c5 tempest-FlavorsExtraSpecsTestJSON-291661429 tempest-FlavorsExtraSpecsTestJSON-291661429-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.704468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eb00fff5-499c-4a7d-a8ef-fbbbc6d382c5 tempest-FlavorsExtraSpecsTestJSON-291661429 tempest-FlavorsExtraSpecsTestJSON-291661429-project] 10.222.0.47 "GET /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.021633 Aug 30 16:04:11.720201 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 39/78] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes => generated 22 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.738695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0cf647aa-c143-4b8d-b948-7f7c1a485694 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:11.806029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0cf647aa-c143-4b8d-b948-7f7c1a485694 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.084349 Aug 30 16:04:11.812948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 40/79] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:04:11 2022] POST /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.821011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eb90eff-2fb9-451f-b776-9cb73e347977 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.833422 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7eb90eff-2fb9-451f-b776-9cb73e347977 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017637 Aug 30 16:04:11.834545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 41/80] 10.222.0.47 () {58 vars in 1200 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.850686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da926a4f-4813-4306-9a1f-f44aa2a2d1fe tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:11.921954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=9,nova_api:INSERT=3,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:11.940851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da926a4f-4813-4306-9a1f-f44aa2a2d1fe tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.096783 Aug 30 16:04:11.948916 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 42/81] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:04:11 2022] PUT /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes => generated 22 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:11.980749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7402809d-86a3-4aea-967d-4cdd7d19880d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.029456 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7402809d-86a3-4aea-967d-4cdd7d19880d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076751 Aug 30 16:04:12.044143 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1200 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/flavors/814178517/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:12.068836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.071295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:12.099884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.100234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.102935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.103732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.105149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.109649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.251475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:12.295439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63e5fdb0-3173-4ea6-af3b-03b70d0b283b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.744655 Aug 30 16:04:12.299976 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 40/83] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:12.338170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81230173-467b-4b4f-b0bd-272b598d211d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.468516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81230173-467b-4b4f-b0bd-272b598d211d tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.167080 Aug 30 16:04:12.476584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 41/84] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:04:12 2022] DELETE /compute/v2.1/flavors/814178517/os-extra_specs/hw:numa_nodes => generated 0 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:12.509041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62d07c87-5eb3-4540-9fe6-f03220481e5e tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.601223 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62d07c87-5eb3-4540-9fe6-f03220481e5e tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/814178517/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.123391 Aug 30 16:04:12.627876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 42/85] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:04:12 2022] DELETE /compute/v2.1/flavors/814178517/os-extra_specs/hw:cpu_policy => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:12.644970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0dfe26ff-43bf-43fc-ad63-009babd58622 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.683101 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0dfe26ff-43bf-43fc-ad63-009babd58622 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/814178517/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.053178 Aug 30 16:04:12.683802 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 43/86] 10.222.0.47 () {58 vars in 1200 bytes} [Tue Aug 30 16:04:12 2022] GET /compute/v2.1/flavors/814178517/os-extra_specs => generated 19 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:12.704056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9055d6fe-fc64-4aa0-97f6-3557eea1ea46 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.761028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9055d6fe-fc64-4aa0-97f6-3557eea1ea46 tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/814178517" status: 202 len: 0 microversion: 2.1 time: 0.062872 Aug 30 16:04:12.771530 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 44/87] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:04:12 2022] DELETE /compute/v2.1/flavors/814178517 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:04:12.794062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b5208d9-2e3b-4333-ba8b-f046ba9e4d5c tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.889452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b5208d9-2e3b-4333-ba8b-f046ba9e4d5c tempest-FlavorsExtraSpecsTestJSON-108603128 tempest-FlavorsExtraSpecsTestJSON-108603128-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115256 Aug 30 16:04:12.921625 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 45/88] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:04:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:13.083697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:13.101505 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e3ee69a-9d77-4e38-8d29-e751437b55ec tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 1.055399 Aug 30 16:04:13.104681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 44/89] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:12 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:13.318934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:13.319904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:13.334887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.338801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.339867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.341122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.341902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.343998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.638495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:13.649419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cceb1b85-6c59-40e3-b344-97edf0e4ad82 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.335959 Aug 30 16:04:13.650515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 46/90] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:13 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:14.126996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:14.129693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:14.146838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.152619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.153192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.155212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.155932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.157840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.442963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:14.451356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1aca0e75-4028-4418-9cda-513425d6ea2a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.329923 Aug 30 16:04:14.459343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 45/91] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:14 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:14.677828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:14.679904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:14.698900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.701226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.704332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.706502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.709204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.710821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:15.405381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:15.417236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df035999-d3ea-4b56-81de-374d39dd1a64 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.744359 Aug 30 16:04:15.423700 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 47/92] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:14 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:15.482286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:15.483299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:15.518216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:15.518827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:15.519361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:15.536661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:15.537158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:15.537637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:15.599561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43a48a6b-d32c-4367-9cb1-d88d6c55eae2 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1191224885", "id": 1422430405, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:15.698989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43a48a6b-d32c-4367-9cb1-d88d6c55eae2 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.379600 Aug 30 16:04:15.703970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 46/93] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:04:15 2022] POST /compute/v2.1/flavors => generated 468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:04:15.908574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:15.930124 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-820d8b3e-cf07-421d-a117-6e95c7820098 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.450652 Aug 30 16:04:15.944416 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 48/94] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:15 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:16.195776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-292479aa-3de1-4ebe-aac8-812b18f89392 tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.225390 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-292479aa-3de1-4ebe-aac8-812b18f89392 tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] 10.222.0.47 "GET /compute/v2.1/flavors/1422430405" status: 200 len: 468 microversion: 2.61 time: 0.513887 Aug 30 16:04:16.235740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 47/95] 10.222.0.47 () {60 vars in 1199 bytes} [Tue Aug 30 16:04:15 2022] GET /compute/v2.1/flavors/1422430405 => generated 468 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:16.241943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-64d6b45e-12ec-4825-a5a3-db338cf7a912 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:16.315366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-64d6b45e-12ec-4825-a5a3-db338cf7a912 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/1422430405" status: 200 len: 469 microversion: 2.61 time: 0.077201 Aug 30 16:04:16.325336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 49/96] 10.222.0.47 () {62 vars in 1219 bytes} [Tue Aug 30 16:04:16 2022] PUT /compute/v2.1/flavors/1422430405 => generated 469 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:16.331271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-498e241d-aa4e-46a3-8510-47d0357e5c85 tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.405103 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-498e241d-aa4e-46a3-8510-47d0357e5c85 tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.077561 Aug 30 16:04:16.407317 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 48/97] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:16.429537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5573f3c9-6816-4232-bdac-f3db1bede3fa tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.444118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.444980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:16.452582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=8,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.455833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.461382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.465675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.476945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.479395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.482703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.532778 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5573f3c9-6816-4232-bdac-f3db1bede3fa tempest-FlavorsV261TestJSON-7516427 tempest-FlavorsV261TestJSON-7516427-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.107126 Aug 30 16:04:16.534692 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 50/98] 10.222.0.47 () {60 vars in 1166 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:16.562291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-195b25fe-d811-4ba7-98a6-fcf1d5f17313 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.603519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-195b25fe-d811-4ba7-98a6-fcf1d5f17313 tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1422430405" status: 202 len: 0 microversion: 2.61 time: 0.056823 Aug 30 16:04:16.604755 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 51/99] 10.222.0.47 () {60 vars in 1202 bytes} [Tue Aug 30 16:04:16 2022] DELETE /compute/v2.1/flavors/1422430405 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:04:16.632215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05a8534e-6658-4098-b3b5-1e7d45b717fd tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.732330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05a8534e-6658-4098-b3b5-1e7d45b717fd tempest-FlavorsV261TestJSON-173209018 tempest-FlavorsV261TestJSON-173209018-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.122205 Aug 30 16:04:16.733230 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 52/100] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:16.836480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:16.847426 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4c7deaf-0a49-484e-912b-736df9c4542e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.407029 Aug 30 16:04:16.849346 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 49/101] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:16.955783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.956398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:16.973197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.976617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.982116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.986256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.987824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.989885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:17.451245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:17.648087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:17.659162 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fff64684-ccbf-43a9-95ff-d569e268218f tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.707581 Aug 30 16:04:17.661376 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 53/102] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:17.874008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:17.876826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:17.898489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:17.901130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:17.903178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:17.905575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:17.907300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:17.910222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.061012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Calling method '.version_select at 0x7fd35db1a280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:18.074834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.077704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.085996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.143926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.146119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.148289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.268257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.268749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.273974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.300586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.301551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.306287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.352102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.352927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.355834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.372158 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a8f7f48-2225-4529-a6be-abb38f0668c5 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.926244 Aug 30 16:04:18.387373 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 50/103] 10.222.0.47 () {60 vars in 1243 bytes} [Tue Aug 30 16:04:17 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:18.396545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Calling method '.version_select at 0x7fd35da6eca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:18.408938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.409758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.417937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.422571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:18.443601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:18.454547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba1fe43f-dca5-4722-9cd3-f682f6f31f65 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.586860 Aug 30 16:04:18.457783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.461701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 54/104] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:17 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:18.462601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.463326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.507354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.508244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.508893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.536496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.540491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.541283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.579835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.584197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.585611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.597029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-618ddc1b-7f8a-42dd-b3bf-5f76d8e0fe5b tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.204092 Aug 30 16:04:18.605192 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 51/105] 10.222.0.47 () {60 vars in 1222 bytes} [Tue Aug 30 16:04:18 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:04:18.611156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Calling method '.version_select at 0x7fd35d8e2940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:18.615792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.620044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.620835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.681596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.682248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.682878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.690648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:18.691282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:18.694359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c09ce1a-6bb3-4fb2-aadb-6e06cf989069 tempest-HypervisorAdminV253TestBase-1664255222 tempest-HypervisorAdminV253TestBase-1664255222-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/b5c9840f-5608-4b5d-aab6-b773b0956c99" status: 200 len: 794 microversion: 2.53 time: 0.086861 Aug 30 16:04:18.702860 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 55/106] 10.222.0.47 () {60 vars in 1298 bytes} [Tue Aug 30 16:04:18 2022] GET /compute/v2.1/os-hypervisors/b5c9840f-5608-4b5d-aab6-b773b0956c99 => generated 794 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:04:18.710379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.711283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.711966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.714147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.715624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.716747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.175407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:19.184819 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8dc8bacc-7b70-4e44-9a56-4feb80259220 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.501263 Aug 30 16:04:19.192176 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:18 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:19.513074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:19.514413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:19.567866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.569163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.571703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.573235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.576102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.578804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.115894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:20.126730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fac9b934-0b73-422f-9e2a-6b266072411b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.642555 Aug 30 16:04:20.129265 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 56/108] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:19 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:20.207259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:20.208478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:20.221030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.222203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.224292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.226243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.227482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.229089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.061910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:21.073431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9e5c519-f2fe-4bd5-9bcc-4328b9b10cfd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.869284 Aug 30 16:04:21.074354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:20 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:21.153155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:21.153766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:21.163401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.165093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.165712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.168395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.169242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.171219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.460239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:21.494613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:21.509931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.361737 Aug 30 16:04:21.528354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 57/110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:21 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:22.095727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:22.096333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:22.107833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.109763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.110419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.113973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.114935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.116128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.194502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:22.195456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e50fcc51-5984-40a9-85ec-394bf6b9307f tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001321 Aug 30 16:04:22.195798 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 58/111] 10.222.0.47 () {56 vars in 886 bytes} [Tue Aug 30 16:04:22 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 16:04:22.422931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:22.433478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c3608b5-e423-49a4-9ce0-336f67de5293 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.341981 Aug 30 16:04:22.434961 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 54/112] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:22 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:22.533041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:22.533648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:22.545631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.546264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.546762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.547985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.548509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.549110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.553524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:22.755610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:22.767911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae0d406e-eab1-4173-af34-b6cffe89fd69 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.238012 Aug 30 16:04:22.770577 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 59/113] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:22 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:23.456304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:23.457174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:23.466566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:23.467071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:23.467521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:23.471834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:23.471834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:23.471834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:23.791878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:23.792662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:23.805525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:23.806436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:23.809149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:23.810048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:23.812524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:23.813269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:23.962003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:23.978914 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3e44a22-5123-4db2-b26f-19140a9398cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.527817 Aug 30 16:04:23.980981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 55/114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:23 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:24.251418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:24.263838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c10323f-2be7-4195-9668-d2305753482b tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.476786 Aug 30 16:04:24.266613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 60/115] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:23 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:24.668059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Calling method '.version_select at 0x7fd35dc259d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.670590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.671236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.671820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.695160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.695801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.696374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.716789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.718563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.719175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.726404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-392abfdc-75f9-4b57-842f-57a4195642a0 tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.405187 Aug 30 16:04:24.727243 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 56/116] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:24.731309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0a83e0-14c1-4f54-9a16-4db2ef240b39", "name": "network-vif-plugged", "status": "completed", "tag": "2c669711-bbf2-4325-988c-6c352854fb78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:24.741418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Calling method '.version_select at 0x7fd35da6ef70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.743212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.743679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.744165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.753358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.755112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.755606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.769096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.769597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.770030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.780008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07457d08-a92a-4c35-91d0-13834bd1337c tempest-HypervisorAdminV228Test-1931837363 tempest-HypervisorAdminV228Test-1931837363-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.042122 Aug 30 16:04:24.781353 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 57/117] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:24.782250 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] Creating event network-vif-plugged:2c669711-bbf2-4325-988c-6c352854fb78 for instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 on n-h1-830883-28 Aug 30 16:04:24.794747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9f76e954-2109-4027-b598-af631c959524 req-c51534a2-1ef8-41f9-9d30-918f86f60397 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306933 Aug 30 16:04:24.795399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 61/118] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:25.003190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:25.004094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:25.011386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.012311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.012965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.014177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.015050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.016456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.287394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:25.288600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:25.310265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.310947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.311514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.312369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.312994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.315004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.556425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:25.600720 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b31b2721-da7e-4ecc-bbf4-a792d9eac2ef tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.600224 Aug 30 16:04:25.604037 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 58/119] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:25.669740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:25.678570 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1b1ad53-36bb-489f-924b-18fc58846776 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.396430 Aug 30 16:04:25.693470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:25 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:26.311477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-31512342", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:26.372989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:04:26.595717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5279f0b1-5958-42c6-9f6e-79a3d4d92217 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:26.630070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5279f0b1-5958-42c6-9f6e-79a3d4d92217 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.388760 Aug 30 16:04:26.631280 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 63/121] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:04:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:26.636432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:26.637231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:26.644522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.645264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.645856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.646916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.647562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.648174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.710450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:04:26.711068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:04:26.711611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:04:26.712231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:04:26.713758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:04:26.724023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.725014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.725564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.727004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.727643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.728284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.755064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Getting quotas for project a86f26509414411c8f89406a892b06b8. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:26.764383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Getting quotas for user 0182975830f8408fa8c6d3656b3f3386 and project a86f26509414411c8f89406a892b06b8. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:26.783644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:04:26.787326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:04:26.841100 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac98f8df-9ead-4779-9d39-88b814a0e8ee tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835293 Aug 30 16:04:26.842150 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 59/122] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:04:26.865627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:26.874817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-00d77fe3-4153-4d33-9393-101e659873c4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.242301 Aug 30 16:04:26.883117 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 64/123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:26 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:26.889457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:26.890716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:26.901045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.902620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.903520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.904532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.905285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.905826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.174404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f6769a6-62b4-4e56-9140-45ca8c0398a4 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1267183885", "id": 612907025, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:27.212197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3f6769a6-62b4-4e56-9140-45ca8c0398a4 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.366323 Aug 30 16:04:27.214130 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 60/124] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:26 2022] POST /compute/v2.1/flavors => generated 422 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:27.227000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a68c5778-7f5d-478e-b514-1045ee06293b tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.227645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a68c5778-7f5d-478e-b514-1045ee06293b tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:27.245624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:27.255188 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb979e33-c03b-428f-8cb0-71e27b7cd76d tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1337 microversion: 2.1 time: 0.370547 Aug 30 16:04:27.256351 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 65/125] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:26 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1337 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:27.261644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6393e931-496d-4a84-98e6-4ddb6949d312 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.273115 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6393e931-496d-4a84-98e6-4ddb6949d312 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015277 Aug 30 16:04:27.275896 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 66/126] 10.222.0.47 () {58 vars in 1182 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:27.285438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99d1a705-c54d-4a74-b7c7-a4412df06322 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-657080508", "id": 1818593437, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:27.311362 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99d1a705-c54d-4a74-b7c7-a4412df06322 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.029924 Aug 30 16:04:27.312623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 67/127] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:27 2022] POST /compute/v2.1/flavors => generated 424 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:27.324081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b142bb97-343b-406e-a775-b12c5021e3a7 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.333764 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b142bb97-343b-406e-a775-b12c5021e3a7 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013564 Aug 30 16:04:27.334843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 68/128] 10.222.0.47 () {58 vars in 1182 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:04:27.353383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2282c066-9cec-40fa-830a-5914ef72e092 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Action: 'create', calling method: .version_select at 0x7fd35d94d8b0>, body: {"keypair": {"name": "tempest-keypair-1981344258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3uy9EQmSUqjXEDKIi7MV0S3OMxjvQmYkS1rXWLcsOUdiliU+6ELJHAh8zY//aovarC+XsjJthFKBk3fHXwBaqtNZpcXfowbCcTK/ovdyHSed8iaC5oCyevdSloBHv9mQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:27.365241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a68c5778-7f5d-478e-b514-1045ee06293b tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:27.392883 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a68c5778-7f5d-478e-b514-1045ee06293b tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1221 microversion: 2.1 time: 0.177310 Aug 30 16:04:27.397834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 61/129] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:27.399085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2282c066-9cec-40fa-830a-5914ef72e092 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for project 4a929e510bc647eaaa73df2a64291566. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:27.408189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2282c066-9cec-40fa-830a-5914ef72e092 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for user 97d70771a4b1486c84483dbf5897bfb3 and project 4a929e510bc647eaaa73df2a64291566. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:27.453377 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2282c066-9cec-40fa-830a-5914ef72e092 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105681 Aug 30 16:04:27.454001 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 69/130] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:04:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:27.902332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.902948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:27.912446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.913195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.914825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.915723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.918850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.919847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.278671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:28.279300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:28.290142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.292022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.292762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.293448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.293898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.294351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.357016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:28.365526 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b0d6fcf5-bbff-4e64-b149-518dfc83b333 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.468431 Aug 30 16:04:28.366104 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 62/131] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:28.415400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:28.416799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:28.424243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.424878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.425467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.426284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.426991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.427738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.763706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:28.779563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-701aa2dd-bcb7-4b9b-a40e-ccd63f35cd5e tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1486 microversion: 2.1 time: 0.505032 Aug 30 16:04:28.779757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:28.782159 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 70/132] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:28 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:28.808923 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d3c5a0f-ec49-4c2b-90f3-72d9b20fda60 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1273 microversion: 2.1 time: 0.397105 Aug 30 16:04:28.809776 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 63/133] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:28 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:28.811252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:28.811886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:28.842537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.843144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.843597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.850381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.854486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.855017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.391248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:29.391867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:29.410237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.410790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.411223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.411927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.412881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.413893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.637816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c98b5ea9-05e5-4abd-a883-e665094ca3b6 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1639 microversion: 2.1 time: 0.834198 Aug 30 16:04:29.656525 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 71/134] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:28 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1639 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:29.667679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:29.668190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:29.680577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.681101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.683344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.684219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.686212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.687418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.728961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:29.929177 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-199da91d-b6a3-4dad-9fc4-d9ddccfe3eb7 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 204 len: 0 microversion: 2.1 time: 0.269112 Aug 30 16:04:29.933192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 72/135] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:29 2022] DELETE /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:30.124889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Calling method '.version_select at 0x7fd35d85fee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.126821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.127337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.127917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.150562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.152021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.152471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.166575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.167260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.167694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.174281 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89f61dd8-c13e-401b-92f6-d21bbd1acdf0 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.242501 Aug 30 16:04:30.180872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 73/136] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:04:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:30.185039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.185758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:30.193536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.194020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.194516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.195207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.195660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.196081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.230483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:30.252043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdf2b234-4001-401a-90e5-c650fb23616d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.864385 Aug 30 16:04:30.270829 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 64/137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:29 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:30.279587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.280698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:30.293824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.294998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.296393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.308400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.309395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.310064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.468883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:30.483553 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83642a50-1b56-408c-beb0-72660098a297 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.306979 Aug 30 16:04:30.484551 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 74/138] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:30.705820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18c8ac34-7ad7-4209-800d-c62bc2409793 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Calling method '.version_select at 0x7fd35d7f1f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.709406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18c8ac34-7ad7-4209-800d-c62bc2409793 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '605f12291a7a44549fbc327b2f0fdb5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ac9c777b94812b421ffad9ac74cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18c8ac34-7ad7-4209-800d-c62bc2409793 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Request method failure captured: Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hypervisors/n-h1-830883-28/search HTTP/1.1 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUMv4qE6PBMfB1aQPWgTYyZU4QUjGQqQ8ISuZ6Gje2OiS5hJ6E_jCzmU4imR-eJUVhv-X-_z0K4bP0hcexWIZMvfjc9on-TS-hAZKPuUXhg3wo_fR1PV59WDPd505lz_7irDKuDtlYWLnDGtOKdPFinmZk2MfQjxPZRWIgEn-x-xUM Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e49ac9c777b94812b421ffad9ac74cb9 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:30.711514 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e49ac9c777b94812b421ffad9ac74cb9"}]}] Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e49ac9c777b94812b421ffad9ac74cb9 Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 605f12291a7a44549fbc327b2f0fdb5a Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 16:04:30.713188 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-h1-830883-28'} Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:30.713846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 16:04:30.715671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.719490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18c8ac34-7ad7-4209-800d-c62bc2409793 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:30.720536 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18c8ac34-7ad7-4209-800d-c62bc2409793 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h1-830883-28/search" status: 403 len: 117 microversion: 2.1 time: 0.234568 Aug 30 16:04:30.721158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 75/139] 10.222.0.47 () {58 vars in 1212 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/os-hypervisors/n-h1-830883-28/search => generated 117 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:30.735486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-655859428", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "1818593437", "adminPass": "***", "networks": [{"uuid": "8ef93de6-6fbd-40ed-aaca-41dd8aba0b67"}], "security_groups": [{"name": "tempest-securitygroup--1217907785"}], "key_name": "tempest-keypair-1981344258", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:30.839864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:30.867332 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4cf192f-34fc-4a3c-a3a8-f9720c41b567 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1492 microversion: 2.1 time: 0.595308 Aug 30 16:04:30.868476 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 65/140] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1492 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:30.884593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] validate_networks() for [('8ef93de6-6fbd-40ed-aaca-41dd8aba0b67', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:04:30.892508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Calling method '.version_select at 0x7fd35d9ebd30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.902054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.902831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.903495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.938240 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Request method failure captured: Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUNhx5I3_P4EvkJO6ZK2uky2LCUzSNgCB_W7FHh-aQNyXk_pav_s3b1lbVY5OKHHBBq6RB3RSzTTxjh9sUFuhj4CXdBelkGlqnOqTMUjPxBE6APYprMktDXQFktG5aHhefJTpFUPJv431f7F0I8OJDuJAU0G6nnTm8PX7XEtx9KQqc Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a1651f3dff524627b0b3bf31992871d6 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:30.940732 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1651f3dff524627b0b3bf31992871d6"}]}] Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a1651f3dff524627b0b3bf31992871d6 Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b384000a713945799fa92d160de45b5d Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 16:04:30.941952 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:30.942763 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:30.943832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:30.943832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:30.943832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:30.943832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 16:04:30.943832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:30.945662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:30.947470 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4cbbf676-0617-4384-8a51-5210e3f24c73 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.076584 Aug 30 16:04:30.952881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 66/141] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:30.960662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Calling method '.version_select at 0x7fd35d9ebe50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.962657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.963210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.963760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.985605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.987198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.987829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.001309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.001809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.002262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.012633 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bab05662-93ea-4328-83e9-e4999ca8c683 tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.058367 Aug 30 16:04:31.020374 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 67/142] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:31.030034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95b192dc-3787-495d-a53f-cb46187bb206 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Calling method '.version_select at 0x7fd35d9ebca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.033533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-95b192dc-3787-495d-a53f-cb46187bb206 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '605f12291a7a44549fbc327b2f0fdb5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e49ac9c777b94812b421ffad9ac74cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95b192dc-3787-495d-a53f-cb46187bb206 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Request method failure captured: Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUMv4qE6PBMfB1aQPWgTYyZU4QUjGQqQ8ISuZ6Gje2OiS5hJ6E_jCzmU4imR-eJUVhv-X-_z0K4bP0hcexWIZMvfjc9on-TS-hAZKPuUXhg3wo_fR1PV59WDPd505lz_7irDKuDtlYWLnDGtOKdPFinmZk2MfQjxPZRWIgEn-x-xUM Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e49ac9c777b94812b421ffad9ac74cb9 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:31.035176 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e49ac9c777b94812b421ffad9ac74cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e49ac9c777b94812b421ffad9ac74cb9"}]}] Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e49ac9c777b94812b421ffad9ac74cb9 Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956 Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 605f12291a7a44549fbc327b2f0fdb5a Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 16:04:31.036298 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1'} Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:31.036963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 16:04:31.037948 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.041210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95b192dc-3787-495d-a53f-cb46187bb206 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:31.041210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95b192dc-3787-495d-a53f-cb46187bb206 tempest-HypervisorAdminNegativeUnderV252Test-2037017956 tempest-HypervisorAdminNegativeUnderV252Test-2037017956-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015130 Aug 30 16:04:31.042842 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 68/143] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:31.048778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Calling method '.version_select at 0x7fd35da6e1f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.050473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.050964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.054923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.063044 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] HTTP exception thrown: No hypervisor matching '2b7569e8-2530-42be-836e-e4e1fcb32689' could be found. Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Request method failure captured: Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/2b7569e8-2530-42be-836e-e4e1fcb32689/servers HTTP/1.1 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUNhx5I3_P4EvkJO6ZK2uky2LCUzSNgCB_W7FHh-aQNyXk_pav_s3b1lbVY5OKHHBBq6RB3RSzTTxjh9sUFuhj4CXdBelkGlqnOqTMUjPxBE6APYprMktDXQFktG5aHhefJTpFUPJv431f7F0I8OJDuJAU0G6nnTm8PX7XEtx9KQqc Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a1651f3dff524627b0b3bf31992871d6 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:31.064892 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a1651f3dff524627b0b3bf31992871d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a1651f3dff524627b0b3bf31992871d6"}]}] Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a1651f3dff524627b0b3bf31992871d6 Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822 Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b384000a713945799fa92d160de45b5d Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: exception: No hypervisor matching '2b7569e8-2530-42be-836e-e4e1fcb32689' could be found. Aug 30 16:04:31.066085 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '2b7569e8-2530-42be-836e-e4e1fcb32689'} Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2b7569e8-2530-42be-836e-e4e1fcb32689' could be found. Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.066835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2b7569e8-2530-42be-836e-e4e1fcb32689' could be found. Aug 30 16:04:31.067794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:31.069936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] Returning 404 to user: No hypervisor matching '2b7569e8-2530-42be-836e-e4e1fcb32689' could be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:31.071038 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c7c4e17-9ee1-4465-b362-e85c185944bc tempest-HypervisorAdminNegativeUnderV252Test-1890966822 tempest-HypervisorAdminNegativeUnderV252Test-1890966822-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/2b7569e8-2530-42be-836e-e4e1fcb32689/servers" status: 404 len: 123 microversion: 2.1 time: 0.026018 Aug 30 16:04:31.077240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 69/144] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/os-hypervisors/2b7569e8-2530-42be-836e-e4e1fcb32689/servers => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:31.278919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.279625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:31.288839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.299000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.299778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.300763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.301561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.302211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.095297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:04:32.096428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:04:32.097058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:04:32.097637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:04:32.098467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:04:32.121675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.122343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.122985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.123911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.124540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.128398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.181195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for project 4a929e510bc647eaaa73df2a64291566. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:32.190753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for user 97d70771a4b1486c84483dbf5897bfb3 and project 4a929e510bc647eaaa73df2a64291566. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:32.224448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:32.232115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:04:32.234628 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-32e2c26e-e0e4-4fbb-8e21-9d3c7d48f3f1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.960104 Aug 30 16:04:32.235917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:04:32.246791 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 70/145] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:32.258932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:32.258932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:32.267887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.273341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.273941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.274813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.275954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.277190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.372723 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61209f06-97d3-4527-a4bb-fed80b95ed12 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.644014 Aug 30 16:04:32.375104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 76/146] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:04:32.381889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:32.382684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:32.391422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.392153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.393048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.393992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:32.395317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:32.395975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:32.563386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:32.575850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3757fcc-10ef-4a70-9653-346d35440ee6 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1492 microversion: 2.1 time: 0.198948 Aug 30 16:04:32.576938 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 77/147] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:32 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1492 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:32.584430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27dda718-9046-45e5-b223-741571af7aba tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:32.585162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27dda718-9046-45e5-b223-741571af7aba tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:32.660716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-27dda718-9046-45e5-b223-741571af7aba tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:32.668714 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27dda718-9046-45e5-b223-741571af7aba tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1264 microversion: 2.1 time: 0.090557 Aug 30 16:04:32.682120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 78/148] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:32 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1264 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:32.841639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:32.849678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:32.852081 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28e7e5a3-3b5d-45e7-acf3-d9006d870095 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.604198 Aug 30 16:04:32.858690 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 71/149] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:32 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:33.000302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4dcf21-2252-439b-83be-876742bbe816", "name": "network-vif-plugged", "status": "completed", "tag": "90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:33.024974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.025652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.026078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.049141 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] Creating event network-vif-plugged:90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67 for instance 5e4dcf21-2252-439b-83be-876742bbe816 on n-h2-830883-28 Aug 30 16:04:33.067252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-af87df87-c078-4f1b-8598-28eede8e6892 req-7e24ed54-f73e-4507-9407-13c613f79209 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070679 Aug 30 16:04:33.068536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 79/150] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:33.275831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:33.284004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:33.299243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.302921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.304984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.309687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.310624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.311218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.370482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f850784f-7b91-44d0-ab49-b7f166afa06d", "tag": "6ddb8958-de6f-4050-8a30-5c01a0682998"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:33.384987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.386240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.386794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.401426 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] Creating event network-changed:6ddb8958-de6f-4050-8a30-5c01a0682998 for instance f850784f-7b91-44d0-ab49-b7f166afa06d on n-h2-830883-28 Aug 30 16:04:33.415485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4a1c5eb1-fc89-429c-816a-7fa5f74bba5f req-164a28d0-3d77-4b02-b0b9-3bc72a3465eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055879 Aug 30 16:04:33.417100 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 80/151] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:33.598493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:33.599193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:33.601124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:33.613813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.614534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.615038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.616131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.616864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.617468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.691696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:33.701640 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8ecc71d-8628-4c6b-ae0f-b08fdb812e6c tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1450 microversion: 2.1 time: 0.107225 Aug 30 16:04:33.715320 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 81/152] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:33 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1450 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:33.721926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:33.722876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:33.731247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.732194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.732835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.733737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.734414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.735079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.765828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:33.798603 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5084016-f5c6-4dac-93b1-74dd764c5840 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.520689 Aug 30 16:04:33.799276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 72/153] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:33 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:33.819585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:33.827954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-012185b8-c4da-4d1a-a44e-b2b492628942 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1337 microversion: 2.1 time: 0.111349 Aug 30 16:04:33.830732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 82/154] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:33 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:33.878234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:33.878953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:33.899500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.902526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.903294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.904529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.906192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.908493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.647490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:34.659264 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2a83c2bf-a328-4904-9ef6-de4c92c66467 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.786934 Aug 30 16:04:34.673274 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 73/155] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:33 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:34.731883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:34.733359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:34.748908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.750176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.750980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.753243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.756306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.757213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.819829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:34.821078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:34.835453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.835981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.836409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.837149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.843112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.843562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.028841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.029855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.030472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.031680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lazy-loading 'fault' on Instance uuid 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:35.038169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.088539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb204af25914228922ff1aaf286fd81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab8add0a924a4f3bafd3a0b931743b47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.096980 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2982a437-d56c-4425-9f17-0726e7db1f89 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 200 len: 1327 microversion: 2.1 time: 0.372337 Aug 30 16:04:35.098343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 83/156] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:34 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 1327 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:35.105101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:35.105886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:35.112118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.112777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.113401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.114588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.115359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.115963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.206220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.216956 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c063ee5b-6cd2-4e3c-b5a3-24a99f364ffc tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1343 microversion: 2.1 time: 0.116308 Aug 30 16:04:35.216956 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 84/157] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:35 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1343 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:35.456375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0a83e0-14c1-4f54-9a16-4db2ef240b39", "name": "network-vif-deleted", "tag": "2c669711-bbf2-4325-988c-6c352854fb78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:35.469321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.472886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.481473 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3ca9b20-a9a2-4754-87ef-3b4befb30ba8 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.665552 Aug 30 16:04:35.482390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.483059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.487874 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 74/158] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:34 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:35.496766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] Creating event network-vif-deleted:2c669711-bbf2-4325-988c-6c352854fb78 for instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 on n-h1-830883-28 Aug 30 16:04:35.502056 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-58e80e5d-feb0-4b14-9099-07dd0249751a req-50958dda-75ef-4ed7-8977-afc52f6cf8af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049709 Aug 30 16:04:35.503235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 85/159] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:35.685959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:35.687202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:35.696042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.697562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.698250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.699147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.700957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.701357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.720960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-62c30d80-d39f-4c86-b52c-2a8c608eeb42 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35da6e280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:35.817022 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-62c30d80-d39f-4c86-b52c-2a8c608eeb42 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc" status: 200 len: 371 microversion: 2.1 time: 0.251479 Aug 30 16:04:35.818581 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 75/160] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:04:35 2022] GET /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc => generated 371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:35.829583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d921b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:35.924256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.934895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.937336 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f587369-c57e-436a-914c-a1f6589a3a80 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.259127 Aug 30 16:04:35.938187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 86/161] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:35 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:35.942085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.942669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.943147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.943864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.944311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.944730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.013273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5d8f314c-926b-4014-9824-fe4d6d697413 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc" status: 200 len: 328 microversion: 2.1 time: 0.187292 Aug 30 16:04:36.019943 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 76/162] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:04:35 2022] PUT /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc => generated 328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:36.026480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37c5edbe-58e5-46b4-be26-79d2eca013c6 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.041045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37c5edbe-58e5-46b4-be26-79d2eca013c6 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc" status: 202 len: 0 microversion: 2.1 time: 0.018518 Aug 30 16:04:36.041805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 87/163] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:04:36 2022] DELETE /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:36.050662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b88bd0c9-74f3-4ad9-a0f4-801688f715e1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35d9ebdc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.118537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.119209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:36.125517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.126010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.126494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.127185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.127642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.128068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.135418 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b88bd0c9-74f3-4ad9-a0f4-801688f715e1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc" status: 200 len: 371 microversion: 2.1 time: 0.088002 Aug 30 16:04:36.137019 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 77/164] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-quota-sets/dee688231456494db2b2627a0452c3cc => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.151007 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] HTTP exception thrown: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Request method failure captured: Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 HTTP/1.1 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmbswaDEjxvqSLTkaAAgp8OOmtPHl3SDySicRoRI8L0Yi5FgAknt4adKFd_MXlVj6UJ7Fz_cIXSsDBn9TiD2sd2s8EkoCcdYs9-ic1q2WmKbSuHj_TGdW9Fufv1t9EdMCP0f9f_yIPtsIRdVV3ISJ2VsvmiNnGPODAMaz9X7dCJR0 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:36.156676 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}] Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7eb204af25914228922ff1aaf286fd81 Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:36.158037 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4e0a83e0-14c1-4f54-9a16-4db2ef240b39'} Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:36.158733 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:36.159732 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:36.162239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Returning 404 to user: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:36.163326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-533082b7-51d9-41a2-867c-870f2006a052 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 404 len: 111 microversion: 2.1 time: 0.048779 Aug 30 16:04:36.164124 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 88/165] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:04:36.174805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5575120a-4bba-4920-ba1b-225893e0e12a tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:36.189885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5575120a-4bba-4920-ba1b-225893e0e12a tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.190422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5575120a-4bba-4920-ba1b-225893e0e12a tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.190854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5575120a-4bba-4920-ba1b-225893e0e12a tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.237529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.238729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:36.247675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.248463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.248908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.251972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.252539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.252854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.385851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5575120a-4bba-4920-ba1b-225893e0e12a tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.216434 Aug 30 16:04:36.387173 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 78/166] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:36 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.393215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c3a1ed9-7b5b-48c4-b9c8-07f2e095d9b8 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35d93dca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.395121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:36.405210 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8c30a1b-5bb0-4d5e-8a55-abc4984b95a9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1343 microversion: 2.1 time: 0.171999 Aug 30 16:04:36.406258 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 89/167] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1343 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:36.413128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-951fa424-fe2c-4781-95fe-5a8a4e1cd0ef tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.468810 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-951fa424-fe2c-4781-95fe-5a8a4e1cd0ef tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.060490 Aug 30 16:04:36.470020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 90/168] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:36 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:36.482891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35da78af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.487828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.488544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.489211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.489994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.490497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.490924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.537850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-945f29c6-a726-4e98-9014-57d5153f42b4 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.059695 Aug 30 16:04:36.545465 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 91/169] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.551212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.552214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:36.559351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.560001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.560661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.561477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.562280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.562828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.688579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c3a1ed9-7b5b-48c4-b9c8-07f2e095d9b8 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.300052 Aug 30 16:04:36.689605 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 79/170] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4/defaults => generated 371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.702562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35d93dee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.706777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.707261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.707717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.708448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.708893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.710975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.754043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5ea784d-834c-4f39-bc9c-f7d5ab790b94 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.063310 Aug 30 16:04:36.754879 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 80/171] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.767859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35daae8b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.769592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:36.772154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.773012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.773785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.776932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.778934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.780815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.781088 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff179fb9-1b94-4b3a-95af-1075fde18280 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.234164 Aug 30 16:04:36.797440 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 92/172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:36.827241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-daf4c2d6-58c5-4aae-ac58-0c89fcdfd9d7 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.063420 Aug 30 16:04:36.828488 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 81/173] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.841079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35d5ddee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.848998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59a597ad-5782-4bce-aabf-a93ea754cf1c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1184990184"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:36.854359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.854794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-59a597ad-5782-4bce-aabf-a93ea754cf1c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid dec8e977-855b-47f8-bd70-42b0a8f33851 for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:36.855278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.855892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.880803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.881615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.882677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.894083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59a597ad-5782-4bce-aabf-a93ea754cf1c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051729 Aug 30 16:04:36.905139 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 82/174] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.910192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c010f0c-ec86-470a-ae93-c8fcbd015d34 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:36.935916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba29fe30-3075-4fb2-84e7-a3e0838064da tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-h1-830883-28" status: 200 len: 471 microversion: 2.1 time: 0.096677 Aug 30 16:04:36.937797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c010f0c-ec86-470a-ae93-c8fcbd015d34 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.938487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c010f0c-ec86-470a-ae93-c8fcbd015d34 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.939221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c010f0c-ec86-470a-ae93-c8fcbd015d34 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.942710 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 93/175] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-hosts/n-h1-830883-28 => generated 471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:36.968913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Calling method '.version_select at 0x7fd35d5dd940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.987064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.987566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.988009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.013982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.014751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.015330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.048370 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d187d7c3-92ab-49a7-a718-3d904a0cac33 tempest-HostsAdminTestJSON-2138729626 tempest-HostsAdminTestJSON-2138729626-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-h2-830883-28" status: 200 len: 603 microversion: 2.1 time: 0.091317 Aug 30 16:04:37.049891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 94/176] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/os-hosts/n-h2-830883-28 => generated 603 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:37.072544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:37.073384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:37.084628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.086169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.086798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.088166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.088633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.089112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.124610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c010f0c-ec86-470a-ae93-c8fcbd015d34 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.217731 Aug 30 16:04:37.126122 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 83/177] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:37.135409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d98e9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:37.311237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:37.320523 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-662981f7-a660-4a08-97fa-fe1b5d49f173 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.269555 Aug 30 16:04:37.321319 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 95/178] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:37.326819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9e452c7-e015-4789-9681-a5ce881a4060 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:37.343049 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9e452c7-e015-4789-9681-a5ce881a4060 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 243 microversion: 2.1 time: 0.020109 Aug 30 16:04:37.343648 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 96/179] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/os-aggregates/2 => generated 243 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:37.358924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-531cf026-8244-47b4-bd2a-d72a5c2ac955 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:37.382292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.383354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.383986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.385190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.386215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.387048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.388595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531cf026-8244-47b4-bd2a-d72a5c2ac955 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.389560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531cf026-8244-47b4-bd2a-d72a5c2ac955 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.390006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531cf026-8244-47b4-bd2a-d72a5c2ac955 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.464722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-445f37ed-6aba-4642-862c-79b6946a9a96 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370" status: 200 len: 328 microversion: 2.1 time: 0.337341 Aug 30 16:04:37.465698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 84/180] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:04:37 2022] PUT /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370 => generated 328 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:37.478977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:37.479692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:37.486465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.487199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.489482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.490284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.490689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.491112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.885081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-531cf026-8244-47b4-bd2a-d72a5c2ac955 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.531548 Aug 30 16:04:37.893844 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 97/181] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:37 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:37.919788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35d5ddc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:37.979716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:37.992678 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9091946-f4e2-499b-98f5-6890a3b9f528 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.525665 Aug 30 16:04:37.996699 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 85/182] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:38.011479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:38.012388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:38.031283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.031779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.032221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.032918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.033370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.033790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.388099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.389488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.390164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.392053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.392842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.393570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.418546 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9170a7f-bcef-42a1-aca3-591732d0f706 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370/detail" status: 200 len: 916 microversion: 2.1 time: 0.523223 Aug 30 16:04:38.419395 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 98/183] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370/detail => generated 916 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:38.428345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-975ed39b-e541-4355-ae0e-27ce4a932cfd tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:38.428568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:38.438809 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-549c5bd5-39c5-47b9-8169-d1ed9448e12c tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1320 microversion: 2.1 time: 0.440671 Aug 30 16:04:38.451096 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 86/184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1320 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:38.458202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:38.459064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:38.465867 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-975ed39b-e541-4355-ae0e-27ce4a932cfd tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.044948 Aug 30 16:04:38.472523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 99/185] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:38 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:38.478820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.479539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.480279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.480930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5f1cfbe-d7bb-4129-a118-186dcd933f20 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1381845080"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:38.481587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.482925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.483849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.490453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-f5f1cfbe-d7bb-4129-a118-186dcd933f20 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid c508aaf0-dfee-4850-a0e1-13ea0b0c5471 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:38.528567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5f1cfbe-d7bb-4129-a118-186dcd933f20 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054999 Aug 30 16:04:38.535306 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 100/186] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:38.553088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60ad061c-4a23-46a1-bd2a-317d2695ed77 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:38.571978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60ad061c-4a23-46a1-bd2a-317d2695ed77 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.572663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60ad061c-4a23-46a1-bd2a-317d2695ed77 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.573590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60ad061c-4a23-46a1-bd2a-317d2695ed77 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.826227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60ad061c-4a23-46a1-bd2a-317d2695ed77 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.289638 Aug 30 16:04:38.827433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 101/187] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:38 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:38.864115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d5f6c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:38.993213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:39.003591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-40e2552e-e76d-49bc-acca-9698850f5b1d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.551328 Aug 30 16:04:39.007028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 87/188] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:38 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:39.025765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88332c69-64d6-4657-944b-6973e748c7d9 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:39.059525 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88332c69-64d6-4657-944b-6973e748c7d9 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.051223 Aug 30 16:04:39.062506 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 88/189] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:04:39 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:39.067368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:39.072763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:39.094115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.101715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.102563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.105075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.105834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.108051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.278264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.278795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.279426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.280677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.281038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.281464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.338836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.339321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.340121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.341196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.341864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.342545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.421844 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4e9d2f9-1032-4553-9c98-029409b7d01a tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370?user_id=65802895ed864b3a92ecc7f451722122" status: 200 len: 328 microversion: 2.1 time: 0.593176 Aug 30 16:04:39.429568 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 102/190] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:04:38 2022] PUT /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370?user_id=65802895ed864b3a92ecc7f451722122 => generated 328 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:39.444900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7dcbf6ec-6f83-42b0-afbd-21d1655ecdaa tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:39.459519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dcbf6ec-6f83-42b0-afbd-21d1655ecdaa tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.460210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dcbf6ec-6f83-42b0-afbd-21d1655ecdaa tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.461290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dcbf6ec-6f83-42b0-afbd-21d1655ecdaa tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.471959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.648564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7dcbf6ec-6f83-42b0-afbd-21d1655ecdaa tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.214003 Aug 30 16:04:39.652133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 103/191] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:39 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:39.661014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109f4699-4c8a-41d4-89fd-8327bbe72f8b", "tag": "8e9e65fb-b83e-4705-bbd7-d757435f4c36"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:39.676187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.679443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.680076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.697376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] Creating event network-changed:8e9e65fb-b83e-4705-bbd7-d757435f4c36 for instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b on n-h1-830883-28 Aug 30 16:04:39.704242 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-30769124-56fc-45b3-a80e-5eedeeb62917 req-1fe356f8-b4e7-43c1-a6e4-352accbf44af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050580 Aug 30 16:04:39.708361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 104/192] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:39.717542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-209c4f89-4b21-4e67-a228-f85b46574607 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35d7080d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:39.735126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:39.745632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e83b8da1-9e4a-4ffd-b1dc-f86c1e6ba8a1 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.681850 Aug 30 16:04:39.746583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 89/193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:39 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:39.770682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:39.771520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:39.795555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.798648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.799639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:39.801166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:39.801640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:39.802071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.299376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:40.310792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-442dfed6-62e0-4ee4-a08b-8a9f08f93876 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1470 microversion: 2.1 time: 0.561810 Aug 30 16:04:40.311681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 90/194] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:39 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1470 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:40.318397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9d4dfbc-d372-4f7a-8385-62695d9856b7 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:40.347182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-209c4f89-4b21-4e67-a228-f85b46574607 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370?user_id=65802895ed864b3a92ecc7f451722122" status: 200 len: 370 microversion: 2.1 time: 0.636869 Aug 30 16:04:40.348026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 105/195] 10.222.0.47 () {58 vars in 1323 bytes} [Tue Aug 30 16:04:39 2022] GET /compute/v2.1/os-quota-sets/0b6b928b13a1419f9200fad0e651a370?user_id=65802895ed864b3a92ecc7f451722122 => generated 370 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:40.349873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9d4dfbc-d372-4f7a-8385-62695d9856b7 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034509 Aug 30 16:04:40.350543 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 91/196] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:40 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:40.359692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:40.360440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:40.367480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.367929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.368407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.369275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.369889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.370596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.710702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:40.711467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:40.724677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.725585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.726919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.729208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.731970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.732575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.029415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:41.093182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:41.101449 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bbab8490-49f9-491c-9b56-5ee5fc342505 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.752115 Aug 30 16:04:41.102028 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 106/197] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:40 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:41.121938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-90ee6271-9785-4da9-bd7b-b21904e57f14 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-544522034"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:41.127176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-90ee6271-9785-4da9-bd7b-b21904e57f14 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid c083d926-8a93-4ebe-b440-2e22e384f50c for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:41.162993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-90ee6271-9785-4da9-bd7b-b21904e57f14 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 30 16:04:41.165074 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 107/198] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:41.174120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:41.175172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:41.188735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.190717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.193858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.196125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.198168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.200067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.249747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2d93745-f040-433b-a2cf-616790115df4 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 204 len: 0 microversion: 2.1 time: 0.897368 Aug 30 16:04:41.251596 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 92/199] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:40 2022] DELETE /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:41.259003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7114a405-2402-4d91-9487-ffefa693daf0 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Calling method '.version_select at 0x7fd35dc4ed30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:41.651895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:41.663765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0919a4d-5e7e-42cb-a84a-fd80a2655d01 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.496706 Aug 30 16:04:41.668085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 108/200] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:41 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:41.677606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-76d3cdc6-c8d8-4531-a3b1-0d695b4f27a0 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:41.700426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76d3cdc6-c8d8-4531-a3b1-0d695b4f27a0 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.700800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76d3cdc6-c8d8-4531-a3b1-0d695b4f27a0 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.701633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76d3cdc6-c8d8-4531-a3b1-0d695b4f27a0 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.711668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7114a405-2402-4d91-9487-ffefa693daf0 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.458577 Aug 30 16:04:41.712929 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 93/201] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:04:41 2022] GET /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4/defaults => generated 371 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:41.728500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:41.729506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:41.739363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.741851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.745047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.745927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.746579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.747124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.929555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-76d3cdc6-c8d8-4531-a3b1-0d695b4f27a0 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.260051 Aug 30 16:04:41.934506 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 109/202] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:41 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:41.940963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d8353a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:42.113538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.115464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.116126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.117624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.119939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.122743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.151857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:42.167169 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6d200e2-ddb7-4f21-bef6-0575fbc508b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1476 microversion: 2.1 time: 0.443708 Aug 30 16:04:42.182922 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 94/203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:41 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1476 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:42.299985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-452a18ae-87b5-449e-b098-5b8ab0074091 tempest-InstanceUsageAuditLogTestJSON-1815937424 tempest-InstanceUsageAuditLogTestJSON-1815937424-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.336440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-452a18ae-87b5-449e-b098-5b8ab0074091 tempest-InstanceUsageAuditLogTestJSON-1815937424 tempest-InstanceUsageAuditLogTestJSON-1815937424-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 16:04:41" status: 200 len: 318 microversion: 2.1 time: 0.152117 Aug 30 16:04:42.337344 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 95/204] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:04:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2016%3A04%3A41 => generated 318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:42.347127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bd05628-f4aa-4622-b849-33a0ae7f4117 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:42.362190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd05628-f4aa-4622-b849-33a0ae7f4117 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.363777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd05628-f4aa-4622-b849-33a0ae7f4117 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.364431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd05628-f4aa-4622-b849-33a0ae7f4117 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.484537 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a142ce09-71b0-4030-91cd-7bd902ccfd33 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4" status: 200 len: 329 microversion: 2.1 time: 0.551551 Aug 30 16:04:42.491160 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 110/205] 10.222.0.47 () {60 vars in 1263 bytes} [Tue Aug 30 16:04:41 2022] PUT /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4 => generated 329 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:42.491160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.491160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:42.503259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.503685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.504125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.504821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.505271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.505688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.516951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:42.547049 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4bd05628-f4aa-4622-b849-33a0ae7f4117 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.208156 Aug 30 16:04:42.547779 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 96/206] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:42 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:42.559931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-427ecc9a-9486-4ed3-a887-524892c41a08 tempest-InstanceUsageAuditLogTestJSON-1815937424 tempest-InstanceUsageAuditLogTestJSON-1815937424-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.583234 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-427ecc9a-9486-4ed3-a887-524892c41a08 tempest-InstanceUsageAuditLogTestJSON-1815937424 tempest-InstanceUsageAuditLogTestJSON-1815937424-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.033746 Aug 30 16:04:42.584127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 97/207] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:04:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:42.589236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Action: 'update', calling method: .version_select at 0x7fd35dbd9280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:42.711521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.712015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.713246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.713973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.714195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.724342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.788160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:42.798607 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3e68502-8745-4a26-b9d2-a3787dea594e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.312438 Aug 30 16:04:42.803414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 111/208] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:42 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:42.809664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc8ff473-1202-40b2-a7b6-705484db742c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.857787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc8ff473-1202-40b2-a7b6-705484db742c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.052465 Aug 30 16:04:42.859342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 112/209] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:42 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:42.867323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.868123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:42.880482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.886437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.887023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.887880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.888452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.889005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:43.357992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:43.360769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:43.368923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cb23c5ca-b993-4010-8796-56f6f3d5049d tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.508409 Aug 30 16:04:43.373276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 113/210] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:42 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:43.381432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7b78b6a-891b-422c-8983-f6289e33c18e tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-451356079"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:43.389504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-e7b78b6a-891b-422c-8983-f6289e33c18e tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid ec68a0b1-b089-4151-80ca-745d4298ee67 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:43.404455 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3e538c8-f3b8-41f4-a6d1-9bb6d0d426c1 tempest-QuotasAdminTestJSON-1519348192 tempest-QuotasAdminTestJSON-1519348192-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4" status: 200 len: 329 microversion: 2.1 time: 0.818887 Aug 30 16:04:43.417407 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 98/211] 10.222.0.47 () {60 vars in 1263 bytes} [Tue Aug 30 16:04:42 2022] PUT /compute/v2.1/os-quota-sets/88c556327b7b49f78b2fc757ac43cff4 => generated 329 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:43.419137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e87ea58-4027-42a0-b4f6-ca714071c680 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-384098893"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:43.436991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-2e87ea58-4027-42a0-b4f6-ca714071c680 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Generated uuid f8726b7d-6654-4a08-9109-de4a9306236b for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:43.448495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e7b78b6a-891b-422c-8983-f6289e33c18e tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.070782 Aug 30 16:04:43.449512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 114/212] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:43.466224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:43.467928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:43.485884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:43.488109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:43.489220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:43.493128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:43.494569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:43.495184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:43.509939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e87ea58-4027-42a0-b4f6-ca714071c680 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.096508 Aug 30 16:04:43.510633 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 99/213] 10.222.0.47 () {62 vars in 1205 bytes} [Tue Aug 30 16:04:43 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:43.523662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfc239a9-529b-495c-9308-903b3e7ef077 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:43.564384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfc239a9-529b-495c-9308-903b3e7ef077 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.051478 Aug 30 16:04:43.565135 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 100/214] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:43.583655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13c48023-d9a1-40d9-9059-6b344d5e74dc tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1029231136"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:43.944033 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13c48023-d9a1-40d9-9059-6b344d5e74dc tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.372254 Aug 30 16:04:43.963312 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 101/215] 10.222.0.47 () {62 vars in 1210 bytes} [Tue Aug 30 16:04:43 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:44.000540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0ec5f2b-e12e-47c0-b858-e2e1cd5e147c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.017943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f0ec5f2b-e12e-47c0-b858-e2e1cd5e147c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0ec5f2b-e12e-47c0-b858-e2e1cd5e147c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Request method failure captured: Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjTp1yragUX3mUDSRrtl_5MdddlNA6RzA__1BRHUcAyBlPM_l8iABfYzsyZssf0pgUg8hW9nWLgF08zQmAqkbf8UlX9tI3YU4GC0gcnu5pDI1DV8BuDCfXqqrOeSj-L8LJYfS371_NiU31qyOVkJ1JZxFmGBw3X6RpPB8oai_wRXLGk Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:44.045688 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}] Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 21fa47d36abd4104a826c6276df10f37 Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: exception: Aggregate 5 could not be found. Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5'} Aug 30 16:04:44.047204 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.048073 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 16:04:44.049214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.058469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0ec5f2b-e12e-47c0-b858-e2e1cd5e147c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:44.059916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f0ec5f2b-e12e-47c0-b858-e2e1cd5e147c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.095150 Aug 30 16:04:44.061081 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 102/216] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:04:43 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:44.072895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.074291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:44.089386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:44.103853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b4f259f-592c-40f4-a80d-06356610fddc tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1476 microversion: 2.1 time: 0.652203 Aug 30 16:04:44.106259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.113336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 115/217] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:43 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1476 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:44.114220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.120042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2a7690c-cb3b-4735-9e03-6b1c138d3301 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.122785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.123622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.124079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.124521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.172639 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2a7690c-cb3b-4735-9e03-6b1c138d3301 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.056407 Aug 30 16:04:44.185060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 116/218] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 16:04:44 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:44.208912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a1729b4-28af-464a-9b18-f0c734a5fc43 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.263512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5a1729b4-28af-464a-9b18-f0c734a5fc43 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a1729b4-28af-464a-9b18-f0c734a5fc43 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Request method failure captured: Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTp1yragUX3mUDSRrtl_5MdddlNA6RzA__1BRHUcAyBlPM_l8iABfYzsyZssf0pgUg8hW9nWLgF08zQmAqkbf8UlX9tI3YU4GC0gcnu5pDI1DV8BuDCfXqqrOeSj-L8LJYfS371_NiU31qyOVkJ1JZxFmGBw3X6RpPB8oai_wRXLGk Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:44.270124 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}] Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 21fa47d36abd4104a826c6276df10f37 Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate 5 could not be found. Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5'} Aug 30 16:04:44.271432 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:44.272259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:44.273453 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:44.274825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:44.274825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:44.274825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:44.274825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 16:04:44.274825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:44.277882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a1729b4-28af-464a-9b18-f0c734a5fc43 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:44.280923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a1729b4-28af-464a-9b18-f0c734a5fc43 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.089823 Aug 30 16:04:44.282068 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 117/219] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:44 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:44.298670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2c65ab8-b3f2-4a6e-be1f-d0e81023edff tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:44.330734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2c65ab8-b3f2-4a6e-be1f-d0e81023edff tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.331315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2c65ab8-b3f2-4a6e-be1f-d0e81023edff tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.333720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2c65ab8-b3f2-4a6e-be1f-d0e81023edff tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.563975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2c65ab8-b3f2-4a6e-be1f-d0e81023edff tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.41 time: 0.280478 Aug 30 16:04:44.565346 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 118/220] 10.222.0.47 () {62 vars in 1232 bytes} [Tue Aug 30 16:04:44 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:44.576354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ab7b9cd-149d-4da7-8f1b-97929f7fc260 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-632892952", "name": "tempest-test_aggregate-1430731851"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:44.592418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-3ab7b9cd-149d-4da7-8f1b-97929f7fc260 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid ebb9d496-76ba-4fb4-a4ad-8f6494add8fa for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:44.598498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:44.626114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6878c168-0273-40b6-ba9f-0c1d8d80b4b9 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.557205 Aug 30 16:04:44.627809 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 103/221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:44 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:44.641828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=3,nova_api:INSERT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.646689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4dcf21-2252-439b-83be-876742bbe816", "name": "network-vif-deleted", "tag": "90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:44.661277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.662030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.662673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.673180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:44.698381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] Creating event network-vif-deleted:90b6e8fc-6a98-4b4f-826b-2d8f2b4f6b67 for instance 5e4dcf21-2252-439b-83be-876742bbe816 on n-h2-830883-28 Aug 30 16:04:44.700642 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ab7b9cd-149d-4da7-8f1b-97929f7fc260 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.133967 Aug 30 16:04:44.703210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 119/222] 10.222.0.47 () {60 vars in 1165 bytes} [Tue Aug 30 16:04:44 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:44.705885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e3c50964-71b5-416b-94e5-7880363bd96e req-0f4304db-86c4-4a37-9dd3-0e4ecda8b63d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071634 Aug 30 16:04:44.707029 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 104/223] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:44.711259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.713001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:44.713401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d96a8daa-a7a3-466a-9e64-dd4f398afd62 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:44.722423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.723158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.723762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.724929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.725572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.726160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.726779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d96a8daa-a7a3-466a-9e64-dd4f398afd62 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.727405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d96a8daa-a7a3-466a-9e64-dd4f398afd62 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.728739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d96a8daa-a7a3-466a-9e64-dd4f398afd62 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.955739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d96a8daa-a7a3-466a-9e64-dd4f398afd62 tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.246214 Aug 30 16:04:44.980756 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 105/224] 10.222.0.47 () {62 vars in 1232 bytes} [Tue Aug 30 16:04:44 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:44.985956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a14a6db-21f4-4c3b-8678-33175a68b5bb tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.001591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=4,nova_api:INSERT=15,nova_api:UPDATE=15 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:45.068998 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a14a6db-21f4-4c3b-8678-33175a68b5bb tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.086854 Aug 30 16:04:45.070239 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 106/225] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:45.086112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18892ee6-85f8-433f-83bb-0972370ea6cf tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.154590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18892ee6-85f8-433f-83bb-0972370ea6cf tempest-AggregatesAdminTestV241-1101192220 tempest-AggregatesAdminTestV241-1101192220-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.073980 Aug 30 16:04:45.163381 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 107/226] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 16:04:45 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.175259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-23557b27-876d-4bcb-b6c3-6add8770b5dc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.197853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-23557b27-876d-4bcb-b6c3-6add8770b5dc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-23557b27-876d-4bcb-b6c3-6add8770b5dc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Request method failure captured: Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjTp1yragUX3mUDSRrtl_5MdddlNA6RzA__1BRHUcAyBlPM_l8iABfYzsyZssf0pgUg8hW9nWLgF08zQmAqkbf8UlX9tI3YU4GC0gcnu5pDI1DV8BuDCfXqqrOeSj-L8LJYfS371_NiU31qyOVkJ1JZxFmGBw3X6RpPB8oai_wRXLGk Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:45.202621 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}] Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 21fa47d36abd4104a826c6276df10f37 Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: exception: Aggregate 7 could not be found. Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7'} Aug 30 16:04:45.204083 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.205079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 16:04:45.206207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.209100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-23557b27-876d-4bcb-b6c3-6add8770b5dc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:45.210792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-23557b27-876d-4bcb-b6c3-6add8770b5dc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.043946 Aug 30 16:04:45.217344 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 108/227] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:04:45 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:45.227319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.230811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:45.254608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.255102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.257480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.259268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.261144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.262882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.298372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:45.311066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df3880ce-f42b-4cce-996c-92d20a25ff9c tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.606454 Aug 30 16:04:45.313575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 120/228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:44 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:45.323503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bea1969-105d-423c-8c1e-cd1dea8abe45 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.335699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.338948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.340743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.343687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid 5e4dcf21-2252-439b-83be-876742bbe816 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:45.351366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3bea1969-105d-423c-8c1e-cd1dea8abe45 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bea1969-105d-423c-8c1e-cd1dea8abe45 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Request method failure captured: Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTp1yragUX3mUDSRrtl_5MdddlNA6RzA__1BRHUcAyBlPM_l8iABfYzsyZssf0pgUg8hW9nWLgF08zQmAqkbf8UlX9tI3YU4GC0gcnu5pDI1DV8BuDCfXqqrOeSj-L8LJYfS371_NiU31qyOVkJ1JZxFmGBw3X6RpPB8oai_wRXLGk Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:45.356322 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ea370597d06544b7a5eb0f8a45d5a2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ea370597d06544b7a5eb0f8a45d5a2b5"}]}] Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ea370597d06544b7a5eb0f8a45d5a2b5 Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-865878387 Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 21fa47d36abd4104a826c6276df10f37 Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminTestJSON-865878387-project-admin Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate 7 could not be found. Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7'} Aug 30 16:04:45.357828 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:45.359253 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:45.360289 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:45.363404 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:45.363404 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:45.363404 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:45.363404 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 16:04:45.363404 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:45.381542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bea1969-105d-423c-8c1e-cd1dea8abe45 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:45.384814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3bea1969-105d-423c-8c1e-cd1dea8abe45 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.066035 Aug 30 16:04:45.386610 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 121/229] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:45.417327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f850784f-7b91-44d0-ab49-b7f166afa06d", "name": "network-vif-plugged", "status": "completed", "tag": "6ddb8958-de6f-4050-8a30-5c01a0682998"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:45.417525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:45.428879 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be05f85e-430f-490d-9b9b-1e035fe146d6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 200 len: 1310 microversion: 2.1 time: 0.210155 Aug 30 16:04:45.429826 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 109/230] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:45 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 1310 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:45.436106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71facfe8-0e84-4fbc-8507-4a4d1a404c81 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-472541117"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:45.439166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.439652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-71facfe8-0e84-4fbc-8507-4a4d1a404c81 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid 2106d576-f091-4817-a985-f47294ef7f9b for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:45.440690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.442157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.463587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] Creating event network-vif-plugged:6ddb8958-de6f-4050-8a30-5c01a0682998 for instance f850784f-7b91-44d0-ab49-b7f166afa06d on n-h2-830883-28 Aug 30 16:04:45.469776 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-24e46275-03b2-475f-902d-da529e926dba req-608ca6f7-4b32-4123-a7ec-a1e9083fb137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080841 Aug 30 16:04:45.472237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 122/231] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.526226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71facfe8-0e84-4fbc-8507-4a4d1a404c81 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.076508 Aug 30 16:04:45.529555 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 110/232] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.543153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab1987ef-afd5-4e93-b7ca-a8ca914c202f tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.568481 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab1987ef-afd5-4e93-b7ca-a8ca914c202f tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.031211 Aug 30 16:04:45.569117 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 123/233] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:04:45 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.582955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b10c051-fee1-446d-b02e-a0171771916c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:45.653698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b10c051-fee1-446d-b02e-a0171771916c tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.070873 Aug 30 16:04:45.655799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.656274 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 111/234] 10.222.0.47 () {60 vars in 1191 bytes} [Tue Aug 30 16:04:45 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.658609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:45.673478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.674225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.676482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.676652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80659d96-f819-41c4-931b-9f09615d1b03 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.677494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:45.683490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:45.684905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.714062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80659d96-f819-41c4-931b-9f09615d1b03 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.044205 Aug 30 16:04:45.714919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 112/235] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:04:45 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.729702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88f8928d-7428-46fc-9b0f-7b048351bb86 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:45.794997 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88f8928d-7428-46fc-9b0f-7b048351bb86 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.072039 Aug 30 16:04:45.799264 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 113/236] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:45 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 16:04:45.806863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1cdfe309-ac74-4941-ab2e-66651bc24ddc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-994687807", "availability_zone": "tempest-test_az-1832476683"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:45.890136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-1cdfe309-ac74-4941-ab2e-66651bc24ddc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid 668a6c76-8dbb-486e-85e8-52d9849aae3b for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:45.977178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1cdfe309-ac74-4941-ab2e-66651bc24ddc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.173253 Aug 30 16:04:45.981806 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 114/237] 10.222.0.47 () {60 vars in 1165 bytes} [Tue Aug 30 16:04:45 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:45.997583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b4cc2320-0de9-4564-a9ba-b2731cba7353 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-994687807_new", "availability_zone": "tempest-test_az-1832476683_new"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:46.102023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4cc2320-0de9-4564-a9ba-b2731cba7353 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.106268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4cc2320-0de9-4564-a9ba-b2731cba7353 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.107735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4cc2320-0de9-4564-a9ba-b2731cba7353 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.211225 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b4cc2320-0de9-4564-a9ba-b2731cba7353 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.222658 Aug 30 16:04:46.212868 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 115/238] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:04:45 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:46.225592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dca87da7-3a3b-41ed-b761-a4d1e673d3db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.241530 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dca87da7-3a3b-41ed-b761-a4d1e673d3db tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.020399 Aug 30 16:04:46.248448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 116/239] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:46.256943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64a2e7d4-926f-4ecc-b4f0-2308775c7fee tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.300665 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64a2e7d4-926f-4ecc-b4f0-2308775c7fee tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.048074 Aug 30 16:04:46.301917 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 117/240] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:04:46 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 16:04:46.314223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aede4456-31f7-40f6-8960-c1d8d0c86bd5 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-497567054"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:46.322628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-aede4456-31f7-40f6-8960-c1d8d0c86bd5 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Generated uuid 389598e9-b7a9-471c-82b1-aeb8f438891c for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:46.367350 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aede4456-31f7-40f6-8960-c1d8d0c86bd5 tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057275 Aug 30 16:04:46.369056 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 118/241] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:46.376708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.381743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:46.396089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.397639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.398966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.402117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.403349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.403943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.473503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:46.483559 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ace8fe39-07d6-4e22-9b5d-3af735bed75f tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1321 microversion: 2.1 time: 0.834826 Aug 30 16:04:46.484801 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 124/242] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:45 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1321 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:46.503605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-96ed94ca-5919-4362-9150-2e10ada51cdc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.547158 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-96ed94ca-5919-4362-9150-2e10ada51cdc tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.038812 Aug 30 16:04:46.550599 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 125/243] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:46.561608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.567126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:46.577545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.578178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.582857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.583595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.584063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.584492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.611993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 HTTP/1.1 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:46.616149 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:04:46.617612 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5e4dcf21-2252-439b-83be-876742bbe816'} Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:46.618477 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:04:46.619726 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.621690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:46.622724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ac85bdb-af99-4b4d-846e-f2ee4927993d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 404 len: 111 microversion: 2.1 time: 0.070849 Aug 30 16:04:46.627431 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 126/244] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:46.653032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e1363d5-b472-4645-9ec3-135b60f4480d tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.690986 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e1363d5-b472-4645-9ec3-135b60f4480d tempest-AggregatesAdminTestJSON-865878387 tempest-AggregatesAdminTestJSON-865878387-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.062203 Aug 30 16:04:46.691572 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 127/245] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:46 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:46.710385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.710800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:46.727101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.728175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.732163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.733100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.733833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.736107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.770830 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] HTTP exception thrown: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Request method failure captured: Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 HTTP/1.1 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmbswaDEjxvqSLTkaAAgp8OOmtPHl3SDySicRoRI8L0Yi5FgAknt4adKFd_MXlVj6UJ7Fz_cIXSsDBn9TiD2sd2s8EkoCcdYs9-ic1q2WmKbSuHj_TGdW9Fufv1t9EdMCP0f9f_yIPtsIRdVV3ISJ2VsvmiNnGPODAMaz9X7dCJR0 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:46.773722 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}] Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7eb204af25914228922ff1aaf286fd81 Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.775511 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4e0a83e0-14c1-4f54-9a16-4db2ef240b39'} Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:46.776204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.777814 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.780092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Returning 404 to user: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:46.780092 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a18a13c4-e4d6-4920-8a75-1aac503f092a tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 404 len: 111 microversion: 2.1 time: 0.076504 Aug 30 16:04:46.780092 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 128/246] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:46 2022] DELETE /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:46.792207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.793724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] [instance: 4e0a83e0-14c1-4f54-9a16-4db2ef240b39] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:46.804899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.806627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.807311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.808282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.809146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.810779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.842661 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] HTTP exception thrown: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Request method failure captured: Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 HTTP/1.1 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmbswaDEjxvqSLTkaAAgp8OOmtPHl3SDySicRoRI8L0Yi5FgAknt4adKFd_MXlVj6UJ7Fz_cIXSsDBn9TiD2sd2s8EkoCcdYs9-ic1q2WmKbSuHj_TGdW9Fufv1t9EdMCP0f9f_yIPtsIRdVV3ISJ2VsvmiNnGPODAMaz9X7dCJR0 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:46.844713 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab8add0a924a4f3bafd3a0b931743b47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab8add0a924a4f3bafd3a0b931743b47"}]}] Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ab8add0a924a4f3bafd3a0b931743b47 Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1043333579 Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7eb204af25914228922ff1aaf286fd81 Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminTestJSON-1043333579-project Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.846157 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4e0a83e0-14c1-4f54-9a16-4db2ef240b39'} Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:46.847603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. Aug 30 16:04:46.848815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:46.857460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] Returning 404 to user: Instance 4e0a83e0-14c1-4f54-9a16-4db2ef240b39 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:46.858356 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8ef21eb-2df1-4425-939d-094229a6ae54 tempest-AggregatesAdminTestJSON-1043333579 tempest-AggregatesAdminTestJSON-1043333579-project] 10.222.0.47 "GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39" status: 404 len: 111 microversion: 2.1 time: 0.075181 Aug 30 16:04:46.866366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 129/247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/servers/4e0a83e0-14c1-4f54-9a16-4db2ef240b39 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:46.877111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-617351533", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:46.917267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:46.925950 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a184ce01-89ac-45e3-b260-c19b53e3e25f tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.555655 Aug 30 16:04:46.926547 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 119/248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:46.953539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:04:47.499322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109f4699-4c8a-41d4-89fd-8327bbe72f8b", "name": "network-vif-plugged", "status": "completed", "tag": "8e9e65fb-b83e-4705-bbd7-d757435f4c36"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:47.518151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.518664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.520150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.538946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:04:47.539744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:04:47.541090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:04:47.541778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:04:47.542227 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] Creating event network-vif-plugged:8e9e65fb-b83e-4705-bbd7-d757435f4c36 for instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b on n-h1-830883-28 Aug 30 16:04:47.542662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:04:47.559349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-06fd8ed8-08d7-4217-bc7b-fcb97ebde765 req-98ee6863-d6a0-4226-a447-3c6367b0a24b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065452 Aug 30 16:04:47.560555 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 120/249] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:47.564258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.566892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.567478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.568384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.570954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:47.571711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.572449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.572873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:47.586617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.588687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.589138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.590560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.592442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.596234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.632235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Getting quotas for project 43bcbf72c458489ea74fb75f81ed9a27. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:47.642651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Getting quotas for user 5a4688d4c394426abfbb02cdff4f7b4a and project 43bcbf72c458489ea74fb75f81ed9a27. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:47.673611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:04:47.677445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:04:47.792853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a707285-35ca-47bd-94a5-bc8ac4f7f2b6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921398 Aug 30 16:04:47.793668 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 130/250] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:04:47.812961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9424b13-2fac-498c-afbb-07cb004bb45e tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:47.815544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9424b13-2fac-498c-afbb-07cb004bb45e tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.201129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9424b13-2fac-498c-afbb-07cb004bb45e tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.227093 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9424b13-2fac-498c-afbb-07cb004bb45e tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1219 microversion: 2.1 time: 0.421205 Aug 30 16:04:48.233552 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 131/251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:47 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:48.249363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:48.254021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.270258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.271408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.272593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.275918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.276896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.278996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.388423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.398357 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de799a28-9f0d-42f5-b592-1623058b1a5e tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1470 microversion: 2.1 time: 0.833664 Aug 30 16:04:48.409254 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 121/252] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:47 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1470 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:48.432300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:48.432300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.469849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.471719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.473116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.474054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.474949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.476849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.607351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Request method failure captured: Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d/diagnostics HTTP/1.1 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUH_PRkyeJPZjp35MHr-974vDRj-g7qWq4d5e5oDl9jH3jWjW7fwl1scnc5oLJE2kNSj6UZEFMcTgzNlsLCDc05gEpWx-930Z-vgYBBTMG1cXbWqHUXnRvAzGChqr8CsQ96yaI88SSd5Dg3opkwao-2fZOUDBTdxPUKNeo7Gjbk00I Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a86f26509414411c8f89406a892b06b8 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:48.609252 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a86f26509414411c8f89406a892b06b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a86f26509414411c8f89406a892b06b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a86f26509414411c8f89406a892b06b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a86f26509414411c8f89406a892b06b8"}]}] Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a86f26509414411c8f89406a892b06b8 Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiagnosticsNegativeTest-259639161-project Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 0182975830f8408fa8c6d3656b3f3386 Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-259639161-project Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:48.610645 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': 'f850784f-7b91-44d0-ab49-b7f166afa06d'} Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:48.611395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 16:04:48.612643 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:48.614446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:48.615319 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e411b7eb-3bbc-4cc0-8eb6-3e14d4c1c2ff tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.188434 Aug 30 16:04:48.626990 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 122/253] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:04:48 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d/diagnostics => generated 117 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:04:48.639411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:48.639928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.659804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.660528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.661028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.665824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.666761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.667299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.750002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:48.960562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12b13eec-df4e-47f5-80b4-2f52ff6733d8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 204 len: 0 microversion: 2.1 time: 0.332231 Aug 30 16:04:48.961851 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 123/254] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:48 2022] DELETE /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:48.975148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:48.984559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.992009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.994448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.995036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.995869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.996323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.996756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:49.181992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.195617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-811da643-4b0c-47ab-a004-f27c4310416a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1390 microversion: 2.1 time: 0.960010 Aug 30 16:04:49.197717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 132/255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:48 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1390 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:49.246503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.256421 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45e36d82-ad5e-4bbe-87f4-8e667e0b96a6 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1476 microversion: 2.1 time: 0.289734 Aug 30 16:04:49.256628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:49.257130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:49.266766 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 124/256] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:48 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:49.276293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:49.276820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:49.277341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:49.277939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:49.278432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:49.278867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:49.407759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.420539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f4d3f5b-0347-4d58-915a-cdad1cd788b0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1215 microversion: 2.1 time: 0.167580 Aug 30 16:04:49.440390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 133/257] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:49 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:50.224486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:50.225104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:50.242013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.242557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.243128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.261100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.261664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.265741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.280074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:50.280694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:50.287750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.288248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.288693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.289401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.307597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.308487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.591756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:50.605205 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5b2dc3a-2757-4736-abae-0ffa2ce130f6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1589 microversion: 2.1 time: 0.390468 Aug 30 16:04:50.610704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 125/258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:50 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1589 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:50.637543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:50.639573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:50.662434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.670100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.672590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.684158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.687306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.699733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.911131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:50.919906 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-592659a0-96d1-43c3-9b2e-0f9a29ff87e0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1271 microversion: 2.1 time: 0.307583 Aug 30 16:04:50.932034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 126/259] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:50 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1271 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:50.937104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:50.937793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:50.954873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.955629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.956208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.957084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.958286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.958940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:51.073580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:51.096863 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c39c2ad-7276-4171-9c10-3f77ba13d06d tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1476 microversion: 2.1 time: 0.820458 Aug 30 16:04:51.097430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 134/260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:50 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1476 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:51.189801 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c35f71f-a301-453e-9904-882afa4489da tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.256323 Aug 30 16:04:51.190858 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 127/261] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:04:50 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:51.960045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:51.961402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:51.981503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:51.982651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:51.995986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:51.997794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.000514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.003176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.306510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:52.321094 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b543b604-63eb-4a19-8a5e-45937a08308d tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1277 microversion: 2.1 time: 0.366938 Aug 30 16:04:52.339994 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 128/262] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:51 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1277 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:52.357125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:52.360146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:52.382090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.382836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.386337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.390074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.390732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.392411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.438458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2049299689", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4e9da5ca-14d4-482f-90c9-bfeef67ee437"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:52.568624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] validate_networks() for [('4e9da5ca-14d4-482f-90c9-bfeef67ee437', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:04:52.731836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:52.844608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0182975830f8408fa8c6d3656b3f3386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a86f26509414411c8f89406a892b06b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:52.853943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b5dc36b-db44-4d9d-9c7a-1aab6fd703c8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 200 len: 1434 microversion: 2.1 time: 0.512771 Aug 30 16:04:52.857563 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 129/263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:52 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 1434 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:52.910759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f850784f-7b91-44d0-ab49-b7f166afa06d", "name": "network-vif-deleted", "tag": "6ddb8958-de6f-4050-8a30-5c01a0682998"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:52.931587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.932234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.932905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.956560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] Creating event network-vif-deleted:6ddb8958-de6f-4050-8a30-5c01a0682998 for instance f850784f-7b91-44d0-ab49-b7f166afa06d on n-h2-830883-28 Aug 30 16:04:52.981770 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-60fba9c3-a549-43b9-bfc0-cbafd879d705 req-91681bc4-c474-4175-8d26-23c145ec9670 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Aug 30 16:04:52.985374 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 130/264] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:53.352894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:53.354014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:53.365050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.372770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.373385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.374417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.375023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.375613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.417186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=70 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.600961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:53.613776 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d941fc5-50ed-49b1-b87a-21988fb2e6cd tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1277 microversion: 2.1 time: 0.265062 Aug 30 16:04:53.627015 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 131/265] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:53 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:53.732069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:04:53.736180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:04:53.737474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:04:53.738176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:04:53.738915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:04:53.755836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=73 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:53.762442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.764947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.765858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.767359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.771181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.773555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.840296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:53.847140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for user 43d55a1e4a9f4f2b9cb85e010154f284 and project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:53.899247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:04:53.901764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:04:54.007228 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80e19113-4754-4791-a24b-d1fdd617f030 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.241223 Aug 30 16:04:54.011385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 135/266] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:04:54.026720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:54.027632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] [instance: f850784f-7b91-44d0-ab49-b7f166afa06d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:54.054724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.059522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.060048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.063087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.063589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.064029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.111322 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] HTTP exception thrown: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Request method failure captured: Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d HTTP/1.1 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUH_PRkyeJPZjp35MHr-974vDRj-g7qWq4d5e5oDl9jH3jWjW7fwl1scnc5oLJE2kNSj6UZEFMcTgzNlsLCDc05gEpWx-930Z-vgYBBTMG1cXbWqHUXnRvAzGChqr8CsQ96yaI88SSd5Dg3opkwao-2fZOUDBTdxPUKNeo7Gjbk00I Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: a86f26509414411c8f89406a892b06b8 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:54.123420 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a86f26509414411c8f89406a892b06b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a86f26509414411c8f89406a892b06b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a86f26509414411c8f89406a892b06b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a86f26509414411c8f89406a892b06b8"}]}] Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: a86f26509414411c8f89406a892b06b8 Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-259639161 Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerDiagnosticsNegativeTest-259639161-project Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 0182975830f8408fa8c6d3656b3f3386 Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-259639161-project Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. Aug 30 16:04:54.124657 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'f850784f-7b91-44d0-ab49-b7f166afa06d'} Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:54.125349 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. Aug 30 16:04:54.126492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:54.130339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] Returning 404 to user: Instance f850784f-7b91-44d0-ab49-b7f166afa06d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:54.134570 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c202aa6c-6d2b-40be-84e6-842a8f1b64a8 tempest-ServerDiagnosticsNegativeTest-259639161 tempest-ServerDiagnosticsNegativeTest-259639161-project] 10.222.0.47 "GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d" status: 404 len: 111 microversion: 2.1 time: 0.121807 Aug 30 16:04:54.138599 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 136/267] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:54 2022] GET /compute/v2.1/servers/f850784f-7b91-44d0-ab49-b7f166afa06d => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:54.145159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34b5d922-e526-4a39-87a3-bdbd4a547e02 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:54.158772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34b5d922-e526-4a39-87a3-bdbd4a547e02 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:54.253506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34b5d922-e526-4a39-87a3-bdbd4a547e02 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:54.267360 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34b5d922-e526-4a39-87a3-bdbd4a547e02 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1211 microversion: 2.1 time: 0.126251 Aug 30 16:04:54.268449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:54 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:54.278783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:54.281001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:54.288582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.291432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.292787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.294044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.294711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.295887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.584709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:54.596390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa51f2d7-e35a-444b-b4be-dff6a46506d8 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 200 len: 1589 microversion: 2.1 time: 0.325855 Aug 30 16:04:54.598805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 138/269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:54 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 1589 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:54.638053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:54.638938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:54.660475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.663068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d778e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:54.671079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.671539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.672346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.672755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.673189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.995939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:55.009284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a9efd6b-5174-4173-ad38-dfcd4b1dca00 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.376519 Aug 30 16:04:55.009879 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 139/270] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:54 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:55.408363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:55.412584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.416385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.416899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.417735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.418217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.418682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.478046 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0cf4ebd-fb4d-475c-a4d0-ea099af5e27e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.442110 Aug 30 16:04:55.484324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 140/271] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:04:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:55.549581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:55.569086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.573820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.574530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.578279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.579722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.582116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.730939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9d8e77f-cf52-4e09-92a8-fdf9c2c675ff tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a" status: 200 len: 148 microversion: 2.57 time: 1.863319 Aug 30 16:04:55.740719 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 132/272] 10.222.0.47 () {62 vars in 1303 bytes} [Tue Aug 30 16:04:53 2022] PUT /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a => generated 148 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:55.754797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:55.756437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:55.776197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.779492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.783039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.785909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.788175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.788642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.938266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109f4699-4c8a-41d4-89fd-8327bbe72f8b", "tag": "8e9e65fb-b83e-4705-bbd7-d757435f4c36"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:55.972390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:55.994472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.997972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.001754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.012796 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a343bdef-4608-461d-b69c-67583475171f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1263 microversion: 2.1 time: 0.270880 Aug 30 16:04:56.018873 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 133/273] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:55 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1263 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:56.030124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9953b41f-38d8-4916-9ba6-c134eea3053b tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-400956570"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:56.040086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] Creating event network-changed:8e9e65fb-b83e-4705-bbd7-d757435f4c36 for instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b on n-h1-830883-28 Aug 30 16:04:56.050236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-9953b41f-38d8-4916-9ba6-c134eea3053b tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 5f5f5e42-a01d-4853-b860-9efdfd3f0edd for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:56.067839 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6ca71146-da20-4ea3-b362-32404560a6fa req-3ad267fd-df47-4d10-8a9a-790959390820 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.580733 Aug 30 16:04:56.070585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 141/274] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:56.122167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Calling method '.version_select at 0x7fd35d58de50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:56.141125 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9953b41f-38d8-4916-9ba6-c134eea3053b tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.117975 Aug 30 16:04:56.144783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 134/275] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:56.169570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:56.173267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:56.194401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.201128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.204754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.207177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.209681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.213354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.263329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.763248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.763740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.764181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.764912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.765517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.765956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.794984 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2a0d9b4-8005-49e9-a2fd-440a6be08df4 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a/detail" status: 200 len: 463 microversion: 2.57 time: 0.710845 Aug 30 16:04:56.796021 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 142/276] 10.222.0.47 () {60 vars in 1304 bytes} [Tue Aug 30 16:04:56 2022] GET /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a/detail => generated 463 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:56.801692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14e570f9-4293-4ee8-94ba-0bbcfe5e3899 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:56.836537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=90,nova_api:DELETE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:56.838687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14e570f9-4293-4ee8-94ba-0bbcfe5e3899 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.839394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14e570f9-4293-4ee8-94ba-0bbcfe5e3899 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.841297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14e570f9-4293-4ee8-94ba-0bbcfe5e3899 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.034516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14e570f9-4293-4ee8-94ba-0bbcfe5e3899 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.235405 Aug 30 16:04:57.038652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 143/277] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:04:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:57.355486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Calling method '.version_select at 0x7fd35d602b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:57.361852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.363737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.365530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.366536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.368890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.369729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.408850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2922346d-cb4f-4f20-ab31-c143d00b0907 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.369054 Aug 30 16:04:57.416296 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 144/278] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:04:57 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:57.422034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:57.423327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:57.450002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.450732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.451338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.453063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.453531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.457298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.601077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:57.611417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26ae1f8f-cf8f-47a2-899c-d7cc33994d9a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1269 microversion: 2.1 time: 0.193624 Aug 30 16:04:57.612561 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 145/279] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:57 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:57.619261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:57.632091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.632684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.633185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.686106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-830883-28. Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 40 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:57.693299 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: {"add_host": {"host": "n-h1-830883-28"}} Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:57.694799 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate 11 already has host n-h1-830883-28. Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-830883-28'}}} Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:57.695812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-830883-28-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:04:57.698219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:04:57.700382 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:04:57.702604 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-830883-28-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 16, 4, 57, 675587), 'updated_at': None, 'host': 'n-h1-830883-28', 'aggregate_id': 11}] Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:57.707767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6651, in add_host_to_aggregate Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-830883-28. Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.709700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-830883-28. Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:57.713258 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-830883-28. Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-830883-28. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8d3e4ff-bfad-4994-b3b2-15fb2d481854 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.081902 Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 146/280] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:04:57 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 30 16:04:57.715720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Action: 'update', calling method: .version_select at 0x7fd35e596f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:57.801903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:57.812373 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be634b70-8063-42eb-abfa-bca3470ef3b5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 1.666229 Aug 30 16:04:57.817235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.817729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.818162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.818905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.825662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.826174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.832577 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 135/281] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:56 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:57.948576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.951032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.951771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.954886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.956829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.988874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.131100 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bf136f7-e8b9-4eaa-8236-149bab4fdb6b tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a?user_id=61cb858090b545bdb8bf7307740b75fc" status: 200 len: 148 microversion: 2.57 time: 0.424414 Aug 30 16:04:58.138220 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 147/282] 10.222.0.47 () {62 vars in 1384 bytes} [Tue Aug 30 16:04:57 2022] PUT /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a?user_id=61cb858090b545bdb8bf7307740b75fc => generated 148 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:58.141245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a30b1fbc-a7de-45e7-a7fa-05f413f4e7a5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:58.157364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30b1fbc-a7de-45e7-a7fa-05f413f4e7a5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:58.157873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30b1fbc-a7de-45e7-a7fa-05f413f4e7a5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:58.158333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30b1fbc-a7de-45e7-a7fa-05f413f4e7a5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.219934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd9cc61b-1955-491e-97c2-7a6915e1b1a2 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Calling method '.version_select at 0x7fd35d921b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.223627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cd9cc61b-1955-491e-97c2-7a6915e1b1a2 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd9cc61b-1955-491e-97c2-7a6915e1b1a2 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:58.225631 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:04:58.226853 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:58.227634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 16:04:58.230015 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.232469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd9cc61b-1955-491e-97c2-7a6915e1b1a2 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:58.232469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd9cc61b-1955-491e-97c2-7a6915e1b1a2 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.393231 Aug 30 16:04:58.238628 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 136/283] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:04:57 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 404 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:58.248961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3d6e4bce-ff0b-4f5e-9a30-f22366f57412 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] Calling method '.version_select at 0x7fd35d699550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.412266 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a30b1fbc-a7de-45e7-a7fa-05f413f4e7a5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.277706 Aug 30 16:04:58.419395 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 148/284] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:04:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:58.426689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40d5a8ed-1a9b-473a-ae62-743845a3372d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Calling method '.version_select at 0x7fd35d51fc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.433483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40d5a8ed-1a9b-473a-ae62-743845a3372d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40d5a8ed-1a9b-473a-ae62-743845a3372d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/n-d-830883-28/reboot HTTP/1.1 Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:58.439803 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28'} Aug 30 16:04:58.440999 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:58.441771 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 16:04:58.443285 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.444554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40d5a8ed-1a9b-473a-ae62-743845a3372d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:58.444554 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40d5a8ed-1a9b-473a-ae62-743845a3372d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-830883-28/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026121 Aug 30 16:04:58.444554 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 149/285] 10.222.0.47 () {58 vars in 1191 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/os-hosts/n-d-830883-28/reboot => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:58.448530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-97424291-0c2d-4cd6-a2ca-62c990477346 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.520895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-97424291-0c2d-4cd6-a2ca-62c990477346 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.074210 Aug 30 16:04:58.522347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 150/286] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:58 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:58.537781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47de66f-b78f-4b17-9851-827c7d5e0e37", "tag": "f1b91fd0-acf9-45a1-bb94-66d7807e3107"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:58.557108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:58.557795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:58.559002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.576690 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] Creating event network-changed:f1b91fd0-acf9-45a1-bb94-66d7807e3107 for instance d47de66f-b78f-4b17-9851-827c7d5e0e37 on n-h2-830883-28 Aug 30 16:04:58.591675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4a9f7b90-82e8-440a-a505-cc770302ab5c req-fe8f3364-1e36-4453-83ae-d04da2141a10 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066572 Aug 30 16:04:58.598505 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 151/287] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:58.607837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3d6e4bce-ff0b-4f5e-9a30-f22366f57412 tempest-QuotasAdminTestV257-1064002323 tempest-QuotasAdminTestV257-1064002323-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a?user_id=61cb858090b545bdb8bf7307740b75fc" status: 200 len: 190 microversion: 2.57 time: 0.362244 Aug 30 16:04:58.611239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aff5958d-4244-464e-b91b-dcc87db0fceb tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Calling method '.version_select at 0x7fd35d51faf0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.625602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 137/288] 10.222.0.47 () {60 vars in 1364 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/os-quota-sets/55b2e55f6067447da248adb5300ff00a?user_id=61cb858090b545bdb8bf7307740b75fc => generated 190 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:58.638244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-40908dae-4ceb-4f1f-85a5-11e475f5ba66 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-497762137"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:58.647113 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-aff5958d-4244-464e-b91b-dcc87db0fceb tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aff5958d-4244-464e-b91b-dcc87db0fceb tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:58.652344 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'nonexistent_hostname'} Aug 30 16:04:58.653665 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:58.654492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 16:04:58.655574 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aff5958d-4244-464e-b91b-dcc87db0fceb tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:58.657616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aff5958d-4244-464e-b91b-dcc87db0fceb tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.055966 Aug 30 16:04:58.660346 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 152/289] 10.222.0.47 () {58 vars in 1212 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:58.672451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-40908dae-4ceb-4f1f-85a5-11e475f5ba66 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 08af8252-93a6-4378-a1e4-c583668fac0b for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:58.676272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.679590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:58.700519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:58.703457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:58.704077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.705114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:58.710229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:58.710724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.751746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-40908dae-4ceb-4f1f-85a5-11e475f5ba66 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.124375 Aug 30 16:04:58.759770 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 138/290] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:58.766792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0da221d0-5af2-43dc-9198-bde2226c40c4 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Calling method '.version_select at 0x7fd35d72c430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.772733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0da221d0-5af2-43dc-9198-bde2226c40c4 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.778428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0da221d0-5af2-43dc-9198-bde2226c40c4 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hosts/n-d-830883-28 HTTP/1.1 Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:58.781053 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'n-d-830883-28'} Aug 30 16:04:58.782192 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:58.783151 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 16:04:58.784218 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.786552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0da221d0-5af2-43dc-9198-bde2226c40c4 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:58.789397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0da221d0-5af2-43dc-9198-bde2226c40c4 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-830883-28" status: 403 len: 109 microversion: 2.1 time: 0.035434 Aug 30 16:04:58.790186 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 139/291] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/os-hosts/n-d-830883-28 => generated 109 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:58.908446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.919521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b07f50a6-6088-49ec-a2d6-93ed71fa26a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1269 microversion: 2.1 time: 0.256906 Aug 30 16:04:58.920658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 153/292] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1269 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:58.927356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6a47592-3f2e-488e-87a6-040bb3f4be7a tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Calling method '.version_select at 0x7fd35d58d5e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.955333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c6a47592-3f2e-488e-87a6-040bb3f4be7a tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6a47592-3f2e-488e-87a6-040bb3f4be7a tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:58.960991 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'nonexistent_hostname'} Aug 30 16:04:58.962627 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.963483 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:58.964737 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:58.965898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6a47592-3f2e-488e-87a6-040bb3f4be7a tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:58.966250 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6a47592-3f2e-488e-87a6-040bb3f4be7a tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.043459 Aug 30 16:04:58.968802 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 154/293] 10.222.0.47 () {58 vars in 1191 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:58.979140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:58.981112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:59.004516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.005300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.006173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.007079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.007710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.009045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.294766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.309743 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6433a2a9-c332-487b-9f9e-d7435e36b784 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.340443 Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 155/294] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:58 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e25dc046-7813-4241-b558-1a84dfcbb39d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Calling method '.version_select at 0x7fd35ecd19d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e25dc046-7813-4241-b558-1a84dfcbb39d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e25dc046-7813-4241-b558-1a84dfcbb39d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/n-d-830883-28/shutdown HTTP/1.1 Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.324043 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.324907 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28'} Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.325689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.326916 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.327937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 16:04:59.327937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.327937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e25dc046-7813-4241-b558-1a84dfcbb39d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.327937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e25dc046-7813-4241-b558-1a84dfcbb39d tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-830883-28/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011691 Aug 30 16:04:59.327937 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 156/295] 10.222.0.47 () {58 vars in 1197 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/os-hosts/n-d-830883-28/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:59.353283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48d51aad-f26c-44e0-8fd2-2aebaa528ffa tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Calling method '.version_select at 0x7fd35d5f6c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.372627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-48d51aad-f26c-44e0-8fd2-2aebaa528ffa tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48d51aad-f26c-44e0-8fd2-2aebaa528ffa tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.374247 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'nonexistent_hostname'} Aug 30 16:04:59.375395 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:59.376081 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 16:04:59.377056 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48d51aad-f26c-44e0-8fd2-2aebaa528ffa tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48d51aad-f26c-44e0-8fd2-2aebaa528ffa tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.036542 Aug 30 16:04:59.378037 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 157/296] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:59.389905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-839163cb-72d6-4c68-9ae8-2564430ac679 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Calling method '.version_select at 0x7fd35d5788b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.391681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-839163cb-72d6-4c68-9ae8-2564430ac679 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.398295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafa4ede-b644-46d2-8ffb-e038948b0947 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.405245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eafa4ede-b644-46d2-8ffb-e038948b0947 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-839163cb-72d6-4c68-9ae8-2564430ac679 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/n-d-830883-28/startup HTTP/1.1 Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:59.407329 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28'} Aug 30 16:04:59.408709 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.409555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 16:04:59.410809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.411841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-839163cb-72d6-4c68-9ae8-2564430ac679 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.411841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-839163cb-72d6-4c68-9ae8-2564430ac679 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "GET /compute/v2.1/os-hosts/n-d-830883-28/startup" status: 403 len: 110 microversion: 2.1 time: 0.024087 Aug 30 16:04:59.416844 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 158/297] 10.222.0.47 () {58 vars in 1194 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/os-hosts/n-d-830883-28/startup => generated 110 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafa4ede-b644-46d2-8ffb-e038948b0947 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 40 Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:04:59.418615 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: {"add_host": {"host": "n-h1-830883-28"}} Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:59.419926 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-830883-28'}}} Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.420664 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 16:04:59.421653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.422921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafa4ede-b644-46d2-8ffb-e038948b0947 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.423918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eafa4ede-b644-46d2-8ffb-e038948b0947 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.631868 Aug 30 16:04:59.424665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 140/298] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:04:58 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 633 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:59.426389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdcb9742-9634-46d4-901d-39c13d43f361 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Calling method '.version_select at 0x7fd35d7f1ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.437814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b567e856-cb56-4000-a8a1-c7a2c35d29f7 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.451445 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-cdcb9742-9634-46d4-901d-39c13d43f361 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdcb9742-9634-46d4-901d-39c13d43f361 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.459221 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'nonexistent_hostname'} Aug 30 16:04:59.460366 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:59.461034 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 16:04:59.462039 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdcb9742-9634-46d4-901d-39c13d43f361 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdcb9742-9634-46d4-901d-39c13d43f361 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043132 Aug 30 16:04:59.468589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 159/299] 10.222.0.47 () {58 vars in 1215 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:59.478956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88bd8c22-a910-4f04-9d58-0edac54da303 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d828040>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.480721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b567e856-cb56-4000-a8a1-c7a2c35d29f7 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.047913 Aug 30 16:04:59.481875 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 141/300] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:59 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:59.495298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43ad4bca-86ca-4c0d-8649-755e6b097f1a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1343714875"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.500645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-43ad4bca-86ca-4c0d-8649-755e6b097f1a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid f37bf031-2a6d-4353-a8fa-cc6f262619ca for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88bd8c22-a910-4f04-9d58-0edac54da303 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-hosts/n-d-830883-28 HTTP/1.1 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 51 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.502321 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: {"status": "enable", "maintenance_mode": "invalid"} Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.503484 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance: Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.504187 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.507679 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88bd8c22-a910-4f04-9d58-0edac54da303 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88bd8c22-a910-4f04-9d58-0edac54da303 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-830883-28" status: 400 len: 199 microversion: 2.1 time: 0.034901 Aug 30 16:04:59.511008 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 160/301] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 16:04:59 2022] PUT /compute/v2.1/os-hosts/n-d-830883-28 => generated 199 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:59.524881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-556bd6c5-69dd-4339-b778-953f6ca537f1 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d58dca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.532160 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43ad4bca-86ca-4c0d-8649-755e6b097f1a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044755 Aug 30 16:04:59.533511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 142/302] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-556bd6c5-69dd-4339-b778-953f6ca537f1 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-hosts/n-d-830883-28 HTTP/1.1 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 51 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.534928 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: {"status": "invalid", "maintenance_mode": "enable"} Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.536120 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance: Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.536850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.538151 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-556bd6c5-69dd-4339-b778-953f6ca537f1 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-556bd6c5-69dd-4339-b778-953f6ca537f1 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-830883-28" status: 400 len: 189 microversion: 2.1 time: 0.025428 Aug 30 16:04:59.539412 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 161/303] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 16:04:59 2022] PUT /compute/v2.1/os-hosts/n-d-830883-28 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:59.549372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1205406763"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.562350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.563227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.563519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd3d4601-eeb6-4312-8082-82ef90c41887 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Action: 'update', calling method: .version_select at 0x7fd35d50dc10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.563772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.572286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.573242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.575066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3d4601-eeb6-4312-8082-82ef90c41887 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'aecc3791f4314a70901c2dc0a0487c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6872494ac32c474c973eb4cc7c687f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd3d4601-eeb6-4312-8082-82ef90c41887 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Request method failure captured: Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-hosts/n-d-830883-28 HTTP/1.1 Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 50 Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUlNvk3CLkodwD38iOAwAj3o5CenZH3MwzDEn-RFNC-tJ8IjGFm_oNKHdgdi6OJOcgsw_VGpl-o_zqzaa0cLuG0JYfy1X9wzdO2HlDBH37NcOURFcdLXERZ4o1li6nKr2zw8w7jOg5qZwjXQLsynhVXqlR6MHY4NIlz5JwbzoryZkw Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:59.578367 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6872494ac32c474c973eb4cc7c687f0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6872494ac32c474c973eb4cc7c687f0a"}]}] Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6872494ac32c474c973eb4cc7c687f0a Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1453636721 Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aecc3791f4314a70901c2dc0a0487c00 Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1453636721-project Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 16:04:59.579887 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.580653 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 16:04:59.581700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.582841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd3d4601-eeb6-4312-8082-82ef90c41887 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.582841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd3d4601-eeb6-4312-8082-82ef90c41887 tempest-HostsAdminNegativeTestJSON-1453636721 tempest-HostsAdminNegativeTestJSON-1453636721-project] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-830883-28" status: 403 len: 111 microversion: 2.1 time: 0.030281 Aug 30 16:04:59.590942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.591313 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 162/304] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 16:04:59 2022] PUT /compute/v2.1/os-hosts/n-d-830883-28 => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:59.598368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6458f059-20aa-4005-a3fe-1d1f6363b85f tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d50d9d0>, body: {"status": null, "maintenance_mode": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6458f059-20aa-4005-a3fe-1d1f6363b85f tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-hosts/n-d-830883-28 HTTP/1.1 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 42 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.608483 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: {"status": null, "maintenance_mode": null} Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 16:04:59.609697 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'n-d-830883-28', 'body': {'status': None, 'maintenance_mode': None}} Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance: Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi None Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.610648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.612069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6458f059-20aa-4005-a3fe-1d1f6363b85f tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.613027 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6458f059-20aa-4005-a3fe-1d1f6363b85f tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/n-d-830883-28" status: 400 len: 127 microversion: 2.1 time: 0.020375 Aug 30 16:04:59.619029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 163/305] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Aug 30 16:04:59 2022] PUT /compute/v2.1/os-hosts/n-d-830883-28 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:59.622933 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1205406763 could not be found. Aug 30 16:04:59.625684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d58dee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 58 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:59.625922 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: {"add_host": {"host": "tempest-nonexist_host-1205406763"}} Aug 30 16:04:59.627297 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: exception: Compute host tempest-nonexist_host-1205406763 could not be found. Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1205406763'}}} Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1205406763' is not mapped to any cell Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.627951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6631, in add_host_to_aggregate Aug 30 16:04:59.628998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1205406763 could not be found. Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1205406763 could not be found. Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.630039 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1205406763 could not be found. Aug 30 16:04:59.631158 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.631530 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.hosts [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Enabling host nonexistent_hostname. Aug 30 16:04:59.633245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1205406763 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.635100 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a979b7b-3991-4230-903b-b6fe6e713cb2 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.090638 Aug 30 16:04:59.636193 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 143/306] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:59.642780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Request method failure captured: Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 50 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUoMFXGoK-1kxY5JVwegnnL_K2VfPCYwYiXN-D-hWOElOmugzXoy2SmU2-1JquiUjdpwatP_lxa-Y6jUpc2mbKROmd29vZbZMbT3HnDe4CoQ8-wbRqwv7a3f7XShdB0jsfTvVHdINB6wpr1WuhO5D2e3jBbj4BlA8J2M6JIQ_AlfxE Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.644680 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/68446b772dff41aa869fe09d9a241ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/68446b772dff41aa869fe09d9a241ec9"}]}] Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 68446b772dff41aa869fe09d9a241ec9 Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2025141189 Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9bc5d6fe0c664bd18584553fc978347e Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2025141189-project-admin Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.645882 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in targeted Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:04:59.646674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.647628 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 16:04:59.648633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.649394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a55c12ab-f838-4d27-a1fa-ed6f2835f419 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.649476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.649476 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cb0695f7-bdee-4e7f-9942-9d586b348fe0 tempest-HostsAdminNegativeTestJSON-2025141189 tempest-HostsAdminNegativeTestJSON-2025141189-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026230 Aug 30 16:04:59.652890 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 164/307] 10.222.0.47 () {60 vars in 1211 bytes} [Tue Aug 30 16:04:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:59.698631 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a55c12ab-f838-4d27-a1fa-ed6f2835f419 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.057884 Aug 30 16:04:59.699536 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 144/308] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:59 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:59.710511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ce3cad1-2952-4620-b132-d7fdf9b0adcc tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ce3cad1-2952-4620-b132-d7fdf9b0adcc tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 283 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.718936 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.720125 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:04:59.720676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.721324 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.722213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.723148 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:04:59.723148 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:04:59.723148 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:04:59.723148 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.723148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ce3cad1-2952-4620-b132-d7fdf9b0adcc tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.723627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ce3cad1-2952-4620-b132-d7fdf9b0adcc tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010607 Aug 30 16:04:59.723627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 165/309] 10.222.0.47 () {60 vars in 1165 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:59.731116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1687aca3-c2f1-41db-b4f3-1e1054390cd3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1687aca3-c2f1-41db-b4f3-1e1054390cd3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 27 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:04:59.737261 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: {"aggregate": {"name": ""}} Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:04:59.738736 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi '' Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.739480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:04:59.741571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.743829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1687aca3-c2f1-41db-b4f3-1e1054390cd3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.743829 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1687aca3-c2f1-41db-b4f3-1e1054390cd3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014774 Aug 30 16:04:59.745890 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 145/310] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:59.754283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f620d72-b4e9-4434-a17f-38441a4da0d3 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1779516762"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.760100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f620d72-b4e9-4434-a17f-38441a4da0d3 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f620d72-b4e9-4434-a17f-38441a4da0d3 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 60 Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:59.762028 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: {"aggregate": {"name": "tempest-test_aggregate-1779516762"}} Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:59.763268 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1779516762'}}} Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.764010 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.765107 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 16:04:59.766710 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.766710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f620d72-b4e9-4434-a17f-38441a4da0d3 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.766710 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f620d72-b4e9-4434-a17f-38441a4da0d3 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013870 Aug 30 16:04:59.768699 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 166/311] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:59.773428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b26501ea-e21c-47b3-8036-d1374e2e72f5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1959498512"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.779541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.aggregate [None req-b26501ea-e21c-47b3-8036-d1374e2e72f5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 54a8b1f2-76d8-4e32-abe2-10d409bb9e38 for aggregate {{(pid=122351) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:59.816506 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b26501ea-e21c-47b3-8036-d1374e2e72f5 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046676 Aug 30 16:04:59.818094 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 146/312] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:59.829807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1959498512"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.833256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid bc8bcd12-64bc-4c16-b2c5-145ae997ade3 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:59.851928 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1959498512 already exists. Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 60 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:04:59.856199 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: {"aggregate": {"name": "tempest-test_aggregate-1959498512"}} Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:59.857643 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate tempest-test_aggregate-1959498512 already exists. Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1959498512'}}} Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6468, in create_aggregate Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 30 16:04:59.858629 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1959498512 already exists. Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:59.859933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1959498512 already exists. Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1959498512 already exists. Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1959498512 already exists. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.861876 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-645b4038-3fba-4ebc-86fd-7a16c0ba8de3 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.032622 Aug 30 16:04:59.863408 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 167/313] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 34 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:04:59.869294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7e797e5-cfe4-44dc-9c17-20cb5b6ed9ba tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.904303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7e797e5-cfe4-44dc-9c17-20cb5b6ed9ba tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.039342 Aug 30 16:04:59.909342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 147/314] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:59 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:04:59.916776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4575a433-53b7-47b3-931a-be3745baa46a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2138799449"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.920890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-4575a433-53b7-47b3-931a-be3745baa46a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 41684443-c39e-450c-8669-8a555e6e5252 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:04:59.943289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.944305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:59.956014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.956854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.957759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.958747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.959540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.960352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.967974 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4575a433-53b7-47b3-931a-be3745baa46a tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056165 Aug 30 16:04:59.971463 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 168/315] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:59.982938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4228e0ae-cfe7-4d12-a8a1-7ec399bc3005 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.984792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4228e0ae-cfe7-4d12-a8a1-7ec399bc3005 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4228e0ae-cfe7-4d12-a8a1-7ec399bc3005 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:04:59.986496 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 16:04:59.987898 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '15'} Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:04:59.988709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:04:59.989715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4228e0ae-cfe7-4d12-a8a1-7ec399bc3005 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:59.990746 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4228e0ae-cfe7-4d12-a8a1-7ec399bc3005 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010802 Aug 30 16:04:59.990746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 169/316] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:05:00.003868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de0d7de1-60ac-48e3-803e-dd2e9e12ac05 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.065714 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de0d7de1-60ac-48e3-803e-dd2e9e12ac05 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.070118 Aug 30 16:05:00.066289 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 170/317] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:04:59 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:05:00.075864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71495a9c-8948-4ca2-aa77-940f70037604 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.113077 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-71495a9c-8948-4ca2-aa77-940f70037604 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71495a9c-8948-4ca2-aa77-940f70037604 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:05:00.116441 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate -1 could not be found. Aug 30 16:05:00.118253 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '-1'} Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6527, in delete_aggregate Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:05:00.118996 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.120025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71495a9c-8948-4ca2-aa77-940f70037604 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71495a9c-8948-4ca2-aa77-940f70037604 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.045711 Aug 30 16:05:00.123897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 171/318] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:00 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 16:05:00.142472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e3bf1ff-3019-41fc-90ef-bf65cf5c32c8 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1515592244"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:00.146047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-8e3bf1ff-3019-41fc-90ef-bf65cf5c32c8 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 7aa35292-a7de-4027-b6fc-537f05bc89b8 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:05:00.214445 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e3bf1ff-3019-41fc-90ef-bf65cf5c32c8 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078236 Aug 30 16:05:00.221168 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 172/319] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:05:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:00.226289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a469b41-b5ec-482f-bf66-ee3657daa302 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.242425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a469b41-b5ec-482f-bf66-ee3657daa302 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a469b41-b5ec-482f-bf66-ee3657daa302 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:00.245014 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 16:05:00.246203 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '16'} Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:00.246885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 16:05:00.247867 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.251226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a469b41-b5ec-482f-bf66-ee3657daa302 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:00.252434 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a469b41-b5ec-482f-bf66-ee3657daa302 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.029995 Aug 30 16:05:00.256368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 173/320] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:05:00 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:00.276367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e83899b3-455b-49a4-894f-a975d5ee47ce tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.336080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e83899b3-455b-49a4-894f-a975d5ee47ce tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.076422 Aug 30 16:05:00.341674 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 174/321] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:00 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:05:00.357636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.358555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:00.368450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:00.374720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:00.375692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:00.377040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:00.380034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:00.381659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:00.828801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.838668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-602d8dea-0490-485d-99e5-b4cfacb95517 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.495656 Aug 30 16:05:00.843137 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 175/322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:00 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:00.861262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd4262b3-15c5-4af3-8fc2-239d2771974e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.875736 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-cd4262b3-15c5-4af3-8fc2-239d2771974e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd4262b3-15c5-4af3-8fc2-239d2771974e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:05:00.877579 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: exception: Aggregate -1 could not be found. Aug 30 16:05:00.879075 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '-1'} Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6474, in get_aggregate Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.879845 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 16:05:00.881003 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.882994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd4262b3-15c5-4af3-8fc2-239d2771974e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:00.889423 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd4262b3-15c5-4af3-8fc2-239d2771974e tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034542 Aug 30 16:05:00.890498 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 176/323] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:05:00 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:05:00.900118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eef05f6b-221f-43ee-b819-ac67bdfb1780 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.901981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eef05f6b-221f-43ee-b819-ac67bdfb1780 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eef05f6b-221f-43ee-b819-ac67bdfb1780 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:00.903770 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 16:05:00.904924 n-d-830883-28 devstack@n-api.service[122352]: action_args: {} Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:00.905575 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 16:05:00.907086 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:00.910853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eef05f6b-221f-43ee-b819-ac67bdfb1780 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:00.915658 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eef05f6b-221f-43ee-b819-ac67bdfb1780 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020282 Aug 30 16:05:00.921961 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 177/324] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:05:00 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:05:00.934862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20ab7ea5-3ac4-4dbd-a6a4-31202c64d013 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2063923390"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:00.938577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-20ab7ea5-3ac4-4dbd-a6a4-31202c64d013 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 7d4dd789-23a8-4586-9a36-16bc71a36270 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:05:00.944827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:00.976804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20ab7ea5-3ac4-4dbd-a6a4-31202c64d013 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047974 Aug 30 16:05:00.981573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 178/325] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:05:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:00.992135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6661daf8-307e-4174-9ae5-9663be524e09 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:01.026256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6661daf8-307e-4174-9ae5-9663be524e09 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.026893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6661daf8-307e-4174-9ae5-9663be524e09 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.027463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6661daf8-307e-4174-9ae5-9663be524e09 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.284383 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6661daf8-307e-4174-9ae5-9663be524e09 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.296729 Aug 30 16:05:01.292206 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 179/326] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:05:00 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:01.313116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a366cd4e-0b34-4367-97d8-54bb56a04f99 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:01.328182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a366cd4e-0b34-4367-97d8-54bb56a04f99 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '277908b6dc234d68b776feb6dc6e1769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3724b27e13408a9f87ff1bd9d0022f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a366cd4e-0b34-4367-97d8-54bb56a04f99 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Request method failure captured: Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 43 Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUkEbAsGu5dPubs0mbceBnLqHfwob2iyx2eUZ2w_92uYTIQkJRvYGQsXSIdeufYk5rSgo6Bcw-J0lhqtKjWoBesqmkI04PRKJxYlBtjY7ckg2_Zj3br5rmtHGI1B6dEx7rLd-WEfYRrCiY_kA3Yi7AjgNg-MwVLKY7qDafKedz5nVA Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:01.340487 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be3724b27e13408a9f87ff1bd9d0022f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be3724b27e13408a9f87ff1bd9d0022f"}]}] Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: be3724b27e13408a9f87ff1bd9d0022f Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827 Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 277908b6dc234d68b776feb6dc6e1769 Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1643031827-project Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: {"remove_host": {"host": "n-h1-830883-28"}} Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:01.342144 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-830883-28'}}} Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:01.346588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 16:05:01.349302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.351924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a366cd4e-0b34-4367-97d8-54bb56a04f99 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:01.351924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a366cd4e-0b34-4367-97d8-54bb56a04f99 tempest-AggregatesAdminNegativeTestJSON-1643031827 tempest-AggregatesAdminNegativeTestJSON-1643031827-project] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.048559 Aug 30 16:05:01.351924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 180/327] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:05:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:05:01.359272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ffc6444-5253-4716-8e25-595aa62eb198 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:01.385695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ffc6444-5253-4716-8e25-595aa62eb198 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.387697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ffc6444-5253-4716-8e25-595aa62eb198 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.393396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ffc6444-5253-4716-8e25-595aa62eb198 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.429842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:01.444099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-640f3a59-e5c9-4ed5-bb1a-c74210a299d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 1.501098 Aug 30 16:05:01.444739 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 148/328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:01.622174 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ffc6444-5253-4716-8e25-595aa62eb198 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.268528 Aug 30 16:05:01.630756 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 181/329] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:05:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:01.634207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffdfffa3-e253-4811-ad27-b85f2c8ede4b tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:01.679071 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffdfffa3-e253-4811-ad27-b85f2c8ede4b tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.048144 Aug 30 16:05:01.681148 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 149/330] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:01 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:05:01.690148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-746ba8d9-76df-4e6d-ae51-a002b77f5e68 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2050146475"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:01.694908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-746ba8d9-76df-4e6d-ae51-a002b77f5e68 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Generated uuid 6f7392d2-2e97-4e99-8dfa-69d9ca285d47 for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:05:01.754686 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-746ba8d9-76df-4e6d-ae51-a002b77f5e68 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066031 Aug 30 16:05:01.757861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 182/331] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:05:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:01.769512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:01.833104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.834417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.838292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.854513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.855007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.857388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.876537 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.compute.aggregates [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 16:05:01.877487 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Request method failure captured: Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 42 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUm5Q0wu04uC1o9klRiBTOKOLYj_jU7criBJ_X3hcFZytrrk-CMhU7QoGjUX6b5exN_lPjZ_hB_TpUJqXrYFW9ifiLolEJpkFtKmDLfaM6v0y7dtjvXSEI_ybkKK1qkZnI_YhMp8oBTjQy3OaB4M53beKFXhJu2-l5-xCfc_LRKVLo Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:05:01.882942 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5587f4b9e39049568930188863f7d890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5587f4b9e39049568930188863f7d890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5587f4b9e39049568930188863f7d890"}]}] Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5587f4b9e39049568930188863f7d890 Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825 Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 674b5fb91292454c99526b217a9604f1 Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: {"remove_host": {"host": "nonexist_host"}} Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:01.884352 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6015, in _get_service_in_cell_by_host Aug 30 16:05:01.885042 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6693, in remove_host_from_aggregate Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 30 16:05:01.886054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _get_service_in_cell_by_host Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.888036 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0ef7a29-46c0-4ea5-b888-d5027dd5c730 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.120408 Aug 30 16:05:01.891861 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 150/332] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:05:01 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:05:01.904043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:01.905032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:01.929335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.932971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.934167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.937202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.940401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.941792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:02.420838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-668253844", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:02.503681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:02.576542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:02.585169 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a43fc25-a7b4-441f-92af-6af7ac619644 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.690062 Aug 30 16:05:02.608973 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 151/333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:01 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:02.627731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27f5dbd3-4c16-420e-92ec-853c589b8e28 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:02.701249 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27f5dbd3-4c16-420e-92ec-853c589b8e28 tempest-AggregatesAdminNegativeTestJSON-1271551825 tempest-AggregatesAdminNegativeTestJSON-1271551825-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.088382 Aug 30 16:05:02.706034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 152/334] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:02 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:05:02.742096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:02.745762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:02.758527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:02.759553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:02.760222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:02.763312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:02.771005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:02.775250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.163840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:03.164277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:03.165916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:03.166954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:03.167424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:03.179803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.181271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.182218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.185144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.186147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.187272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.213347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=29 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:03.241294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Getting quotas for project 712205074da447cd82dc1976c15ed17a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:03.253155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Getting quotas for user db82b0783b824658ae5524504a7f71f2 and project 712205074da447cd82dc1976c15ed17a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:03.280711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:03.283095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:03.373005 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a1ab9af-8c41-4920-8877-c9a33c026fcb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548776 Aug 30 16:05:03.374946 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 183/335] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:05:03.381201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19024a0d-1979-4d16-8972-39a367642e09", "tag": "5fdf7d78-1af0-48b1-a5f4-feb068b0a535"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:03.407117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.408291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.409953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.429693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] Creating event network-changed:5fdf7d78-1af0-48b1-a5f4-feb068b0a535 for instance 19024a0d-1979-4d16-8972-39a367642e09 on n-h2-830883-28 Aug 30 16:05:03.436556 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4caf8995-dfac-4b29-81a9-1ca8a8e989c0 req-de8a0842-4eb1-49bf-8455-eb3eb4f101c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059962 Aug 30 16:05:03.437984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 184/336] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:03.444697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89a0f8c2-7f47-425c-a354-9c07d809c569 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:03.445407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89a0f8c2-7f47-425c-a354-9c07d809c569 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:03.625816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89a0f8c2-7f47-425c-a354-9c07d809c569 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.640798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89a0f8c2-7f47-425c-a354-9c07d809c569 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1221 microversion: 2.1 time: 0.200950 Aug 30 16:05:03.641320 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 185/337] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:03 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:03.660228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:03.660852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:03.683262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.689229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.689844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.690799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.691543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.692138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.812364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.826062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df43d5fa-42e7-4c00-abc7-e2198e1fe75e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 1.099578 Aug 30 16:05:03.828067 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 153/338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:02 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:04.331787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.361594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59505dbc-9d8e-4723-aede-d700b9d5def0 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.697602 Aug 30 16:05:04.365488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 186/339] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:03 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:04.662031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:04.663037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:04.677278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.677776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.678216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.678946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.679408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.679824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.848951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:04.849569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:04.861800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.862317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.862756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.863448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.863905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.864312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.933212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.945115 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b11a278-cbc3-4486-9bdc-187bfcf54a4d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1273 microversion: 2.1 time: 0.287694 Aug 30 16:05:04.949995 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 154/340] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:04 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:05.143335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:05.157230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-386ef197-12e0-4cfe-90be-a841ffaff88f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.311958 Aug 30 16:05:05.157818 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 187/341] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:04 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:05.385475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:05.387170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:05.397942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.399251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.399895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.400817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.401489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.402109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.889658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:05.898944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.903846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.906384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.910900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.911680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.919488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.928344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:05.943550 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db80aa50-11c3-4412-9f59-c241bf5152ca tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.562015 Aug 30 16:05:05.944181 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 155/342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:05 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:05.971399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:05.971862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:05.984348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.985464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.985464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.985960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.989120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.989820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.022408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88fa6efa-5403-4c83-9207-c22b6307cab4 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.317056 Aug 30 16:05:06.031145 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 188/343] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:06.036779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.041066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.044290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.046521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.047280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.048969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.051069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.092839 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc0e0c75-aa19-403c-a8ea-3a2f8326ed67 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.060053 Aug 30 16:05:06.094026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 189/344] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:06.111004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.114781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.115797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.116464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.117794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.118506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.119149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.151395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63a8e5ff-ab6c-4222-8524-d7283127c118 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.044289 Aug 30 16:05:06.152753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 190/345] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:06.168275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.174636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.175248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.175800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.176726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.177295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.177827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.219149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.235280 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-91449670-430b-4640-8230-82d7ad08bc94 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1279 microversion: 2.1 time: 0.267164 Aug 30 16:05:06.235800 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5e6468b-20ec-44df-92c0-9d503d58aaf8 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-830883-28&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.075234 Aug 30 16:05:06.236958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 191/346] 10.222.0.47 () {58 vars in 1196 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services?host=n-d-830883-28&binary=xxx => generated 16 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:05:06.268976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.269848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:06.275051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 156/347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:05 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1279 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:06.285443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.285978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.287770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.288849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.289808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.290917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.291447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.299775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.300199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.302254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.304701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.306401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.308811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.392532 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3d551cac-642b-40e2-ab43-cf66b5445032 tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.115716 Aug 30 16:05:06.393270 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 157/348] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services => generated 949 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:06.405900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.409708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.410482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.411633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.413486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.415738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.416359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.476357 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49632a80-2f08-4717-9eb4-09ac23c4e13f tempest-ServicesAdminNegativeTestJSON-1787790338 tempest-ServicesAdminNegativeTestJSON-1787790338-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.074094 Aug 30 16:05:06.477819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 158/349] 10.222.0.47 () {58 vars in 1198 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:05:06.545266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.569224 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-488a6223-8bcc-44a9-bbfd-5ba0ca353406 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.330571 Aug 30 16:05:06.571718 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 192/350] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:06.935398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e349d71d-bf42-4bcb-b52c-60f688846e58 tempest-ServicesAdminNegativeTestJSON-2002827484 tempest-ServicesAdminNegativeTestJSON-2002827484-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.938942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e349d71d-bf42-4bcb-b52c-60f688846e58 tempest-ServicesAdminNegativeTestJSON-2002827484 tempest-ServicesAdminNegativeTestJSON-2002827484-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8aa9ef73746c4349929c0a664090b49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149fd028ca6840e4bf407f7659d256bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e349d71d-bf42-4bcb-b52c-60f688846e58 tempest-ServicesAdminNegativeTestJSON-2002827484 tempest-ServicesAdminNegativeTestJSON-2002827484-project] Request method failure captured: Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUvnGf0yBr76SwX40x2hWRi5Kc2DTe6Rn8GJgrfPseG8cZfSL6lGCrBY2QdJfQXft0GLXVSidouFAk3wEbXBRlA6m52tM8ZdL6buq8Afk-hVGkZMI-n-plB1In1w-Zph_BUExsjTViBQMltI5EMX-G9T1r7GLFzTiZKawu-pGXBzbI Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 149fd028ca6840e4bf407f7659d256bb Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2002827484 Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:05:06.940850 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/149fd028ca6840e4bf407f7659d256bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_149fd028ca6840e4bf407f7659d256bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/149fd028ca6840e4bf407f7659d256bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/149fd028ca6840e4bf407f7659d256bb"}]}] Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2002827484 Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 149fd028ca6840e4bf407f7659d256bb Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2002827484 Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServicesAdminNegativeTestJSON-2002827484-project Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 8aa9ef73746c4349929c0a664090b49f Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2002827484-project Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:05:06.942074 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:06.942852 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:05:06.948389 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:06.951870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e349d71d-bf42-4bcb-b52c-60f688846e58 tempest-ServicesAdminNegativeTestJSON-2002827484 tempest-ServicesAdminNegativeTestJSON-2002827484-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:06.951870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e349d71d-bf42-4bcb-b52c-60f688846e58 tempest-ServicesAdminNegativeTestJSON-2002827484 tempest-ServicesAdminNegativeTestJSON-2002827484-project] 10.222.0.47 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.456103 Aug 30 16:05:06.957854 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 159/351] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:06.969879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.971321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:06.988741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.994691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.996161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.999050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.000449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.001182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.155257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47de66f-b78f-4b17-9851-827c7d5e0e37", "name": "network-vif-plugged", "status": "completed", "tag": "f1b91fd0-acf9-45a1-bb94-66d7807e3107"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:07.186334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.186865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.193295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.238167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] Creating event network-vif-plugged:f1b91fd0-acf9-45a1-bb94-66d7807e3107 for instance d47de66f-b78f-4b17-9851-827c7d5e0e37 on n-h2-830883-28 Aug 30 16:05:07.255162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.256171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c635eaf2-146b-43e4-b7af-31063672617d req-594cb0e8-cbd5-4bdf-a370-d459fbf65f17 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109148 Aug 30 16:05:07.256802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 160/352] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:07.265664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:07.266648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:07.268613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bdea9fe5-7563-4357-8362-c56b3058ac59 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.306891 Aug 30 16:05:07.269602 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 193/353] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:07.279106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.283504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.286373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.287813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.288765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.294251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.596822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:07.597457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:07.614228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.615036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.615590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.616664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.618847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.619873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.620198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.642173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3362611e-909a-4a86-b516-2a5407095486 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.381062 Aug 30 16:05:07.657758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 161/354] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:07 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:07.845297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.855713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99495883-7472-449e-b204-c5a8875dac7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.266020 Aug 30 16:05:07.857138 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 194/355] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:07 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:08.291144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.292926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:08.308731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.310709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.312601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.313574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.316677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.317343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.603068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.639741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:08.648190 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38661cf5-506d-4515-a7b2-03d70462b5f6 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.361641 Aug 30 16:05:08.651069 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 195/356] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:08.668834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69b81b86-0d68-4b16-bff6-bd2a8553b098 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.671032 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-69b81b86-0d68-4b16-bff6-bd2a8553b098 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 30 16:05:08.681027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.683326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69b81b86-0d68-4b16-bff6-bd2a8553b098 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin] Request method failure captured: Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjU0Akiu2eKAEzoU12ARtrrIwYv1g2NyTOxllPMBbouII5t2A_iI7Vt9iBRrjH7mOm5uOjv2EdJTKutXmZuTw62Ob_uUsYu-i0qoOtrnjuUKF4rj7K93pOqtUxlWVNS2n-_KPe0JicdoUxSLnSvSXDZw3kGRYrE48k_elpiSdiqJtdo Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6a89b0a418c74fb3b5e86f6b11836a82 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:05:08.685037 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a89b0a418c74fb3b5e86f6b11836a82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6a89b0a418c74fb3b5e86f6b11836a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6a89b0a418c74fb3b5e86f6b11836a82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6a89b0a418c74fb3b5e86f6b11836a82"}]}] Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6a89b0a418c74fb3b5e86f6b11836a82 Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: bda3633cd35e4769a7d0b8d7e979a1d4 Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:08.686201 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid timestamp for date invalid_time Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'invalid_time'} Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:08.686859 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 30 16:05:08.687882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.690034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69b81b86-0d68-4b16-bff6-bd2a8553b098 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:08.691174 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69b81b86-0d68-4b16-bff6-bd2a8553b098 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076 tempest-InstanceUsageAuditLogNegativeTestJSON-109150076-project-admin] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.512479 Aug 30 16:05:08.694819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 162/357] 10.222.0.47 () {58 vars in 1224 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 516 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:08.707089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.723352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.726228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.728144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.731096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.731838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.896551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-735f01c5-49c2-4577-90c3-fa0fcbe88838 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.898683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-735f01c5-49c2-4577-90c3-fa0fcbe88838 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '09eb1f17c504425c985d86050a506d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d88837ba52b4428be1b368dd5487c4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-735f01c5-49c2-4577-90c3-fa0fcbe88838 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Request method failure captured: Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUysWA-AcJ3mgRcFwn9I8Pf_7RDTXPF4BNE0i9R8xbILSX8L3ZadbXUKIgNh8kwBsFl8Vc8ECX1B3QIKHqk6R18vwJRR32FcVR27Lzob1UL_Eq-B5OxWp4FiATfEtdH-XRolaOyWVWl1KIQma6Dnq0EXfZ9n5JIbLdui_RE5tss1xw Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6d88837ba52b4428be1b368dd5487c4f Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:05:08.900493 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d88837ba52b4428be1b368dd5487c4f"}]}] Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6d88837ba52b4428be1b368dd5487c4f Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 09eb1f17c504425c985d86050a506d88 Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project Aug 30 16:05:08.901740 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:08.902291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 16:05:08.905370 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:08.908244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-735f01c5-49c2-4577-90c3-fa0fcbe88838 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:08.909403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-735f01c5-49c2-4577-90c3-fa0fcbe88838 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.210705 Aug 30 16:05:08.910514 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 163/358] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:08.918859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0fd3820-327c-43b8-8e18-bee3518d7840", "tag": "782494a2-83d6-4c15-8dd5-db8e8334028b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:08.932185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.933240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.934504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.951721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] Creating event network-changed:782494a2-83d6-4c15-8dd5-db8e8334028b for instance b0fd3820-327c-43b8-8e18-bee3518d7840 on n-h1-830883-28 Aug 30 16:05:08.960463 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b3a3cad4-9ea0-4892-bba7-f67a64162aab req-72b244c5-d3b4-49ab-8494-1a9010639b68 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047108 Aug 30 16:05:08.963073 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 164/359] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:08.971345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.972346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:08.975667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:08.980898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.981652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.982391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.983446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.984110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.984725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.162836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.173621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4ff25b2-1441-4058-8534-4296c9c9c4cb tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.501216 Aug 30 16:05:09.188623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 196/360] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:09.196063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-606c9a92-4370-4678-a516-20f1effe864a tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:09.205199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-606c9a92-4370-4678-a516-20f1effe864a tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '09eb1f17c504425c985d86050a506d88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d88837ba52b4428be1b368dd5487c4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-606c9a92-4370-4678-a516-20f1effe864a tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Request method failure captured: Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2016:05:08 HTTP/1.1 Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUysWA-AcJ3mgRcFwn9I8Pf_7RDTXPF4BNE0i9R8xbILSX8L3ZadbXUKIgNh8kwBsFl8Vc8ECX1B3QIKHqk6R18vwJRR32FcVR27Lzob1UL_Eq-B5OxWp4FiATfEtdH-XRolaOyWVWl1KIQma6Dnq0EXfZ9n5JIbLdui_RE5tss1xw Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6d88837ba52b4428be1b368dd5487c4f Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:09.207747 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6d88837ba52b4428be1b368dd5487c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d88837ba52b4428be1b368dd5487c4f"}]}] Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6d88837ba52b4428be1b368dd5487c4f Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 09eb1f17c504425c985d86050a506d88 Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project Aug 30 16:05:09.208941 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '2022-08-30 16:05:08'} Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:09.210062 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 16:05:09.211773 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:09.233010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-606c9a92-4370-4678-a516-20f1effe864a tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:09.234105 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-606c9a92-4370-4678-a516-20f1effe864a tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479 tempest-InstanceUsageAuditLogNegativeTestJSON-1573737479-project] 10.222.0.47 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 16:05:08" status: 403 len: 128 microversion: 2.1 time: 0.044198 Aug 30 16:05:09.235577 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 197/361] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:05:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2016%3A05%3A08 => generated 128 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:09.643969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.660897 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dae2acab-cc34-4a07-8608-4c3620c0de49 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.695417 Aug 30 16:05:09.663632 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 165/362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:09.680803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:09.681590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:09.690659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.693688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.694177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.695210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.699178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.700554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.066145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.087639 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-204d732d-6b3f-4b9b-ab24-27d504e3a4a1 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1319 microversion: 2.1 time: 0.405020 Aug 30 16:05:10.088992 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 198/363] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:09 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:10.204926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:10.205962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:10.225494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.226396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.227171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.228164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.229000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.229583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.690919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:10.692262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:10.695888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.710322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c492b244-d589-4cdf-b037-0a8137cc2cd3 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.516574 Aug 30 16:05:10.711161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.712228 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 166/364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:10 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:10.713846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.717138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.718184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.719738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.721076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.131621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:11.134620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:11.135974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:11.149804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-931a3699-267c-4bee-9043-78e186d8b0ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.466764 Aug 30 16:05:11.150873 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 199/365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:10 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:11.151935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.153180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.153769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.154849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.155450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.156040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.737339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:11.740872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:11.758757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:11.760499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.765137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.765726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.767402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.768733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.771447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.772211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1313cf28-660e-4174-8247-afaaeb5c7866 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1468 microversion: 2.1 time: 0.662387 Aug 30 16:05:11.773178 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 167/366] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:11 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1468 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:11.808387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:11.813735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:11.844785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.845643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.846217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.847229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.847860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.849633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.099677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4df5d619-ef6e-4bf8-8ce5-5a74a0e51fe5 tempest-DeleteServersAdminTestJSON-1880606253 tempest-DeleteServersAdminTestJSON-1880606253-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37/action" status: 202 len: 0 microversion: 2.1 time: 0.305327 Aug 30 16:05:12.104499 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 168/367] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:11 2022] POST /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:12.111179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19024a0d-1979-4d16-8972-39a367642e09", "name": "network-vif-plugged", "status": "completed", "tag": "5fdf7d78-1af0-48b1-a5f4-feb068b0a535"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:12.126408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.127379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.128170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.143882 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] Creating event network-vif-plugged:5fdf7d78-1af0-48b1-a5f4-feb068b0a535 for instance 19024a0d-1979-4d16-8972-39a367642e09 on n-h2-830883-28 Aug 30 16:05:12.151161 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4f7fd917-0dc9-4ffb-9383-5ed12951be04 req-9d3b3023-9ab3-4029-a2bd-112de8d71329 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044695 Aug 30 16:05:12.152449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 169/368] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:12.158646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:12.159770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.167085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.167986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.168625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.169710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.170393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.171048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.214750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.215626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.216314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.217140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid d47de66f-b78f-4b17-9851-827c7d5e0e37 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:12.312208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.330572 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f44945eb-598b-4afa-bc42-01b1a530fadd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.596777 Aug 30 16:05:12.333037 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 200/369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:11 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:12.360693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:12.363485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.382536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.384410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.386983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.387977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.390012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.392768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.453841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.703537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.710870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:12.718101 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd7b297e-3f54-4f94-8db7-cc11fcfa7924 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1451 microversion: 2.1 time: 0.562704 Aug 30 16:05:12.732180 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 170/370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:12 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1451 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:12.745224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:12.750868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.769127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.771350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.771947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.772823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.780551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.780933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.831158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:05:12.863886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.878601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-535c07d4-b805-4272-a317-167ae3f03ffe tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.544153 Aug 30 16:05:12.880608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 201/371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:12 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:12.993683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dee8dc0a-a096-46a1-b658-532be8f8c4d5 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 204 len: 0 microversion: 2.1 time: 0.253018 Aug 30 16:05:12.994339 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 171/372] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:12 2022] DELETE /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:13.003187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:13.004143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:13.017285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.017793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.018233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.022354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.022914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.024080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.123141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.123633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.126979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.127451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid d47de66f-b78f-4b17-9851-827c7d5e0e37 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:13.356819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:13.357528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:13.367144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.367915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.368519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.370402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.372467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.373279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.500544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.512628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61949301-1cd6-45e2-bc97-dd912193c4e7 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1457 microversion: 2.1 time: 0.513753 Aug 30 16:05:13.513496 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 202/373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:12 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1457 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:13.812961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.824840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9fd44a2a-6a50-46e3-8786-c79e14e55b87 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.472268 Aug 30 16:05:13.840142 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 172/374] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:13 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:13.903227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:13.903843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:13.913638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=29 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:13.919799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.920386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.920926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.921796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.923811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.925221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.534447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:14.535078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:14.555410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.555895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.556330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.557036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.557486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.564109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.697390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.697892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.698363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.709452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid d47de66f-b78f-4b17-9851-827c7d5e0e37 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:14.817216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:14.838874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-212a239a-ce06-4ea5-860d-b21be366734c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1311 microversion: 2.1 time: 0.933224 Aug 30 16:05:14.852981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 203/375] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:13 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1311 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:14.857992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:14.867228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:14.877708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.878412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.878953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.883432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.883432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.883432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:15.059587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.079328 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4980a7df-ed36-4a9e-9a46-b5fe4be62dc9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1457 microversion: 2.1 time: 0.537252 Aug 30 16:05:15.080162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 173/376] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:14 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1457 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:15.357886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.365565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c446395-4a53-4e87-8e4a-c8964370ce63 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.511374 Aug 30 16:05:15.366135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 204/377] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:14 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:15.871578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:15.872452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:15.881988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:15.885745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:15.886396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:15.887238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:15.889988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:15.890596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.100939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:16.101810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:16.118539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.119574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.120229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.121167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.121846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.128841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.195899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:16.211477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.212438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.213132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.213792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid d47de66f-b78f-4b17-9851-827c7d5e0e37 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:16.430142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:16.490993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.499007 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad810dc0-3d80-4abf-a31c-7538e0c2af28 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1457 microversion: 2.1 time: 0.401822 Aug 30 16:05:16.500278 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 205/378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:16 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1457 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:16.504880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:16.510151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:16.522261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.526164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.526750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.527568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.529340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.531293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.898990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.908627 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5094fc7c-d89c-4084-96ac-f7276c27ed08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1494 microversion: 2.1 time: 1.044698 Aug 30 16:05:16.913612 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 174/379] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:15 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1494 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:17.237158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7df5c9a6-ed78-414b-870c-bd4f8575742b tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Action: 'create', calling method: .version_select at 0x7fd35d5e3b80>, body: {"keypair": {"name": "tempest-keypair-362408194", "type": "ssh", "user_id": "db3f21802e714abc98e863f5b301d88a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFFmbfQrVCO+KrZyeKaAZMgGdSWn5YK+LygqD7RvYj18sjuoNZ5RCs3dxhIVPwNDLgr4HFDVbus/nXt1+VUoi8XOhYELBmlt/AJzvmYvYJz2u7JcNCd5hGyh808bncW5g=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:17.283785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7df5c9a6-ed78-414b-870c-bd4f8575742b tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:17.290360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7df5c9a6-ed78-414b-870c-bd4f8575742b tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for user 4c36e7c77b684e0fa9459e628286349d and project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:17.341385 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7df5c9a6-ed78-414b-870c-bd4f8575742b tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.425148 Aug 30 16:05:17.354268 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 175/380] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:05:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:17.411370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:17.422408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f511400-1928-4daf-b217-08d4d927a293 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.920597 Aug 30 16:05:17.422578 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 206/381] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:16 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:17.447386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47de66f-b78f-4b17-9851-827c7d5e0e37", "name": "network-vif-deleted", "tag": "f1b91fd0-acf9-45a1-bb94-66d7807e3107"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:17.460680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.462085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.464560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.488961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] Creating event network-vif-deleted:f1b91fd0-acf9-45a1-bb94-66d7807e3107 for instance d47de66f-b78f-4b17-9851-827c7d5e0e37 on n-h2-830883-28 Aug 30 16:05:17.507992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0ca4a977-b320-48a2-8b05-464c194e8286 req-5bdfbf10-e112-4845-a1ec-72baf5490043 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078810 Aug 30 16:05:17.509584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 207/382] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:17.515057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bbc01e9-8732-4931-8acf-7f9f7a1cdc61 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Action: 'create', calling method: .version_select at 0x7fd35d4f6310>, body: {"keypair": {"name": "tempest-keypair-1897002492", "type": "ssh", "user_id": "db3f21802e714abc98e863f5b301d88a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8+Fl3hRSNLmXMN3xmIAS58x+TlfQQRZRQxnHGrt0WS7+9JZa5Vm3QgMnYqT+1WgmoaFJMsdMQwlnk4reWbq3aUg4AroYTRrAG+u9rwV+bM2MIH+e56uATv9oGElkq7ig=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:17.543886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:17.562470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1bbc01e9-8732-4931-8acf-7f9f7a1cdc61 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:17.580512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:17.582090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:17.583619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1bbc01e9-8732-4931-8acf-7f9f7a1cdc61 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for user 4c36e7c77b684e0fa9459e628286349d and project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:17.597242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.598220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.599277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.600352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.601062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.603122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.667578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bbc01e9-8732-4931-8acf-7f9f7a1cdc61 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.156396 Aug 30 16:05:17.668748 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 208/383] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:05:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:17.679287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:17.687328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:17.695151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.695715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.696069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.696771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.697220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.697642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.780149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.781037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.781632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.782477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lazy-loading 'fault' on Instance uuid d47de66f-b78f-4b17-9851-827c7d5e0e37 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:18.006702 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72ee9f70-45d9-4ad4-b7e0-6008728160e7 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1647 microversion: 2.1 time: 0.645472 Aug 30 16:05:18.008693 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 176/384] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:17 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1647 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:18.014454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30309389-7b95-41a5-bd44-662e2176b698 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Calling method '.version_select at 0x7fd35d5ed280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.038607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a4688d4c394426abfbb02cdff4f7b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bcbf72c458489ea74fb75f81ed9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.066521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30309389-7b95-41a5-bd44-662e2176b698 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-362408194?user_id=db3f21802e714abc98e863f5b301d88a" status: 200 len: 511 microversion: 2.10 time: 0.055487 Aug 30 16:05:18.069774 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 177/385] 10.222.0.47 () {60 vars in 1337 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-362408194?user_id=db3f21802e714abc98e863f5b301d88a => generated 511 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:18.073413 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1bbc23c-e4b1-45ab-9e48-01a52ec22a1b tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 200 len: 1309 microversion: 2.1 time: 0.403436 Aug 30 16:05:18.076532 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 209/386] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:17 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:18.085679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87e6e976-33b9-457c-85af-d9496453dc1f tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Action: 'create', calling method: .version_select at 0x7fd35d708310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-510841175", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLAX7QxfjcfoI2mklU81eA/tZY3ufcZA4+B1hpDa/0ueRlENDfNzCMA7mxhtdBczIcQ6CeM7Rvo1cL/HUECdt6EtSPVoXbv/Wmxagqt2txsm493zCHvLM3kadrj9vkzIg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:18.086781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.087696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:18.109372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.114081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.115349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87e6e976-33b9-457c-85af-d9496453dc1f tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:18.116488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.118187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.121471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.122198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.123527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87e6e976-33b9-457c-85af-d9496453dc1f tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Getting quotas for user 4c36e7c77b684e0fa9459e628286349d and project c206a79bdbc7448eac49b1eba8cb4dfc. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:18.169030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87e6e976-33b9-457c-85af-d9496453dc1f tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.087181 Aug 30 16:05:18.171990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 210/387] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:05:18 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:05:18.185031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e726198e-df4f-4d0e-b02d-def3c9c0e433 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Calling method '.version_select at 0x7fd35d50d8b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.191695 n-d-830883-28 devstack@n-api.service[122352]: WARNING oslo_db.sqlalchemy.utils [None req-e726198e-df4f-4d0e-b02d-def3c9c0e433 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:05:18.206016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e726198e-df4f-4d0e-b02d-def3c9c0e433 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "GET /compute/v2.1/os-keypairs?user_id=db3f21802e714abc98e863f5b301d88a" status: 200 len: 725 microversion: 2.10 time: 0.025758 Aug 30 16:05:18.207521 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 211/388] 10.222.0.47 () {60 vars in 1259 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/os-keypairs?user_id=db3f21802e714abc98e863f5b301d88a => generated 725 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:18.224945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e891e3b3-7628-426e-a1cb-c3b661ae89c2 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Calling method '.version_select at 0x7fd35d51fdc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.263579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e891e3b3-7628-426e-a1cb-c3b661ae89c2 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-510841175" status: 204 len: 0 microversion: 2.10 time: 0.047895 Aug 30 16:05:18.265838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 212/389] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Aug 30 16:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-510841175 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:05:18.279673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91db9e56-6d91-4aba-b641-f134d2a6a9f4 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Calling method '.version_select at 0x7fd35d578700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.322063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91db9e56-6d91-4aba-b641-f134d2a6a9f4 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897002492?user_id=db3f21802e714abc98e863f5b301d88a" status: 204 len: 0 microversion: 2.10 time: 0.051273 Aug 30 16:05:18.323317 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 213/390] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1897002492?user_id=db3f21802e714abc98e863f5b301d88a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:05:18.334180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-966a2638-8ae3-4914-9e36-d61f38bce502 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] Calling method '.version_select at 0x7fd35d50dc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.362817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-966a2638-8ae3-4914-9e36-d61f38bce502 tempest-KeyPairsV210TestJSON-1436413299 tempest-KeyPairsV210TestJSON-1436413299-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362408194?user_id=db3f21802e714abc98e863f5b301d88a" status: 204 len: 0 microversion: 2.10 time: 0.034590 Aug 30 16:05:18.363638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 214/391] 10.222.0.47 () {60 vars in 1340 bytes} [Tue Aug 30 16:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362408194?user_id=db3f21802e714abc98e863f5b301d88a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:05:18.446176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.446866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:18.463584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.465110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.466128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.469195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.469783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.472527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.628996 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4de59708-cac5-4ea1-bfda-57bc1820c378 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1647 microversion: 2.1 time: 0.544437 Aug 30 16:05:18.630936 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 178/392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1647 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:18.652484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.670486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.671063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.671657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.677376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.677858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.679022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.772802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83e1aa7b-a6fa-4c80-82d6-39efcbc1186a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.126439 Aug 30 16:05:18.776088 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 179/393] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:18.785999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-830883-28", "block_migration": true, "disk_over_commit": false}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:18.810394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:18.827566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.828112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.830637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.834062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.835078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.837330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.957356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.966082 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cae239ad-736f-4865-a889-077ce30705f6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.524805 Aug 30 16:05:18.968989 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 215/394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:19.100841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.102250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.120221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.122940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.123651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.124638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.126913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.127603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.169047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 HTTP/1.1 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:19.173542 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.174933 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd47de66f-b78f-4b17-9851-827c7d5e0e37'} Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:19.175596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.176708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.177676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:19.178468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-262a52a3-402a-42e4-aaa7-6b0a87b2eb85 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 404 len: 111 microversion: 2.1 time: 0.081829 Aug 30 16:05:19.184638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 216/395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:19.194777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.198816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.226791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.227317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.228215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.228950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.229410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.233780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.267201 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 HTTP/1.1 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:19.272718 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.274625 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd47de66f-b78f-4b17-9851-827c7d5e0e37'} Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:19.275304 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.276383 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.278080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:19.278080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c672cd0-1c93-4a12-b52b-f11a424de39a tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 404 len: 111 microversion: 2.1 time: 0.088773 Aug 30 16:05:19.278080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 217/396] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:19 2022] DELETE /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:19.291897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.295752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: d47de66f-b78f-4b17-9851-827c7d5e0e37] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.319731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.323243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.325559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.327887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.330420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.331579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.401495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 HTTP/1.1 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:19.403078 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.404259 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd47de66f-b78f-4b17-9851-827c7d5e0e37'} Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:19.405288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. Aug 30 16:05:19.406593 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.407569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance d47de66f-b78f-4b17-9851-827c7d5e0e37 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:19.407569 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da7dd252-2829-49c0-8558-71241e4336e4 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37" status: 404 len: 111 microversion: 2.1 time: 0.122143 Aug 30 16:05:19.420960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 218/397] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/d47de66f-b78f-4b17-9851-827c7d5e0e37 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:19.426143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.426815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.435132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.435635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.436089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.436797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.437269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.451048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.475983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 HTTP/1.1 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:19.478435 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.479606 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5e4dcf21-2252-439b-83be-876742bbe816'} Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:19.480316 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.481352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.482429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:19.482429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3b10055-1807-4acc-85ff-7a5b782427c9 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 404 len: 111 microversion: 2.1 time: 0.057869 Aug 30 16:05:19.488596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 219/398] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:19 2022] DELETE /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:19.494836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.495782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] [instance: 5e4dcf21-2252-439b-83be-876742bbe816] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.503570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lazy-loading 'flavor' on Instance uuid 19024a0d-1979-4d16-8972-39a367642e09 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:19.506052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.506808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.508239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.509473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.510092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.510710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.542649 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] HTTP exception thrown: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Request method failure captured: Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 HTTP/1.1 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjTmC2axfFmFsbwOoDU808MC0jnh75Z_WIlHjtweHpkL5Uoh58dJEZ4PgE6e9TfupOJXyQayXcTVZyciIVo3k4eh6VUAxds0bnFUXBIVu1UJXdLaKh1oKtzP_y-mMkIpciIrMa15A9FgF8dE64eA1p04sc2Z2OawdppYOoeiR2pYip4 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:19.551326 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/43bcbf72c458489ea74fb75f81ed9a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/43bcbf72c458489ea74fb75f81ed9a27"}]}] Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 43bcbf72c458489ea74fb75f81ed9a27 Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-730886804 Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a4688d4c394426abfbb02cdff4f7b4a Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersAdminTestJSON-730886804-project Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.552901 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5e4dcf21-2252-439b-83be-876742bbe816'} Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:19.553700 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. Aug 30 16:05:19.555329 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:19.557426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] Returning 404 to user: Instance 5e4dcf21-2252-439b-83be-876742bbe816 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:19.558583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37e7d099-e30c-438d-8337-6926a6007e84 tempest-DeleteServersAdminTestJSON-730886804 tempest-DeleteServersAdminTestJSON-730886804-project] 10.222.0.47 "GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816" status: 404 len: 111 microversion: 2.1 time: 0.068586 Aug 30 16:05:19.564382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 220/399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/5e4dcf21-2252-439b-83be-876742bbe816 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:19.597164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Going to try to live migrate instance to n-h1-830883-28 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:05:19.988225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.989455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.999906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.002996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.003625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.004496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.005104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.006538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.831520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:20.846732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-31f46d7f-9ebb-46cb-961f-bde064275634 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1321 microversion: 2.1 time: 0.859432 Aug 30 16:05:20.849542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 221/400] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1321 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:20.862892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd3820-327c-43b8-8e18-bee3518d7840", "name": "network-vif-plugged", "status": "completed", "tag": "782494a2-83d6-4c15-8dd5-db8e8334028b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:20.896342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.897597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.903896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.948792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] Creating event network-vif-plugged:782494a2-83d6-4c15-8dd5-db8e8334028b for instance b0fd3820-327c-43b8-8e18-bee3518d7840 on n-h1-830883-28 Aug 30 16:05:20.959282 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-964633e7-8fc2-417a-a546-e1b818547d9c req-61064750-eb3f-4987-8d0a-8cf45b7cce47 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107164 Aug 30 16:05:20.961747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 222/401] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:21.278821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1666103584", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:21.425900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] validate_networks() for [('0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:22.951239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:22.953204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:22.954390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:22.955018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:22.955658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:22.973027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.977913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.982520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:22.983580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.986967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.991465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:23.061293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:23.076639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for user 51cc027d79fe4ae0b644e49473acbd71 and project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:23.111704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:23.122504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:23.271330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b06f04f2-f6a8-48ec-a643-3f54ee981b9c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.296325 Aug 30 16:05:23.280812 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 223/402] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:23.308832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:23.332108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:23.362715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:23.365717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:23.369578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:23.370729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:23.374319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:23.376846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:24.253361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:24.268009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-754d7b6a-55be-403b-9a6b-345fb0728105 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1471 microversion: 2.1 time: 0.985826 Aug 30 16:05:24.295693 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 224/403] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:23 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1471 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:24.307607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c8fecbf-faed-458f-9155-663432e4a44d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:24.308245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c8fecbf-faed-458f-9155-663432e4a44d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:25.062073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c8fecbf-faed-458f-9155-663432e4a44d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:25.072246 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c8fecbf-faed-458f-9155-663432e4a44d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1208 microversion: 2.1 time: 0.775236 Aug 30 16:05:25.075410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 225/404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:24 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1208 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:25.087441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:25.091413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:25.107021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.110268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.111018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.113530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.114906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.117108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.181369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:05:25.475211 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4eabca4b-91e8-47fd-a8d3-761bd1057331 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 204 len: 0 microversion: 2.1 time: 0.397629 Aug 30 16:05:25.493726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 226/405] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:25 2022] DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:25.734259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-373316db-7122-4977-8d31-51d37c9a3d42 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09/action" status: 202 len: 0 microversion: 2.1 time: 6.952105 Aug 30 16:05:25.735286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 180/406] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:18 2022] POST /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09/action => generated 0 bytes in 6954 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:05:25.745194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:25.746219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:25.774965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.775835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.782019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.784791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.786428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.786952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:26.435554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:26.436965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] [instance: 8a1623bf-d516-448b-9085-fdba8580ac9c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:26.446729 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] HTTP exception thrown: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Request method failure captured: Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/8a1623bf-d516-448b-9085-fdba8580ac9c/action HTTP/1.1 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUtSMlMq2-lyNnMY7KdSe3zTih2Sb83taVucBREWAbzgKGFXQ6HcMgM-b6r9URgQjv4bVAwp2rHw1FXb9ZpNKdoxZ82jpNa1ZPHAOlsDaabkutn7_ZCOr0JbdUg3sXo-IItxtvYWcLK75lsjmOr-tiLXh-PmHAp-hlCykG-8hAM0fQ Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:05:26.449703 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}] Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 571bae4a95414d2cacab94b7952ba271 Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: {"migrate": {}} Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:26.451293 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '8a1623bf-d516-448b-9085-fdba8580ac9c', 'body': {'migrate': {}}} Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:26.452237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. Aug 30 16:05:26.453937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:26.462261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Returning 404 to user: Instance 8a1623bf-d516-448b-9085-fdba8580ac9c could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:26.463344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c8b4eea-7c11-442a-a222-b8ea9b73ddb1 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/8a1623bf-d516-448b-9085-fdba8580ac9c/action" status: 404 len: 111 microversion: 2.1 time: 0.964258 Aug 30 16:05:26.464411 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 227/407] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:25 2022] POST /compute/v2.1/servers/8a1623bf-d516-448b-9085-fdba8580ac9c/action => generated 111 bytes in 969 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:26.476732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1738739493", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "612907025", "adminPass": "***", "networks": [{"uuid": "8ef93de6-6fbd-40ed-aaca-41dd8aba0b67"}], "security_groups": [{"name": "tempest-securitygroup--1217907785"}], "key_name": "tempest-keypair-1981344258", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:27.310833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:27.496625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] validate_networks() for [('8ef93de6-6fbd-40ed-aaca-41dd8aba0b67', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:28.067744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.093105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82d633fd-b026-4acc-baff-3acc7984d745 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 2.352860 Aug 30 16:05:28.094017 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 181/408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:25 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:28.105835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:28.108068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:28.127972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.130256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.130820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.134485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.135150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.137015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.384180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.394515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b5de8a0-cb84-4868-8ca8-a8737bb7c0a1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1266 microversion: 2.1 time: 0.296969 Aug 30 16:05:28.395318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 182/409] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:28 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:28.415801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-732683158", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:28.522955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:28.704674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:29.558805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:29.561021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:29.561970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:29.562618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:29.563495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:29.584644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.586540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.587264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.589980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.591286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.592824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.600703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:29.603074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:29.603951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:29.604579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:29.605200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:29.618577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.619457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.620126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.627173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.627991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.628662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.637179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Getting quotas for project 712205074da447cd82dc1976c15ed17a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:29.648557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Getting quotas for user db82b0783b824658ae5524504a7f71f2 and project 712205074da447cd82dc1976c15ed17a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:29.658125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for project 4a929e510bc647eaaa73df2a64291566. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:29.666625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:29.669013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:29.671417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Getting quotas for user 97d70771a4b1486c84483dbf5897bfb3 and project 4a929e510bc647eaaa73df2a64291566. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:29.676791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:29.690551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:29.693753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:29.732989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ec9b8e8-e812-4a28-a520-83453cd53f92 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324446 Aug 30 16:05:29.733961 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 183/410] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:29.765767 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b7195de-e4a9-4778-94a9-8f1dfb7d5e05 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.300150 Aug 30 16:05:29.767089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 228/411] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:29.771819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.773017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.781941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.783695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.784291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.785517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.786129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.786786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.810629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:30.199397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe4b3e0d-6c94-4ba8-9aa9-719064cda8d3 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] Calling method '.version_select at 0x7fd35d5445e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:30.279053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.294042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-febd3604-8511-41a6-9a88-50bb2907fd15 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.522099 Aug 30 16:05:30.297304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 229/412] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:30.307429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe4b3e0d-6c94-4ba8-9aa9-719064cda8d3 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.572106 Aug 30 16:05:30.329472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 184/413] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:30.346341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:30.349203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:30.375928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.381310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.383112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.395147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.401265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.406286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.515270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c66a731b-dee3-418a-bb9f-3d2089cd4a06 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-704364174", "id": 604143963, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:30.579967 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c66a731b-dee3-418a-bb9f-3d2089cd4a06 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.281338 Aug 30 16:05:30.595186 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 230/414] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:05:30 2022] POST /compute/v2.1/flavors => generated 467 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:30.779539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34555eae-ea8e-48d0-a870-e171e35f4ca0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d602a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-532566187", "description": "tempest-description-731484649"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:31.460820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.489068 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-739b2711-f35a-4b78-8028-5273f15ff17d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 1.145808 Aug 30 16:05:31.490854 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 185/415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:30 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:31.515565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:31.516749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:31.532827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.535193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.537091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.540060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.545462 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34555eae-ea8e-48d0-a870-e171e35f4ca0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.948545 Aug 30 16:05:31.546059 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 231/416] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:05:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:31.546348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.547185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.566813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:31.567884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:31.594747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.595670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.596359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.600637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.601814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.602459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.798000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.810674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.824267 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18544acc-58a1-4351-8bf9-febf03611952 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1259 microversion: 2.1 time: 0.276452 Aug 30 16:05:31.826618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b864f54-db37-43a6-8fef-1f42ad79eed9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1273 microversion: 2.1 time: 0.327414 Aug 30 16:05:31.829891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 186/417] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:31 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:31.831403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 232/418] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:31 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1259 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:31.849915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-81108d19-2aff-44b9-81cc-8c9034c24243 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d5d10d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:31.850144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4dd2c94-8fdb-4a63-ab9c-82f5c01f466a tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:32.254917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=5,nova_api:INSERT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:32.428187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4dd2c94-8fdb-4a63-ab9c-82f5c01f466a tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/604143963/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.590521 Aug 30 16:05:32.435053 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 233/419] 10.222.0.47 () {62 vars in 1262 bytes} [Tue Aug 30 16:05:31 2022] POST /compute/v2.1/flavors/604143963/os-extra_specs => generated 62 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:32.448675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109f4699-4c8a-41d4-89fd-8327bbe72f8b", "name": "network-vif-deleted", "tag": "8e9e65fb-b83e-4705-bbd7-d757435f4c36"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:32.471361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.476436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.477184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.506890 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] Creating event network-vif-deleted:8e9e65fb-b83e-4705-bbd7-d757435f4c36 for instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b on n-h1-830883-28 Aug 30 16:05:32.525890 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-670f2516-aa23-4ee7-872c-2a7b462cf30d req-4cfff217-3d6d-4724-bcd9-aa380886cea4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088830 Aug 30 16:05:32.527143 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 234/420] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:32.541039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:32.541788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:32.560358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.562219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.562723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.563654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.564279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.564863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.826394 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-81108d19-2aff-44b9-81cc-8c9034c24243 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.993178 Aug 30 16:05:32.827477 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 187/421] 10.222.0.47 () {60 vars in 1206 bytes} [Tue Aug 30 16:05:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:32.856722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3cd4fc99-02a4-4b8a-9661-61925dbaad76 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d54f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-459694625", "description": "tempest-description-121998443"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:32.898593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:32.908215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19e74a41-282a-4352-ae05-539b670cdbf7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.377028 Aug 30 16:05:32.912191 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 235/422] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:32 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:32.918609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19024a0d-1979-4d16-8972-39a367642e09", "name": "network-vif-unplugged", "status": "completed", "tag": "5fdf7d78-1af0-48b1-a5f4-feb068b0a535"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:32.956047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.956548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.983299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.007427 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] Creating event network-vif-unplugged:5fdf7d78-1af0-48b1-a5f4-feb068b0a535 for instance 19024a0d-1979-4d16-8972-39a367642e09 on n-h2-830883-28 Aug 30 16:05:33.019846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4b66e414-19d5-40d1-a26a-ed31ff0b0481 req-5adb5d20-e394-44f4-8189-0ae0cb5a31c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104947 Aug 30 16:05:33.025546 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 236/423] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:33.035344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e36478f4-73a7-48d7-a556-0b05592e5327 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.072791 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e36478f4-73a7-48d7-a556-0b05592e5327 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/604143963" status: 202 len: 0 microversion: 2.86 time: 0.045507 Aug 30 16:05:33.077746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 237/424] 10.222.0.47 () {60 vars in 1199 bytes} [Tue Aug 30 16:05:33 2022] DELETE /compute/v2.1/flavors/604143963 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:33.089476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.090615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:33.099098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.099853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.100454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.101681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.102407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.103171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.327311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.347240 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-051ecfce-e3fd-4c35-8555-31288b164574 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.263558 Aug 30 16:05:33.364789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 238/425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:33.369428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f02d350-ce02-43de-bb90-0ec36026e92c tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] Calling method '.version_select at 0x7fd35d50ddc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.385831 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f02d350-ce02-43de-bb90-0ec36026e92c tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.020567 Aug 30 16:05:33.386784 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 239/426] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:33.391600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.392225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:33.399960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.400471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.400919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.401635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.402100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.402595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.486073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.496045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2df3079-8325-4467-8cb2-477be936c48a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1279 microversion: 2.1 time: 0.108203 Aug 30 16:05:33.496854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 240/427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:33.501853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.502510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:33.509932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.510398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.510847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.511886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.512355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.512787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.701191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.712419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33573bba-8e5d-4f92-a681-3e81105b2c33 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1321 microversion: 2.1 time: 0.214128 Aug 30 16:05:33.713380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 241/428] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:33.719872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0028209-07ac-4918-8fd3-213846402586 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.754462 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0028209-07ac-4918-8fd3-213846402586 tempest-FlavorMetadataValidation-2017525211 tempest-FlavorMetadataValidation-2017525211-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.038610 Aug 30 16:05:33.762915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 242/429] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:33.775845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85fe32b9-fe36-467f-94cf-3a3a3cb3e767 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d51fca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:33.968074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85fe32b9-fe36-467f-94cf-3a3a3cb3e767 tempest-QuotaClassesAdminTestJSON-1861902122 tempest-QuotaClassesAdminTestJSON-1861902122-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.203497 Aug 30 16:05:33.979155 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 243/430] 10.222.0.47 () {60 vars in 1206 bytes} [Tue Aug 30 16:05:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:33.985685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.989832 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3cd4fc99-02a4-4b8a-9661-61925dbaad76 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.158273 Aug 30 16:05:33.991456 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 188/431] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:05:32 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:34.008282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:34.033126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.038294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.042231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.044473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.045200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.046259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.372837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:34.373463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:34.394405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.394986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.398660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.401563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.402284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.403141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.639997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.651548 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3143d5e7-7f08-4b3b-a5a2-972911e55285 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.668135 Aug 30 16:05:34.652208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 244/432] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:34.681573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1324766398", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "a5ae5f5f-6836-4d2c-89f2-663c71d3ac24"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:34.795674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] validate_networks() for [('a5ae5f5f-6836-4d2c-89f2-663c71d3ac24', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:35.901024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:35.906109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:35.920024 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1917497-5ad0-4bb1-8392-26dc46492c75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 1.552163 Aug 30 16:05:35.922800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 189/433] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:34 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:35.956361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:35.957348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:35.996541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.999243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.999634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:36.001828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:36.002295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:36.007477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:36.821064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:36.849128 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ccf21e38-344f-4f8c-ad18-793ea412cf8a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.924114 Aug 30 16:05:36.871311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 190/434] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:35 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:36.885145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:36.892716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:36.906871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:36.907407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:36.913634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:36.914649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:36.917515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:36.918005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.078700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:37.079206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:37.079933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:37.081072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:37.081853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:37.100478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.102992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.105352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.106156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.107395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.108108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.146356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Getting quotas for project 2cb257ea23314fb1a37c24e9d58368b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:37.154035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Getting quotas for user 7460aaf7caf743c7a16249dc67123b41 and project 2cb257ea23314fb1a37c24e9d58368b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:37.172407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:37.175948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:37.301987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5f74c97-24d6-42dc-8a9e-07e54ffac3f9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.631789 Aug 30 16:05:37.306003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 245/435] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:37.311785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19024a0d-1979-4d16-8972-39a367642e09", "tag": "5fdf7d78-1af0-48b1-a5f4-feb068b0a535"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:37.324669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.326429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.327123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.357950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] Creating event network-changed:5fdf7d78-1af0-48b1-a5f4-feb068b0a535 for instance 19024a0d-1979-4d16-8972-39a367642e09 on n-h2-830883-28 Aug 30 16:05:37.369019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b3eec714-f16d-4871-9e24-b7ec6e0268c0 req-5495e4b0-ae61-4a32-8c68-1dad2c5e6db1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061200 Aug 30 16:05:37.371876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 246/436] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:37.381294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:37.384065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:37.392410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.393199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.400602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.409722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.411691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.422580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.953279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:37.968713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-311df6c4-2776-42c2-864a-1df85b4897c7 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.593513 Aug 30 16:05:37.985684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 247/437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:37 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:37.999402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.000111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:38.017936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.021884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.023053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.024252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.024744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.025187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.391322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:38.416704 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d477a0c2-89bb-4a72-a2ad-9b07b95dddd9 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 1.542634 Aug 30 16:05:38.418215 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 191/438] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:36 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:38.445290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.446348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:38.465511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.468259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.470652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.474155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.476120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.477062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.619581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:38.631270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d86665e2-31c8-4afb-8afb-78efc9fe1175 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.643745 Aug 30 16:05:38.636118 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 248/439] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:37 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:38.643654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16929167-e0e7-4a5a-a47f-b9b15900db58", "tag": "1e9d38f5-458d-4238-b6f3-9d0caec9bf1b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:38.649814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:38.658619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.660316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.661041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.677781 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] Creating event network-changed:1e9d38f5-458d-4238-b6f3-9d0caec9bf1b for instance 16929167-e0e7-4a5a-a47f-b9b15900db58 on n-h2-830883-28 Aug 30 16:05:38.687039 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c597c732-7cf1-4f96-9f0d-283f3fcbaf8f req-24fd582a-6552-438c-9559-33dee93ca38a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049338 Aug 30 16:05:38.688475 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 249/440] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:38.697255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.699977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:38.717665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.718807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.719376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.720332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.721418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.722117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.747362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:38.755334 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19419e0e-0aad-43a2-94f9-a426798f1b5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1220 microversion: 2.1 time: 0.317116 Aug 30 16:05:38.774333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 192/441] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:38 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:38.992300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.992916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:39.001974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.002502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.002933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.003703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.004078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.004503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.025077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:39.046907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9df7324a-c9d8-4a95-b264-a6edd9dd810d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.356436 Aug 30 16:05:39.048520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 250/442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:38 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:39.442926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:39.442926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:39.449341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.449826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.450267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.450978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.451431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.452645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.520725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:39.534679 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-732f9909-9acd-4f2f-a6de-67a38ba45bdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.545909 Aug 30 16:05:39.535394 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 193/443] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:38 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:39.564516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecdfd15-1ebd-4fbb-ae11-99ea22767c09", "tag": "323b7e1a-7df5-428e-99e0-88470e924314"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:39.606026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.607150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.608330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.641962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:39.652095 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] Creating event network-changed:323b7e1a-7df5-428e-99e0-88470e924314 for instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 on n-h2-830883-28 Aug 30 16:05:39.658608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:39.666895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cacf5918-6b9f-40b9-9f17-27da55699c46 req-365aa819-a65f-4447-b629-a392b6223044 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126318 Aug 30 16:05:39.669827 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 194/444] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:39.673098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cee3e0a3-605f-4e18-9db0-46aaeac10560 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.236812 Aug 30 16:05:39.688634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 251/445] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:39 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:39.690249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:39.691158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:39.712841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.713530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.714296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.715297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.718268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.719103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.787856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:39.788824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:39.798453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.803636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.804534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.807758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.808510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.809922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.905928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:39.922847 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b0fd127-e0c2-4f69-8cbf-1d9af037c175 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1274 microversion: 2.1 time: 0.138062 Aug 30 16:05:39.924311 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 252/446] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:39 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:40.070017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.070947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.077908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.078980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.079412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.080347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.081022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.081929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.090551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:40.098227 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72abd8c3-271a-473a-beba-fc1aa510fb3d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.426882 Aug 30 16:05:40.101280 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 195/447] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:39 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:40.317816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:40.331617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-439726f1-66ba-4874-9d84-70b8a93f293d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.266828 Aug 30 16:05:40.332205 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 253/448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:40.555835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.557076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.563533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.568020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.571280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.572271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.572915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.573718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.694713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.696066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.705055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.705877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.706662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.707927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.708792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.709355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.021762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.033286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08138b34-f531-4a7b-a268-b3b0d64c150a tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.342517 Aug 30 16:05:41.047040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 254/449] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.057282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.058178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.064952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.065901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.066709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.067898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.068513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.069756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.144458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.153736 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd1572cd-8d0e-489f-9468-428c5057d012 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1274 microversion: 2.1 time: 0.105279 Aug 30 16:05:41.163541 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 255/450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.354284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7de13626-7332-4187-be72-efc32050c2ef tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1942882386", "ram": 512, "vcpus": 1, "disk": 10, "id": 489453752, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:41.374567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7de13626-7332-4187-be72-efc32050c2ef tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.209554 Aug 30 16:05:41.375263 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 256/451] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:41 2022] POST /compute/v2.1/flavors => generated 413 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:41.382857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.383045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.388961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.389443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.389872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.390743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.391255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.391676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.412744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:41.515836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.525156 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5dd6801-725d-4817-af69-a16ae38f0f5a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.973185 Aug 30 16:05:41.525867 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 196/452] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.532490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.540501 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34c3e7a2-2da5-4866-b004-adf3b9da8c18 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.164256 Aug 30 16:05:41.541165 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 257/453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.561391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.565130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.572567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.573853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.576887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.580408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.580914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.581724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.640267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-465359745", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:41.717559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:41.777083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.786525 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9f6fe51-e9d2-453c-8594-7ae239343a5a tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.228794 Aug 30 16:05:41.787227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 258/454] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.906073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8ec9fec-6e8a-49c2-a79d-6a5047a1a9cd tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.917063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a8ec9fec-6e8a-49c2-a79d-6a5047a1a9cd tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] HTTP exception thrown: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8ec9fec-6e8a-49c2-a79d-6a5047a1a9cd tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Request method failure captured: Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVTbQho5EYWNjnmfgCmqv742gPMeUneOuAP_PzXINeMVZK7PmRDKgWe7RB9UdsRpN8l4oMlundqDA6a2Q03gF7FY7tHPvSAEY5mgl19IcH637_mIDkdqC41aHc9R6smw52rmO7zfycyQ84lT0ZmCqGiLXXUuEdhCvxSS_z4iXTfZR4 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:41.923000 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}] Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e54b492c709a440293b71ad3967958ea Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:41.924419 n-d-830883-28 devstack@n-api.service[122352]: exception: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '489453752', 'id': 'hw:cpu_thread_policy'} Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.925164 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8ec9fec-6e8a-49c2-a79d-6a5047a1a9cd tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Returning 404 to user: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:41.926648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8ec9fec-6e8a-49c2-a79d-6a5047a1a9cd tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] 10.222.0.47 "GET /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.123145 Aug 30 16:05:41.931217 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 259/455] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:41.936005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d", "tag": "0b9c98e7-c1ee-480d-9480-f41e13132084"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:41.947514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.948122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.948651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.961302 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] Creating event network-changed:0b9c98e7-c1ee-480d-9480-f41e13132084 for instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d on n-h2-830883-28 Aug 30 16:05:41.967377 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f613cc72-b33b-4196-9c96-2419b609b9bd req-95d56e77-9e41-43a2-a3f9-72d72d538b8a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034913 Aug 30 16:05:41.968233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 260/456] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:41.973960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e0bd5b9-5a62-467d-afb6-86087cd663fe tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:41.978676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e0bd5b9-5a62-467d-afb6-86087cd663fe tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e54b492c709a440293b71ad3967958ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afaf4107df4a08b793a9491c6079f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e0bd5b9-5a62-467d-afb6-86087cd663fe tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Request method failure captured: Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/flavors/489453752/os-extra_specs HTTP/1.1 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 66 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVTbQho5EYWNjnmfgCmqv742gPMeUneOuAP_PzXINeMVZK7PmRDKgWe7RB9UdsRpN8l4oMlundqDA6a2Q03gF7FY7tHPvSAEY5mgl19IcH637_mIDkdqC41aHc9R6smw52rmO7zfycyQ84lT0ZmCqGiLXXUuEdhCvxSS_z4iXTfZR4 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:41.980605 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}] Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e54b492c709a440293b71ad3967958ea Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 30 16:05:41.982021 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '489453752', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:41.983135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 16:05:41.984242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.987120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e0bd5b9-5a62-467d-afb6-86087cd663fe tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:41.988137 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e0bd5b9-5a62-467d-afb6-86087cd663fe tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] 10.222.0.47 "POST /compute/v2.1/flavors/489453752/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.018583 Aug 30 16:05:41.989207 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 261/457] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:05:41 2022] POST /compute/v2.1/flavors/489453752/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:42.001972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da00d4f2-6f05-4b95-88b5-db6136dd8e82 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:42.046887 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da00d4f2-6f05-4b95-88b5-db6136dd8e82 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/489453752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049276 Aug 30 16:05:42.047824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 262/458] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:05:41 2022] POST /compute/v2.1/flavors/489453752/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:05:42.057601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29f008a7-98cb-481a-9afc-aa3a72e80d88 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:42.059118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-29f008a7-98cb-481a-9afc-aa3a72e80d88 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e54b492c709a440293b71ad3967958ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afaf4107df4a08b793a9491c6079f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29f008a7-98cb-481a-9afc-aa3a72e80d88 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Request method failure captured: Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVTbQho5EYWNjnmfgCmqv742gPMeUneOuAP_PzXINeMVZK7PmRDKgWe7RB9UdsRpN8l4oMlundqDA6a2Q03gF7FY7tHPvSAEY5mgl19IcH637_mIDkdqC41aHc9R6smw52rmO7zfycyQ84lT0ZmCqGiLXXUuEdhCvxSS_z4iXTfZR4 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:42.060661 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}] Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e54b492c709a440293b71ad3967958ea Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:42.062145 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '489453752', 'id': 'hw:numa_nodes'} Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:42.062928 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 16:05:42.064237 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.065958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29f008a7-98cb-481a-9afc-aa3a72e80d88 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:42.066860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29f008a7-98cb-481a-9afc-aa3a72e80d88 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] 10.222.0.47 "DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013454 Aug 30 16:05:42.067396 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 263/459] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:42 2022] DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:42.076765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:42.077727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:42.086431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.087190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.087789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.088659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.089280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.089721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.143115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:42.143809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:42.144551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:42.145312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:42.145932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:42.156877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.157722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.158797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.159783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.160442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.161091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.186504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:42.193238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for user b9b2f53d6296454faac1c0c7a45860f0 and project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:42.219310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:42.221846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:42.291644 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84a34be0-0561-4873-8431-6ebce497226b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751916 Aug 30 16:05:42.295576 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 197/460] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:42.340777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5108752d-31ae-45ac-a631-734aea0d8821 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:42.394965 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5108752d-31ae-45ac-a631-734aea0d8821 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors/489453752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.097918 Aug 30 16:05:42.402834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 198/461] 10.222.0.47 () {60 vars in 1221 bytes} [Tue Aug 30 16:05:42 2022] POST /compute/v2.1/flavors/489453752/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:05:42.407676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:42.408294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:42.416666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.416666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.417098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.417790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.418243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.418763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.618104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:42.633866 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-01496ac4-e0d1-4915-a8b5-42093c8ba525 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.229718 Aug 30 16:05:42.648843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 199/462] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:42 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:42.655968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1611960986", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:42.733935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:42.746444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:42.759291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8cca95c1-1ced-4844-98be-1f7883077150 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.690624 Aug 30 16:05:42.760690 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 264/463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:42 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:42.766658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab2f5439-9ec7-46d0-be0e-9aee10b67a06 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:42.770359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab2f5439-9ec7-46d0-be0e-9aee10b67a06 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e54b492c709a440293b71ad3967958ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73afaf4107df4a08b793a9491c6079f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab2f5439-9ec7-46d0-be0e-9aee10b67a06 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Request method failure captured: Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 22 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVTbQho5EYWNjnmfgCmqv742gPMeUneOuAP_PzXINeMVZK7PmRDKgWe7RB9UdsRpN8l4oMlundqDA6a2Q03gF7FY7tHPvSAEY5mgl19IcH637_mIDkdqC41aHc9R6smw52rmO7zfycyQ84lT0ZmCqGiLXXUuEdhCvxSS_z4iXTfZR4 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:05:42.773236 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73afaf4107df4a08b793a9491c6079f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73afaf4107df4a08b793a9491c6079f7"}]}] Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 73afaf4107df4a08b793a9491c6079f7 Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e54b492c709a440293b71ad3967958ea Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: {"hw:numa_nodes": "1"} Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:42.774472 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '489453752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:05:42.775272 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 16:05:42.776323 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:42.779410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab2f5439-9ec7-46d0-be0e-9aee10b67a06 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:42.781146 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab2f5439-9ec7-46d0-be0e-9aee10b67a06 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993 tempest-FlavorsExtraSpecsNegativeTestJSON-1304011993-project] 10.222.0.47 "PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019075 Aug 30 16:05:42.783586 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 265/464] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:05:42 2022] PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:42.792155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:42.793215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:42.802398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.804135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.804866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.805828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.806596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.807257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.065029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:43.065497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:43.065859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:43.066256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:43.066693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:43.078165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.079262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.079883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.080772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.081483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.082130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.095352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:43.103081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:43.114783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d803ae4b-f41c-449f-ab1b-a97370aff119 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.329516 Aug 30 16:05:43.115343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for user b9b2f53d6296454faac1c0c7a45860f0 and project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:43.116808 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 266/465] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:42 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:43.123089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.125352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:43.141516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.145993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:43.146563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.147723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.150357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:43.151400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.152039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.152688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.182145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=8,nova_api:INSERT=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:43.262031 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e86a95bd-5fba-42d4-a208-3791784ea2b5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610706 Aug 30 16:05:43.271525 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 200/466] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:43.282688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0cb01b2-69f1-4550-89ed-1a3fdb4dce06 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.296351 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b0cb01b2-69f1-4550-89ed-1a3fdb4dce06 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] HTTP exception thrown: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0cb01b2-69f1-4550-89ed-1a3fdb4dce06 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Request method failure captured: Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVUI3AcdJivVFd1gG189kakd1ZN-WtTrYHp5JCnsS5kpvU23Q7OFQWLJGUPpmhCNo1wwZD7UzMvn8eGZD_t4QxFu-ZRpVb3T3LOFbYQL6ITqhFOueWuGgwMJWwsWOf5zk3ObGm2fS2HZYG8vE7k6_Oeh2Uhf1IgeZUERf0RLQ8sZpo Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:05:43.298138 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}] Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: c0d2debe446c4ac7af14b36bfab4853f Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:43.299676 n-d-830883-28 devstack@n-api.service[122351]: exception: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'flavor_id': '489453752', 'id': 'hw:cpu_thread_policy'} Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:43.300457 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. Aug 30 16:05:43.302016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.303835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0cb01b2-69f1-4550-89ed-1a3fdb4dce06 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Returning 404 to user: Flavor 489453752 has no extra specs with key hw:cpu_thread_policy. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:43.304870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b0cb01b2-69f1-4550-89ed-1a3fdb4dce06 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.026909 Aug 30 16:05:43.310148 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 201/467] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:05:43 2022] DELETE /compute/v2.1/flavors/489453752/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:43.316657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.317448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:43.327276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.328003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.328866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.329764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.330559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.331152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.727358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:43.738911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b2927787-2387-4e4f-87af-d5ade6c6bccd tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.426847 Aug 30 16:05:43.742105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 202/468] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:43 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:43.750541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64ed3cc9-9e74-4321-b154-55a5a6a8db59 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.751627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64ed3cc9-9e74-4321-b154-55a5a6a8db59 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:43.825099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64ed3cc9-9e74-4321-b154-55a5a6a8db59 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:43.832458 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64ed3cc9-9e74-4321-b154-55a5a6a8db59 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1214 microversion: 2.1 time: 0.087538 Aug 30 16:05:43.833025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 203/469] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:43 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:43.838169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffae63b0-187c-4434-b2e0-3868fa09e29c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:43.841747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ffae63b0-187c-4434-b2e0-3868fa09e29c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffae63b0-187c-4434-b2e0-3868fa09e29c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Request method failure captured: Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 27 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVUI3AcdJivVFd1gG189kakd1ZN-WtTrYHp5JCnsS5kpvU23Q7OFQWLJGUPpmhCNo1wwZD7UzMvn8eGZD_t4QxFu-ZRpVb3T3LOFbYQL6ITqhFOueWuGgwMJWwsWOf5zk3ObGm2fS2HZYG8vE7k6_Oeh2Uhf1IgeZUERf0RLQ8sZpo Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:05:43.843421 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}] Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: c0d2debe446c4ac7af14b36bfab4853f Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: {"hw:cpu_policy": "shared"} Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:05:43.844671 n-d-830883-28 devstack@n-api.service[122351]: exception: Request body and URI mismatch Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'flavor_id': '489453752', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:43.845394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:43.846554 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:43.846554 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:43.846554 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 30 16:05:43.846554 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:05:43.848578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffae63b0-187c-4434-b2e0-3868fa09e29c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:43.849618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffae63b0-187c-4434-b2e0-3868fa09e29c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015289 Aug 30 16:05:43.850773 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 204/470] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:05:43 2022] PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:05:43.856513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.862694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:43.875266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:43.879842 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5cb289a9-114a-4906-88b6-826c3f9a7f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.755518 Aug 30 16:05:43.880698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 267/471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:43 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:43.886368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:43.890238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.891010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.892824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:43.893274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.895550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.896913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.897543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.908057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.908681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.909316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.912749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:43.913155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:43.913768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:44.554273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:44.565461 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98347214-7931-4c6f-80e8-f8cece31ca28 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.682742 Aug 30 16:05:44.566260 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 268/472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:43 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:44.573986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15dcec6e-e1ce-4b9c-ad72-66a421bb6758 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15dcec6e-e1ce-4b9c-ad72-66a421bb6758 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Request method failure captured: Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 49 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVUI3AcdJivVFd1gG189kakd1ZN-WtTrYHp5JCnsS5kpvU23Q7OFQWLJGUPpmhCNo1wwZD7UzMvn8eGZD_t4QxFu-ZRpVb3T3LOFbYQL6ITqhFOueWuGgwMJWwsWOf5zk3ObGm2fS2HZYG8vE7k6_Oeh2Uhf1IgeZUERf0RLQ8sZpo Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:05:44.585034 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2322dadd867c408a9a6ec62c1b649fc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2322dadd867c408a9a6ec62c1b649fc9"}]}] Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2322dadd867c408a9a6ec62c1b649fc9 Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: c0d2debe446c4ac7af14b36bfab4853f Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 30 16:05:44.586347 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'flavor_id': '489453752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance: Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 30 16:05:44.587052 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.588302 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 16:05:44.589438 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:05:44.594690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15dcec6e-e1ce-4b9c-ad72-66a421bb6758 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:44.595812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-15dcec6e-e1ce-4b9c-ad72-66a421bb6758 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026699 Aug 30 16:05:44.597122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 269/473] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:05:44 2022] PUT /compute/v2.1/flavors/489453752/os-extra_specs/hw:numa_nodes => generated 117 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:05:44.603172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d31955a-ce1d-49cf-866e-34d2f46e998c", "tag": "99639d14-a8a9-4469-bb89-63e6740a376c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:44.618689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:44.619596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:44.620220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:44.633753 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] Creating event network-changed:99639d14-a8a9-4469-bb89-63e6740a376c for instance 8d31955a-ce1d-49cf-866e-34d2f46e998c on n-h1-830883-28 Aug 30 16:05:44.639468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fb0bff24-c1cc-40ea-a382-faf1bab543e2 req-70427089-dcbc-4f66-8107-beeb99838e61 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Aug 30 16:05:44.640316 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 270/474] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:44.646648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:44.648143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:44.671483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:44.672217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:44.672836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:44.674200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:44.674942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:44.675553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.099537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:45.122865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f0ef022-0eb8-4ab1-86d3-a5dd7e48f86d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.475204 Aug 30 16:05:45.123635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 271/475] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:44 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:45.135508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:45.144510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6a2bed7-870c-47ca-a975-c06ac90feae1 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:45.156406 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f142ca9d-3228-4165-9b37-62ccb1422837 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 1.303913 Aug 30 16:05:45.158229 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 205/476] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:43 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:45.165324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:45.166365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:45.174250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.175181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.175849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.176790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.177458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.179052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.207381 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6a2bed7-870c-47ca-a975-c06ac90feae1 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/489453752" status: 202 len: 0 microversion: 2.1 time: 0.082444 Aug 30 16:05:45.208627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 272/477] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:05:45 2022] DELETE /compute/v2.1/flavors/489453752 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:45.226249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:45.227149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:45.241473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.241980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.242483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.245825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.246331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.249271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.691465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:45.730885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65c5ff42-4b65-4355-bee2-2dd941f59449 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1274 microversion: 2.1 time: 0.520864 Aug 30 16:05:45.733843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 273/478] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:45 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1274 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:45.742713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:45.743919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:45.751653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.752942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.753548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.755615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.757678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.759321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.046704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.067027 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6dbf6c0-16ec-4b82-af33-d4a8115fd2c1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.331767 Aug 30 16:05:46.068013 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 274/479] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:45 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.073597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58d09972-8ed5-4f86-b557-4a0d3edf395c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.116707 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58d09972-8ed5-4f86-b557-4a0d3edf395c tempest-FlavorsExtraSpecsNegativeTestJSON-6241744 tempest-FlavorsExtraSpecsNegativeTestJSON-6241744-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.046893 Aug 30 16:05:46.119265 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 275/480] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.135206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.184926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.196530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.202637 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a983bf7-c1a0-4945-af97-f14e62577244 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 1.042966 Aug 30 16:05:46.203739 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 206/481] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:45 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.227419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecdfd15-1ebd-4fbb-ae11-99ea22767c09", "name": "network-vif-plugged", "status": "completed", "tag": "323b7e1a-7df5-428e-99e0-88470e924314"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:46.236717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.239946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.240446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.241231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.249279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.250127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.252947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.253776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.254413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.299945 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] Creating event network-vif-plugged:323b7e1a-7df5-428e-99e0-88470e924314 for instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 on n-h2-830883-28 Aug 30 16:05:46.317966 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-66077411-e38b-4f34-aa7f-bd556c573efd req-51eb46b9-5df7-4d07-8757-3eacd40ef5e8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104186 Aug 30 16:05:46.319972 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 207/482] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:46.326381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.327848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.338570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.339311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.340066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.340921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.341529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.342104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.635947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.646540 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-399e6413-ac99-4319-85dd-350c82856d3b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.325255 Aug 30 16:05:46.647464 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 208/483] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.667675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.668728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.675134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.675618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.676048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.676729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.677357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.677764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.713003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.721885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d31f4d8-f636-4734-bf1e-f20ce4a842e5 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.601571 Aug 30 16:05:46.728918 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 276/484] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.755555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.757025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.773298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.773843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.774295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.775063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.775529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.776492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.961266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.970020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74443cac-57f2-469b-b9ae-665c2e76eeec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1272 microversion: 2.1 time: 0.218456 Aug 30 16:05:46.971299 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 277/485] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:47.094775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.096001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.106065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.107237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.108992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.110985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.112368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.113404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.119070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:47.164949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=32 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:47.453071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:47.464716 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd6a7527-db00-4820-8f03-a916b1f2ca4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.375033 Aug 30 16:05:47.465868 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 278/486] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:47.486289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.487206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.494804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.495800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.496435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.497308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.497928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.498579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.626036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:47.635570 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-faad74ce-121e-4881-aa29-65a95d6ca0c5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.972742 Aug 30 16:05:47.636450 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 209/487] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:47.670204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.671009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.687223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.687693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.688244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.689041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.689588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.690199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.918081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:47.929079 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-95d3c05c-4a67-46d5-a5ff-4bd1510f4d76 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.447171 Aug 30 16:05:47.946620 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 279/488] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:47.952952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.956722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.965968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.966702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.967561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.968434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.969104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.969689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.236455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:48.248613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23bee2d7-4f41-4d47-91f7-1b66f47509f2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.299661 Aug 30 16:05:48.264582 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 280/489] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:48.271194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.272756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:48.279439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.280758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.281377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.282243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.282876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.283445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.347307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:48.381590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb167aff-6389-43ed-afaf-41c92fcad2e3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.714984 Aug 30 16:05:48.398487 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 210/490] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:48.401838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:48.404696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16929167-e0e7-4a5a-a47f-b9b15900db58", "name": "network-vif-plugged", "status": "completed", "tag": "1e9d38f5-458d-4238-b6f3-9d0caec9bf1b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:48.415159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.415890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.416109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dce153a6-0568-4be3-91da-ac4d92b30847 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1272 microversion: 2.1 time: 0.149967 Aug 30 16:05:48.416822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.432179 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 281/491] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:48.444823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] Creating event network-vif-plugged:1e9d38f5-458d-4238-b6f3-9d0caec9bf1b for instance 16929167-e0e7-4a5a-a47f-b9b15900db58 on n-h2-830883-28 Aug 30 16:05:48.450191 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-712f2eba-0b4c-4987-96f2-bb7a40c99bde req-41fcfd68-4367-48b1-a05f-8272843e9a6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049789 Aug 30 16:05:48.451608 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 211/492] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:48.489147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.489526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:48.500853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.502324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.503094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.504033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.504638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.505363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.659829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.661172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:48.672253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.675126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.687015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.687983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.688623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.689218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.067904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.077473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f35ae5d8-d3ab-45ed-ae9c-183271540be2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.592319 Aug 30 16:05:49.091677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 282/493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:49.099050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930eb535-b9f1-47f0-ba97-086a35fa1f9d", "tag": "c20211d3-fc22-4db8-9855-623f0a7db613"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:49.109624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.110362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.110941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.123846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] Creating event network-changed:c20211d3-fc22-4db8-9855-623f0a7db613 for instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d on n-h1-830883-28 Aug 30 16:05:49.129214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3214d98b-f69a-4ce6-9083-ef3049f4e450 req-deb5de66-7f90-46ff-82b4-0d3b9ff9558b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036004 Aug 30 16:05:49.130153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 283/494] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:49.135748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.136796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:49.143368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.144068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.144809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.145687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.146487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.147733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.152430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:49.217235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.240539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3f079924-fc55-4d5f-9cc0-7076b5e7a87b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.584450 Aug 30 16:05:49.241934 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 212/495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:49.291989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.292812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:49.304909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.305703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.306510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.307380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.307995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.308713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.720534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.728865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5afd7ea9-ea2d-46aa-b6f8-b041e5de1a25 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.597484 Aug 30 16:05:49.730211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 284/496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:49.735303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.736051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:49.742541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.743156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.743835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.744746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.745410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.746043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.883268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.891100 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65d63efb-966a-4afb-9a48-b7f8b7a1cbc3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.159555 Aug 30 16:05:49.891666 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 285/497] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:49.898902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.899713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:49.907867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.908524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.909135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.910387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.910992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.912453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.926601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.930017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:49.939216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9aaba91-ec62-4a76-a524-a2e97da4d539 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.664910 Aug 30 16:05:49.943409 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 213/498] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:50.104087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:50.105184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:50.117729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.124865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.125581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.128256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.128915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.129510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.537125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:50.555694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b097894-41af-467d-ae75-201f62d69505 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.655999 Aug 30 16:05:50.559843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 286/499] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:50.577340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:50.586926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:50.599508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.600631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.602833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.604001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.606620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.607329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.629458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:50.641916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cbcd6a06-8822-4a82-ad24-80da14f118cf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1308 microversion: 2.1 time: 0.543242 Aug 30 16:05:50.642850 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 214/500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:50 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:50.753883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:50.754537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:50.763263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.764588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.765195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.766333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.767034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.767966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.846590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:50.859446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e04fac3-3b47-467f-aeae-e0fc3f3dd8f8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.283841 Aug 30 16:05:50.880637 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 287/501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:50 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:50.920361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:50.921405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:50.931416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.932668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.933128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.933887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.934379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.934947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.120110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:51.132824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3056f1cd-9b0d-410e-a0fb-b2716e3b5109 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.382657 Aug 30 16:05:51.136489 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 215/502] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:50 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:51.141397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:51.142255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:51.142873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:51.155227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3636ed5-eb0f-4967-a377-5ff9aed66fb4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.244359 Aug 30 16:05:51.156826 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 288/503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:50 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:51.158672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.160343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.160862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.166792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.167332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.167775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.531310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:51.539950 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-811e7baa-0b9d-4977-8571-7c7cdeb8c1a7 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1389 microversion: 2.1 time: 0.402156 Aug 30 16:05:51.554211 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 216/504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:51 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1389 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:51.582706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:51.583330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:51.592003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.592826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.593441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.594493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.594955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.595831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.598202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a", "tag": "4aab3995-e449-4499-88f5-8199af975e20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:51.610994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.614954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.616915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.669632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] Creating event network-changed:4aab3995-e449-4499-88f5-8199af975e20 for instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a on n-h1-830883-28 Aug 30 16:05:51.680835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-582b8f0b-6aad-46c3-baf0-c8a0afe9c003 req-d71a1fab-2c00-4b9e-baee-bf993c1f43a9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086713 Aug 30 16:05:51.692168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 217/505] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:51.712228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:51.714853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:51.737256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.739487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.742085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.743279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.745703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.746807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.037482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.057220 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9701f18a-f50b-41ad-81d3-4e4ad1a4af82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.475686 Aug 30 16:05:52.057915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 289/506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:51 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.077222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.087081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.111327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.111327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.111327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.111327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.112262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.112262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.332802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.347685 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9525068d-32e2-4e06-8490-bcf9ca9ef05e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1488 microversion: 2.1 time: 0.654073 Aug 30 16:05:52.349275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 218/507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:51 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1488 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.369717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.370497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.378400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.379972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.380672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.395949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.397895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.399631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.485574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.502769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81dfd806-ffa2-454a-a07d-ff38d4d64178 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.442640 Aug 30 16:05:52.504546 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 290/508] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.510946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.511771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.518988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.521471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.522493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.525206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.526074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.526839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.769433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.779523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a87ce0f0-3cc8-4cda-932a-7b1b4839e8ea tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.427445 Aug 30 16:05:52.795438 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 219/509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.801860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:52.804116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.812681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.813721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.814715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.816078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.816771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.818528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.939873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e28fc28d-f14c-4f69-a2cc-81b09e8228b2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09/action" status: 202 len: 0 microversion: 2.1 time: 0.140913 Aug 30 16:05:52.942871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 220/510] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:52 2022] POST /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:52.965948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.975381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.992085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.993583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.994427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.995480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.996124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.998223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.065228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:53.076668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5025b16-08f9-4eb8-90b3-083467493d54 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1504 microversion: 2.1 time: 0.570875 Aug 30 16:05:53.091226 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 291/511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.092367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:53.100574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d31955a-ce1d-49cf-866e-34d2f46e998c", "name": "network-vif-plugged", "status": "completed", "tag": "99639d14-a8a9-4469-bb89-63e6740a376c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:53.128540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.129389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.130349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.146048 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] Creating event network-vif-plugged:99639d14-a8a9-4469-bb89-63e6740a376c for instance 8d31955a-ce1d-49cf-866e-34d2f46e998c on n-h1-830883-28 Aug 30 16:05:53.154706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-49731628-9c67-4860-9bb8-d2bb0961d6e5 req-c22e080b-c791-4e10-bebc-ea279f9889d9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062112 Aug 30 16:05:53.155685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 292/512] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:53.164964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.166077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.174614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.175432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.176212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.177173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.178128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.179377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.296900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:53.311928 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2186668d-c4e9-4576-8674-8f05af3c6254 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1587 microversion: 2.1 time: 0.366956 Aug 30 16:05:53.314646 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 221/513] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1587 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.326910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.327649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.360619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.362033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.362533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.364608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.365120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.366078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.597632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:53.607866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d23adef5-4ed8-4726-995f-203d427029f9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1493 microversion: 2.1 time: 0.450489 Aug 30 16:05:53.608873 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 293/514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1493 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.613581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.614070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.617306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:53.622462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.623283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.623886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.625391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.626182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.626333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.641006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:53.654186 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3933bb79-aaaa-43ee-9cac-fb18c9545548 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.338299 Aug 30 16:05:53.655368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 222/515] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.718615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6aa315e6-0e02-44a3-9f60-1373fba35bc6 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107939 Aug 30 16:05:53.727012 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 294/516] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:53.731449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.732301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.751190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.751708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.752156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.752880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.753341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.753768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.829648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=60,nova_cell0:UPDATE=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:53.874099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Calling method '.version_select at 0x7fd35d5d18b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.875999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.876480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.876909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.911242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.911878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.913523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.926394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.926978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.927642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.935248 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf10c89b-6592-43c1-8501-8d1cf1ee26f4 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.278616 Aug 30 16:05:53.936023 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 223/517] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:53.946143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.947021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.954068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.954844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.955467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.956354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.956968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.957549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.192600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:54.201358 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ebc2e74-27e2-426c-99c6-16208cd59f71 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.476861 Aug 30 16:05:54.216805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 295/518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:54.217841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Calling method '.version_select at 0x7fd35d472280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.226341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.226835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.228186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.247517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:54.258636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.258979 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb7237ed-5243-4c6b-a0f7-9f72331d2597 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.321241 Aug 30 16:05:54.259115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.259527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.275611 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 224/519] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:54.280467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.281091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:54.291679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.292430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.293108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.300051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f701429-97a1-4c78-9741-3925784a40ef tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h1-830883-28/servers" status: 200 len: 513 microversion: 2.1 time: 0.089501 Aug 30 16:05:54.301273 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 296/520] 10.222.0.47 () {58 vars in 1215 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/os-hypervisors/n-h1-830883-28/servers => generated 513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:54.304578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.307248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.307850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.308752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.311211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.311811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.314143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Calling method '.version_select at 0x7fd35d7f1670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.316144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.316810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.317498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.346941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.347736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.348442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.373497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.374005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.374567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.383362 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25a8dae7-92c6-4938-abe4-2bc5d97c2b06 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.073045 Aug 30 16:05:54.385254 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 297/521] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:54.401922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Calling method '.version_select at 0x7fd35d4729d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.406376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.410292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.411011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.436604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.438329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.438936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.446116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2704071-0423-46f2-8401-31fc0c153518 tempest-HypervisorAdminUnderV252Test-415164905 tempest-HypervisorAdminUnderV252Test-415164905-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/n-h1-830883-28/search" status: 200 len: 105 microversion: 2.1 time: 0.055689 Aug 30 16:05:54.447591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 298/522] 10.222.0.47 () {58 vars in 1212 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/os-hypervisors/n-h1-830883-28/search => generated 105 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:54.630513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.631234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:54.638589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.639065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.639500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.640292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.640749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.641449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.644388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:54.660529 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e717fc95-ce0d-4ff2-91e4-bf2c686ff3fb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1494 microversion: 2.1 time: 0.382674 Aug 30 16:05:54.670530 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 225/523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1494 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:54.683542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.685226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:54.700112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.700609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.702366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.704708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.707041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.708771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.924560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:54.934937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d9b591f-c3bf-4f9f-97ab-2df4a74e36f5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.260872 Aug 30 16:05:54.936193 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 226/524] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:54.952669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5d61dc7-251f-488b-bfd5-fe4fea7a74d0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '.version_select at 0x7fd35d46d280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.956900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5d61dc7-251f-488b-bfd5-fe4fea7a74d0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.957456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5d61dc7-251f-488b-bfd5-fe4fea7a74d0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.958056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5d61dc7-251f-488b-bfd5-fe4fea7a74d0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.974029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5d61dc7-251f-488b-bfd5-fe4fea7a74d0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.035581 Aug 30 16:05:54.976293 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 227/525] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:54.987364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.987995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:54.995866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.996368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.996812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.997889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.998380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.998820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.006684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:55.019507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8eeb97e6-7c9c-488a-965b-07bb7aa2cd22 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 200 len: 1473 microversion: 2.1 time: 0.392544 Aug 30 16:05:55.020373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 299/526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:55.059553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-786385686"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:55.065673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:55.076080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.076966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.077596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.078765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.079385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.079968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.299809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:55.302888 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9c3717c-26a7-4b9a-8d60-79511ba57168 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1647 microversion: 2.1 time: 0.319114 Aug 30 16:05:55.305546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 228/527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1647 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:55.310963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d", "name": "network-vif-plugged", "status": "completed", "tag": "0b9c98e7-c1ee-480d-9480-f41e13132084"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:55.352608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.357260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.357874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.364335 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9f93b94-ebb6-4a25-9e7c-fcfd1213f6a4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09/action" status: 202 len: 0 microversion: 2.1 time: 0.326311 Aug 30 16:05:55.368898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 300/528] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:55 2022] POST /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:05:55.385185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.385698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] Creating event network-vif-plugged:0b9c98e7-c1ee-480d-9480-f41e13132084 for instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d on n-h2-830883-28 Aug 30 16:05:55.385903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:55.392483 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-130e2df8-1204-42f3-9a30-0f38a55653f9 req-a4b1e2f7-b7cf-4bd7-b1e3-c4d6bb76cced service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084722 Aug 30 16:05:55.398988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 229/529] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.403527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.404033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.404463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.406863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.407876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:55.410209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.410731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.411180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.417393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.418345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.419036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.421245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.421902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.424692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.735876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:55.745025 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daa57bb7-ed3b-44a1-9287-baa7d3786f58 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1316 microversion: 2.1 time: 0.374458 Aug 30 16:05:55.746099 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 301/530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.759672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:55.760922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37edd57a-5341-470a-af06-5caec995b81f tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.359836 Aug 30 16:05:55.762702 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 230/531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.766253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d560edd-bd8f-40c3-bc42-c02ce6d2e6ac tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d578160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.777762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1762460054", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4e9da5ca-14d4-482f-90c9-bfeef67ee437"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:55.825820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d560edd-bd8f-40c3-bc42-c02ce6d2e6ac tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.059285 Aug 30 16:05:55.827236 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 302/532] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.865735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] validate_networks() for [('4e9da5ca-14d4-482f-90c9-bfeef67ee437', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:55.963219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.966338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:55.986912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.987975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.988428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.989154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.990516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.992442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.340878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:56.353208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e9a74f3-0fd9-4460-af85-2109ec993939 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.398562 Aug 30 16:05:56.370991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 303/533] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:56.377223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:56.378333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:56.386825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.387561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.388322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.389860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.391161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.391769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.593971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:56.605812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d457dbf1-6da3-4135-9209-98034f25bd70 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1587 microversion: 2.1 time: 0.232269 Aug 30 16:05:56.618997 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 304/534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:56 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1587 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:56.626699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16929167-e0e7-4a5a-a47f-b9b15900db58", "tag": "1e9d38f5-458d-4238-b6f3-9d0caec9bf1b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:56.637042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.637679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.638174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.654588 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] Creating event network-changed:1e9d38f5-458d-4238-b6f3-9d0caec9bf1b for instance 16929167-e0e7-4a5a-a47f-b9b15900db58 on n-h2-830883-28 Aug 30 16:05:56.662800 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0d6a7465-9105-41b4-81d3-10e285cd05b7 req-b1fad8fb-8ea3-4483-bc3d-c7743e269493 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041368 Aug 30 16:05:56.664698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 305/535] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:56.673525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:56.674157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:56.674650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:56.675058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:56.675454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:56.686860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.687604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.688241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.689170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.689830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.690516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.710098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:56.715585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for user 43d55a1e4a9f4f2b9cb85e010154f284 and project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:56.729339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:56.732041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:56.768110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:56.768910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:56.799130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.800725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.802441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.804426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.805136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.805916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.812133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b224ec95-f648-43d2-8f1e-b3f4ef03dfb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046713 Aug 30 16:05:56.814264 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 231/536] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:56.822780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:56.824500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:56.834204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.834944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.835482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.836402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.837348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.837802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.843013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:57.003322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:57.010399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:57.014331 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4610ab63-735f-49f1-a87c-56f867240b62 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1504 microversion: 2.1 time: 0.250830 Aug 30 16:05:57.014914 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 306/537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:56 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:57.031166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a3a732c9-356f-480b-88cd-0018af256d1e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1321 microversion: 2.1 time: 0.214877 Aug 30 16:05:57.033327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 232/538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:56 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:57.048044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff38eb6c-fe8d-4b1c-adb2-200e7e06384b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.048663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff38eb6c-fe8d-4b1c-adb2-200e7e06384b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:57.134748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff38eb6c-fe8d-4b1c-adb2-200e7e06384b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:57.150693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff38eb6c-fe8d-4b1c-adb2-200e7e06384b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1211 microversion: 2.1 time: 0.113570 Aug 30 16:05:57.152584 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 233/539] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:57.166419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da24673f-a1c7-484a-95a0-67d015a598b7 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d417e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.197381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bdfc1c07-2943-409d-8eed-683a8a78561b tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.215623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bdfc1c07-2943-409d-8eed-683a8a78561b tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.196593 Aug 30 16:05:57.218409 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 307/540] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:57.243073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-532566187"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:57.243753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:57.249816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:57.250343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:57.250783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:57.251489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:57.252045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:57.252381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:57.278996 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da24673f-a1c7-484a-95a0-67d015a598b7 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.122170 Aug 30 16:05:57.286919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 234/541] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:57.292149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-98549959-a6f2-4432-b442-880ed971e9e0 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.349446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-98549959-a6f2-4432-b442-880ed971e9e0 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.065618 Aug 30 16:05:57.351983 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 235/542] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:57.373893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2843a3c8-99d7-4ab0-a045-e395d45907cb tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.385965 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2843a3c8-99d7-4ab0-a045-e395d45907cb tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021143 Aug 30 16:05:57.395286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 236/543] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:57.403291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.404207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:57.414274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:57.415738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:57.417150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:57.418865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:57.419947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:57.420758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:57.517916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Adding security group 795a2945-549e-4395-b842-2257e2ed7bbf to port 99639d14-a8a9-4469-bb89-63e6740a376c Aug 30 16:05:57.927065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:57.936501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-375f88da-848e-4e2a-a1f3-95adadbac7fa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.539711 Aug 30 16:05:57.939261 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 237/544] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:57.954574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3c95cb74-ceed-4bf5-bfa6-9e1a986ef087 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:57.971840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3c95cb74-ceed-4bf5-bfa6-9e1a986ef087 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029210 Aug 30 16:05:57.981878 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 238/545] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:57.997849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930eb535-b9f1-47f0-ba97-086a35fa1f9d", "name": "network-vif-plugged", "status": "completed", "tag": "c20211d3-fc22-4db8-9855-623f0a7db613"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:58.014826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.017339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.019604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.047995 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] Creating event network-vif-plugged:c20211d3-fc22-4db8-9855-623f0a7db613 for instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d on n-h1-830883-28 Aug 30 16:05:58.060151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c0f2ff5b-e05b-48ea-bd83-6f0eed90cf59 req-b23ffa28-0ae7-4402-b5b1-7a44e99ac042 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076415 Aug 30 16:05:58.061197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 239/546] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:58.085073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5d3dda00-57d2-48b0-b382-5317019b9845 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.164183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5d3dda00-57d2-48b0-b382-5317019b9845 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.101485 Aug 30 16:05:58.164783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 240/547] 10.222.0.47 () {58 vars in 1165 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.184484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5499f4d5-710c-487c-931f-79c4e12b862c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/action" status: 202 len: 0 microversion: 2.1 time: 0.962718 Aug 30 16:05:58.186085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 308/548] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:57 2022] POST /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/action => generated 0 bytes in 965 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:58.188245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.189065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:58.193251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.194234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:58.207556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.208440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.209711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.211121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.212799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.214465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.215418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.215871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.216437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.217346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.222676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.223338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.377387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:58.390531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0609dc2f-9d2c-40db-bd4a-c3bf5cffae19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1207 microversion: 2.1 time: 0.202846 Aug 30 16:05:58.391130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 309/549] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1207 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.420399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1904e32f-86a6-47ea-9209-d6252ddf21e6 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.439656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1904e32f-86a6-47ea-9209-d6252ddf21e6 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033955 Aug 30 16:05:58.447611 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 310/550] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:58.464436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-459694625"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:58.467083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:58.482290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.483350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.486421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.490336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.491176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.491727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.590249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:58.600851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfe7ae89-d2b1-4fb1-a58b-8d9adc6848f5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1471 microversion: 2.1 time: 0.422430 Aug 30 16:05:58.601433 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 241/551] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.608375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57ef3edb-cfaf-46d3-a2f6-06b9410d6997 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d5ede50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.680166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57ef3edb-cfaf-46d3-a2f6-06b9410d6997 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.075241 Aug 30 16:05:58.688322 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 242/552] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.693177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89cee6fe-54a5-474f-a80c-5b645d91b43f tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.707219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Adding security group da4ff018-dd1c-48bb-b2b2-ba1afc5842b1 to port 99639d14-a8a9-4469-bb89-63e6740a376c Aug 30 16:05:58.712776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:58.722724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89cee6fe-54a5-474f-a80c-5b645d91b43f tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033021 Aug 30 16:05:58.723848 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 243/553] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.729250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:58.730064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:58.739214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.740049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.740847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.741999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.742684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.743318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.775177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lazy-loading 'flavor' on Instance uuid 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:58.910008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-697cf665-3f85-4b6a-bf41-63e933fa9ed5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d/action" status: 202 len: 0 microversion: 2.1 time: 0.183841 Aug 30 16:05:58.911041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 244/554] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:58 2022] POST /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:58.937999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d31955a-ce1d-49cf-866e-34d2f46e998c", "tag": "99639d14-a8a9-4469-bb89-63e6740a376c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:58.957407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.958187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.959007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.975558 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] Creating event network-changed:99639d14-a8a9-4469-bb89-63e6740a376c for instance 8d31955a-ce1d-49cf-866e-34d2f46e998c on n-h1-830883-28 Aug 30 16:05:58.981766 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cb6e002b-151f-4997-9b7e-fa4937aabed0 req-e98c4b67-9366-4819-a068-a22c9a177a3d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069202 Aug 30 16:05:58.982621 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 245/555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:58.990965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8099a58f-2cc0-4353-908f-86028766b151 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.004885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8099a58f-2cc0-4353-908f-86028766b151 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020164 Aug 30 16:05:59.005588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 246/556] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:59.020053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.021274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:59.028491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.029242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.030171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.031051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.031653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.032703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.254940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9de23e8-030a-4e6d-80de-31cc96b84d3e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/action" status: 202 len: 0 microversion: 2.1 time: 0.804712 Aug 30 16:05:59.257125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 311/557] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:58 2022] POST /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/action => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:59.263858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.264633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:59.286508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.288843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.290527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.292316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.299182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.299648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.538858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:59.548471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06493880-8673-4bb8-9021-898e5b66f824 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.289512 Aug 30 16:05:59.549325 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 312/558] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:59.555635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c57bdbd5-0ced-4d83-a99e-b2adede67973 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.566751 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c57bdbd5-0ced-4d83-a99e-b2adede67973 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016038 Aug 30 16:05:59.568435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 313/559] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:59.580058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.580734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:59.588407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.589321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.589975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.591388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.592068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.592677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.597171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-60260339-3928-4e4b-8d34-ff92c57e3f77 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1632 microversion: 2.1 time: 0.581257 Aug 30 16:05:59.617164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 247/560] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1632 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:59.641956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.642615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:59.652102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.653702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.654155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.655687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:59.656333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:59.657651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:59.741958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:59.751301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-092bd7b9-5d5c-4730-bb73-7f0997af91dc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1269 microversion: 2.1 time: 0.132681 Aug 30 16:05:59.752292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 248/561] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:59.897389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fdd482f2-77a7-43f2-b51a-d7b8815306d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.326689 Aug 30 16:05:59.900275 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 314/562] 10.222.0.47 () {58 vars in 1293 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c/os-security-groups => generated 1155 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:59.906641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2c7b210-3304-4e6e-8c0d-cda61d0a74fb tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:59.967439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2c7b210-3304-4e6e-8c0d-cda61d0a74fb tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.065128 Aug 30 16:05:59.969418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 315/563] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:59.998425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-278a381b-3a4c-47ae-81ef-6b6cfa6e1f8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d3b5af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:00.031235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-628782490", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:00.079434 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-278a381b-3a4c-47ae-81ef-6b6cfa6e1f8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.108660 Aug 30 16:06:00.088969 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 316/564] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:05:59 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:00.110120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d8a3619-c256-44d7-916a-c4d2a0b3f87e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d3ffee0>, body: {"security_group": {"name": " tempest-securitygroup -843941514 ", "description": "tempest-description-1679454974"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:00.163107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:00.514989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:00.515668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:00.516335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:00.516900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:00.517467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:00.541532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.542192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.542802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.543689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.544324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.544922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.579185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:00.595122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:00.627914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:00.634124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:00.689589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d8a3619-c256-44d7-916a-c4d2a0b3f87e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.603580 Aug 30 16:06:00.690529 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 317/565] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:00 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:00.707557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8c93e63-220f-4843-ae16-a6c1086c84c0 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:00.726062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-482c71ee-0f92-45ad-b800-c6fd8e23b445 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972665 Aug 30 16:06:00.729356 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 249/566] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:00.734012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecdfd15-1ebd-4fbb-ae11-99ea22767c09", "name": "network-vif-plugged", "status": "completed", "tag": "323b7e1a-7df5-428e-99e0-88470e924314"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:00.746319 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8c93e63-220f-4843-ae16-a6c1086c84c0 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039669 Aug 30 16:06:00.749235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 318/567] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:06:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:00.762618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:00.763396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:00.772633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.773932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.774642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.776130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.776887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.777493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.810935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.815790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.827002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.856961 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] Creating event network-vif-plugged:323b7e1a-7df5-428e-99e0-88470e924314 for instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 on n-h2-830883-28 Aug 30 16:06:00.873445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3a5505f4-c537-40be-9893-f24112268b4f req-da573f53-7559-49ff-957f-844b486c74e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142637 Aug 30 16:06:00.877800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 250/568] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:00.886394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:00.887103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:00.903664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.904093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.904807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.905817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:00.906392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:00.906821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:00.977249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:00.986794 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8388ae5-26d6-414e-a1a8-f1f78ef2361a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.235959 Aug 30 16:06:00.987574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 319/569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:00 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:00.994506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5e1f3c6-98ee-4d32-b86b-d686a643e6f5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d51faf0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.054214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5e1f3c6-98ee-4d32-b86b-d686a643e6f5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31" status: 200 len: 223 microversion: 2.1 time: 0.065207 Aug 30 16:06:01.054900 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 320/570] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:00 2022] GET /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 => generated 223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:01.059612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84286014-4152-499f-b8f9-3017bc474c8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.060459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84286014-4152-499f-b8f9-3017bc474c8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:01.134623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84286014-4152-499f-b8f9-3017bc474c8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:01.142905 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84286014-4152-499f-b8f9-3017bc474c8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1212 microversion: 2.1 time: 0.086774 Aug 30 16:06:01.143951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 321/571] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.161812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da76ad21-2bd7-4f7a-b6cc-02da2da3fada tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.193753 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da76ad21-2bd7-4f7a-b6cc-02da2da3fada tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043830 Aug 30 16:06:01.194840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 322/572] 10.222.0.47 () {58 vars in 1144 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.215478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.217506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:01.234517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.235115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.235978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.236894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.237601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.238211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.327118 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e985592-8521-4421-9cb4-475ff09945c5 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1615 microversion: 2.1 time: 0.447912 Aug 30 16:06:01.327690 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 251/573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:00 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1615 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.342037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d31955a-ce1d-49cf-866e-34d2f46e998c", "tag": "99639d14-a8a9-4469-bb89-63e6740a376c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:01.362988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.363472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.363896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.384729 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] Creating event network-changed:99639d14-a8a9-4469-bb89-63e6740a376c for instance 8d31955a-ce1d-49cf-866e-34d2f46e998c on n-h1-830883-28 Aug 30 16:06:01.400630 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-39a15483-7e06-4b60-a009-20ddc07b9e9c req-97f1076c-9690-46e2-a444-864e6ad40191 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071493 Aug 30 16:06:01.403804 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 252/574] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:01.414679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8cf6ae9-4676-4f98-8de1-b5636b0eb710 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d417d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.445960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:01.467858 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd90591a-2c55-4db7-a324-13ec554be34e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.270738 Aug 30 16:06:01.469005 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 323/575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.474831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5284c481-1555-469f-8025-d42c5b79215e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d51f940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.539391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5284c481-1555-469f-8025-d42c5b79215e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.069167 Aug 30 16:06:01.539964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 324/576] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.556551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e849792-396a-47c6-8ed2-b7e4a04e8689 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.567050 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e849792-396a-47c6-8ed2-b7e4a04e8689 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014522 Aug 30 16:06:01.569418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 325/577] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:01.582434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:01.583114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:01.592330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.593189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.593783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.594664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.595943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.596591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.714268 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d while it is in vm_state suspended Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Request method failure captured: Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d/action HTTP/1.1 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUtSMlMq2-lyNnMY7KdSe3zTih2Sb83taVucBREWAbzgKGFXQ6HcMgM-b6r9URgQjv4bVAwp2rHw1FXb9ZpNKdoxZ82jpNa1ZPHAOlsDaabkutn7_ZCOr0JbdUg3sXo-IItxtvYWcLK75lsjmOr-tiLXh-PmHAp-hlCykG-8hAM0fQ Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:06:01.716454 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}] Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 571bae4a95414d2cacab94b7952ba271 Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: {"migrate": {}} Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:06:01.718615 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'migrate' instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d while it is in vm_state suspended Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d', 'body': {'migrate': {}}} Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d in vm_state suspended. Cannot resize while the instance is in this state. Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.719409 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d while it is in vm_state suspended Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.720642 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.721818 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:01.721818 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:01.721818 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d while it is in vm_state suspended Aug 30 16:06:01.721818 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.723071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Returning 409 to user: Cannot 'migrate' instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d while it is in vm_state suspended {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:01.724053 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-641b1a4c-9f70-4f22-9d8e-724eb95710e9 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d/action" status: 409 len: 148 microversion: 2.1 time: 0.153647 Aug 30 16:06:01.725536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 326/578] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d/action => generated 148 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:01.744566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cabdb23-71dd-4c32-82c8-98b637b5038d tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.772485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cabdb23-71dd-4c32-82c8-98b637b5038d tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.045624 Aug 30 16:06:01.781365 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 327/579] 10.222.0.47 () {58 vars in 1148 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.781365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93d1b296-bac4-4f2c-98db-61378c3bf276 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93d1b296-bac4-4f2c-98db-61378c3bf276 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Request method failure captured: Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action HTTP/1.1 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 39 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUtSMlMq2-lyNnMY7KdSe3zTih2Sb83taVucBREWAbzgKGFXQ6HcMgM-b6r9URgQjv4bVAwp2rHw1FXb9ZpNKdoxZ82jpNa1ZPHAOlsDaabkutn7_ZCOr0JbdUg3sXo-IItxtvYWcLK75lsjmOr-tiLXh-PmHAp-hlCykG-8hAM0fQ Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:06:01.782848 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}] Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 571bae4a95414d2cacab94b7952ba271 Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: {"os-resetState": {"state": "invalid"}} Aug 30 16:06:01.784168 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b0fd3820-327c-43b8-8e18-bee3518d7840', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.784861 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:06:01.786618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 16:06:01.788312 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.788312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93d1b296-bac4-4f2c-98db-61378c3bf276 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:01.788312 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93d1b296-bac4-4f2c-98db-61378c3bf276 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action" status: 400 len: 144 microversion: 2.1 time: 0.009690 Aug 30 16:06:01.788312 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 328/580] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:01.800395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7d56edb-7e00-4086-9e60-9a00c077d48f tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.815729 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e7d56edb-7e00-4086-9e60-9a00c077d48f tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024291 Aug 30 16:06:01.824376 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 329/581] 10.222.0.47 () {58 vars in 1140 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:01.824376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a814615-7d38-4eb0-a281-2f80cc6b2b03 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a814615-7d38-4eb0-a281-2f80cc6b2b03 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Request method failure captured: Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action HTTP/1.1 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 31 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUtSMlMq2-lyNnMY7KdSe3zTih2Sb83taVucBREWAbzgKGFXQ6HcMgM-b6r9URgQjv4bVAwp2rHw1FXb9ZpNKdoxZ82jpNa1ZPHAOlsDaabkutn7_ZCOr0JbdUg3sXo-IItxtvYWcLK75lsjmOr-tiLXh-PmHAp-hlCykG-8hAM0fQ Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:06:01.827346 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}] Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 571bae4a95414d2cacab94b7952ba271 Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: {"os-resetState": {"state": 1}} Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:06:01.828990 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b0fd3820-327c-43b8-8e18-bee3518d7840', 'body': {'os-resetState': {'state': 1}}} Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 1 Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:01.830687 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 16:06:01.832315 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.834388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a814615-7d38-4eb0-a281-2f80cc6b2b03 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:01.836382 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a814615-7d38-4eb0-a281-2f80cc6b2b03 tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action" status: 400 len: 120 microversion: 2.1 time: 0.017957 Aug 30 16:06:01.840746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 330/582] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840/action => generated 120 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:01.849055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc92a944-ee73-403b-9236-f2e65f2d8bf2 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.859852 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc92a944-ee73-403b-9236-f2e65f2d8bf2 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017552 Aug 30 16:06:01.860383 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 331/583] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:01.867230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:01.869674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Failed to fetch instance by id 999 {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:06:01.870281 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 30 16:06:01.870877 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8cf6ae9-4676-4f98-8de1-b5636b0eb710 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31" status: 202 len: 0 microversion: 2.1 time: 0.463091 Aug 30 16:06:01.871523 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 253/584] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:01 2022] DELETE /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Request method failure captured: Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 37 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUtSMlMq2-lyNnMY7KdSe3zTih2Sb83taVucBREWAbzgKGFXQ6HcMgM-b6r9URgQjv4bVAwp2rHw1FXb9ZpNKdoxZ82jpNa1ZPHAOlsDaabkutn7_ZCOr0JbdUg3sXo-IItxtvYWcLK75lsjmOr-tiLXh-PmHAp-hlCykG-8hAM0fQ Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:06:01.875605 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e30d4c16e0904895ac9a5ee5bb4b61f6"}]}] Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e30d4c16e0904895ac9a5ee5bb4b61f6 Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2115330098 Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 571bae4a95414d2cacab94b7952ba271 Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2115330098-project-admin Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: {"os-resetState": {"state": "error"}} Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:06:01.876968 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 999 could not be found. Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:06:01.877743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:01.885942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e283b31-e440-4c35-ba28-a12daf1b7c2d tempest-ServersAdminNegativeTestJSON-2115330098 tempest-ServersAdminNegativeTestJSON-2115330098-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015779 Aug 30 16:06:01.889215 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 332/585] 10.222.0.47 () {60 vars in 1179 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:01.889215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d828040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.889661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69a1c3bf-9978-4a5f-91ae-be611ea07373 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.932347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69a1c3bf-9978-4a5f-91ae-be611ea07373 tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.056011 Aug 30 16:06:01.934498 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 254/586] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:01.940506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:01.942842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:01.958455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.959468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.959582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.960206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:01.960655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:01.963460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:01.968009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:01.968620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:01.969183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.969183 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 HTTP/1.1 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:01.981697 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.983790 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1d7aca8c-aa19-4f1b-9013-b5f613225c31'} Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:01.984791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:01.987173 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.988204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-d6cc4661-e138-4006-bcde-44144c0311bc'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0772ead-110a-44b6-9064-9bff261aee4f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31" status: 404 len: 194 microversion: 2.1 time: 0.104673 Aug 30 16:06:01.989616 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 333/587] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:01 2022] GET /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:02.006909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab195c32-74a1-41a8-9112-15c05b92a168", "tag": "6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:02.007727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:02.027925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.028545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.029604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.045958 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] Creating event network-changed:6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e for instance ab195c32-74a1-41a8-9112-15c05b92a168 on n-h2-830883-28 Aug 30 16:06:02.056500 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d95b5abb-97d6-4d18-8907-ba956d88d0d6 req-4d979030-6ef6-450c-ab5c-697308d382bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058028 Aug 30 16:06:02.057403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 334/588] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:02.065962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bfe5e97-2d94-4e88-95e4-1dd9d2511fcf tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.095899 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bfe5e97-2d94-4e88-95e4-1dd9d2511fcf tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.037091 Aug 30 16:06:02.096732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 335/589] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.102058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cf588eb-0f6d-43c9-8e7d-4234f5e92446 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d48e700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-16386575", "description": "tempest-description-56922240"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:02.155715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbb08947-f5ef-4af2-b14b-aad8a3db9c4c tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 204 len: 0 microversion: 2.1 time: 0.219906 Aug 30 16:06:02.160773 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 255/590] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:01 2022] DELETE /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:02.171549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.173378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:02.180233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.180782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.181229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.181934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.182417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.182846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.336361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:02.345972 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da998a9b-c56e-4222-8ff8-9cdfa955326f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.185583 Aug 30 16:06:02.346780 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 256/591] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.358729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-629674f7-a1c9-4ecd-b8d5-6170255122dc tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.367668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-629674f7-a1c9-4ecd-b8d5-6170255122dc tempest-FlavorsV2TestJSON-2101026600 tempest-FlavorsV2TestJSON-2101026600-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019851 Aug 30 16:06:02.368660 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 257/592] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:02.383366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.383986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:02.385752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1cf588eb-0f6d-43c9-8e7d-4234f5e92446 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.287788 Aug 30 16:06:02.386524 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 336/593] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:02 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:02.390452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.391180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.391814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.392703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.393346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.394048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.404365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.406204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:02.416571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.417351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.417929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.418806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.419455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.420046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.489303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:02.498514 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6e21f5b-ae31-4dfa-8392-824dab939175 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1264 microversion: 2.1 time: 0.102486 Aug 30 16:06:02.499083 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 337/594] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.503752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee3f08fb-5937-4be9-9a03-8b42860efeca tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d578820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-445238257", "description": "tempest-description-1264553175"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:02.570269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:02.579419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f78fbff0-2779-48fa-bd9a-cf2f2e7ca183 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1468 microversion: 2.1 time: 0.200372 Aug 30 16:06:02.579981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 258/595] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1468 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.585710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.586519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:02.592975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.593649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.594451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.595384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.595839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.596257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.665182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee3f08fb-5937-4be9-9a03-8b42860efeca tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.164871 Aug 30 16:06:02.666441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 338/596] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:02.681355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-396cd665-5a66-4254-beaf-c4843cfd50b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d28a8b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:02.730470 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-396cd665-5a66-4254-beaf-c4843cfd50b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.062789 Aug 30 16:06:02.731027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 339/597] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.738742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4bef5c55-e4c4-4f8a-b1c6-4880bf867db4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d28a4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1023316985", "description": "tempest-description-1400221400"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:02.748539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:02.757503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0bd83597-9ae3-4014-a566-43a63e5d5e23 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.176033 Aug 30 16:06:02.758093 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 259/598] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:02.914758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a", "name": "network-vif-plugged", "status": "completed", "tag": "4aab3995-e449-4499-88f5-8199af975e20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:02.925397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:02.925846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:02.926290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:02.937972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4bef5c55-e4c4-4f8a-b1c6-4880bf867db4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.205921 Aug 30 16:06:02.938573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] Creating event network-vif-plugged:4aab3995-e449-4499-88f5-8199af975e20 for instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a on n-h1-830883-28 Aug 30 16:06:02.938853 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 340/599] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:02 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:02.947133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b9ac23e7-3a83-4ee0-9c89-e8b9ab78ea0a req-d79a60d4-ac0c-4cf0-8146-3ce4c1861c53 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Aug 30 16:06:02.947133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 260/600] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:06:02.953387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44333cba-ceb3-43d1-b26f-07d3fd35d41e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d417310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.248087 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44333cba-ceb3-43d1-b26f-07d3fd35d41e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 1828 microversion: 2.1 time: 0.299612 Aug 30 16:06:03.248733 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 261/601] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:06:02 2022] GET /compute/v2.1/os-security-groups => generated 1828 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:03.264250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48cbb313-e7f8-4d38-a15e-2543fc5fbe13 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d50d670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.368454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.370227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:03.377387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.378109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.378569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.379582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.380331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.381517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.400969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:03.467231 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48cbb313-e7f8-4d38-a15e-2543fc5fbe13 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9" status: 202 len: 0 microversion: 2.1 time: 0.207836 Aug 30 16:06:03.467814 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 341/602] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:03 2022] DELETE /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:03.477377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d21f160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.504456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:03.505269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:03.506762 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.506762 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9 HTTP/1.1 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:03.508742 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.510056 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'eb88db1e-a72d-4d1e-871e-364ef9325dd9'} Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.510921 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:03.512250 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.515666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-750ee948-b12d-4d5b-a804-942683c47cf3'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a89e80d7-51a8-4e39-8b7f-6a5f5cd02321 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9" status: 404 len: 194 microversion: 2.1 time: 0.038142 Aug 30 16:06:03.518102 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 342/603] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:03.535527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-286b5a48-c2ef-45a2-9a06-1f9299392c6a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d3b5ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.591762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:03.603932 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa553421-9ed6-45af-83ef-71f6a87e5b82 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1314 microversion: 2.1 time: 0.240099 Aug 30 16:06:03.604504 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 262/604] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:03.609216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.615171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:03.623832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.624327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.624980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.625767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.626255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.626758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.704224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:03.712817 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9dbdadd2-2347-428d-93f7-c6610ef7ae02 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1264 microversion: 2.1 time: 0.107258 Aug 30 16:06:03.713298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 263/605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1264 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:03.718104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.718936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:03.725624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.726332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.726800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.727792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.728249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.728673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.792920 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-286b5a48-c2ef-45a2-9a06-1f9299392c6a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b" status: 202 len: 0 microversion: 2.1 time: 0.276883 Aug 30 16:06:03.793676 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 343/606] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:03 2022] DELETE /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:03.798611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-920700b4-e483-418b-bd62-dd3808e26268 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d28aa60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.847272 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-920700b4-e483-418b-bd62-dd3808e26268 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.052483 Aug 30 16:06:03.852154 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 344/607] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:03.858683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.860542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:03.868046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.868616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.869112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.870486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:03.871080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:03.871533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:03.901233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:03.913031 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2531c99e-7b7c-4937-8e7d-cfd99dd682e5 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1468 microversion: 2.1 time: 0.198706 Aug 30 16:06:03.913610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 264/608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:03.918846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d400d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:03.972700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:03.973385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 3c046600-721f-4e1b-a844-005a2ff9b83b not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:03.973998 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.973998 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b HTTP/1.1 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:03.979685 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.981233 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3c046600-721f-4e1b-a844-005a2ff9b83b'} Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.982163 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:03.983559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.985118 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] Aug 30 16:06:03.987836 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:03.990939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:03.990939 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-a07820d7-d347-4049-af1f-e5d7c1a4730a'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:03.990939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76caabc1-39f9-47f6-b275-3aff9d0eb52c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b" status: 404 len: 194 microversion: 2.1 time: 0.075159 Aug 30 16:06:03.990939 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 265/609] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:03.998779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ab4eb3d-a345-4cd8-b701-c423ccd325d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d2f90d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:04.025258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:04.036006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0fae9200-f28d-4058-85eb-4b270f135aaf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.182777 Aug 30 16:06:04.036574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 345/610] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:03 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:04.360736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ab4eb3d-a345-4cd8-b701-c423ccd325d4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2" status: 202 len: 0 microversion: 2.1 time: 0.365672 Aug 30 16:06:04.361638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 266/611] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:03 2022] DELETE /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:06:04.371941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d58db80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:04.413701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:04.414337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:04.414908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.414908 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2 HTTP/1.1 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:04.417018 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.418277 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '3a669b20-c459-40bc-a4d5-eab0021dd0e2'} Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:04.419219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:04.420288 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.421500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-adb97a00-4d48-4b8b-b4eb-945da1221ca4'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ff6ba11-d564-4997-a252-581f7d221812 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2" status: 404 len: 194 microversion: 2.1 time: 0.052576 Aug 30 16:06:04.424677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 346/612] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:04 2022] GET /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:06:04.430199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c43e9c0-67b9-4902-856b-5b703d15d3ea tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d3a3e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:04.625073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:04.625760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:04.638071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:04.638620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:04.639054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:04.640268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:04.642460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:04.642895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:04.925502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:04.941257 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f4eb0d8-40ab-4d79-b883-6a0166db0c65 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1464 microversion: 2.1 time: 0.319021 Aug 30 16:06:04.942125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 347/613] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:04 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:04.949081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:04.950393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:04.962100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:04.963754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:04.963754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:04.965417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:04.966897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:04.968078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.106018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:05.128249 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-779aa71b-1c94-488a-bba0-9974b200a413 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1270 microversion: 2.1 time: 0.184509 Aug 30 16:06:05.131716 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 348/614] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:04 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:05.148674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34f4800c-fb44-4b85-ba64-a792d73c04c9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d28ad30>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:05.232698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34f4800c-fb44-4b85-ba64-a792d73c04c9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.097308 Aug 30 16:06:05.235018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 349/615] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:05 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:05.252129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:05.265612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:05.278285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.278918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.279607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.283379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.283869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.284309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.397967 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c43e9c0-67b9-4902-856b-5b703d15d3ea tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.974333 Aug 30 16:06:05.399162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 267/616] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:06:04 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:05.404222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:05.405194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:05.422530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.426899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.427751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.428743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.430743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.431890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.719495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:05.732347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0b848e6-40e9-4eda-b23e-16441f2e816c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1463 microversion: 2.1 time: 0.331826 Aug 30 16:06:05.737288 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 268/617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:05 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1463 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:05.752667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:05.752667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:05.772728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.773265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.773704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.776244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:05.776716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:05.778424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:05.841916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:05.846861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:05.859528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-138c28b0-5458-4515-b12e-4fde235ce01e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1468 microversion: 2.1 time: 0.622473 Aug 30 16:06:05.861604 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 350/618] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:05 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1468 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:05.871389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b11a0941-7c2a-42cc-85b4-4a7d7717c6bc tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35e596f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1626289025", "description": "tempest-description-728235442"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:06.717180 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b11a0941-7c2a-42cc-85b4-4a7d7717c6bc tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.852678 Aug 30 16:06:06.718690 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 351/619] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:06.723810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2077355045", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "930eb535-b9f1-47f0-ba97-086a35fa1f9d"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:06.813194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:06.913970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:06.929165 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5dd72847-f445-400f-9afd-35fc38c4ec01 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 1.188050 Aug 30 16:06:06.929807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 269/620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:05 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:06.963828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:06.964819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:06.986340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:06.992639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:06.993378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:06.995778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:06.996439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:06.997684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.193795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:07.207642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ae923cf-56f7-458a-87e5-f439f4044b9b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.273387 Aug 30 16:06:07.210241 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 270/621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:06 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:07.234217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34b94db3-58ce-4310-ba06-f753a436bd75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d547e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:07.296750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:07.297762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:07.298429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:07.299130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:07.299706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:07.318436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:07.319420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:07.320023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.320913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:07.321532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:07.322130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.355569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34b94db3-58ce-4310-ba06-f753a436bd75 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.143012 Aug 30 16:06:07.358626 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 271/622] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:07 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:07.374904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:07.377457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d", "name": "network-vif-deleted", "tag": "0b9c98e7-c1ee-480d-9480-f41e13132084"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:07.380680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Getting quotas for user b9b2f53d6296454faac1c0c7a45860f0 and project 42f74557b03a43d98507b0328fcae35b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:07.395325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:07.398620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:07.409631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:07.411922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:07.413881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.450908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] Creating event network-vif-deleted:0b9c98e7-c1ee-480d-9480-f41e13132084 for instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d on n-h2-830883-28 Aug 30 16:06:07.463645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-dde1c340-a56f-4cf5-87b3-2710b1a29f0f req-73ca376a-bd7b-4757-837b-0682db114860 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103484 Aug 30 16:06:07.472771 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 272/623] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:07.482755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24858d3e-f685-4197-a394-c8b6adeb591f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35d2f81f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071682911", "description": "tempest-description-1870808549"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:07.486133 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b955209f-c248-456b-ac85-f6d1f0585b41 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766075 Aug 30 16:06:07.488636 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 352/624] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:07.495301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:07.496088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:07.503396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:07.504294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:07.504905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.506579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:07.507405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:07.508179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:07.675043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:07.695494 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2dce230-a5b0-4d77-a730-70e6158106e0 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 200 len: 1426 microversion: 2.1 time: 0.205509 Aug 30 16:06:07.701407 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 353/625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:07 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 1426 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:07.725729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3548b50-a259-4bef-8f8a-cd30469ed172 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:07.733744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3548b50-a259-4bef-8f8a-cd30469ed172 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:07.749897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:07.948255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3548b50-a259-4bef-8f8a-cd30469ed172 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:07.957310 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3548b50-a259-4bef-8f8a-cd30469ed172 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1214 microversion: 2.1 time: 0.254825 Aug 30 16:06:07.958277 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 354/626] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:07 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:07.987225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:07.987706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:08.010751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:08.011252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:08.011696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:08.012410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:08.012871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:08.013298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:08.275329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24858d3e-f685-4197-a394-c8b6adeb591f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.800904 Aug 30 16:06:08.276501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 273/627] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:08.281287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:08.282017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:08.313066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:08.313868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:08.315466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:08.319412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:08.320149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:08.321048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:08.601606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:08.613853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c020d2a-330f-46bc-acba-f977b43f6776 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.652840 Aug 30 16:06:08.630327 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 355/628] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:07 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:08.647930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94ec534e-706a-4ff4-a46a-e67034e795be tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d50d3a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:08.709553 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94ec534e-706a-4ff4-a46a-e67034e795be tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.077069 Aug 30 16:06:08.710512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 356/629] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:08 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:08.716309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1689970720", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "a5ae5f5f-6836-4d2c-89f2-663c71d3ac24"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:08.830290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] validate_networks() for [('a5ae5f5f-6836-4d2c-89f2-663c71d3ac24', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:09.275797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:09.285539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c781fe39-80cc-4e98-88dc-9ed4156f65a3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 1.007813 Aug 30 16:06:09.286831 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 274/630] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:08 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:09.296080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:09.311729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:09.319507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.320451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.321065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.321993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.322731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.323335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.339395 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] HTTP exception thrown: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Request method failure captured: Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d HTTP/1.1 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUsg3Jjrdp1LmG5_y9vrNhw-lyoIiITjj6G9Is0Zv43RIDdQIbDmt1pqgM2hgG2mDgzS9ZRcvail8nVEhvGGHFvR5pbLOY770FQR6H4-st51_v_8BvXMa5pf6Fddss22Oyleruc07ROFpsc645ox3D2XfH-0n8qzfwkrPdiCsxAWK4 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 712205074da447cd82dc1976c15ed17a Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:09.342556 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/712205074da447cd82dc1976c15ed17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_712205074da447cd82dc1976c15ed17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/712205074da447cd82dc1976c15ed17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/712205074da447cd82dc1976c15ed17a"}]}] Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 712205074da447cd82dc1976c15ed17a Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAdminNegativeTestJSON-1089123303-project Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db82b0783b824658ae5524504a7f71f2 Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1089123303-project Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. Aug 30 16:06:09.344115 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d'} Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:09.345029 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. Aug 30 16:06:09.346833 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:09.349176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Returning 404 to user: Instance 5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:09.350347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6b29d01-ad8b-408e-8da9-3ff741022b7d tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d" status: 404 len: 111 microversion: 2.1 time: 0.060814 Aug 30 16:06:09.354511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 275/631] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:09 2022] GET /compute/v2.1/servers/5e9ffdb0-1643-433f-b0c3-4b6b1fe5448d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:09.360222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:09.361090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:09.378530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.381493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.382631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.387031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.389360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.390162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.686883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:09.725765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61488c35-dd1e-48c6-9e6e-82325d6d057c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1266 microversion: 2.1 time: 0.366971 Aug 30 16:06:09.735248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 276/632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:09 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:09.763392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:09.764198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:09.775033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:09.776320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:09.776810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:09.777224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:09.779633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.780781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.780781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.781260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.781718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.782148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.787933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:09.845389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.845949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.846431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.857892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:09.859975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:09.860456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:09.874658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:09.939514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Getting quotas for project 2cb257ea23314fb1a37c24e9d58368b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:09.954880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Getting quotas for user 7460aaf7caf743c7a16249dc67123b41 and project 2cb257ea23314fb1a37c24e9d58368b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:10.000675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:10.005015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:10.134404 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d27e14e-7bd3-4a96-808b-1d45f1069b3f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417025 Aug 30 16:06:10.135157 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 357/633] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:10.141988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6525efac-8391-4001-930b-e2b9751441a6 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 204 len: 0 microversion: 2.1 time: 0.398864 Aug 30 16:06:10.142673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 277/634] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:09 2022] DELETE /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:10.163539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:10.164199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:10.164456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48755d48-cecf-489d-85e5-03916f0608ec tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d4005e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:10.190922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.191431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.191869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.197110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.198009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.198870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.309333 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48755d48-cecf-489d-85e5-03916f0608ec tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.160089 Aug 30 16:06:10.318735 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 278/635] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:10 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:10.327370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:10.345164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.345651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.346086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.388029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] Creating event network-changed:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h2-830883-28 Aug 30 16:06:10.393615 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-77bc880f-fbad-441a-a9be-bfd194685c9d req-0e058670-bb25-45e5-a55c-7ee494bbdf42 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079121 Aug 30 16:06:10.394544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 279/636] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:10.412808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-267e25f7-f5e8-49e0-b585-7c9f31ac4438 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:10.413515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-267e25f7-f5e8-49e0-b585-7c9f31ac4438 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:10.554728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:10.614450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:10.648206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-267e25f7-f5e8-49e0-b585-7c9f31ac4438 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:10.656419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-267e25f7-f5e8-49e0-b585-7c9f31ac4438 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1216 microversion: 2.1 time: 0.260700 Aug 30 16:06:10.663324 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 280/637] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:10 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1216 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:10.670640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:10.671256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:10.706097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.710009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.710497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.716827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.717399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.719587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.859120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:10.887005 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e642d5c4-ec1e-4c7d-b5b9-be3bb8dd8a06 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.736059 Aug 30 16:06:10.889628 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 358/638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:10 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:10.899754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:10.901650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:10.921939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.923357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.924777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:10.926191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:10.928719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:10.932566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.233070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:11.244347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11e8803e-bf7b-46b1-b9d2-d63eede18e84 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1477 microversion: 2.1 time: 0.578933 Aug 30 16:06:11.260805 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 281/639] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:10 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:11.266094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:11.268493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:11.278645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.279565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.280353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.281346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.282002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.282689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.385541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:11.394739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aed401ec-be6e-41e5-8af2-21308352a72f tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1284 microversion: 2.1 time: 0.132406 Aug 30 16:06:11.395858 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 282/640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:11 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:11.407774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d496a9d6-cd3a-49d5-bd78-64024f9295f4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2f8820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:11.482983 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d496a9d6-cd3a-49d5-bd78-64024f9295f4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.084940 Aug 30 16:06:11.484543 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 283/641] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:11 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:11.683750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:11.684661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:11.691556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.696698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.697300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.698992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.699579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.700273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.846260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:11.854945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:11.861297 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-52613678-538e-4dc7-a8d4-81a88078666d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.969309 Aug 30 16:06:11.861876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 359/642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:10 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:11.866411 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8949f103-30bc-4a40-8e27-4167c920614b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1212 microversion: 2.1 time: 0.184025 Aug 30 16:06:11.867212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 284/643] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:11 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:11.908972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:11.909586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:11.928719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.929328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.929930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:11.930876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:11.931411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:11.931902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.267943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:12.268552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:12.276404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.281994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.282906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.283779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.290536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.291042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.448123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:12.458009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14b5be9e-c030-4439-a74d-230944e61b11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.552782 Aug 30 16:06:12.460779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 360/644] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:11 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:12.475027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:12.475971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:12.483085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.483940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.484462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.485267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.485826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.486412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.530841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db82b0783b824658ae5524504a7f71f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712205074da447cd82dc1976c15ed17a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:12.556596 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45731494-9f2b-481c-9b40-00ad0c4ae57e tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 200 len: 1477 microversion: 2.1 time: 0.292365 Aug 30 16:06:12.557535 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 285/645] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:12 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:12.562090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bab8f92a-f205-459b-9172-a79e62c50788 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2b1940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:12.615658 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bab8f92a-f205-459b-9172-a79e62c50788 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.051443 Aug 30 16:06:12.616321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 286/646] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:12 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:12.732042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:12.741425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5fa402fc-4820-4f51-87c7-42218ea080c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1272 microversion: 2.1 time: 0.273784 Aug 30 16:06:12.747580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 361/647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:12 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:12.883955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:12.884735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:12.891492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:12.892113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:12.906391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.909124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.909902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.911358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.912119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.912780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.917032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.918190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:12.921866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.924890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:12.928594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:12.928969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.116371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:13.126950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d169a8d-71d9-411f-834b-952acb045a91 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1212 microversion: 2.1 time: 0.239094 Aug 30 16:06:13.132120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 362/648] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:12 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:13.137079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fd3820-327c-43b8-8e18-bee3518d7840", "name": "network-vif-deleted", "tag": "782494a2-83d6-4c15-8dd5-db8e8334028b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:13.168117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.173040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.173752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.209587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] Creating event network-vif-deleted:782494a2-83d6-4c15-8dd5-db8e8334028b for instance b0fd3820-327c-43b8-8e18-bee3518d7840 on n-h1-830883-28 Aug 30 16:06:13.223495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-121b8520-2610-4252-a890-c4b1dc19aefe req-82c31cec-2e89-42a3-a0e5-a996db9025aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086954 Aug 30 16:06:13.224534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 363/649] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:13.229927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab195c32-74a1-41a8-9112-15c05b92a168", "name": "network-vif-plugged", "status": "completed", "tag": "6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:13.279883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.280377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.280812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.316626 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] Creating event network-vif-plugged:6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e for instance ab195c32-74a1-41a8-9112-15c05b92a168 on n-h2-830883-28 Aug 30 16:06:13.329993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-01f13947-bf4b-413d-8405-c89b8eba9d0c req-c0506f0e-0814-4528-b63b-f0afd1a90568 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103848 Aug 30 16:06:13.337605 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 364/650] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:13.485196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:13.490836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:13.515928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.520037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.520531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.522532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.533322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.533322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.263413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:14.288689 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f9d9331-b993-4e7e-859e-3895862bd54d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 1.406899 Aug 30 16:06:14.289559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 287/651] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:12 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:14.299062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:14.317352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] [instance: b0fd3820-327c-43b8-8e18-bee3518d7840] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:14.356219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.369740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.376220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.382333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.382897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.383338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.397329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:14.426243 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-105ef7ce-e8ee-425d-80b9-54bea4a1b78c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.945534 Aug 30 16:06:14.426871 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 365/652] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:13 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:14.451160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cec28982-d3d3-4047-b2a1-9c95497e3dea tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d242af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:14.461501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] HTTP exception thrown: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Request method failure captured: Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 HTTP/1.1 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUsg3Jjrdp1LmG5_y9vrNhw-lyoIiITjj6G9Is0Zv43RIDdQIbDmt1pqgM2hgG2mDgzS9ZRcvail8nVEhvGGHFvR5pbLOY770FQR6H4-st51_v_8BvXMa5pf6Fddss22Oyleruc07ROFpsc645ox3D2XfH-0n8qzfwkrPdiCsxAWK4 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 712205074da447cd82dc1976c15ed17a Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:14.469420 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/712205074da447cd82dc1976c15ed17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_712205074da447cd82dc1976c15ed17a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/712205074da447cd82dc1976c15ed17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/712205074da447cd82dc1976c15ed17a"}]}] Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 712205074da447cd82dc1976c15ed17a Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1089123303 Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAdminNegativeTestJSON-1089123303-project Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db82b0783b824658ae5524504a7f71f2 Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1089123303-project Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. Aug 30 16:06:14.471022 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b0fd3820-327c-43b8-8e18-bee3518d7840'} Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:14.471860 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. Aug 30 16:06:14.473245 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:14.481543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] Returning 404 to user: Instance b0fd3820-327c-43b8-8e18-bee3518d7840 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:14.482432 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc8261ac-cef8-48a7-a70e-7d6dae5a5ba9 tempest-ServersAdminNegativeTestJSON-1089123303 tempest-ServersAdminNegativeTestJSON-1089123303-project] 10.222.0.47 "GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840" status: 404 len: 111 microversion: 2.1 time: 0.189686 Aug 30 16:06:14.498746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 288/653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:14 2022] GET /compute/v2.1/servers/b0fd3820-327c-43b8-8e18-bee3518d7840 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:14.514014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:14.518106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:14.532771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:14.534276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.534928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.535371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.536148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.546370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.546849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.566895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:14.574329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cec28982-d3d3-4047-b2a1-9c95497e3dea tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.141230 Aug 30 16:06:14.575526 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 366/654] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:14 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:14.585183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:14.586196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:14.605638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.606475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.607077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.607948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.610158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.610791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.742154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:14.775630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:14.783611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40f08567-d7a9-442c-9f8f-9b9138ff1972 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1268 microversion: 2.1 time: 0.206768 Aug 30 16:06:14.784613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 367/655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:14 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:14.785985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2cb7da02-98fe-4928-9b63-e2a155d36503 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.286041 Aug 30 16:06:14.798189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 289/656] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:14 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:15.313640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:15.314289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:15.324776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.325481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.325925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.326791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.327130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.327817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.465954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:15.467428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:15.481883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.482548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.482922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.483655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.486680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.487796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.753870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:15.765985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5bf06bf-0717-4f40-984f-73f917027e86 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.456059 Aug 30 16:06:15.775534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 368/657] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:15 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:15.817069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f4431027-c30d-4b20-bbc6-c961201f1e04 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d48e310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:15.898533 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f4431027-c30d-4b20-bbc6-c961201f1e04 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.119955 Aug 30 16:06:15.901454 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 369/658] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:15 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:15.918600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:15.919236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:15.953920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.954473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.954925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.955656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.956124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.956563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.143990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.162822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7848e57-c965-4916-8718-214171883028 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1286 microversion: 2.1 time: 0.257757 Aug 30 16:06:16.190838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 370/659] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:15 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:16.199718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:16.200946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:16.211736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.212476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.213213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.214271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.215416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.216169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.383248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.405053 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77c85250-edd7-442c-8a84-2144b855d675 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1311 microversion: 2.1 time: 0.952342 Aug 30 16:06:16.426993 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 290/660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:15 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1311 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:16.432969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6c88e14-f05a-4870-bafe-da955a6fd7c4", "tag": "dd0baae3-1a1f-4b7a-8278-6deb36bff2cf"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:16.487021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.490004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.491646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.535164 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] Creating event network-changed:dd0baae3-1a1f-4b7a-8278-6deb36bff2cf for instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 on n-h1-830883-28 Aug 30 16:06:16.554944 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-98ddb220-0fbe-4574-b198-0fda079bb2f8 req-d0cea9cb-8442-458d-86fe-fb7670027f27 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125419 Aug 30 16:06:16.557325 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 291/661] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:16.798480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:16.800252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:16.825176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.831396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.832093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.832949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.836158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.838619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.839505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.854016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07cc4263-5260-468e-afcc-ee5e86789032 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.653933 Aug 30 16:06:16.857501 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 371/662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:16 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:16.913753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43cb3ef7-46e7-4415-820e-a48b907f3519 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d3ff1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:16.981660 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43cb3ef7-46e7-4415-820e-a48b907f3519 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.072234 Aug 30 16:06:16.983207 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 372/663] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:16 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:17.188292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:17.189297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:17.203105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.203893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.204480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.205511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.209503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.214643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.293132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:17.308379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f273e06-4d06-4266-8966-d4dec1441407 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.512677 Aug 30 16:06:17.324397 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 292/664] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:16 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:17.626818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1520641978", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "23f2e904-2767-475c-acd9-99e9d18555dc"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:17.744120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] validate_networks() for [('23f2e904-2767-475c-acd9-99e9d18555dc', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:17.812285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:17.827859 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02e9d6cf-16ab-4b99-a8e2-4b87bc8b89e0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1274 microversion: 2.1 time: 0.639220 Aug 30 16:06:17.828873 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 373/665] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:17 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1274 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:17.845336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:17.848978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:17.860658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.865814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.866420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.867413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.868093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.868777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.220220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:18.229438 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9da30294-4d19-44f8-bc37-5e58e4e9a6bd tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1493 microversion: 2.1 time: 0.398891 Aug 30 16:06:18.230004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 374/666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:17 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1493 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:18.239182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:18.246263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:18.252557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.256355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.257012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.257878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.262346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.262801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.560021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:18.568536 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b1a08463-6ac8-491c-b680-ce2279ad0991 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.337318 Aug 30 16:06:18.569206 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 375/667] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:18 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:18.578779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa76bba4-3a67-4f90-a596-2248b9b32528 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2423a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:18.636531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa76bba4-3a67-4f90-a596-2248b9b32528 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.061773 Aug 30 16:06:18.638066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 376/668] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:18 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:18.644117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:18.644981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:18.652598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.653391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.654012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.655134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.655940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.656560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.681405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:18.802789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:18.803942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:18.804645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:18.805300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:18.806038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:18.829786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.834258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.835039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.836065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.836776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.837623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.889340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Getting quotas for project 8ea1726b3b30410ab93a0407a77df7a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:18.921638 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1aca2df1-ec06-4c60-90b3-eda96319a7fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1646 microversion: 2.1 time: 0.282253 Aug 30 16:06:18.922978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Getting quotas for user b31b992df85c411d9e93bec3b8c474d6 and project 8ea1726b3b30410ab93a0407a77df7a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:18.929544 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 377/669] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:18 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1646 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:18.943246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:18.945335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:18.950649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:18.958280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:18.965282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.967303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.967771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:18.970892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:18.973530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:18.974757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.055657 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a00ec3aa-2e13-4701-bd94-18f39eceea6f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741138 Aug 30 16:06:19.056730 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 293/670] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:19.062346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:19.063528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:19.072328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.072995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.073599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.074538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.075139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.075748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.531679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:19.547577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b46760c2-09e3-44e6-8e81-4fc576ce96bf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.615295 Aug 30 16:06:19.551411 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 378/671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:18 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:19.563072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:19.564302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:19.565101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:19.576711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52ec4a3a-daa1-4ac2-b78a-e37c4f33c19f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.517223 Aug 30 16:06:19.578865 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 294/672] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:19 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:19.587527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.588933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5eaa7109-166b-4f6b-b4db-1028fe7422ed tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:19.589368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.590395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.591200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5eaa7109-166b-4f6b-b4db-1028fe7422ed tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:19.594082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.594870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.598054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.684095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5eaa7109-166b-4f6b-b4db-1028fe7422ed tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:19.722786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5eaa7109-166b-4f6b-b4db-1028fe7422ed tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1224 microversion: 2.1 time: 0.141339 Aug 30 16:06:19.725644 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 295/673] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:19 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:19.893854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:19.979729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=16 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:20.208775 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6889ff4d-8dc3-4a7a-99c4-1348878a35c9 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.481084 Aug 30 16:06:20.215929 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 296/674] 10.222.0.47 () {58 vars in 1128 bytes} [Tue Aug 30 16:06:19 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:06:20.228665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.229489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:20.250236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.254100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.255353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.258743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.260135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.262051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.342291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5cfa1ab0-5a82-4f8d-863e-efa935f955fe tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1646 microversion: 2.1 time: 0.788836 Aug 30 16:06:20.343504 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 379/675] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:19 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1646 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:20.350831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20afb10c-92e9-4222-a03b-a96193ba2ada tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d3b5ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.458994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20afb10c-92e9-4222-a03b-a96193ba2ada tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.113852 Aug 30 16:06:20.468011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 380/676] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:20.480117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "name": "network-vif-plugged", "status": "completed", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:20.505525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.511093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.511627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.527667 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] Creating event network-vif-plugged:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h2-830883-28 Aug 30 16:06:20.533772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-135f8491-27d9-4595-a1cd-7ac3f6288b4d req-91e8997a-940f-437e-8b8e-47c360bd3fb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063905 Aug 30 16:06:20.535011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 381/677] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:20.541578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91548c73-d40b-404d-ac2c-b1e970b9866e", "tag": "357650ce-f108-462d-a1ca-c78a7abbcea7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:20.555400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.556741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.557445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.576181 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] Creating event network-changed:357650ce-f108-462d-a1ca-c78a7abbcea7 for instance 91548c73-d40b-404d-ac2c-b1e970b9866e on n-h2-830883-28 Aug 30 16:06:20.589756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-39958820-dc91-406e-812c-46a8d86fd79c req-01421632-6554-4b91-b132-dd6627b56976 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047796 Aug 30 16:06:20.595052 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 382/678] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:20.602089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1e8dbe8-3d2d-48a7-8db2-39d493ede73d tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Calling method '.version_select at 0x7fd35d472280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.678792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e1e8dbe8-3d2d-48a7-8db2-39d493ede73d tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] HTTP exception thrown: Image not found. Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1e8dbe8-3d2d-48a7-8db2-39d493ede73d tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Request method failure captured: Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjV7CHA2yS5a5FbvoUeegBNuamoPyRqwdaXhalZGaWVjrg1IhLIVCt93SvJkpjNnZqj-s_xQattLwlDRA-ytKxsR0S28dctIXJv0ypr2lXWgX8r-JpXXJ7cDNcYuCmEzlDxN4f41_nlUdsHo_CMk_2ENzQ1sgS_ll97PbPJopsI7SCY Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:20.693306 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}] Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f345bd5f2d394961ad1dc5df2c7a622b Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '-1'} Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:20.694937 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.695934 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:20.697172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:06:20.698452 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.701384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1e8dbe8-3d2d-48a7-8db2-39d493ede73d tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:20.702878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1e8dbe8-3d2d-48a7-8db2-39d493ede73d tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.105455 Aug 30 16:06:20.704588 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 383/679] 10.222.0.47 () {58 vars in 1134 bytes} [Tue Aug 30 16:06:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:20.712914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.716966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.718598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.719659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.721039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.721860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.722553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.753110 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-216e06be-e440-4008-b954-7c0eb2a61c10 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047258 Aug 30 16:06:20.754385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 384/680] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:20.765314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.769604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:20.777636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.778596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.779284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.780347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.781071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.782058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.910372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:20.924802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3953f99-cc66-4f76-a36f-63de012bec62 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.707563 Aug 30 16:06:20.925997 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 297/681] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:20.944893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.945744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:20.952474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.952968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.956127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.958645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.962084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.962807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.056113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:21.065387 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a5bfc36-f564-43a6-af7c-109eec1e78b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.309071 Aug 30 16:06:21.090064 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 385/682] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:21.097882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-015e86ae-c63e-45b2-83ac-f67ff7fe84c3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Calling method '.version_select at 0x7fd35d3ffca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.133476 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-015e86ae-c63e-45b2-83ac-f67ff7fe84c3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] HTTP exception thrown: Image not found. Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-015e86ae-c63e-45b2-83ac-f67ff7fe84c3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Request method failure captured: Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/f4475066-d84f-4c80-8c52-07e76556d98j HTTP/1.1 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjV7CHA2yS5a5FbvoUeegBNuamoPyRqwdaXhalZGaWVjrg1IhLIVCt93SvJkpjNnZqj-s_xQattLwlDRA-ytKxsR0S28dctIXJv0ypr2lXWgX8r-JpXXJ7cDNcYuCmEzlDxN4f41_nlUdsHo_CMk_2ENzQ1sgS_ll97PbPJopsI7SCY Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:21.135642 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}] Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f345bd5f2d394961ad1dc5df2c7a622b Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'f4475066-d84f-4c80-8c52-07e76556d98j'} Aug 30 16:06:21.136919 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f4475066-d84f-4c80-8c52-07e76556d98j to delete Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.137778 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f4475066-d84f-4c80-8c52-07e76556d98j could not be found. Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:21.139118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:06:21.140265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.143318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-015e86ae-c63e-45b2-83ac-f67ff7fe84c3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:21.144529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-015e86ae-c63e-45b2-83ac-f67ff7fe84c3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/f4475066-d84f-4c80-8c52-07e76556d98j" status: 404 len: 62 microversion: 2.1 time: 0.052917 Aug 30 16:06:21.146239 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 386/683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:21 2022] DELETE /compute/v2.1/images/f4475066-d84f-4c80-8c52-07e76556d98j => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:21.154642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.155672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:21.165966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.166591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.167123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.167919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.168456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.168961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.262057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:21.266817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:21.276319 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dcc33021-7a02-49c8-bc49-8c0b8d9a9a2f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.348988 Aug 30 16:06:21.276513 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a7a1c51-d2e8-4eba-a4de-dea7e80b80eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1276 microversion: 2.1 time: 0.128669 Aug 30 16:06:21.276951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 387/684] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:21 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:21.293867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:21.294787 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 298/685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:21.299869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:21.302187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ecca843-3c2b-4610-80ad-70be69e7b2b3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Calling method '.version_select at 0x7fd35d2b1dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.324788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.324938 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4ecca843-3c2b-4610-80ad-70be69e7b2b3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] HTTP exception thrown: Image not found. Aug 30 16:06:21.325687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.326390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.328034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ecca843-3c2b-4610-80ad-70be69e7b2b3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Request method failure captured: Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/e34c3a06-494a-45cb-a367-57e27328275f1 HTTP/1.1 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjV7CHA2yS5a5FbvoUeegBNuamoPyRqwdaXhalZGaWVjrg1IhLIVCt93SvJkpjNnZqj-s_xQattLwlDRA-ytKxsR0S28dctIXJv0ypr2lXWgX8r-JpXXJ7cDNcYuCmEzlDxN4f41_nlUdsHo_CMk_2ENzQ1sgS_ll97PbPJopsI7SCY Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:21.328812 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}] Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f345bd5f2d394961ad1dc5df2c7a622b Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e34c3a06-494a-45cb-a367-57e27328275f1'} Aug 30 16:06:21.330124 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e34c3a06-494a-45cb-a367-57e27328275f1 to delete Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.330992 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e34c3a06-494a-45cb-a367-57e27328275f1 could not be found. Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:21.332519 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ecca843-3c2b-4610-80ad-70be69e7b2b3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:21.333861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ecca843-3c2b-4610-80ad-70be69e7b2b3 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/e34c3a06-494a-45cb-a367-57e27328275f1" status: 404 len: 62 microversion: 2.1 time: 0.034472 Aug 30 16:06:21.334799 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 299/686] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:21 2022] DELETE /compute/v2.1/images/e34c3a06-494a-45cb-a367-57e27328275f1 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:21.336332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.337003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.346923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-822fff10-a81c-436c-995a-40d9609787ee tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Calling method '.version_select at 0x7fd35d22c3a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.385952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-822fff10-a81c-436c-995a-40d9609787ee tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] HTTP exception thrown: Image not found. Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-822fff10-a81c-436c-995a-40d9609787ee tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Request method failure captured: Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/tempest-invalid-1342071948 HTTP/1.1 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjV7CHA2yS5a5FbvoUeegBNuamoPyRqwdaXhalZGaWVjrg1IhLIVCt93SvJkpjNnZqj-s_xQattLwlDRA-ytKxsR0S28dctIXJv0ypr2lXWgX8r-JpXXJ7cDNcYuCmEzlDxN4f41_nlUdsHo_CMk_2ENzQ1sgS_ll97PbPJopsI7SCY Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:21.388134 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}] Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f345bd5f2d394961ad1dc5df2c7a622b Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'tempest-invalid-1342071948'} Aug 30 16:06:21.389405 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1342071948 to delete Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1342071948 could not be found. Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:21.391894 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:06:21.393395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.397760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-822fff10-a81c-436c-995a-40d9609787ee tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:21.398909 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-822fff10-a81c-436c-995a-40d9609787ee tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/tempest-invalid-1342071948" status: 404 len: 62 microversion: 2.1 time: 0.058183 Aug 30 16:06:21.400273 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 300/687] 10.222.0.47 () {58 vars in 1206 bytes} [Tue Aug 30 16:06:21 2022] DELETE /compute/v2.1/images/tempest-invalid-1342071948 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:21.413504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafd9ed3-6ec6-4f5a-b9c8-5ecf65f3d034 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Calling method '.version_select at 0x7fd35d2b1430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.443410 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-eafd9ed3-6ec6-4f5a-b9c8-5ecf65f3d034 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] HTTP exception thrown: Image not found. Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafd9ed3-6ec6-4f5a-b9c8-5ecf65f3d034 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Request method failure captured: Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/8fc6aad0-0629-4770-b5c5-ff3653dc025e HTTP/1.1 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjV7CHA2yS5a5FbvoUeegBNuamoPyRqwdaXhalZGaWVjrg1IhLIVCt93SvJkpjNnZqj-s_xQattLwlDRA-ytKxsR0S28dctIXJv0ypr2lXWgX8r-JpXXJ7cDNcYuCmEzlDxN4f41_nlUdsHo_CMk_2ENzQ1sgS_ll97PbPJopsI7SCY Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:21.445490 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6ccf9fdb417141bc913ce7a2132ce0e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6ccf9fdb417141bc913ce7a2132ce0e2"}]}] Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6ccf9fdb417141bc913ce7a2132ce0e2 Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-187843920 Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f345bd5f2d394961ad1dc5df2c7a622b Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-187843920-project Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8fc6aad0-0629-4770-b5c5-ff3653dc025e'} Aug 30 16:06:21.446807 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8fc6aad0-0629-4770-b5c5-ff3653dc025e to delete Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.447611 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fc6aad0-0629-4770-b5c5-ff3653dc025e could not be found. Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:21.448740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:06:21.450057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:21.455076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafd9ed3-6ec6-4f5a-b9c8-5ecf65f3d034 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:21.455926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eafd9ed3-6ec6-4f5a-b9c8-5ecf65f3d034 tempest-ImagesDeleteNegativeTestJSON-187843920 tempest-ImagesDeleteNegativeTestJSON-187843920-project] 10.222.0.47 "DELETE /compute/v2.1/images/8fc6aad0-0629-4770-b5c5-ff3653dc025e" status: 404 len: 62 microversion: 2.1 time: 0.049441 Aug 30 16:06:21.460954 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 301/688] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:21 2022] DELETE /compute/v2.1/images/8fc6aad0-0629-4770-b5c5-ff3653dc025e => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:06:21.491099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbce5f59-de69-48b2-9dc2-2c69209d5be8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d22c5e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.551196 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aef68682-4056-4410-b58b-88da5c63dffb tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168/action" status: 202 len: 0 microversion: 2.1 time: 0.271947 Aug 30 16:06:21.556255 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 388/689] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:21 2022] POST /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:21.574201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.575261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:21.606806 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbce5f59-de69-48b2-9dc2-2c69209d5be8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.135226 Aug 30 16:06:21.621005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 302/690] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:21 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:21.625821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.626341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.626802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.627493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.629374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.630768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.857816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-486c7c54-63da-4819-8ac7-418e73f4ace6 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1651 microversion: 2.1 time: 0.299755 Aug 30 16:06:21.860032 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 389/691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:21 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1651 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:21.948018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:21.949036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:21.967073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.969293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.970496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:21.971457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:21.974262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:21.975770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.088611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:22.091569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:22.099557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.100242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.100746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.101517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.102140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.102797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.268574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:22.285420 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f027661-4689-4781-941b-d86ba191d301 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.341863 Aug 30 16:06:22.289448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 303/692] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:21 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:22.330451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:22.334354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:22.334509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:22.345434 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8fb6f22-7358-4949-9ef0-e1909c23efcd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1312 microversion: 2.1 time: 0.260634 Aug 30 16:06:22.346698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 390/693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:22 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:22.357222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:22.358152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:22.365981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.366794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.367467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.368063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.368572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.368746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.369014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.369509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.370084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.378115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.380919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.383690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.557657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:22.570068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45e4c73d-a36f-4779-a51f-4b1499cf35f7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1276 microversion: 2.1 time: 0.220180 Aug 30 16:06:22.584862 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 391/694] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:22 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:22.651272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c58a8c61-3ce6-4663-9786-5da7d8af9c2a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d1f35e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:22.732291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c58a8c61-3ce6-4663-9786-5da7d8af9c2a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.107606 Aug 30 16:06:22.732949 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 392/695] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:22 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:22.881835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:22.882500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:22.899866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.902987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.903563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:22.909076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:22.910863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:22.912559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.227937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b874335f-fb9c-4741-94c3-cd70aa57fec0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1631 microversion: 2.1 time: 0.351427 Aug 30 16:06:23.230835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 393/696] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:22 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1631 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:23.264586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-830883-28", "block_migration": true, "disk_over_commit": false}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:23.268398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:23.276484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.278636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.279559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.280603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.281424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.282062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.371974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lazy-loading 'flavor' on Instance uuid ab195c32-74a1-41a8-9112-15c05b92a168 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:06:23.429267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Going to try to live migrate instance to n-h1-830883-28 {{(pid=122352) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:06:23.464575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:23.474832 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eb89808d-7067-4305-9cd1-aec33409e749 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 1.178790 Aug 30 16:06:23.491114 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 304/697] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:22 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:23.502674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:23.503317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:23.517334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.518832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.519842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.521662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.522501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.523153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.733736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:23.745555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ee0abbb-cc76-4ecf-960e-51b198ece0fc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.253221 Aug 30 16:06:23.760619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 305/698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:23 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:23.767589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:23.769280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:23.778513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.779775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.780443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:23.781369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:23.782055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:23.782763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:24.059269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:24.080467 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfd0646e-b31a-4fda-ad4a-6afbc397c1cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1461 microversion: 2.1 time: 0.317685 Aug 30 16:06:24.097620 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 306/699] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:23 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1461 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:24.108903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:24.109957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:24.119193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:24.119692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:24.120270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:24.120982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:24.121575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:24.122006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:24.195497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:24.211060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f416701d-94a0-411a-aa81-5f316e40bb54 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1282 microversion: 2.1 time: 0.111582 Aug 30 16:06:24.212201 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 307/700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:24 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:24.217750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5b2e7a1-f8af-4376-80c1-35ad495a0f6b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d25fee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:24.269313 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5b2e7a1-f8af-4376-80c1-35ad495a0f6b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.055810 Aug 30 16:06:24.270176 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 308/701] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:24 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:24.579886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:24.581189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:24.588388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:24.588972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:24.589515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:24.590325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:24.591155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:24.591781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:24.883971 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b912c02-f03f-46c1-a14d-b9e350b98bf3 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1614 microversion: 2.1 time: 0.610412 Aug 30 16:06:24.914459 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 309/702] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:24 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1614 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:24.979668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0550e22a-56e8-4ee9-9e0b-6847827983c1 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d2b1550>, body: {"keypair": {"name": "tempest-keypair-1791688400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMvxAsEjyRK0seNTdUu7rcQf+tvTeeRohTx/6ULLed7xjC8ppGTZSn7noUGlC8V8hTcqoTerW0D+zXyvJ4zJ2OpRTjM0Ve/GWN/K7sD4yY7icuubh+1zlb+EPxBsjF4Ug=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:24.996337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0550e22a-56e8-4ee9-9e0b-6847827983c1 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:25.002258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0550e22a-56e8-4ee9-9e0b-6847827983c1 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:25.030675 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0550e22a-56e8-4ee9-9e0b-6847827983c1 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.114697 Aug 30 16:06:25.031297 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 310/703] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:25.036214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:25.037159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:25.044405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.045104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.045702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.046596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.047211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.047833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.213407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:25.225244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db61f6ce-42a5-45f3-9cb2-b746144c212a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.192221 Aug 30 16:06:25.239065 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 311/704] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:25 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:25.244270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:25.245157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:25.251608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.252102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.252540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.253239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.253755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.254188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.410786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:25.420050 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-488f4596-a4d6-4efe-83a0-20bc1282c9e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1314 microversion: 2.1 time: 0.179611 Aug 30 16:06:25.421197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 312/705] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:25 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:25.426206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c88e14-f05a-4870-bafe-da955a6fd7c4", "name": "network-vif-plugged", "status": "completed", "tag": "dd0baae3-1a1f-4b7a-8278-6deb36bff2cf"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:25.436578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.437068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.437497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.450797 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] Creating event network-vif-plugged:dd0baae3-1a1f-4b7a-8278-6deb36bff2cf for instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 on n-h1-830883-28 Aug 30 16:06:25.461812 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-46acd495-50ea-4f06-a42d-b8a0022ac485 req-a7a023de-2759-4b3a-9aa6-09d6134e72fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Aug 30 16:06:25.462793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 313/706] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:25.468424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:25.468940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:25.476498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.477009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.477453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.478175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.478672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.479096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.573426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0311c8b6b57f42a49ede546f73115c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bacc7c5c86a642c29515e888fdf7ffd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:25.574015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] flavor_id is None. Assuming migration. {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4206}} Aug 30 16:06:25.574613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:06:25.758576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:25.822265 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51fd8162-b884-4a27-8672-26d2caf0cd84 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89/action" status: 202 len: 0 microversion: 2.1 time: 0.358382 Aug 30 16:06:25.824335 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 314/707] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:25 2022] POST /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:25.829608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8046faba-8044-479d-bf65-a2eb04229456 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d2b13a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:25.838687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8046faba-8044-479d-bf65-a2eb04229456 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1791688400" status: 200 len: 512 microversion: 2.2 time: 0.013051 Aug 30 16:06:25.840040 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 315/708] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Aug 30 16:06:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1791688400 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:25.848551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:25.849337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:25.857423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.858148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.859673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.860382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:25.860834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:25.861259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:25.992375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:26.007361 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7422001a-6879-4d70-a343-088ac7045ce4 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1282 microversion: 2.1 time: 0.162299 Aug 30 16:06:26.021276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 316/709] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:25 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:26.032958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-053e8e99-43fa-4755-8dbd-5818deac242f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2b1700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:26.105710 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-053e8e99-43fa-4755-8dbd-5818deac242f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1411 microversion: 2.1 time: 0.082607 Aug 30 16:06:26.106769 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 317/710] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:26 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:26.118207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:26.118860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:26.125553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:26.125929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:26.126466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:26.127341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:26.127752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:26.128974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:26.575216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:26.584359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24b69a8b-33c4-4b35-af56-997db515f45f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.472883 Aug 30 16:06:26.584941 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 318/711] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:26 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:26.590837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93cd623c-a564-4c74-9f25-27a589719b53 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d2b10d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:26.617070 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93cd623c-a564-4c74-9f25-27a589719b53 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791688400" status: 204 len: 0 microversion: 2.2 time: 0.030781 Aug 30 16:06:26.617756 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 319/712] 10.222.0.47 () {60 vars in 1261 bytes} [Tue Aug 30 16:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791688400 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:26.628467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:26.629390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:26.636569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:26.637200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:26.637815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:26.638618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:26.639136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:26.639625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.060897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:27.070133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd15dbac-6975-46a9-a748-83842c3b4079 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.450897 Aug 30 16:06:27.070760 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 320/713] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:26 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.090291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.090926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:27.096757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.097322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.097983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.098599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.099625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.100482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.174349 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ec715e3-869d-43b5-a5e4-b35bada14f26 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168/action" status: 202 len: 0 microversion: 2.1 time: 3.920652 Aug 30 16:06:27.178140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 394/714] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:23 2022] POST /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168/action => generated 0 bytes in 3932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:06:27.183454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73284158-f87e-4511-b4ba-391e96f00574 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d0bb160>, body: {"keypair": {"name": "tempest-keypair-208701287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtr7IimXqldQsIsxUvcaRLzRAK0eTb3izem8sOIqQWKrqt8EfZTct4e0k4iSYWaxtjSyGEM0w87+CaFuEAG13oxMbRi2tG8edfX/IUERzZkLU72AJt9+k7YWJLs51YFNw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:27.218790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-73284158-f87e-4511-b4ba-391e96f00574 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:27.227313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-73284158-f87e-4511-b4ba-391e96f00574 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:27.260366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73284158-f87e-4511-b4ba-391e96f00574 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.080801 Aug 30 16:06:27.261287 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 395/715] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:27.283541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.284690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:27.294414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.298001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.298503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.299233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.299689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.301053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.407234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:27.424041 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d76f4ee7-b9bd-4a9c-8c31-611ef39958c5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1464 microversion: 2.1 time: 0.337506 Aug 30 16:06:27.424668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 321/716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.429671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5344c5e-e3b3-4aeb-9ec1-9fbce39a7f48 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2f8040>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.460233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:27.470511 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc19e4d2-70f5-4e25-a98f-12a750475081 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.207960 Aug 30 16:06:27.471574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 396/717] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.491129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.491958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:27.506436 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5344c5e-e3b3-4aeb-9ec1-9fbce39a7f48 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1420 microversion: 2.1 time: 0.080104 Aug 30 16:06:27.507259 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 322/718] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.516163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.516163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.516163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.521350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.522148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.522711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.529927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac3dd0b7-e345-4d7a-ab50-3a6d5d0bec3a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d22c1f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.573553 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac3dd0b7-e345-4d7a-ab50-3a6d5d0bec3a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208701287" status: 204 len: 0 microversion: 2.2 time: 0.053986 Aug 30 16:06:27.574686 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 323/719] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Aug 30 16:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208701287 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:27.784244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:27.788417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:27.794106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8cffa535-3bef-4ee9-89a8-04b1fc1e0551 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.311194 Aug 30 16:06:27.803380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 397/720] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.810743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-589902f3-a4d7-461b-9f98-cb56845aba5d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d0ad940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.849212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.860402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'deleted': False, 'project_id': '1fbcd177ce9e4c2c839448f6bf6c10df'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:27.879120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.880325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.882250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.893615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.894102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.894567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.904219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-589902f3-a4d7-461b-9f98-cb56845aba5d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 200 len: 1420 microversion: 2.1 time: 0.099494 Aug 30 16:06:27.913676 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 398/721] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:27.913676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8924629-aa59-4777-bdd9-bf613cbb96f3 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d1f3e50>, body: {"keypair": {"name": "tempest-keypair-1163082386", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:27.919650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:27.933865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c8924629-aa59-4777-bdd9-bf613cbb96f3 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:27.940580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c8924629-aa59-4777-bdd9-bf613cbb96f3 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:27.971146 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8924629-aa59-4777-bdd9-bf613cbb96f3 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.064167 Aug 30 16:06:27.979594 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 399/722] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:27 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:27.982737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:27.982737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:27.987477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.988011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.988589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:27.990249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:27.990455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:27.990852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:28.049913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1d6c847c-bbb4-47a1-86ba-2d3e2f7b4e37 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.474169 Aug 30 16:06:28.050522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 324/723] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:06:28.067741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84e21533-7f7c-437c-bf85-8f7950161f09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2f8670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:28.262476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:28.283489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cbb87596-2ebe-44b6-8100-0f6c0305a27c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.308330 Aug 30 16:06:28.290701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 400/724] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:27 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:28.290701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b0033a5-b827-4fba-83d6-6a7e650c09b9 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d0b5160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:28.319539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b0033a5-b827-4fba-83d6-6a7e650c09b9 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163082386" status: 204 len: 0 microversion: 2.2 time: 0.033867 Aug 30 16:06:28.320470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 401/725] 10.222.0.47 () {60 vars in 1261 bytes} [Tue Aug 30 16:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163082386 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:28.325093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:28.331894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'deleted': False} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:28.339791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:28.340587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:28.341232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:28.342227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:28.342902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:28.343508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:28.471453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:06:28.634881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:28.635664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:28.636453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:28.809934 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84e21533-7f7c-437c-bf85-8f7950161f09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 204 len: 0 microversion: 2.1 time: 0.756474 Aug 30 16:06:28.810130 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 325/726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:28 2022] DELETE /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:28.818222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:28.818899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:28.826058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:28.826601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:28.827298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:28.828005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:28.828605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:28.829033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.209304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:29.226571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aeeded45-a3ce-41ca-969d-22bc9529be79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.412282 Aug 30 16:06:29.227781 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 326/727] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:28 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:29.233419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.245240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.245838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.246410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.258618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] Creating event network-changed:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:06:29.263905 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e74a6e23-5c8e-4ebc-aec0-af3825a92ecb req-f34828af-44e8-4fd7-8156-826c6dc2c618 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 Aug 30 16:06:29.264787 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 327/728] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:29.271925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1b5636d-7b62-4da7-9c6b-4c8eabab2798 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d2b1940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-355432585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgL6WTjaLHAkYSIGibPYEFWZ25r91vt4LtUXzSrhkMsrreKFP6YD3zHzghOI+fPTO4iflX+ICxzvzuPnN6Qh2hc44q7yHi4e3nFXhksBWSBMIIYXtCRJLhxCAecShkxcw=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.287392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a1b5636d-7b62-4da7-9c6b-4c8eabab2798 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:29.288772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6205132f-8e3b-4298-9332-e14a227f4956 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17902 microversion: 2.1 time: 0.967020 Aug 30 16:06:29.303030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 402/729] 10.222.0.47 () {58 vars in 1171 bytes} [Tue Aug 30 16:06:28 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17902 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:06:29.303030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.303030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:29.303030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.303781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.303781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.303781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.304161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.304850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.321055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a1b5636d-7b62-4da7-9c6b-4c8eabab2798 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:29.328483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:29.365010 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1b5636d-7b62-4da7-9c6b-4c8eabab2798 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.098513 Aug 30 16:06:29.367028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 328/730] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:29.372429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.373170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:29.382325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.382826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.383889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.384592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.385045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.385466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.412955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:29.491924 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d2d8ffce-5c70-4b7c-a4ba-60008d188b81 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 204 len: 0 microversion: 2.1 time: 0.123332 Aug 30 16:06:29.492622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 329/731] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:29 2022] DELETE /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:29.499129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.499950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:29.507742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.508405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.508901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.509735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.510668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.510808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.559353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:29.569385 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-571b57aa-26cc-4351-94e6-45f89091ee74 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.278126 Aug 30 16:06:29.571193 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 403/732] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:29 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:29.575986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91548c73-d40b-404d-ac2c-b1e970b9866e", "name": "network-vif-plugged", "status": "completed", "tag": "357650ce-f108-462d-a1ca-c78a7abbcea7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.586350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.587139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.587812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.604081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] Creating event network-vif-plugged:357650ce-f108-462d-a1ca-c78a7abbcea7 for instance 91548c73-d40b-404d-ac2c-b1e970b9866e on n-h2-830883-28 Aug 30 16:06:29.609528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d152208e-028c-4b8d-a240-0261663d17bd req-9446f494-7c97-4232-906b-f6a9c90c84a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036996 Aug 30 16:06:29.610133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 404/733] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:29.616067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.616952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:29.623928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.624664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.625283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.626137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.626778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.627365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.679245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:29.687523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9cd5d294-246f-4481-8df0-45f4ff881bf1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.192937 Aug 30 16:06:29.688184 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 330/734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:29 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:29.693274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.698361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'deleted': False, 'project_id': '1fbcd177ce9e4c2c839448f6bf6c10df'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:29.703647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.704207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.704696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.705482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.705998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.706517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.733675 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-209e697f-a4ad-4b68-a2b1-59b20bbce475 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?tenant_id=42f74557b03a43d98507b0328fcae35b" status: 200 len: 15 microversion: 2.1 time: 0.044422 Aug 30 16:06:29.734608 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 331/735] 10.222.0.47 () {58 vars in 1231 bytes} [Tue Aug 30 16:06:29 2022] GET /compute/v2.1/servers/detail?tenant_id=42f74557b03a43d98507b0328fcae35b => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:06:29.740918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66e2ca7d-5f08-4a74-b945-841244334000 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d2f9ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1683102460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYjyhBDRikEHwrU5hvUb1l1Ehd9BXDKbOM+u9UdCmzTPTtXFnI3lky2dvcuUOZ8KRrXV0Lqg291KJhJ1NddK5opsMjcorcYo1TcBy1tLf0Zo3AkWazU6YeurB0Y8B46KQ=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.756878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-66e2ca7d-5f08-4a74-b945-841244334000 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:29.761922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-66e2ca7d-5f08-4a74-b945-841244334000 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:29.787190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-66e2ca7d-5f08-4a74-b945-841244334000 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.051171 Aug 30 16:06:29.787718 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 332/736] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:29.792763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab195c32-74a1-41a8-9112-15c05b92a168", "name": "network-vif-unplugged", "status": "completed", "tag": "6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.803681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.804074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.804498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.816948 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] Creating event network-vif-unplugged:6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e for instance ab195c32-74a1-41a8-9112-15c05b92a168 on n-h2-830883-28 Aug 30 16:06:29.822576 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-71963894-11b6-4804-b9f3-7d9f5a7661e3 req-b1cf9f72-e3c2-407a-81de-24c379d1e5af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033478 Aug 30 16:06:29.823176 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 333/737] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:29.828457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1243416068", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.874426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:29.884263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67bc2a64-9922-4baa-91e6-8828d9a16766 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.272924 Aug 30 16:06:29.884968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] validate_networks() for [('0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:29.898355 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 405/738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:29 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:29.898355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:29.898355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'tenant_id': '42f74557b03a43d98507b0328fcae35b', 'deleted': False} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:29.900509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.901164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.901774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:29.902549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:29.903073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:29.903638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.002500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:06:30.084888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.085384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.085821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.211555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cb18241-c167-4c4f-9af7-e20b90d92d7d tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=42f74557b03a43d98507b0328fcae35b" status: 200 len: 4833 microversion: 2.1 time: 0.325590 Aug 30 16:06:30.212241 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 406/739] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:06:29 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=42f74557b03a43d98507b0328fcae35b => generated 4833 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:30.217339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53e6de68-58ca-4b2d-ad31-89529abbbabe tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d0ad550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2048561832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBCKn4tCXki07yiE/fS95iMQ0ejp3jB3oz8izCuheHTb/Ips8QiIFYFSo67y8ZvT5FGT7e+3tONc9J1W4iegK1TlGfjII2hDplSC9JIrofXFbnZIik5myn/PNk3Ucedig=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:30.235501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53e6de68-58ca-4b2d-ad31-89529abbbabe tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:30.241292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53e6de68-58ca-4b2d-ad31-89529abbbabe tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:30.265833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53e6de68-58ca-4b2d-ad31-89529abbbabe tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.052170 Aug 30 16:06:30.266441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 407/740] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:30 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:30.273148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:30.273690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:30.274254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:30.274779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:30.275290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:30.275854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.281617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'tenant_id': '1fbcd177ce9e4c2c839448f6bf6c10df', 'deleted': False} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:30.284304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.284864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.285368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.286223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.286774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.287257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.287401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.287881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.288315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.289028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.289573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.289890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.304617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:30.309657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for user 51cc027d79fe4ae0b644e49473acbd71 and project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:30.316320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6eaba222-7934-47d1-a467-05834b745f4f tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1fbcd177ce9e4c2c839448f6bf6c10df" status: 200 len: 15 microversion: 2.1 time: 0.048936 Aug 30 16:06:30.317664 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 408/741] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1fbcd177ce9e4c2c839448f6bf6c10df => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:06:30.322195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.322829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:30.323106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:30.325466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:30.328870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.329349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.329776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.330480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.331089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.331660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.374271 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca220fea-5b17-4973-aced-3030256ff69a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549840 Aug 30 16:06:30.374954 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 334/742] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:30.381643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-929808ad-75a7-40a1-b2d2-6ae47f03c3a9 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d22c280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.385993 n-d-830883-28 devstack@n-api.service[122351]: WARNING oslo_db.sqlalchemy.utils [None req-929808ad-75a7-40a1-b2d2-6ae47f03c3a9 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:06:30.396479 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-929808ad-75a7-40a1-b2d2-6ae47f03c3a9 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.020505 Aug 30 16:06:30.397326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 335/743] 10.222.0.47 () {60 vars in 1177 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:30.407617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-957597a5-5465-428b-a625-696c78821070 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.413633 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-957597a5-5465-428b-a625-696c78821070 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015193 Aug 30 16:06:30.414586 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 336/744] 10.222.0.47 () {58 vars in 1189 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:06:30.431397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb03997e-a085-4ff1-8217-3b3d8f3c0809 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.432083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fb03997e-a085-4ff1-8217-3b3d8f3c0809 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:30.481915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:30.490045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fb03997e-a085-4ff1-8217-3b3d8f3c0809 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:30.490665 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2037104c-e596-438b-ad07-60e9bf645bc6 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.171758 Aug 30 16:06:30.491554 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 409/745] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:30.496091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48b8ee67-c2fa-4883-89a1-cdc525e85e94 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d28a790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.500877 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb03997e-a085-4ff1-8217-3b3d8f3c0809 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1208 microversion: 2.1 time: 0.084644 Aug 30 16:06:30.501529 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 337/746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:30.507480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:30.510407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:30.519869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.521199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.521655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.522586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.523050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.523474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.524315 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48b8ee67-c2fa-4883-89a1-cdc525e85e94 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2048561832" status: 204 len: 0 microversion: 2.2 time: 0.031680 Aug 30 16:06:30.525378 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 410/747] 10.222.0.47 () {60 vars in 1321 bytes} [Tue Aug 30 16:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2048561832 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:30.533173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ced1e43c-2673-47ab-bc26-7d3a28454c2d tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d111790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.552569 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ced1e43c-2673-47ab-bc26-7d3a28454c2d tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1683102460" status: 204 len: 0 microversion: 2.2 time: 0.022815 Aug 30 16:06:30.553301 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 411/748] 10.222.0.47 () {60 vars in 1321 bytes} [Tue Aug 30 16:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1683102460 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:30.561204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59027e5f-4b5e-4425-b8f2-cbb15b4a1642 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35ce578b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.581108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59027e5f-4b5e-4425-b8f2-cbb15b4a1642 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-355432585" status: 204 len: 0 microversion: 2.2 time: 0.023295 Aug 30 16:06:30.581855 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 412/749] 10.222.0.47 () {60 vars in 1318 bytes} [Tue Aug 30 16:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-355432585 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:30.595591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.596194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:30.607679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.608555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.609013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.609759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.610220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.610721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.613440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b4a971c-b44d-44e2-a96a-95f53bb7f073 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 0 microversion: 2.1 time: 0.110714 Aug 30 16:06:30.614170 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 338/750] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:30 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:30.619272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38383135-f5df-4208-8315-fbb086d03d90 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d1bd040>, body: {"keypair": {"name": "tempest-keypair-1877118642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAOQbNuBWdO1meuYy1MFCDCrmUN7jOWbyeKFIsA5oE7RJtZbU7b4BZ6k1gPGkmvMw+7uKD0s2Jqp0Km48blNMzEoA2HgZFH1ApB5W6JUIPvgKOQbFePGG6ovxM3kKFfNw=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:30.634139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-38383135-f5df-4208-8315-fbb086d03d90 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:30.639063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-38383135-f5df-4208-8315-fbb086d03d90 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:30.666788 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38383135-f5df-4208-8315-fbb086d03d90 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.051295 Aug 30 16:06:30.673276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 339/751] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Aug 30 16:06:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:06:30.673276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.679657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:30.680830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '42f74557b03a43d98507b0328fcae35b'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:30.688946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.689426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.689860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.690602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.691051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.692566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.771228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:30.780815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bccc94bb-5e2c-4f7a-ac74-21cbeed3ea7c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.189063 Aug 30 16:06:30.781025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:06:30.781388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 413/752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:30.786222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-90590f21-cc63-4232-832c-aa0b1ee8eb06 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d183280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.794895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-90590f21-cc63-4232-832c-aa0b1ee8eb06 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1877118642" status: 200 len: 513 microversion: 2.2 time: 0.012468 Aug 30 16:06:30.802064 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 414/753] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1877118642 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:30.807110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:30.807724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:30.814488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.815201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.815683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.816535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:30.817741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:30.818546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:30.988788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:30.997823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9fedaa80-2a9f-4953-a939-7a5133cdd6e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.194360 Aug 30 16:06:30.998681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 415/754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:31.004248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdb8ec0a-7bac-40d7-b539-26719ee903de tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d07c1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.010355 n-d-830883-28 devstack@n-api.service[122352]: WARNING oslo_db.sqlalchemy.utils [None req-cdb8ec0a-7bac-40d7-b539-26719ee903de tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:06:31.019678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdb8ec0a-7bac-40d7-b539-26719ee903de tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.018964 Aug 30 16:06:31.021268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 416/755] 10.222.0.47 () {60 vars in 1177 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:31.028260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.029378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.037479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.038002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.038493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.039306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.039692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.040124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.079426 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-261d145b-0a12-4bf4-be84-f3627c2ccf64 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.410494 Aug 30 16:06:31.079931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 340/756] 10.222.0.47 () {58 vars in 1150 bytes} [Tue Aug 30 16:06:30 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:31.084618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48a88533-4e20-4d19-b7bf-0175ef2c951a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d1791f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.103433 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48a88533-4e20-4d19-b7bf-0175ef2c951a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877118642" status: 204 len: 0 microversion: 2.2 time: 0.022474 Aug 30 16:06:31.104005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 341/757] 10.222.0.47 () {60 vars in 1261 bytes} [Tue Aug 30 16:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877118642 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:31.108615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:31.110955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.117878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.118398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.119018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.119720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.120180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.120609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.165724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:31.183647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:31.193274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a577074-886f-4864-b847-b42cffb19378 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.170811 Aug 30 16:06:31.194234 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 417/758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:31.194468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ac5431c-00ce-430b-98cf-f66085b0aebb tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 0 microversion: 2.1 time: 0.089230 Aug 30 16:06:31.198272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 342/759] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:31 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:31.203009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.203635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.207026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Action: 'create', calling method: .version_select at 0x7fd35d28a5e0>, body: {"keypair": {"name": "tempest-keypair-1646175679", "type": "x509"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:31.210952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.211447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.211888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.212778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.213239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.213671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.222776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:31.227605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:31.242690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.processutils [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxvo59g8_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxvo59g8_/temp.key -subj /CN=d08f82de9cb94ca6a3996b77c49309e9 -extensions v3_req_client {{(pid=122352) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 16:06:31.339367 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-215b2e4b-460a-4ca8-86d6-4f317201131b tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1616 microversion: 2.1 time: 0.139928 Aug 30 16:06:31.340187 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 343/760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1616 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:31.359577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.360212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.367092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.367609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.368047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.368733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.369186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.369613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.499294 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c19bc6eb-7555-491e-a761-a05ca7a1be66 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1616 microversion: 2.1 time: 0.143139 Aug 30 16:06:31.499864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 344/761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1616 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:31.510331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.511088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.517740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.518234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.518719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.519415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.519878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.520340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.623850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.processutils [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxvo59g8_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxvo59g8_/temp.key -subj /CN=d08f82de9cb94ca6a3996b77c49309e9 -extensions v3_req_client" returned: 0 in 0.381s {{(pid=122352) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 16:06:31.625448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.processutils [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxvo59g8_/temp.key -password pass: {{(pid=122352) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 16:06:31.648909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.processutils [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxvo59g8_/temp.key -password pass:" returned: 0 in 0.023s {{(pid=122352) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 16:06:31.656447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:31.664462 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e7f8e50-e2d2-490a-8896-ae6f0f1b1f60 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.157738 Aug 30 16:06:31.665076 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 345/762] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:31.669376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.675130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'host': 'n-h1-830883-28', 'deleted': False} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:31.679753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.680220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.680658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.681420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.681880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.682324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.797704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:06:31.868387 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b58414a-70bc-49a8-8e6b-fcf16e2f4abc tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers?host=n-h1-830883-28&all_tenants=1" status: 200 len: 1641 microversion: 2.1 time: 0.202239 Aug 30 16:06:31.869159 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 346/763] 10.222.0.47 () {58 vars in 1192 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers?host=n-h1-830883-28&all_tenants=1 => generated 1641 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:31.873947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.874750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.883051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.883558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.884003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.884802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.885289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.885901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.915283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:31.920757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Getting quotas for user d08f82de9cb94ca6a3996b77c49309e9 and project 04e118384c6a4aa3afa201819853f26b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:31.937144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6801e5b-525f-49cf-8553-7a7087b86b9e tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.742057 Aug 30 16:06:31.937881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 418/764] 10.222.0.47 () {62 vars in 1198 bytes} [Tue Aug 30 16:06:31 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 743 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:31.944578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecdfd15-1ebd-4fbb-ae11-99ea22767c09", "name": "network-vif-unplugged", "status": "completed", "tag": "323b7e1a-7df5-428e-99e0-88470e924314"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:31.949603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:31.954736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.955240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.955672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.957799 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6775f4a5-3363-4d84-83f1-07dc30393f00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1212 microversion: 2.1 time: 0.087490 Aug 30 16:06:31.970325 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 347/765] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:31.970325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.970325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.970700 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] Creating event network-vif-unplugged:323b7e1a-7df5-428e-99e0-88470e924314 for instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 on n-h2-830883-28 Aug 30 16:06:31.970797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.970797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.970797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.971070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.971446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.971874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.973328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-892d20a7-dc20-4bb7-b231-8eb879f9004b req-dd2732b9-6eb0-48e1-941b-9e4ed58fed96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034165 Aug 30 16:06:31.974596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 419/766] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:31.979704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab195c32-74a1-41a8-9112-15c05b92a168", "tag": "6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:31.990104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.990657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.991088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.001907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] Creating event network-changed:6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e for instance ab195c32-74a1-41a8-9112-15c05b92a168 on n-h2-830883-28 Aug 30 16:06:32.008071 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-01848cd2-0a25-478b-b6fa-40380263c391 req-7018e311-467f-413f-be89-11d201218498 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032132 Aug 30 16:06:32.008995 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 420/767] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:32.014229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.021144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:06:32.028236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.028728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.029236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.029972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.030582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.031012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.108667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.112978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40db4634-9f32-4dea-a9d9-ee9bdf5dbfe7 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.102892 Aug 30 16:06:32.113858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 421/768] 10.222.0.47 () {58 vars in 1196 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:06:32.117061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dda96a36-362e-447b-ac78-691af0ff5138 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.157563 Aug 30 16:06:32.130469 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 348/769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.130693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61a0f328-0fd7-404c-ab30-302231f74c7a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d096b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.130798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.130798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.131004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:32.131093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.131093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.131093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.131334 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61a0f328-0fd7-404c-ab30-302231f74c7a tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1646175679" status: 200 len: 1534 microversion: 2.2 time: 0.015409 Aug 30 16:06:32.131409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.131483 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 422/770] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1646175679 => generated 1534 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.131806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.132064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.136166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:32.138606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.146379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.146891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.147332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.148031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.148490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.148919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.236098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ae5b75f-2064-4e02-980c-db231339b488 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 0 microversion: 2.1 time: 0.103682 Aug 30 16:06:32.239891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 423/771] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:32 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:32.243483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-13a519ab-8c6d-4739-8724-54041d6113f5 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d0b5820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.247371 n-d-830883-28 devstack@n-api.service[122352]: WARNING oslo_db.sqlalchemy.utils [None req-13a519ab-8c6d-4739-8724-54041d6113f5 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:06:32.252412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-13a519ab-8c6d-4739-8724-54041d6113f5 tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014154 Aug 30 16:06:32.252970 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 424/772] 10.222.0.47 () {60 vars in 1177 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.257864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.258552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.264495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.264980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.265412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.266107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.266593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.267019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.276694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.284432 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16098c83-084f-4412-8612-bd71cc0b5230 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.165889 Aug 30 16:06:32.285101 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 349/773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.294152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:32.294152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.298211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.298726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.299163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.299844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.300306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.300711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.378997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:32.380182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:32.380424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:32.380838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:32.381254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:32.404815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.413425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-281c9e98-6ba6-4a7e-8746-07ac0821e230 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.159436 Aug 30 16:06:32.414363 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 425/774] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.419264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b709e547-7ba2-4050-b480-139555191b7d tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] Calling method '.version_select at 0x7fd35d0b5b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.438409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b709e547-7ba2-4050-b480-139555191b7d tempest-KeyPairsV22TestJSON-504599994 tempest-KeyPairsV22TestJSON-504599994-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646175679" status: 204 len: 0 microversion: 2.2 time: 0.022924 Aug 30 16:06:32.438984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 426/775] 10.222.0.47 () {60 vars in 1261 bytes} [Tue Aug 30 16:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646175679 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:32.445188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.451170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.451662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.452366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.453069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.453527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.453955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.481551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-202ff0a8-4cb6-4e46-a061-ae35d7d8c1ef tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 1067 microversion: 2.1 time: 0.195345 Aug 30 16:06:32.482318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 350/776] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:32 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 1067 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 16:06:32.499994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.500728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.506903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.507392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.507830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.508527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.508981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.509402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.653272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.666327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48bee79a-31d4-48e2-9f9e-7ea19d0c9a76 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.170669 Aug 30 16:06:32.666930 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 427/777] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:32.686410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.687133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.693844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.694381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.694900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.695618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.696320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.696488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.838771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.848712 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf06d7ae-49d4-4077-a17d-0257da4efabe tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.166349 Aug 30 16:06:32.849358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 351/778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:32.980336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.980967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.986996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.987492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.987939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.988668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.989688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.990127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.994459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:33.058959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.070065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a40d0c7-78b2-4383-a810-3ffa4a699477 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1212 microversion: 2.1 time: 0.093435 Aug 30 16:06:33.074925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 428/779] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:33.137096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.137712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.140017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:33.151756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.152443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.152935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.153887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.155042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.155543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.305810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.306470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.308576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.313566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.314261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.314740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.315451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.316016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.316451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.318326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5fc2a5bb-7e36-45c3-8048-ef6746cfc250 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.183825 Aug 30 16:06:33.319117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 352/780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:33.435064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.435783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.443960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.444457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.444939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.445853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.446412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.446840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.482957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.499648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d94123b4-da60-499f-9216-b8de689ba919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.198368 Aug 30 16:06:33.500359 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 429/781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:33.645611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.655326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9bb47e9-e2af-4008-9a82-2e286d660625 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1470 microversion: 2.1 time: 0.224614 Aug 30 16:06:33.656484 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 353/782] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:33.688116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.689346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.698293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.701676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.702327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.704204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.706610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.707219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.870035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.870685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.871335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.877913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.879301 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2a266fa2-f0dd-4a6d-bde8-dcc235114e2c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.194919 Aug 30 16:06:33.879463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.879867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.880534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 430/783] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:33.881053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.881757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.882382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.016104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:34.025771 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b529cf8d-4e4d-4052-9d50-4dc50ffb3228 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.159528 Aug 30 16:06:34.026365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 354/784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:34.091772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:34.092522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:34.099511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.100215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.100739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.101522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.102078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.102602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.178640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:34.197308 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5780e785-2d79-4ee6-bcd3-cd26b4d5892c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1204 microversion: 2.1 time: 0.108988 Aug 30 16:06:34.211963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 431/785] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1204 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:34.341916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:34.342737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:34.352944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.353827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.354442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.356087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.356926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.357524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.523559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:34.524394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:34.532163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.532669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.533550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.534735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.535351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.535849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.578452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:34.587956 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7756f64-e782-400e-8151-25b6a7f789ac tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.251814 Aug 30 16:06:34.588691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 355/786] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:34.679645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:34.680456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:34.693087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.693965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.695231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.696759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.697473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.698126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.731520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:34.793763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:34.819612 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e07cf782-fb63-4398-8362-18a53665d264 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.302181 Aug 30 16:06:34.824945 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 432/787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:34.904027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:34.904941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:34.914746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.915508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.916160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.917359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:34.917993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:34.919187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:34.936580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:34.955680 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e66a48b6-0bf8-445c-b1e1-8b76cb868b09 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.282282 Aug 30 16:06:34.958061 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 356/788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:35.046647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:35.047357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:35.056929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.059612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.061728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.064581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.065160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.065671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.156241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:35.165678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bbca7df3-26aa-4a7b-8bfd-6ba7e3389d24 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.267524 Aug 30 16:06:35.166604 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 433/789] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:35.182286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecdfd15-1ebd-4fbb-ae11-99ea22767c09", "name": "network-vif-deleted", "tag": "323b7e1a-7df5-428e-99e0-88470e924314"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:35.203238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.204930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.205390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.228845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] Creating event network-vif-deleted:323b7e1a-7df5-428e-99e0-88470e924314 for instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 on n-h2-830883-28 Aug 30 16:06:35.236156 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-dc68d911-9b65-4980-a38a-b9f2f6227112 req-13a8ee1e-25ce-489c-b4f8-ab9dff47cfd7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068359 Aug 30 16:06:35.240468 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 434/790] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:35.247575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "name": "network-vif-plugged", "status": "completed", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:35.259573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.259975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.260409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.273196 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] Creating event network-vif-plugged:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:06:35.278080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7067e107-aade-4bc0-821d-50290defcb95 req-0996a1ca-0109-4585-b5f9-7f1fe93e9212 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035989 Aug 30 16:06:35.278742 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 435/791] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:35.283798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:35.284806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:35.290851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.291339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.291782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.292478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.292935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.293363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.310950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:35.320299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce10bac6-7d1e-47be-a6de-c9b06d7b1d2d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1316 microversion: 2.1 time: 0.278062 Aug 30 16:06:35.345465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 357/792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:35 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:35.367986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:35.376038 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1de2d41-cbbc-4e22-97ba-9cfe34c68559 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1260 microversion: 2.1 time: 0.096116 Aug 30 16:06:35.376968 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 436/793] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:35 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1260 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:35.611193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:35.611778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:35.624391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.624889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.626872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.629989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.630678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.631285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.845283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:35.847224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:35.870423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.871852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.873066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.873984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.875170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.875804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.064280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.073929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eda34d97-9fb7-413a-b10b-63298e8feed8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.233211 Aug 30 16:06:36.074866 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 437/794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:35 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:36.080740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:36.081358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.088636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.089092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.089532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.090518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.090947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.091342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.300536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.309916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b8c234a-b615-4ea2-9e33-2a3e7a042d4f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.234028 Aug 30 16:06:36.310534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 438/795] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:36 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.315988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:36.316475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.323357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.324597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.325359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.326194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.327172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.327730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.380343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.390590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-426c33ed-15f4-4f9e-9cbd-537c0c46d9c8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.785106 Aug 30 16:06:36.393950 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 358/796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:35 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.412970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:36.415861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.434075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.434815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.435416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.436328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.436815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.437249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.527879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.539758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-90bca2ed-7f36-4f8a-b69b-621840912ab0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.228056 Aug 30 16:06:36.540669 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 439/797] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:36 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.545443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:36.546632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.556502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.557009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.557455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.558168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.558741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.559183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.631063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.639624 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5bb31cd-5a28-483a-8b00-01bf58e0693d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1260 microversion: 2.1 time: 0.097713 Aug 30 16:06:36.640224 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 440/798] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:36 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1260 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.687862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.695831 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f629a90c-7ce8-4c16-9512-194b6a8fbf53 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1503 microversion: 2.1 time: 0.299823 Aug 30 16:06:36.696410 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 359/799] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:36 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.716537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1626289025"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:36.717086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.723736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.724232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.724669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.725374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.725860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.726289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.865312 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Adding security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 to port 357650ce-f108-462d-a1ca-c78a7abbcea7 Aug 30 16:06:37.099598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.100366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.106782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.107264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.107857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.108548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.109142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.109704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.237444 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-882041c3-67bb-499e-a34f-1676dfef3373 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action" status: 202 len: 0 microversion: 2.1 time: 0.524816 Aug 30 16:06:37.239671 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 441/800] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:36 2022] POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:37.247337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d4f6ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.385890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:37.393713 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1bde46a0-e904-47d3-922a-4b1c9ed642ef tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.301228 Aug 30 16:06:37.407760 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 360/801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:37.412518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91548c73-d40b-404d-ac2c-b1e970b9866e", "tag": "357650ce-f108-462d-a1ca-c78a7abbcea7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:37.423278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.423764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.424198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.424917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use.", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:37.425979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.425979 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0 HTTP/1.1 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:37.429235 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: exception: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.430587 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '065b7904-d4ad-4f7a-85c5-fe64925176f0'} Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:37.431361 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.435935 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:37.437219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 400 to user: Security Group 065b7904-d4ad-4f7a-85c5-fe64925176f0 in use. Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-18141af6-5e07-4add-9dbd-5e00e8878faa'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4310f85b-f79b-4905-a374-ce8b8563df57 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0" status: 400 len: 185 microversion: 2.1 time: 0.187828 Aug 30 16:06:37.438410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 442/802] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:37 2022] DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0 => generated 185 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:06:37.439027 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] Creating event network-changed:357650ce-f108-462d-a1ca-c78a7abbcea7 for instance 91548c73-d40b-404d-ac2c-b1e970b9866e on n-h2-830883-28 Aug 30 16:06:37.439124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.439124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.445416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-60f609df-300d-4d0e-bc2d-8b6e55bb4238 req-095beca2-cf01-45a5-a441-1194c6ba888f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035462 Aug 30 16:06:37.446447 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 361/803] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:37.451265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.452033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.452500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.452613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.453224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.453339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.453693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.454130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.460930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.461429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.461870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.462795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.463426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.463859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.634560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:37.643249 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-abe2e0f3-f986-4ce1-9d90-e2c00812959a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.210694 Aug 30 16:06:37.659354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 443/804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:37.664804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:37.667800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.676115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.676889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.677721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.678722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.679410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.680065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.731926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:37.743441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a335206-33d2-46b5-90b3-a4eebcbc09e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1324 microversion: 2.1 time: 0.295597 Aug 30 16:06:37.749930 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 362/805] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1324 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:37.761189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.762091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.787134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.788106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.789086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.792161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.794112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.806691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.846120 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1e02abd-6206-4e74-983e-7c7592e9bb29 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action" status: 202 len: 0 microversion: 2.1 time: 0.184083 Aug 30 16:06:37.849223 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 444/806] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:37 2022] POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:37.880317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.886082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.898940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.899833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.900583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.901588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.902446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.903096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.004339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:38.024292 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-444dcafd-9189-4cb3-bd31-71619823f784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1268 microversion: 2.1 time: 0.173085 Aug 30 16:06:38.025702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 445/807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:38.031726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:38.032883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:38.041074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.042057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.042947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.044295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.044978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.045734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.066255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:38.276162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:38.353857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1c14fb7-b20e-44a5-af9f-35ec264473df tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.594472 Aug 30 16:06:38.356356 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 363/808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:38.419260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:38.419896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:38.424366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:38.434691 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2a481e7f-f6ba-4250-8a34-23c13cdefa32 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1574 microversion: 2.1 time: 0.407190 Aug 30 16:06:38.435281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.435980 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 446/809] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:38 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1574 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:38.438495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.438968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.439696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.442607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.443391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.668971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:38.670455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:38.680634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.681454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.682278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.682860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.683333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.683789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.919377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:38.932525 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f4a3c0c-763a-40db-a9d4-af6f64c6fae3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.269139 Aug 30 16:06:38.946708 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 447/810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:38 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:38.952602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:38.953235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:38.960038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.960537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.960983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.961693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.962385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.963144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.033048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:39.053584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-290d5f75-ed73-40d1-84cd-0045ea1fb1b2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.640029 Aug 30 16:06:39.054575 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 364/811] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:38 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:39.059215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:39.059832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:39.078103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.078642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.079085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.079796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.080255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.080688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.199824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:39.223726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38286099-25f2-4bcd-af3e-7376e1c25772 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1520 microversion: 2.1 time: 0.273923 Aug 30 16:06:39.232201 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 448/812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:38 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:39.249494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:39.250234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83d4bcf0-b251-4cbc-8627-c9789599e47d tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'create', calling method: .version_select at 0x7fd35d183b80>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:39.263573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9d053c9-c76a-404f-a205-90966023fd16 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1266 microversion: 2.1 time: 0.205859 Aug 30 16:06:39.264174 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 365/813] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:39 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:39.377315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:39.378134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:39.385790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.386283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.386795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.387434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.387892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.388347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.857634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:39.871066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e4be396-7088-45e2-9a56-1607fde475ed tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.497701 Aug 30 16:06:39.888870 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 366/814] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:39 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:39.894001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:39.895511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:39.902995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.903842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.904699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.905509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.906071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.906618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:40.354993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:40.375916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f7f7b99-2131-4717-a97f-f5967bae4685 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1574 microversion: 2.1 time: 0.482501 Aug 30 16:06:40.378400 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 367/815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:39 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1574 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:40.385947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:40.390085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:40.405883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.409472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.410116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:40.411792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.412802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.413501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:40.647720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=34 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:40.733613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:40.787946 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-311e0970-df7f-4108-bd53-929436dea428 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.403461 Aug 30 16:06:40.788589 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 368/816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:40 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:40.795716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:40.803303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:40.824840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.827351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.828973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:40.829846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.831997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.837318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:41.498836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:41.513485 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c600874-8e6d-4b8f-95b9-360d0ffb9dec tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1503 microversion: 2.1 time: 0.723037 Aug 30 16:06:41.530329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 369/817] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:40 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1503 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:41.538128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:41.539023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:41.545762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:41.546600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:41.547448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:41.548695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:41.549365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:41.550051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:41.712136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:41.930113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=24 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:42.058469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:42.116313 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83d4bcf0-b251-4cbc-8627-c9789599e47d tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.865414 Aug 30 16:06:42.116972 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 449/818] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:06:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:06:42.122817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:42.123461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.130478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.130978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.131415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.132112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.132570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.133116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.255698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.263853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf39bbae-4237-453f-9c63-d67425de9e70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.732079 Aug 30 16:06:42.264432 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 370/819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:41 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.283002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:42.284595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.292274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.292860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.293433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.294387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.295037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.295762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.318439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.328600 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03ae4af3-5c6a-47af-a1e0-8f5ee49d684e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.210164 Aug 30 16:06:42.330042 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 450/820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:42 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.335779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:42.336597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.344228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.344727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.345168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.345881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.346356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.346792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.572362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.580730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cb1cdf5-47b4-4aaa-88a9-7c930c0b1590 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.249570 Aug 30 16:06:42.582533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 451/821] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:42 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.587766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1620774464", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "23f2e904-2767-475c-acd9-99e9d18555dc"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:42.618481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.627476 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e24720cb-a01c-4972-b748-b974421245d9 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1572 microversion: 2.1 time: 0.359123 Aug 30 16:06:42.630639 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 371/822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:42 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1572 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.638905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:42.645070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.654645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.655143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.655577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.656308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.656750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.657178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.675613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] validate_networks() for [('23f2e904-2767-475c-acd9-99e9d18555dc', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:42.924545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.933388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bce246f9-7d5c-44be-b13e-ce4a5ab8c127 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1478 microversion: 2.1 time: 0.301407 Aug 30 16:06:42.934225 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 372/823] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:42 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.940494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071682911"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:42.941949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.949583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.950458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.951125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.953314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.954017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.954730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.230954 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.network.security_group_api [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Adding security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 to port 357650ce-f108-462d-a1ca-c78a7abbcea7 Aug 30 16:06:43.378381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:43.380542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:43.381738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:43.382594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:43.383366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:43.397121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.397888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.398596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.399743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.400576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.401216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.425483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Getting quotas for project 8ea1726b3b30410ab93a0407a77df7a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:43.432673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Getting quotas for user b31b992df85c411d9e93bec3b8c474d6 and project 8ea1726b3b30410ab93a0407a77df7a7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:43.447666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:43.450489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:43.527278 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eee5c0ae-cad5-4409-bbad-ea55b13860d0 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943502 Aug 30 16:06:43.533836 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 452/824] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:43.538856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84554004-28f8-4e87-8f71-b966acb4a834", "tag": "81db1d56-f6cc-45e1-b149-dcb8e85ae63a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:43.559337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.559924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.560510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.574050 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] Creating event network-changed:81db1d56-f6cc-45e1-b149-dcb8e85ae63a for instance 84554004-28f8-4e87-8f71-b966acb4a834 on n-h2-830883-28 Aug 30 16:06:43.579926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-36fb7fc1-6662-48a4-b971-bf1adc50ac43 req-a12fb259-5a14-4143-a76a-fea5939a019e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050008 Aug 30 16:06:43.580848 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 453/825] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:43.586156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20bb7ca1-66a0-4559-88ed-5a6b7b02f90a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '.version_select at 0x7fd35d50d1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:43.591289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20bb7ca1-66a0-4559-88ed-5a6b7b02f90a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.591958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20bb7ca1-66a0-4559-88ed-5a6b7b02f90a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.592562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20bb7ca1-66a0-4559-88ed-5a6b7b02f90a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.616761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20bb7ca1-66a0-4559-88ed-5a6b7b02f90a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1187 microversion: 2.1 time: 0.034410 Aug 30 16:06:43.626088 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 454/826] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:06:43 2022] GET /compute/v2.1/os-migrations => generated 1187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:43.633312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:43.634234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:43.642831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.644907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.645556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.647131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.647911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.648617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.901285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:43.911813 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5401ae28-a5ed-4659-9d19-2c22f3b0a391 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.281760 Aug 30 16:06:43.928189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 455/827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:43 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:43.936505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:43.937267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:43.944088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.944910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.945459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.946265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.946979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.947510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.110052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:44.122650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-743566d9-22f6-47f5-900c-7e17870f5daa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.190930 Aug 30 16:06:44.123682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 456/828] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:43 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:44.130340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0eb373b7-7c09-4aab-a6b4-6f26cc6c8fbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.131148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0eb373b7-7c09-4aab-a6b4-6f26cc6c8fbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:44.207760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0eb373b7-7c09-4aab-a6b4-6f26cc6c8fbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:44.218255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0eb373b7-7c09-4aab-a6b4-6f26cc6c8fbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1224 microversion: 2.1 time: 0.091923 Aug 30 16:06:44.230328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 457/829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:44 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:44.230328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.230328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:44.244033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.246239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.247475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.251333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.253158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.253538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.470552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:44.484104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ab7154e-9fee-4bf2-9dbe-0e51504ec5cd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.259065 Aug 30 16:06:44.485161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 458/830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:44 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:44.495315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.496941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33308394-707e-46d8-9f1c-2ede9a52bffa tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action" status: 202 len: 0 microversion: 2.1 time: 1.560963 Aug 30 16:06:44.498292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 373/831] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:42 2022] POST /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e/action => generated 0 bytes in 1563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:44.499010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:44.509722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.515639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.520243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.521336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.521817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.522292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.656969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdeaeb44-eee8-42b8-8d84-f7d9807990bb tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d4bd550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-32322111", "description": "tempest-description-1374120000"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:44.679785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d65114d-84b6-4a70-b469-85f68411e1d9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1631 microversion: 2.1 time: 0.193124 Aug 30 16:06:44.682656 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 459/832] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:44 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1631 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:44.689604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d096ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.810720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use.", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:44.811773 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.811773 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42 HTTP/1.1 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:44.814514 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: exception: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.815918 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '52be0bc2-2257-4d94-a4b2-b4eceeedec42'} Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:44.816872 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.818159 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:44.819403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] Aug 30 16:06:44.820931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:44.824108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 400 to user: Security Group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 in use. Aug 30 16:06:44.824108 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7308a1ec-891d-4e80-b2ef-21fef60b3126'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:44.825595 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-040c96db-27cb-494f-981e-8486993812cf tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42" status: 400 len: 185 microversion: 2.1 time: 0.141358 Aug 30 16:06:44.830016 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 460/833] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:44 2022] DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42 => generated 185 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:44.841076 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdeaeb44-eee8-42b8-8d84-f7d9807990bb tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.340357 Aug 30 16:06:44.841692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 374/834] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:44 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:44.850187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95b6286e-7457-4fc8-ab46-2d76f68d5ec6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: .version_select at 0x7fd35d111040>, body: {"keypair": {"name": "tempest-keypair-318817253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNChV0YqAGkTwCwoSaiIsPKY2tqJPPkdrejWTNjB2wq4wT/6P7740lbdRLF4TX03/afVTiGi0jHDWboDTL1l8LhRYs6MjoXlOOchc2CRoxiFUhf8A/HYU1cHqRrD09ahQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:44.867529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.867954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:44.871403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-95b6286e-7457-4fc8-ab46-2d76f68d5ec6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:44.877787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-95b6286e-7457-4fc8-ab46-2d76f68d5ec6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for user 43d55a1e4a9f4f2b9cb85e010154f284 and project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:44.883524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.884027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.884471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.885213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.885657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.886547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.891919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:44.916786 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-95b6286e-7457-4fc8-ab46-2d76f68d5ec6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085400 Aug 30 16:06:44.918068 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 461/835] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:06:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:44.925177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65545671-b19e-4532-9a45-752715651d81 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35ce47f70>, body: {"security_group_rule": {"parent_group_id": "87b8c076-d83f-4de0-8111-d6b9593f6614", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:44.927278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:45.080988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d608490-1c56-4cfa-a8e9-8f977a5d3424 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 204 len: 0 microversion: 2.1 time: 0.224481 Aug 30 16:06:45.083177 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 375/836] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:44 2022] DELETE /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:45.091502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.092461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.100823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.101544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.102133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.103945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.104600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.105184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.295109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65545671-b19e-4532-9a45-752715651d81 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.375528 Aug 30 16:06:45.303835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 462/837] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:45.308690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.309312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.311578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:45.319204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.320036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.320801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.322098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.322802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.323453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.418111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:45.428793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acf88460-3ace-45f8-834f-7641c3648b34 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.343574 Aug 30 16:06:45.429800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 376/838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:45.434974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.435592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.444003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.444504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.444948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.445862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.446498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.446982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.516031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:45.525606 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50931533-7edb-4fae-a6e8-517d38269c39 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1647 microversion: 2.1 time: 0.220617 Aug 30 16:06:45.526235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 463/839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1647 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:45.530990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.531869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.539241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.539950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.540687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.541569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.542233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.542854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.614832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:45.623849 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37ca6a42-61de-4550-91e2-de4edc73cb65 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1220 microversion: 2.1 time: 0.096327 Aug 30 16:06:45.624933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 464/840] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:45.629760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91a6a013-af26-4259-8622-76c5831ca7bd tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d242ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1866579971", "description": "tempest-description-1839704443"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:45.667503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:45.681524 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3a7e216-358e-470f-988f-0b1833f1adce tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.250625 Aug 30 16:06:45.696729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 377/841] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:45.696729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.698636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.705684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.706507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.709378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.710334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.711054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.711677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.809735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91a6a013-af26-4259-8622-76c5831ca7bd tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.183487 Aug 30 16:06:45.810393 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 465/842] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:45.814973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91548c73-d40b-404d-ac2c-b1e970b9866e", "tag": "357650ce-f108-462d-a1ca-c78a7abbcea7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:45.835855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.836346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.836782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.856218 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] Creating event network-changed:357650ce-f108-462d-a1ca-c78a7abbcea7 for instance 91548c73-d40b-404d-ac2c-b1e970b9866e on n-h2-830883-28 Aug 30 16:06:45.861767 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6ab465b0-f59e-4ad0-8b8a-d93cf220b778 req-8cea9e02-ab8e-4013-8fc8-ee3559199229 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049963 Aug 30 16:06:45.862648 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 466/843] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:45.867964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50afcd4f-722a-43f7-8aef-0e9551735685 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d242c10>, body: {"security_group_rule": {"parent_group_id": "275b16a4-b81a-4066-a3a0-2b61e8dbbca7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:46.000308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:46.009388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f60adb0c-4b7d-4b3b-bee2-6b3a2ac20c0c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.320580 Aug 30 16:06:46.024272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 378/844] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:46.111166 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50afcd4f-722a-43f7-8aef-0e9551735685 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.247051 Aug 30 16:06:46.119951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 467/845] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:46.124414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b81d5537-3780-45cc-bbd5-5346ef881fca tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d5ed040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-285675167", "description": "tempest-description-1890698692"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:46.386356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b81d5537-3780-45cc-bbd5-5346ef881fca tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.265379 Aug 30 16:06:46.387138 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 379/846] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:06:46.400746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-673285bf-a1ac-40b3-a12c-e74fb6351659 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d3b5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-23625808", "description": "tempest-description-930237077"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:46.450093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:46.451059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:46.462835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.463330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.463773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.464917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.465015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.465404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.653129 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-673285bf-a1ac-40b3-a12c-e74fb6351659 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.256293 Aug 30 16:06:46.654858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 468/847] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:46 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:06:46.660391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:46.661627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:46.679704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.680200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.680636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.681335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.682003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.682465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.771017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:46.780200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0dd67170-ae9f-45de-9d28-c5cf041884f6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.334496 Aug 30 16:06:46.781290 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 380/848] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:46 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:46.786582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:46.787471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:46.794736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.795521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.796191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.797139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.797836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.798868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.889260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:46.893027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:46.900340 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2617a3bd-2101-4df0-8f7c-c5e1a49020ab tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1220 microversion: 2.1 time: 0.117711 Aug 30 16:06:46.904021 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba32a3ec-bfc8-49a7-8400-79698f82ef88 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1647 microversion: 2.1 time: 0.247984 Aug 30 16:06:46.905715 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 469/849] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:46 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1647 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:46.911227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4dae59f5-aafc-4cae-a2b2-c364a880e97e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d07c1f0>, body: {"security_group_rule": {"parent_group_id": "5eefcbb4-8242-4aa8-af7d-3d9cc16ef834", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "02393a68-f304-4477-a0dd-9588fb667248"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:46.911871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 381/850] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:46 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:46.917193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:46.917814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:46.934021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.934928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.935575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.936313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.936934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.940965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:47.276475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:47.284301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f33da46-4a27-43c9-964a-b8083420c42e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.371317 Aug 30 16:06:47.285043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 382/851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:46 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:47.290119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:47.292479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:47.302840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:47.310611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:47.311410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:47.312330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:47.312964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:47.313395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:47.352582 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4dae59f5-aafc-4cae-a2b2-c364a880e97e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.445452 Aug 30 16:06:47.353221 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 470/852] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:46 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:47.358139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-20774864", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4e9da5ca-14d4-482f-90c9-bfeef67ee437"}], "security_groups": [{"name": "tempest-securitygroup--1722866983"}], "key_name": "tempest-keypair-318817253", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:47.498261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:47.507560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d4587e39-b5d8-4d2a-8b3f-72bd2f7968fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.221044 Aug 30 16:06:47.508142 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 383/853] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:47 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:47.522182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] validate_networks() for [('4e9da5ca-14d4-482f-90c9-bfeef67ee437', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:47.530221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6410298b-a82e-4c4b-aeaf-e0a894da59a7 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d5edee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1512256965", "description": "tempest-description-345598517"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:47.733703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6410298b-a82e-4c4b-aeaf-e0a894da59a7 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.223845 Aug 30 16:06:47.734430 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 384/854] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:47.756842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a22d12e7-ddc0-4437-a181-0b48398a18cb tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35dbd91f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-695181663", "description": "tempest-description-741029918"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:47.934816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a22d12e7-ddc0-4437-a181-0b48398a18cb tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.188687 Aug 30 16:06:47.951128 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 385/855] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:47 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:47.968481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:47.969350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:47.981669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:47.982598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:47.983308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:47.984234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:47.984932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:47.985567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.169649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.178208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0056365-3c19-4e75-a468-7a52303a1066 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.224579 Aug 30 16:06:48.180033 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 386/856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:47 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.184789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.185697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.193282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.193888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.194458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.195335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.196039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.196558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.263225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.267104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:48.272370 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35342f60-62d9-4371-b36f-5022830ca1f5 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1276 microversion: 2.1 time: 0.091246 Aug 30 16:06:48.277579 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 387/857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.278215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:48.278777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:48.279202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:48.279624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:48.280903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.281510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.289410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.289899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.290357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.291047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.291503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.291759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.291924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.292240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.292700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.293423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.293880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.294336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.314948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:48.320250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for user 43d55a1e4a9f4f2b9cb85e010154f284 and project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:48.335142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:48.337440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:48.386182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-392bcd18-6d05-45b4-8955-48ab52362bdc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.031919 Aug 30 16:06:48.387043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 471/858] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:48.391361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59624052-6a36-4bbc-8288-72513085e05b tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d21f4c0>, body: {"security_group_rule": {"parent_group_id": "a505102f-9c27-49df-8822-aa2ab8c543aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "506ed436-a938-4a35-a71c-80ab60840260"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:48.462175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.476038 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-403aecad-0815-4603-8998-298d22aab108 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1647 microversion: 2.1 time: 0.201649 Aug 30 16:06:48.476511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 388/859] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1647 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.495507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.496310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.507040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.507712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.508301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.509240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.509848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.510475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.764288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.773492 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-690fe617-29fb-4a91-9234-e0aace1fd0c8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1471 microversion: 2.1 time: 0.282068 Aug 30 16:06:48.774148 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 389/860] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.779001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a7ee6b9c-c54f-4e3c-af4e-14ddf4efb8a5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.779690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a7ee6b9c-c54f-4e3c-af4e-14ddf4efb8a5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.815455 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59624052-6a36-4bbc-8288-72513085e05b tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.427386 Aug 30 16:06:48.816925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 472/861] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:48 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:48.823824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.825769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.841485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.841992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.842482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.843399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.844058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.844761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.874748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a7ee6b9c-c54f-4e3c-af4e-14ddf4efb8a5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.882083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a7ee6b9c-c54f-4e3c-af4e-14ddf4efb8a5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1232 microversion: 2.1 time: 0.106550 Aug 30 16:06:48.883296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 390/862] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.887923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb1fcb3f-c84e-4faa-af11-a0cf56f10281 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d25f4c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.999569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:49.009394 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0fba692a-1d9c-42a6-b4b2-ac8a157c6826 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.191067 Aug 30 16:06:49.009996 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 473/863] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:49.140697 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb1fcb3f-c84e-4faa-af11-a0cf56f10281 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/506ed436-a938-4a35-a71c-80ab60840260" status: 202 len: 0 microversion: 2.1 time: 0.256138 Aug 30 16:06:49.141298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 391/864] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:48 2022] DELETE /compute/v2.1/os-security-groups/506ed436-a938-4a35-a71c-80ab60840260 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:49.151779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc4d0566-9485-4a9b-8d10-47a621bb0dde tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d242310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.201390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.202276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:49.221952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.223207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.223669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.224387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.224853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.225267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.328310 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc4d0566-9485-4a9b-8d10-47a621bb0dde tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/a505102f-9c27-49df-8822-aa2ab8c543aa" status: 200 len: 247 microversion: 2.1 time: 0.181994 Aug 30 16:06:49.329239 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 474/865] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/os-security-groups/a505102f-9c27-49df-8822-aa2ab8c543aa => generated 247 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:49.334659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.335379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:49.350100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.350637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.351435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.352545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.353241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.353896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.447215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:49.455884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-456a706a-f185-4d76-a1d5-bb41f0894c1a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1276 microversion: 2.1 time: 0.125859 Aug 30 16:06:49.457648 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 475/866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:49.462990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66f150ac-bf54-4780-8a73-bb2435852d58 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35cdd59d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1712752126", "description": "tempest-description-2056544570"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:49.758011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:49.776239 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96bdc64d-af12-4f79-8f2e-a0f0d51e7015 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.575750 Aug 30 16:06:49.786335 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 392/867] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:49.786335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84554004-28f8-4e87-8f71-b966acb4a834", "name": "network-vif-plugged", "status": "completed", "tag": "81db1d56-f6cc-45e1-b149-dcb8e85ae63a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:49.830720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.831250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.831749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.876225 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] Creating event network-vif-plugged:81db1d56-f6cc-45e1-b149-dcb8e85ae63a for instance 84554004-28f8-4e87-8f71-b966acb4a834 on n-h2-830883-28 Aug 30 16:06:49.892815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e7650bae-e581-42dd-a2f6-475002b5746f req-35989203-f2a8-4c5c-a509-49214f9f42c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107545 Aug 30 16:06:49.895196 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 393/868] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:49.900750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.901665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:49.908515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.909250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.910494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.911493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.912693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.913440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.987816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66f150ac-bf54-4780-8a73-bb2435852d58 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.528480 Aug 30 16:06:49.989338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 476/869] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:50.001567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.002566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.026484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.027035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.027455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.028186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.028657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.029091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.262857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.272556 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8603db9-e964-43c3-8fe0-61354528b0c9 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.281733 Aug 30 16:06:50.273187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 477/870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:50.278323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.279053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.285776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.287172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.288059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.289017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.289656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.290091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.309545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:50.375319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.389416 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-529a598d-b8b4-4114-ad1c-a901a861b16d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1284 microversion: 2.1 time: 0.114754 Aug 30 16:06:50.392347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 478/871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:50 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:50.399070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-96a5d950-1bac-40d7-a7df-3bbfbdc8a9ce tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35d111dc0>, body: {"security_group_rule": {"parent_group_id": "56ef3f41-84df-4cb8-b012-32667e043982", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:50.513863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.528664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4c5222aa-b603-461a-899d-457531cd606c tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1647 microversion: 2.1 time: 0.630252 Aug 30 16:06:50.530664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 394/872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1647 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:50.540109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.546111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.561276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.562540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.562990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.563725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.564191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.564628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.775355 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-96a5d950-1bac-40d7-a7df-3bbfbdc8a9ce tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.381386 Aug 30 16:06:50.775975 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 479/873] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:50.781074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91548c73-d40b-404d-ac2c-b1e970b9866e", "name": "network-vif-deleted", "tag": "357650ce-f108-462d-a1ca-c78a7abbcea7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:50.791683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.792633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.793261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.807206 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] Creating event network-vif-deleted:357650ce-f108-462d-a1ca-c78a7abbcea7 for instance 91548c73-d40b-404d-ac2c-b1e970b9866e on n-h2-830883-28 Aug 30 16:06:50.814386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a28f5594-11c5-4288-a0c8-e688d557dfe1 req-c1f1ff4f-bf3c-4170-9925-50e8b9048e35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037133 Aug 30 16:06:50.815626 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 480/874] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:50.823870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.825069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.833598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.834461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.835112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.835848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.836495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.837095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.917413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.933841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d68ca0b9-f239-4794-914d-469eceba234f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1282 microversion: 2.1 time: 0.115923 Aug 30 16:06:50.935447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 481/875] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:50 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:50.940929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-011a06f6-354c-45e8-902c-26865f2352a7 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Action: 'create', calling method: .version_select at 0x7fd35cdd5940>, body: {"security_group_rule": {"parent_group_id": "56ef3f41-84df-4cb8-b012-32667e043982", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:51.130406 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-011a06f6-354c-45e8-902c-26865f2352a7 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.193511 Aug 30 16:06:51.131011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 482/876] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:06:50 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:51.135823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.136861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.143046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.143531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.144197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.145078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.145705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.146155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.218787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.230067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:51.239876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2bfd2856-86f1-44b5-90a2-d51f78087092 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.707949 Aug 30 16:06:51.249371 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 395/877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:50 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.249371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6062757-7953-4d53-b2b4-4089bd3ef662 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d4f8820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.308792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.317498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40408a53-0dfe-4bb7-b576-7fb17e609fd5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.185305 Aug 30 16:06:51.318140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 483/878] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.323174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.323840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.330337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.332807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.333953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.334869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.335363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.335810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.355469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6062757-7953-4d53-b2b4-4089bd3ef662 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/56ef3f41-84df-4cb8-b012-32667e043982" status: 200 len: 665 microversion: 2.1 time: 0.113386 Aug 30 16:06:51.364889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 396/879] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/os-security-groups/56ef3f41-84df-4cb8-b012-32667e043982 => generated 665 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:51.370098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-969be86e-9098-4026-8276-52b758444f46 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d5ed550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.492966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.500906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17f68c3c-95b1-42ed-977f-7bcbc2dc1fb0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.181745 Aug 30 16:06:51.501639 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 484/880] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.507736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.508613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.526254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.526930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.527449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.528384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.529145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.530025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.606596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.616213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af9acf93-d774-4334-a6c2-ff6ebac76632 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1290 microversion: 2.1 time: 0.113719 Aug 30 16:06:51.630229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 485/881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.630229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.630229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.630229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.630955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.630955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.630955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.630955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.631249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.673099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.673600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.674055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.675398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lazy-loading 'fault' on Instance uuid 91548c73-d40b-404d-ac2c-b1e970b9866e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:06:51.724373 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-969be86e-9098-4026-8276-52b758444f46 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/a975c089-13f2-4a0e-a7c0-67a2d83f5560" status: 202 len: 0 microversion: 2.1 time: 0.358060 Aug 30 16:06:51.725253 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 397/882] 10.222.0.47 () {58 vars in 1287 bytes} [Tue Aug 30 16:06:51 2022] DELETE /compute/v2.1/os-security-group-rules/a975c089-13f2-4a0e-a7c0-67a2d83f5560 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:51.727653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.734851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb6303ed-43c9-4cb6-aa8e-84657378c07e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d547430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.735890 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e07e6b32-4125-444c-86f2-efac34eb52e2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1306 microversion: 2.1 time: 0.117747 Aug 30 16:06:51.736661 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 486/883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.955611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.956254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.963074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.963833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.964449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.965325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.965938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.966628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.121627 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb6303ed-43c9-4cb6-aa8e-84657378c07e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/56ef3f41-84df-4cb8-b012-32667e043982" status: 202 len: 0 microversion: 2.1 time: 0.391284 Aug 30 16:06:52.122212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 398/884] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:51 2022] DELETE /compute/v2.1/os-security-groups/56ef3f41-84df-4cb8-b012-32667e043982 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:52.130528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d25f0d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.151983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.162680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1950ddac-d25e-49fc-9497-cbc0aa18706b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.211121 Aug 30 16:06:52.163282 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 487/885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:52.173313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:52.174059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Neutron security group 506ed436-a938-4a35-a71c-80ab60840260 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:52.174728 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] HTTP exception thrown: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.174728 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Request method failure captured: Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/506ed436-a938-4a35-a71c-80ab60840260 HTTP/1.1 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjWUNvko6S39kJTmd4xx6ESzKpEz00uivReMcAssJXO9GhRilkXGIyWEl448Ccn8sLGPR4jp_W_2zhzMJVxbu1Yr-oMduUtSd6Ajwb_FS9EKnsX28MnWJMRKO0bL1AKK4DqLExiZcd3MoV1NuWccXx2LjdmNKP_kflnEP6SySEFpAVE Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 72abc4118668402786617b2a830d79b0 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1105264207 Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:52.177358 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/72abc4118668402786617b2a830d79b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_72abc4118668402786617b2a830d79b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/72abc4118668402786617b2a830d79b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/72abc4118668402786617b2a830d79b0"}]}] Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1105264207 Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 72abc4118668402786617b2a830d79b0 Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1105264207 Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupRulesTestJSON-1105264207-project Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 5dfcc86f1ab2428faab86ebcdf33f72a Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1105264207-project Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.178976 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '506ed436-a938-4a35-a71c-80ab60840260'} Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:52.179962 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:52.181789 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.183323 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Returning 404 to user: Security group 506ed436-a938-4a35-a71c-80ab60840260 does not exist Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-21ad9cf8-61c5-45e9-b9a7-7d3a6a5a5b08'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab035ec9-9a3e-4efa-ba74-b81713154c20 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/506ed436-a938-4a35-a71c-80ab60840260" status: 404 len: 194 microversion: 2.1 time: 0.052646 Aug 30 16:06:52.184835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 399/886] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:52 2022] DELETE /compute/v2.1/os-security-groups/506ed436-a938-4a35-a71c-80ab60840260 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:52.188466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-040d9f64-5b80-4e5e-a201-e62ce9b1c02e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35cdd5040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.262651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.263454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.271163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.271952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.272636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.273543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.274148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.274744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.404459 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-040d9f64-5b80-4e5e-a201-e62ce9b1c02e tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/a505102f-9c27-49df-8822-aa2ab8c543aa" status: 202 len: 0 microversion: 2.1 time: 0.220047 Aug 30 16:06:52.405237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 488/887] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:52 2022] DELETE /compute/v2.1/os-security-groups/a505102f-9c27-49df-8822-aa2ab8c543aa => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:06:52.411510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.412357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.419350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.419888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.420365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.421072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.421532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.421961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.541777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.549781 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7018c368-dc1c-4520-84db-0be2418a5833 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.291282 Aug 30 16:06:52.564902 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 400/888] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:52.570619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa57c866-9fc2-4ab1-979f-ed06351cfe88 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d46daf0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.573525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.582000 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4c7fc9e-08f5-4af2-84c3-b33cbfd5729f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1308 microversion: 2.1 time: 0.175143 Aug 30 16:06:52.582532 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 489/889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:52.587311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.588103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.594541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.595222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.595840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.596537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.597000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.597988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.732726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.741448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d948602f-339f-4bc7-bdcf-65c5c4c9ef0b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.157756 Aug 30 16:06:52.742336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 490/890] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:52.747049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.747915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.757812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.758326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.758862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.759577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.760040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.760472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.824709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.833364 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-209fe0d7-7af5-4880-95d4-ec8f910c336e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1290 microversion: 2.1 time: 0.089769 Aug 30 16:06:52.834447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 491/891] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:52.839267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.840079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.850896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.851393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.851837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.852549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.853005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.853619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.890600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.891224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.891737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.892261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lazy-loading 'fault' on Instance uuid 91548c73-d40b-404d-ac2c-b1e970b9866e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:06:52.939434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.950316 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f4cda0a-5342-48bf-a0d3-358ab1e92ad5 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 200 len: 1306 microversion: 2.1 time: 0.114695 Aug 30 16:06:52.954423 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 492/892] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:53.187334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.189139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.196976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.197820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.199170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.200760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.201707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.202539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.285060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa57c866-9fc2-4ab1-979f-ed06351cfe88 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/02393a68-f304-4477-a0dd-9588fb667248" status: 202 len: 0 microversion: 2.1 time: 0.718762 Aug 30 16:06:53.286891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 401/893] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:52 2022] DELETE /compute/v2.1/os-security-groups/02393a68-f304-4477-a0dd-9588fb667248 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:53.296333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6eeaa1ee-444e-4582-b6e4-212979f659d9 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35d4f8310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.430469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:53.440539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0881b7f5-1b3b-4a34-ab17-b588e1c68f8c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.259805 Aug 30 16:06:53.441874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 493/894] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:53.572497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.573114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.581136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.582389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.582777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.583865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.584511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.585102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.735841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:53.746831 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-653ec541-7f50-407c-9e66-d48e7b5fe8c2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.178861 Aug 30 16:06:53.747419 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 494/895] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:53.753358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.754805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.762518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.763072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.763542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.764298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.764979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.765718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.821242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6eeaa1ee-444e-4582-b6e4-212979f659d9 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/5eefcbb4-8242-4aa8-af7d-3d9cc16ef834" status: 202 len: 0 microversion: 2.1 time: 0.529440 Aug 30 16:06:53.821844 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 402/896] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:53 2022] DELETE /compute/v2.1/os-security-groups/5eefcbb4-8242-4aa8-af7d-3d9cc16ef834 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:53.827052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba", "tag": "73058020-9300-451a-ac67-655df233a5c7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:53.848371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.848941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.849439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.860926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] Creating event network-changed:73058020-9300-451a-ac67-655df233a5c7 for instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba on n-h2-830883-28 Aug 30 16:06:53.867354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4fa5a80a-b595-4d37-a29f-175ae7faf816 req-1f02483e-1c33-46a6-b3dc-b9700d9778f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043992 Aug 30 16:06:53.868326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 403/897] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:53.876764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.879124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.891800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.892495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.893022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.895408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.895894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.896342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.943557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:53.953835 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-812525ab-216d-40ab-8163-14046cb594d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1487 microversion: 2.1 time: 0.205099 Aug 30 16:06:53.967634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 495/898] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1487 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:53.992391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9931c314-0681-4a9d-8e53-06e4582c9129 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35ce52e50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.182791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:54.184687 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9931c314-0681-4a9d-8e53-06e4582c9129 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/275b16a4-b81a-4066-a3a0-2b61e8dbbca7" status: 202 len: 0 microversion: 2.1 time: 0.215834 Aug 30 16:06:54.188862 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 496/899] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:53 2022] DELETE /compute/v2.1/os-security-groups/275b16a4-b81a-4066-a3a0-2b61e8dbbca7 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:54.196159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.197827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.204604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a2b605c-3381-47ea-8d56-1155df3f0c5e tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.331872 Aug 30 16:06:54.211046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.211548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.211991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.212877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.213340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.213770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.237113 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 404/900] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:54.243581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.244202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.250365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.251066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.251500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.252360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.253054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.253897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.268626 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e HTTP/1.1 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:54.271244 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:54.272887 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '91548c73-d40b-404d-ac2c-b1e970b9866e'} Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:54.273870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:54.275415 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:54.276914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:54.276914 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c9fd621-378d-4cd6-9256-a91d99059226 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 404 len: 111 microversion: 2.1 time: 0.033409 Aug 30 16:06:54.276914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 405/901] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:54.281262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:54.287925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.289191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.289675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.357349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Going to try to stop instance {{(pid=122351) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:06:54.372223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:54.384409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e10e173-8e49-4923-9c46-40219db0d80e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.193663 Aug 30 16:06:54.385884 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 497/902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:54.392497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1612a682-5860-47a2-b981-d963b6fd1c61 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] Calling method '.version_select at 0x7fd35cdd5670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.419716 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-75f809dd-0f4b-4424-afdc-529688d89431 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834/action" status: 202 len: 0 microversion: 2.1 time: 0.141910 Aug 30 16:06:54.420464 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 406/903] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:54 2022] POST /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:54.426429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31489dc8-a9b3-4d4d-bcb0-ed69fa58fa79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d5d1670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.584874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1612a682-5860-47a2-b981-d963b6fd1c61 tempest-SecurityGroupRulesTestJSON-1105264207 tempest-SecurityGroupRulesTestJSON-1105264207-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/87b8c076-d83f-4de0-8111-d6b9593f6614" status: 202 len: 0 microversion: 2.1 time: 0.197454 Aug 30 16:06:54.585575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 498/904] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:54 2022] DELETE /compute/v2.1/os-security-groups/87b8c076-d83f-4de0-8111-d6b9593f6614 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:54.591489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.592222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.605457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.606257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.607078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.607897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.608478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.609015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.802109 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31489dc8-a9b3-4d4d-bcb0-ed69fa58fa79 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0" status: 202 len: 0 microversion: 2.1 time: 0.380134 Aug 30 16:06:54.804638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 407/905] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:54 2022] DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:54.811981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.813043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.823183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.823852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.824482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.825368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.826773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.827467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.837064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:54.850898 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aaa87539-793c-42f4-bffb-c5c055537553 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.263829 Aug 30 16:06:54.868980 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 499/906] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:54.884820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.888617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.896370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.897236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.898591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.899563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.900513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.901039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.905953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:55.011225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:55.018922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cae45017-d986-4c9d-be7b-a09f7904b479 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.213102 Aug 30 16:06:55.020179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 408/907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:55.025604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dce5f0a-6a86-420f-8006-cf5ca5d71439 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d735f70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:55.298590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dce5f0a-6a86-420f-8006-cf5ca5d71439 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42" status: 202 len: 0 microversion: 2.1 time: 0.276358 Aug 30 16:06:55.303927 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 409/908] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:55 2022] DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:55.316334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:55.317278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:55.324573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.325158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.325681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.326946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.327631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.328134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.491551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:55.506489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d5ec551-f989-45e9-8db5-f39d7e78156c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1475 microversion: 2.1 time: 0.633310 Aug 30 16:06:55.521572 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 500/909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1475 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:55.521572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930eb535-b9f1-47f0-ba97-086a35fa1f9d", "name": "network-vif-plugged", "status": "completed", "tag": "c20211d3-fc22-4db8-9855-623f0a7db613"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:55.531381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.532212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.533118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.545771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] Creating event network-vif-plugged:c20211d3-fc22-4db8-9855-623f0a7db613 for instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d on n-h1-830883-28 Aug 30 16:06:55.551763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-18c81b20-958c-4be2-bbb4-ec6833cc39f8 req-2012ce16-29a7-4372-8ac0-52c936f73536 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043238 Aug 30 16:06:55.552516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 501/910] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:55.560388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eae046f6-4272-4db2-896c-5c84f48cf591 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'create', calling method: .version_select at 0x7fd35ce52700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2136098299", "description": "tempest-description-1762379006"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:55.656396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:55.674679 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88b2447a-6099-4974-9837-16e364670fad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.368587 Aug 30 16:06:55.676807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 410/911] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:55 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:55.681946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:55.682904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:55.686127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:55.690404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.690949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.691387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.692311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.692955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.693199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.856722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:55.867262 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-517d446a-0b5c-4b96-8154-81ef1507dd76 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.189182 Aug 30 16:06:55.867936 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 411/912] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:55 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:55.891764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:55.892439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:55.901941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.902785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.903495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.904380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.905366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.905972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.026106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eae046f6-4272-4db2-896c-5c84f48cf591 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.471940 Aug 30 16:06:56.026753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 502/913] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:06:55 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:56.031490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:56.043589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.044450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.045420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.059295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] Creating event network-changed:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h2-830883-28 Aug 30 16:06:56.064660 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-62912336-f7b5-4316-883c-7df7435a4660 req-315a3ed7-732c-4a69-9c62-e035722b6740 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036533 Aug 30 16:06:56.065692 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 503/914] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:56.071699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-258dad0b-e6f0-4642-88b3-f53039df180b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Action: 'update', calling method: .version_select at 0x7fd35cdd5d30>, body: {"security_group": {"name": "tempest-sg-hth-1654559301", "description": "tempest-description-hth-409316928"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:56.372878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-258dad0b-e6f0-4642-88b3-f53039df180b tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "PUT /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d" status: 200 len: 217 microversion: 2.1 time: 0.305398 Aug 30 16:06:56.382611 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 504/915] 10.222.0.47 () {60 vars in 1290 bytes} [Tue Aug 30 16:06:56 2022] PUT /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d => generated 217 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:56.389062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:56.390099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:56.400338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.401198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.401555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.421135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.423303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.425971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.471260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:56.482054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eed91945-1679-4fad-87cf-ddbb34e6d9e9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.595576 Aug 30 16:06:56.494913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 412/916] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:55 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:56.502241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f15bdc5-3d07-4ead-89df-4f8526289e2a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d2b1dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:56.660261 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f15bdc5-3d07-4ead-89df-4f8526289e2a tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d" status: 200 len: 217 microversion: 2.1 time: 0.163462 Aug 30 16:06:56.661163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 413/917] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:06:56 2022] GET /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d => generated 217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:56.670465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:56.671393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:56.681545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.682217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.682682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.683971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.684434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.685091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.730840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:56.739559 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd573a97-b967-42db-93ac-b09dbff62bfe tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.355290 Aug 30 16:06:56.740150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 505/918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:56 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:56.744669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-669bf4c3-1a3c-48b6-b101-04c2990a0781 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35ce479d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:56.827307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:56.835021 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-397f81cb-2d40-40ac-bf69-41f7c95bac95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1474 microversion: 2.1 time: 0.171289 Aug 30 16:06:56.835595 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 414/919] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:56 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1474 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:56.840232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:56.840835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:56.846508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.847202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.847865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.848764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.849371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.849984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.984920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:56.993274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9df99fc0-bfd5-4322-a065-c650a6930ea5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1477 microversion: 2.1 time: 0.156708 Aug 30 16:06:56.993881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 415/920] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:56 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:57.010022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.010678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.016609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.017098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.017537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.018225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.018712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.019296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.151510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:57.160512 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ddd56513-5061-4f12-ba23-f744a321ade2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.164997 Aug 30 16:06:57.161240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 416/921] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:56 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:57.255815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-669bf4c3-1a3c-48b6-b101-04c2990a0781 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d" status: 202 len: 0 microversion: 2.1 time: 0.514607 Aug 30 16:06:57.256501 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 506/922] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:56 2022] DELETE /compute/v2.1/os-security-groups/8fa5c348-dc3b-4821-aae6-dd199dbef04d => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:57.264606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.265103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.272748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.273238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.273670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.274380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.274830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.275250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.289836 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e HTTP/1.1 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.291547 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.293092 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '91548c73-d40b-404d-ac2c-b1e970b9866e'} Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.293973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.295468 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.296891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.296891 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f86a459-5aa9-41a1-8f3e-6b74f7b6bff0 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 404 len: 111 microversion: 2.1 time: 0.032195 Aug 30 16:06:57.296891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 417/923] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.305591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.306240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 91548c73-d40b-404d-ac2c-b1e970b9866e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.312321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.312804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.313252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.313932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.314517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.314948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.330241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e HTTP/1.1 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:57.332710 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.334332 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '91548c73-d40b-404d-ac2c-b1e970b9866e'} Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.335130 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. Aug 30 16:06:57.336516 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.337854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Instance 91548c73-d40b-404d-ac2c-b1e970b9866e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.337854 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45a704c9-195e-44b6-8784-c7181aa4d7de tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e" status: 404 len: 111 microversion: 2.1 time: 0.032432 Aug 30 16:06:57.337854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 507/924] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:57 2022] GET /compute/v2.1/servers/91548c73-d40b-404d-ac2c-b1e970b9866e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.343010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d5edca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.389795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.390471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.391048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.391048 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42 HTTP/1.1 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.392891 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.395826 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '52be0bc2-2257-4d94-a4b2-b4eceeedec42'} Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.396638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.397740 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.400261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 52be0bc2-2257-4d94-a4b2-b4eceeedec42 does not exist Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-77e95784-33e7-4a75-831b-8b1e53605b53'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-905da874-afed-4d18-9b53-f8d6d57429e8 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42" status: 404 len: 194 microversion: 2.1 time: 0.055596 Aug 30 16:06:57.403215 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 418/925] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/52be0bc2-2257-4d94-a4b2-b4eceeedec42 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:06:57.404695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35ce47ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.452598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.453270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.453866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.453866 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0 HTTP/1.1 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:06:57.460814 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.462561 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '065b7904-d4ad-4f7a-85c5-fe64925176f0'} Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.463557 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.464954 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.469692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 065b7904-d4ad-4f7a-85c5-fe64925176f0 does not exist Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-e47c2178-3d37-4992-b36a-7beda8f0d938'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17065bd2-b6ea-462c-ac1d-5ffc361004a4 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0" status: 404 len: 194 microversion: 2.1 time: 0.064607 Aug 30 16:06:57.471087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 508/926] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/065b7904-d4ad-4f7a-85c5-fe64925176f0 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:06:57.475565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d1bd790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.511762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.512358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.512873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.512873 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2 HTTP/1.1 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.515567 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.517111 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3a669b20-c459-40bc-a4d5-eab0021dd0e2'} Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.518028 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.519400 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.520647 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 3a669b20-c459-40bc-a4d5-eab0021dd0e2 does not exist Aug 30 16:06:57.522079 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-51335508-f280-4fad-a996-0df7caeef5da'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.522967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.522967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.523143 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6f8be13-9356-449d-8284-d1b8f766341e tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2" status: 404 len: 194 microversion: 2.1 time: 0.047968 Aug 30 16:06:57.526326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 419/927] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/3a669b20-c459-40bc-a4d5-eab0021dd0e2 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.536818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d2b1940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.542496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.543002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.543446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.546421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.546901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.547341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.587147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.588592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 3c046600-721f-4e1b-a844-005a2ff9b83b not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.589117 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.589117 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b HTTP/1.1 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.591724 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.593183 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3c046600-721f-4e1b-a844-005a2ff9b83b'} Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.594121 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.595406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.596662 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 3c046600-721f-4e1b-a844-005a2ff9b83b does not exist Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-ca96e744-7aec-48d1-9048-200fc89efe54'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-833c52b2-aba0-46c1-8b58-ebfeb7a62dc2 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b" status: 404 len: 194 microversion: 2.1 time: 0.067460 Aug 30 16:06:57.598578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 420/928] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/3c046600-721f-4e1b-a844-005a2ff9b83b => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.621833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d1bd9d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.695296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.696614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.697396 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.697396 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9 HTTP/1.1 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.700129 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.701914 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'eb88db1e-a72d-4d1e-871e-364ef9325dd9'} Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.702913 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.704027 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.705221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group eb88db1e-a72d-4d1e-871e-364ef9325dd9 does not exist Aug 30 16:06:57.709583 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e1e46dfb-e343-45bd-98a7-ae6bf3f7bbc1'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.711324 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21a090d3-662a-490e-a821-040780c5af8f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9" status: 404 len: 194 microversion: 2.1 time: 0.110784 Aug 30 16:06:57.715185 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 421/929] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/eb88db1e-a72d-4d1e-871e-364ef9325dd9 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.723969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "name": "network-vif-unplugged", "status": "completed", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:57.738593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.739284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.740113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.754798 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Creating event network-vif-unplugged:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h1-830883-28 Aug 30 16:06:57.765091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:06:57.780537 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-588f1369-c34e-4f87-8a22-ff02db3b928c req-0734ebad-6086-40af-8c08-0e1c9698a811 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065653 Aug 30 16:06:57.782034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 422/930] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:57.788747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d3d1280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.823188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:06:57.829999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Neutron security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:06:57.830932 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.830932 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 HTTP/1.1 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:06:57.835136 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.836460 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1d7aca8c-aa19-4f1b-9013-b5f613225c31'} Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.837236 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:06:57.839634 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.840704 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] Aug 30 16:06:57.841914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:06:57.844871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Security group 1d7aca8c-aa19-4f1b-9013-b5f613225c31 does not exist Aug 30 16:06:57.844871 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-31a83ab5-95dc-4b11-844f-4d38fd659fec'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:57.846538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f359bbe3-9bf0-4bb1-9b05-6ca7242958af tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31" status: 404 len: 194 microversion: 2.1 time: 0.062746 Aug 30 16:06:57.848252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 423/931] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/os-security-groups/1d7aca8c-aa19-4f1b-9013-b5f613225c31 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:57.855540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.856607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.870922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.872328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.873095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.876787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.877541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.878658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.907366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:57.923349 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61794150-a634-4b37-97ea-bc2b314ba472 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.418094 Aug 30 16:06:57.926340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 509/932] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:57 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:57.944386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:57.945314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:57.952633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.953423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.954116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.955053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:57.955723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:57.957197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:57.994156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:58.117622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf9e4047-3a9b-419f-a523-155d3accb958 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 204 len: 0 microversion: 2.1 time: 0.186316 Aug 30 16:06:58.122080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 510/933] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:57 2022] DELETE /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:58.130710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.131266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.138954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.139984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.140802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.141720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.142394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.142827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.169839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.181224 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfa438e9-998d-4157-8940-b1dcc7bbad5a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.331485 Aug 30 16:06:58.182545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 424/934] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:57 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.187731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.188341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.194996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.195792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.196584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.197533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.198068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.198589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.306212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.319526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.329208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad06578c-7c30-4012-83f1-c3626a51963d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1474 microversion: 2.1 time: 0.204848 Aug 30 16:06:58.329785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 511/935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.334985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.335594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.337330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.347017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.348105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.348843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.349544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.350002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.350458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.431993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.440376 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38f9953c-9637-4682-ab76-b5cc51b36bbd tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1463 microversion: 2.1 time: 0.256544 Aug 30 16:06:58.441571 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 425/936] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1463 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.446524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.447215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.454132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.454922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.455574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.457157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.457865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.458510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.509513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.517324 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a66b5bb1-ef40-4200-bb55-79af848f3d12 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1646 microversion: 2.1 time: 0.186603 Aug 30 16:06:58.517904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 512/937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1646 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.523955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.524571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.530850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.531341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.531786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.532483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.532944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.533721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.672384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.684563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:58.686130 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05c30b9e-305c-4bfb-ae20-ed66e25567ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.243009 Aug 30 16:06:58.687191 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 426/938] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.694693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d68efcab-57c2-451a-ad51-67d7d2d3bae4 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1463 microversion: 2.1 time: 0.175494 Aug 30 16:06:58.695469 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 513/939] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:58.715829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:58.718784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.725483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.726167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.726791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.727675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.728309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.728923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.807989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.822642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:58.822969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:58.823639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:58.824056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:58.824465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:58.879799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:58.894738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.901872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.902482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.903129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.904041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.904768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.905283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.934480 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9f9ffcc-58a1-4b4b-91aa-38cbf930cd7a tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 1067 microversion: 2.1 time: 0.222649 Aug 30 16:06:58.944943 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 427/940] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:06:58 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 1067 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 16:06:58.946658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.949116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.954293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:58.955246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:58.956169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.957963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.958522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.959647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.960282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.960739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.965342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.966156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.967158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:58.970084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:58.970575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:58.971005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.142167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:59.150961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ec322018-3599-4305-99cd-2992c5908f64 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.209700 Aug 30 16:06:59.151654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 514/941] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:59.207652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:59.208165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:59.214933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.216257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.216931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.218167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.218866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.219508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.420735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:59.428208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:59.439397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da7491c5-bba1-4698-a1b1-fe4354aa69bc tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.490741 Aug 30 16:06:59.446793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b1b28ba-a2e7-4b43-b3a5-6ae989c51767 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.244604 Aug 30 16:06:59.447932 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 515/942] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:59 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:59.458691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 428/943] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:58 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:59.462523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:59.463291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:59.465637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:59.473151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.474182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.477387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.478609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.479961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.480539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.538751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:59.539367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:59.565531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.571531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.572330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.587144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.589216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.590564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.699893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:59.717344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c28c9e39-789e-4752-93d6-baeb9535a3a7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1474 microversion: 2.1 time: 0.268065 Aug 30 16:06:59.717885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 516/944] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:59 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:59.724003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:59.725081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:59.755578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.756103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.756637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:59.757274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:59.757747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:59.758167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.324313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:00.337164 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a94c3dc9-0f51-4896-84be-3670050ef898 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.617108 Aug 30 16:07:00.338176 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 517/945] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:59 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:00.345571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:00.376206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.376769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.377271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.405932 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Creating event network-changed:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h1-830883-28 Aug 30 16:07:00.433924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:07:00.461597 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d1f218d8-aeff-4c55-b9a3-c224c30ccc0a req-f2e20d54-e92e-4f4c-b0d6-7b5d38f90c2d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121205 Aug 30 16:07:00.463951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 518/946] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:00.474686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:00.479278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:00.492499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.492856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.493393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.494198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.494890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.495379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.689798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:00.703848 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6fd7ea3f-431c-4c34-9132-673026df3567 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1646 microversion: 2.1 time: 1.168711 Aug 30 16:07:00.721125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 429/947] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:59 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1646 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:00.732477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:00.735736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:00.736369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:00.744572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.745108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.745548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.746257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.746741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.747354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.749302 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac3dcfac-d132-46f6-a468-dda667ffd0ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.285205 Aug 30 16:07:00.752839 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 519/948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:00 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:00.771029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:00.773972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:00.791039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.791627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.792330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:00.793264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:00.793939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:00.794620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.074580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.088826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bcdbc013-3085-4114-8183-749f09f49e9a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.333101 Aug 30 16:07:01.094568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.105000 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 520/949] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:00 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.111795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:01.112170 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ac18244-a84d-4842-bfdd-d39fd79093f3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.380231 Aug 30 16:07:01.114048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:01.114700 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 430/950] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:00 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.121602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.122420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.123092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.124303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.124926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.125514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.144555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:01.308854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d31955a-ce1d-49cf-866e-34d2f46e998c", "name": "network-vif-deleted", "tag": "99639d14-a8a9-4469-bb89-63e6740a376c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:01.319691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.326121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.327396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.328017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.329286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e902d6f4-e808-4f77-a3b4-13b40f62a26b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1472 microversion: 2.1 time: 0.223249 Aug 30 16:07:01.335613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 521/951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:01 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.346412 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] Creating event network-vif-deleted:99639d14-a8a9-4469-bb89-63e6740a376c for instance 8d31955a-ce1d-49cf-866e-34d2f46e998c on n-h1-830883-28 Aug 30 16:07:01.352899 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8f40c32d-edba-4171-8671-8b6d4c135d5e req-ce729916-29e7-4ee1-84ce-aaf7052e6e7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048524 Aug 30 16:07:01.354000 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 431/952] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:01.364022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:01.364661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:01.370733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.371443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.372516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.373270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.373702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.374131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.551429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.561223 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b27e28ed-3138-413a-9025-1936ccaaf5d8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.201229 Aug 30 16:07:01.561822 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 522/953] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:01 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.725669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:01.726707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:01.734117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.734659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.735100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.735811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.736269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.736698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.776104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:01.795046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:01.802197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.802732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.803202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.803993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:01.804468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:01.804902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:01.817318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.826422 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecac38c7-7c81-4058-9cfc-dd9647badd0f tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1468 microversion: 2.1 time: 0.104698 Aug 30 16:07:01.827489 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 432/954] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:01 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1468 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.961269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:01.970954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db46ba46-ee7e-4a28-94f1-6302a3566f10 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.201831 Aug 30 16:07:01.971953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 523/955] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:01 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:01.990897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba", "name": "network-vif-plugged", "status": "completed", "tag": "73058020-9300-451a-ac67-655df233a5c7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:02.001147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.001625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.002056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.017136 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] Creating event network-vif-plugged:73058020-9300-451a-ac67-655df233a5c7 for instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba on n-h2-830883-28 Aug 30 16:07:02.024876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a239ae2e-efda-4da4-9185-31956990f116 req-e412c42f-5807-44ab-a65d-ced4552e74ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037621 Aug 30 16:07:02.026258 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 433/956] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:02.115660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:02.116273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:02.123267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.123911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.124444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.125263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.125912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.126501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.138433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:02.139026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:02.156764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.157221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.157931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.158774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.159229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.160177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.303778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:02.318081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6cd9409c-6373-4ab0-82bb-292ee465d3a9 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.206662 Aug 30 16:07:02.320371 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 524/957] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:02 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:02.355009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:02.356017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:02.364696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.365619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.366293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.367696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.368692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.369417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.465349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:02.474175 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f8fc215-746c-4986-80f5-c04b56e6cd18 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.340171 Aug 30 16:07:02.474893 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 434/958] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:02 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:02.586357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:02.587065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:02.596638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.599346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.600495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.601863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.605391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.608265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.678633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:02.690289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e03ec40-f8ee-4f68-867f-f31626a4f3a5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1472 microversion: 2.1 time: 0.341511 Aug 30 16:07:02.691503 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 525/959] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:02 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:02.853931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:02.857094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:02.877370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.883272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.885473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.886512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.887076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.887715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.939286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:02.940071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:02.941321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:02.942028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lazy-loading 'fault' on Instance uuid 8d31955a-ce1d-49cf-866e-34d2f46e998c {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:03.021830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7460aaf7caf743c7a16249dc67123b41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb257ea23314fb1a37c24e9d58368b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.034546 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b989beca-aa40-4db5-9665-5ca7d975e0f7 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 200 len: 1306 microversion: 2.1 time: 0.189115 Aug 30 16:07:03.036796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 526/960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:02 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:03.043045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:03.043807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.050824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.051645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.052449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.053320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.054547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.055173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.105805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.121429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c1f49410-3b31-4ca2-9760-9761215a7250 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.541218 Aug 30 16:07:03.122372 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 435/961] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:02 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:03.307780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.317194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f597abf5-3712-40dd-ba80-91f83f3e14b5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.278966 Aug 30 16:07:03.317788 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 527/962] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:03 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:03.341162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:03.341776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.351521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.352895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.355932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.359082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.360302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.360877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.496662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:03.497499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.504759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.505264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.506471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.507562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.508326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.508970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.708740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.716864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-155a4337-9f48-4e20-aec7-60090024c53e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1324 microversion: 2.1 time: 0.379688 Aug 30 16:07:03.717506 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 436/963] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:03 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:03.724228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:03.724947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.728043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.731228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.731967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.732640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.733915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.734619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.735163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.739301 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c70e5b7-ffe3-4e25-a826-6fb42a3bc2e0 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.246438 Aug 30 16:07:03.739893 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 528/964] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:03 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:03.917410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:03.928739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b93d073-9f3c-4dc4-b5b7-bc4e4eb775df tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1469 microversion: 2.1 time: 0.209524 Aug 30 16:07:03.929349 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 437/965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:03 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:03.951679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:03.952475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.964507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.965433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.966128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.967460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.968112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.968702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.062541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:04.063755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] [instance: 8d31955a-ce1d-49cf-866e-34d2f46e998c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:04.063882 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1b9c609-4d26-4457-b15e-24390f133c88 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89/action" status: 204 len: 0 microversion: 2.1 time: 0.116892 Aug 30 16:07:04.069412 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 529/966] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:03 2022] POST /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:04.073752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.074546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.075258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.076747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.077629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.078351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.082845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:04.088501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:04.104154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.104757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.105267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.107322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.108698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.109223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.111912 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] HTTP exception thrown: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Request method failure captured: Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c HTTP/1.1 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVJvCUdLn-oKbha50mAtA7r2u4MS8L_zA-D0yzkP48VHWWwKWRm9WcUhBZU08uW8Y8YQvCXGLNHz9OGUAUtVYwcykHo6okzhQF3ZGfqtXRloWsm6zYJJeQMUkCiJxdpAhnqEFBAqMfp5PD1sEUmDBBeVjfXI0MwLlmKSGnnEkrw_lE Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:04.114070 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2cb257ea23314fb1a37c24e9d58368b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2cb257ea23314fb1a37c24e9d58368b7"}]}] Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2cb257ea23314fb1a37c24e9d58368b7 Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1923383469 Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7460aaf7caf743c7a16249dc67123b41 Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsTestJSON-1923383469-project Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. Aug 30 16:07:04.115599 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8d31955a-ce1d-49cf-866e-34d2f46e998c'} Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:04.116447 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. Aug 30 16:07:04.117887 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:04.119192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Returning 404 to user: Instance 8d31955a-ce1d-49cf-866e-34d2f46e998c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:04.120454 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28d70120-f4cc-45af-9740-434b5514ed5d tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c" status: 404 len: 111 microversion: 2.1 time: 0.059008 Aug 30 16:07:04.121060 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 438/967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:04 2022] GET /compute/v2.1/servers/8d31955a-ce1d-49cf-866e-34d2f46e998c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:04.137120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9fda4324-0a2e-4eaa-88ad-5f966efa0ebd tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35d7e4820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:04.527833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:04.543564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-39973e92-cd14-4a79-b660-edc4e4ccf39c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1469 microversion: 2.1 time: 0.467976 Aug 30 16:07:04.563058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 530/968] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:04 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:04.574015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:04.574742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:04.586329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.587356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.587975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.588779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.589296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.590343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.930647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:04.939820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50594070-fa93-48e4-bd39-510903d85a11 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.374423 Aug 30 16:07:04.959321 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 531/969] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:04 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:04.964400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:04.975597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:04.989141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.989953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.990629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:04.991580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:04.992251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:04.992876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.037150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9fda4324-0a2e-4eaa-88ad-5f966efa0ebd tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/da4ff018-dd1c-48bb-b2b2-ba1afc5842b1" status: 202 len: 0 microversion: 2.1 time: 0.911012 Aug 30 16:07:05.038206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 439/970] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:04 2022] DELETE /compute/v2.1/os-security-groups/da4ff018-dd1c-48bb-b2b2-ba1afc5842b1 => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:05.043095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:05.043795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:05.056568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.059288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.059906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.060822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.062864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.063475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.304707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:05.343558 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aab0476a-0aee-4f07-b8b5-8d020ebfb247 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 200 len: 1520 microversion: 2.1 time: 0.304214 Aug 30 16:07:05.358384 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 440/971] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:05 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:05.370690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:05.371351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:05.377486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.378545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.379078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.380678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.381145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.381580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.474620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:05.488598 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b55b4da-accd-4060-acab-b6d274508754 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.527151 Aug 30 16:07:05.489213 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 532/972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:04 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:05.498540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-109ef576-a4fa-447f-bc46-ac62ed0f5c35 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] Calling method '.version_select at 0x7fd35cda8430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:05.565244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:05.573920 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f1625e3-fd14-4db9-b09e-335e1850a476 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.220219 Aug 30 16:07:05.574543 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 441/973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:05 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:05.579382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: .version_select at 0x7fd35eaebf70>, body: {"addFloatingIp": {"address": "172.25.3.169"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:05.582796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:05.589275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.589835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.590274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.591003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.591454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.591904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.665365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:07:05.665766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquired lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:07:06.391989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-109ef576-a4fa-447f-bc46-ac62ed0f5c35 tempest-SecurityGroupsTestJSON-1923383469 tempest-SecurityGroupsTestJSON-1923383469-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/795a2945-549e-4395-b842-2257e2ed7bbf" status: 202 len: 0 microversion: 2.1 time: 0.901362 Aug 30 16:07:06.393122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 533/974] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:05 2022] DELETE /compute/v2.1/os-security-groups/795a2945-549e-4395-b842-2257e2ed7bbf => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:06.400047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "name": "network-vif-plugged", "status": "completed", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:06.418869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.419799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.420457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.437460 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Creating event network-vif-plugged:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h1-830883-28 Aug 30 16:07:06.445020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:07:06.460123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-009b26cc-edc3-435c-9452-9d70933b49ce req-e7e8f424-993d-4075-8602-b8def0bca68c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064750 Aug 30 16:07:06.461885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 534/975] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:06.467689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:06.469326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:06.480609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.481595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.484062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.485456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.486205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.486882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.974451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:06.983981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84439ec8-03b7-4da2-8e18-91ac9a7f3f1b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1469 microversion: 2.1 time: 0.520528 Aug 30 16:07:06.984881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 535/976] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:06 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1469 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:06.990324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:06.991308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:07.003223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.003740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.004195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.004917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.005386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.006016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.465998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:07.469610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:07.474132 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41f14ba8-47a3-4aa6-bf9a-c69ffd7b8719 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.488042 Aug 30 16:07:07.474753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 536/977] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:06 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:07.479761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:07.480538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:07.486696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.487438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.488130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.488914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.489528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.490115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.788520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:07.792632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:07.818970 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37beaec7-948b-4bf2-a4f1-80a19ee2c621 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.342853 Aug 30 16:07:07.820123 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 537/978] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:07 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:07.825493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:07.827974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:07.838496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.839326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.839939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.840650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.841112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.841544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.183443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Updating instance_info_cache with network_info: [{"id": "32ee36ce-c04a-4df0-9d9d-424f1271454c", "address": "fa:16:3e:cd:44:16", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32ee36ce-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:08.205545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:08.224757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-883c8bf0-ceb5-419b-a157-c3e5e1e5dbec tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.403243 Aug 30 16:07:08.230655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Releasing lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:07:08.233034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-482c2581-98bf-4526-9cba-8d9cb2a332eb tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action" status: 202 len: 0 microversion: 2.1 time: 2.657491 Aug 30 16:07:08.235195 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 442/979] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:05 2022] POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action => generated 0 bytes in 2660 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:07:08.240043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 538/980] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:07 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:08.246486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:08.257371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.258141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.258763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.259003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:08.260135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:08.273587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] Creating event network-changed:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:07:08.278295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.278853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.281290 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-76f59472-4d16-4bdc-a242-894d518f2fee req-26111508-3d03-4ae2-83d5-fe6f72adb39f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039992 Aug 30 16:07:08.282173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 539/981] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:08.282630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.283537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.285875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.287758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.301309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: .version_select at 0x7fd35eaebf70>, body: {"addFloatingIp": {"address": "172.25.3.169"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:08.312337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:08.337530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.338608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.339440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.340351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.341150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.341791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.428806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:07:08.429529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquired lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:07:08.687831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:08.698106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd5fd372-bffb-4752-9c02-d40816a9f98f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1461 microversion: 2.1 time: 0.455092 Aug 30 16:07:08.718183 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 443/982] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:08 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1461 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:08.723623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:08.724537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:08.731373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.732117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.732613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.733319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.733773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.734206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.762734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:09.040003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:09.051320 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03d9dbce-9a05-4af9-8127-416b59f91faa tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.331643 Aug 30 16:07:09.067540 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 444/983] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:08 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:09.073089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:09.073713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:09.099730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.101435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.102423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.103306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.103924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.104504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.462150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd723993-a430-4c34-bcad-570266c23673 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1614 microversion: 2.1 time: 0.392721 Aug 30 16:07:09.463530 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 445/984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:09 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1614 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:09.469591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "name": "network-vif-plugged", "status": "completed", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:09.501352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.501852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.502287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.522246 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] Creating event network-vif-plugged:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h2-830883-28 Aug 30 16:07:09.530851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-79005beb-1051-4315-925d-85ace63ca46c req-57673668-6f0e-4e0f-9bac-de903b5f264a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065103 Aug 30 16:07:09.537333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 446/985] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:09.548991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:09.551081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:09.561137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.562466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.563161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.564520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.565179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.567815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.036251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:10.045084 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3f281f9-1832-4df6-9ed8-52cc3316d1ad tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.505233 Aug 30 16:07:10.062353 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 447/986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:09 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:10.062906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:10.063540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:10.077134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.077762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.078325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.079167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.079716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.080260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.355584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:10.374018 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-377b7b99-ecdc-4cd0-b733-fe76dc0e96ad tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.322185 Aug 30 16:07:10.375062 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 448/987] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:10 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:10.380069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-045b58d4-0217-4058-855b-5dc682d0dff8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '.version_select at 0x7fd35d3e6280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:10.383793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045b58d4-0217-4058-855b-5dc682d0dff8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.384474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045b58d4-0217-4058-855b-5dc682d0dff8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.385078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045b58d4-0217-4058-855b-5dc682d0dff8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.399219 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-045b58d4-0217-4058-855b-5dc682d0dff8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.022938 Aug 30 16:07:10.400406 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 449/988] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:07:10 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:10.405792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:10.406675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:10.415364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.416119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.416944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.417810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.418465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.419067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.702914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:10.712930 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0f2f0ee-b43b-4fec-ad01-f83b48d151e5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1358 microversion: 2.1 time: 0.311239 Aug 30 16:07:10.713806 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 450/989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:10 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:10.726986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-532441690", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:10.819083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:07:11.703451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:07:11.704513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:07:11.705369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:07:11.706534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:07:11.707113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:07:11.729474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:11.729887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:11.733815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:11.734683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:11.735155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:11.736681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:11.761420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:07:11.767395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:07:11.782644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:07:11.787143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:07:11.850423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bde832ce-5441-4e49-a4ab-e4c7be0dd27f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135212 Aug 30 16:07:11.851732 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 451/990] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:07:11.856590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:11.857465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:11.864116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:11.864966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:11.865623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:11.866624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:11.867301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:11.867944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.191847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:12.199884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d600b35-7021-45fc-bc82-fb4c83b8e984 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.346931 Aug 30 16:07:12.200461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 452/991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:11 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:12.208486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:12.209102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:12.221039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.222197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.222668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.230492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.231801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.232253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.752034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:12.769571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d385255-86a9-4da0-8c2c-83fa86321052 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.564803 Aug 30 16:07:12.770559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 453/992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:12 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:12.782974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:12.788642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:12.800775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.807382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.808053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.808825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.809365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.809847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.860083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:13.078283 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d25c00a3-48c0-46a2-920b-10aef8555077 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 204 len: 0 microversion: 2.1 time: 0.303795 Aug 30 16:07:13.079774 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 454/993] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:12 2022] DELETE /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:13.099765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:13.101093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:13.110239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.111036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.111674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.112703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.113402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.114019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.236104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.neutron [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] re-assign floating IP 172.25.3.169 from instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf Aug 30 16:07:13.345671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Building network info cache for instance {{(pid=122352) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:13.613003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:13.625513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-016c930b-6387-45b0-b47c-126e7d61611d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1541 microversion: 2.1 time: 0.542624 Aug 30 16:07:13.626215 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 455/994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:13 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1541 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:13.636910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:13.637871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:13.662940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.663407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.663905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.664576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.671403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.671937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.801957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:13.823137 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-974869fa-dc1c-426c-8d4b-57d517aec0fc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1264 microversion: 2.1 time: 0.195695 Aug 30 16:07:13.827933 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 456/995] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:13 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:14.089852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e3ea5a9-d682-4a0d-939f-1d5669b4d700 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35ce05820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-978897414", "description": "tempest-description-1112324478"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:14.183653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Updating instance_info_cache with network_info: [{"id": "32ee36ce-c04a-4df0-9d9d-424f1271454c", "address": "fa:16:3e:cd:44:16", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32ee36ce-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122352) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:14.207759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Building network info cache for instance {{(pid=122352) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:14.485469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e3ea5a9-d682-4a0d-939f-1d5669b4d700 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.655458 Aug 30 16:07:14.486345 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 457/996] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:07:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:14.503235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:14.504195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:14.511928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:14.525399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.526186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.527360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.528238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.528858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.529582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.770958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:14.788020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49d77cf3-88d7-4537-91af-82decf042a65 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1711 microversion: 2.1 time: 0.290697 Aug 30 16:07:14.788816 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 458/997] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:14 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1711 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:14.808158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:14.820779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.821526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.822122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.837358 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] Creating event network-changed:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:07:14.844514 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1f575f86-f2a4-4a36-9b2a-b7fe18218c87 req-f0d2eecd-538e-42c1-884d-08efb78bc77c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040382 Aug 30 16:07:14.846041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 459/998] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:14.851898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:14.852819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:14.860194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.860919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.861550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.862506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.863175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.864344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.111979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:15.133705 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdd559a4-3080-47c3-b30e-66af8901bb44 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.285592 Aug 30 16:07:15.135009 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 460/999] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:14 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:15.147125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:15.149776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:15.164375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.166556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.167162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.168756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.170985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.171599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.361214 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9439767a-18ec-46cb-b3dd-aa88de193121 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224831 Aug 30 16:07:15.362945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 461/1000] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:07:15 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:15.367591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:15.368334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:15.383199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.383199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.383199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.386423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.387235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.387704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.062529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:16.079576 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b90f19b7-90dc-4c6b-8324-e786037739d5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.715473 Aug 30 16:07:16.080189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 462/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:15 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:16.109809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d10a73d3-2f20-4ddb-adc0-d6bc07d4b54b tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35d54fca0>, body: {"security_group_rule": {"parent_group_id": "f486ef21-cd0b-4043-89a8-3a67d7a03074", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:16.431864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Updating instance_info_cache with network_info: [{"id": "73058020-9300-451a-ac67-655df233a5c7", "address": "fa:16:3e:78:2a:17", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73058020-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122352) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:16.466101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Releasing lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:07:16.476872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5496a6f7-a3fd-4852-af15-6a8d88465289 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba/action" status: 202 len: 0 microversion: 2.1 time: 8.191385 Aug 30 16:07:16.481217 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 540/1002] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:08 2022] POST /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba/action => generated 0 bytes in 8198 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:07:16.506492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:16.510858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:16.529400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.530280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.542912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.546575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.549349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.550268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.659736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d10a73d3-2f20-4ddb-adc0-d6bc07d4b54b tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.559939 Aug 30 16:07:16.666607 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 463/1003] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:16.666607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:16.667128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:16.677684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.678179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.678912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.679858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.680514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.681605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.703932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:16.771261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:16.785803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75c5cc41-0dfb-443d-a8c2-1086dd21fa44 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1270 microversion: 2.1 time: 0.301608 Aug 30 16:07:16.786427 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 541/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:16 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:16.802679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:16.805357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:16.821440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.825101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.825990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.828317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:16.830808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:16.831540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:17.109787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d70771a4b1486c84483dbf5897bfb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a929e510bc647eaaa73df2a64291566', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:17.131251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f3a3cb0-b4ca-41fb-9a3b-a066113250de tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 200 len: 1711 microversion: 2.1 time: 0.469214 Aug 30 16:07:17.135005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 464/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:16 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 1711 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:17.164103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: .version_select at 0x7fd35eaeb4c0>, body: {"removeFloatingIp": {"address": "172.25.3.169"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:17.499569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:17.509293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:17.511502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:17.512749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:17.513730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:17.514661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:17.515350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:17.842229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:17.850987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] HTTP exception thrown: Floating IP 172.25.3.169 is not associated with instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf. Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Request method failure captured: Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action HTTP/1.1 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 49 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjV4nv23Pd1ML6CHU1Sndnndk32TDa1S1P9onyP3QU0zb088sblQJ5SlQne9rf_xnpE0KoJXbESwgXy5-HqYnVeiUISTYMTSH-2tNBex1sjJJKup6ZPoBb5q6LECuc6gsVYccZRA74DJmlsN-fG9m0dRMIfKpfW8NSI7XFe3OLaIbK0 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:17.853362 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}] Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b31b992df85c411d9e93bec3b8c474d6 Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: {"removeFloatingIp": {"address": "172.25.3.169"}} Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:07:17.854952 n-d-830883-28 devstack@n-api.service[122351]: exception: Floating IP 172.25.3.169 is not associated with instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf. Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7128abb2-62ff-4b86-adf2-a6bfbf9651cf', 'body': {'removeFloatingIp': {'address': '172.25.3.169'}}} Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.169 is not associated with instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf. Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.855882 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.169 is not associated with instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf. Aug 30 16:07:17.857314 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.859415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Returning 409 to user: Floating IP 172.25.3.169 is not associated with instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:17.860489 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd5a52f7-ea2d-48ae-a389-2a28afe9f483 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action" status: 409 len: 146 microversion: 2.1 time: 0.724273 Aug 30 16:07:17.861222 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3a4c720-88ba-47fe-a612-571d3b0ea065 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 1.069990 Aug 30 16:07:17.862402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 465/1006] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:17 2022] POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action => generated 146 bytes in 726 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:07:17.867287 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 542/1007] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:16 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:17.869429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6650dfcd-797f-4a74-81e8-c93db3046729 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35ce05700>, body: {"security_group_rule": {"parent_group_id": "f486ef21-cd0b-4043-89a8-3a67d7a03074", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:17.952551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6650dfcd-797f-4a74-81e8-c93db3046729 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6650dfcd-797f-4a74-81e8-c93db3046729 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 138 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:17.954929 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: {"security_group_rule": {"parent_group_id": "f486ef21-cd0b-4043-89a8-3a67d7a03074", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 16:07:17.957212 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: exception: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f486ef21-cd0b-4043-89a8-3a67d7a03074', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:17.957988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:17.959226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6650dfcd-797f-4a74-81e8-c93db3046729 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: This rule already exists in group f486ef21-cd0b-4043-89a8-3a67d7a03074 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:17.970562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6650dfcd-797f-4a74-81e8-c93db3046729 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.106116 Aug 30 16:07:17.974385 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 466/1008] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:17 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:07:17.991873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba", "tag": "73058020-9300-451a-ac67-655df233a5c7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:18.008105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.008655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.009421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.025746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] Creating event network-changed:73058020-9300-451a-ac67-655df233a5c7 for instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba on n-h2-830883-28 Aug 30 16:07:18.033785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-119d9932-55ed-4c7f-a482-a4803e48751e req-c896b5ce-d546-494a-8d8a-cadb36ea22fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055448 Aug 30 16:07:18.035853 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 467/1009] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:18.043032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:18.047294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:18.056912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.057562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.058171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.059103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.059665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.060395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.199264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:18.202279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.203465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.204975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.207609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.208207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.212109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.241446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:18.251459 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6241ab0a-fc77-47b4-88cd-f7e2ffca3974 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.213911 Aug 30 16:07:18.266150 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 468/1010] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:18 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:18.266150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16929167-e0e7-4a5a-a47f-b9b15900db58", "name": "network-vif-deleted", "tag": "1e9d38f5-458d-4238-b6f3-9d0caec9bf1b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:18.267961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.269064 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf0296b7-253f-40f2-9d98-365d260a409d tempest-AZV2TestJSON-1703021075 tempest-AZV2TestJSON-1703021075-project] 10.222.0.47 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.399695 Aug 30 16:07:18.269172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.269662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.269779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 543/1011] 10.222.0.47 () {58 vars in 1164 bytes} [Tue Aug 30 16:07:17 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:07:18.284217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:18.284460 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] Creating event network-vif-deleted:1e9d38f5-458d-4238-b6f3-9d0caec9bf1b for instance 16929167-e0e7-4a5a-a47f-b9b15900db58 on n-h2-830883-28 Aug 30 16:07:18.285279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:18.289922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7167bd6e-9eee-41a1-8223-970ce6895d09 req-7c959091-3c16-4705-b429-c32d8afc7bb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Aug 30 16:07:18.293676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 469/1012] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:18.300349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.300558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.169"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:18.301549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.302394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.303988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.304692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.305359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.821970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:18.828887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.829681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.831167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.832106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:18.832772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:18.833436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:18.882604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:18.901979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8b668c9-a00e-46fc-bc64-e49d92015e0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1312 microversion: 2.1 time: 0.622603 Aug 30 16:07:18.909370 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 544/1013] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:18 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:18.921827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e1c98c3-241c-4869-9450-f82a9977b92f tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35cda8a60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:19.139206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:07:19.139671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquired lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:07:19.599725 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e1c98c3-241c-4869-9450-f82a9977b92f tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/732f671f-9cf2-4524-9af5-f9f3343a05a3" status: 202 len: 0 microversion: 2.1 time: 0.688728 Aug 30 16:07:19.608469 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 545/1014] 10.222.0.47 () {58 vars in 1287 bytes} [Tue Aug 30 16:07:18 2022] DELETE /compute/v2.1/os-security-group-rules/732f671f-9cf2-4524-9af5-f9f3343a05a3 => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:19.616112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:19.618625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:19.630566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:19.631329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:19.633088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:19.634051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:19.635303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:19.635956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:19.657466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 HTTP/1.1 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:19.659927 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:19.661339 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '16929167-e0e7-4a5a-a47f-b9b15900db58'} Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:19.662085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:19.664309 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:19.670145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:19.670145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66e2745c-f248-426e-911e-7b3a2d60baae tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 404 len: 111 microversion: 2.1 time: 0.054530 Aug 30 16:07:19.670145 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 546/1015] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:19 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:19.670145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:19.670739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:19.677493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:19.677999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:19.678479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:19.679183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:19.679644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:19.680073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.093931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:20.125719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-528a6ee9-d91c-4f59-85d0-f9831467ea26 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.459461 Aug 30 16:07:20.126726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 547/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:19 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:20.141914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:20.145392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:20.156783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:20.164004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.164618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.165163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.165979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.166641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.167441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.459446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:20.469623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59568bda-c537-4113-9b17-4a25cd56a3ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.341609 Aug 30 16:07:20.470718 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 548/1017] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:20 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:20.486790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89c14239-a7cd-4a22-bb42-d66c5f525d6f tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35cda8ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1418254188", "description": "tempest-description-783693633"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:20.904296 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89c14239-a7cd-4a22-bb42-d66c5f525d6f tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.431813 Aug 30 16:07:20.904933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 549/1018] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:07:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:20.911059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:20.911569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:20.919241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Updating instance_info_cache with network_info: [{"id": "73058020-9300-451a-ac67-655df233a5c7", "address": "fa:16:3e:78:2a:17", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap73058020-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:20.922814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.923593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.924044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.926256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.926902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.928121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.943565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b HTTP/1.1 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:20.945178 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:20.946623 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '109f4699-4c8a-41d4-89fd-8327bbe72f8b'} Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:20.947347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:20.949416 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:20.952046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Releasing lock "refresh_cache-a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:07:20.953939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8532f822-2126-48be-bb99-3d09e774b86e tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba/action" status: 202 len: 0 microversion: 2.1 time: 2.656852 Aug 30 16:07:20.954103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:20.954103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b954c8d8-2da8-48c9-8bdc-9063fef8c52e tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 404 len: 111 microversion: 2.1 time: 0.047906 Aug 30 16:07:20.955202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 550/1019] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:20 2022] DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:20.957423 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 470/1020] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:18 2022] POST /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba/action => generated 0 bytes in 2663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:07:20.960813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:20.961653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:20.962836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}, {"name": "network-changed", "server_uuid": "317ffe47-9b46-4e64-ad90-b46585de11e5", "tag": "f064cf46-a3e2-418c-8ad8-653141ee6a01"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:20.968961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.969652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.970333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.971698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.972887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.973325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.975676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:20.976348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:20.977500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:20.991702 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Creating event network-changed:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h2-830883-28 Aug 30 16:07:20.993206 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] Creating event network-changed:f064cf46-a3e2-418c-8ad8-653141ee6a01 for instance 317ffe47-9b46-4e64-ad90-b46585de11e5 on n-h1-830883-28 Aug 30 16:07:21.013168 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-226e3dd5-28d1-407d-9482-92708454d2f4 req-eda8925b-338f-4fa5-9225-59fa0a8d82de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053298 Aug 30 16:07:21.014824 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 471/1021] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:21.022408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba", "tag": "73058020-9300-451a-ac67-655df233a5c7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:21.034956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.035659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.036245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.054876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] Creating event network-changed:73058020-9300-451a-ac67-655df233a5c7 for instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba on n-h2-830883-28 Aug 30 16:07:21.062030 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-079b0a2e-b1e3-4b65-9f71-a6fb005984b7 req-869ebed2-a45e-452a-b7ca-512a0ab423fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043904 Aug 30 16:07:21.062959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 472/1022] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:21.070443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ea2d4ab-f125-4b9a-844d-4a0cf6e95b2d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35d4bdf70>, body: {"security_group_rule": {"parent_group_id": "0c471d7f-e456-4e26-9e18-26a3ddfbfe22", "ip_protocol": "tcp", "from_port": 2114161716, "to_port": 22}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:21.123653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8ea2d4ab-f125-4b9a-844d-4a0cf6e95b2d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Invalid port range 2114161716:22. Former value cannot be greater than the later Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ea2d4ab-f125-4b9a-844d-4a0cf6e95b2d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 146 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:21.125603 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: {"security_group_rule": {"parent_group_id": "0c471d7f-e456-4e26-9e18-26a3ddfbfe22", "ip_protocol": "tcp", "from_port": 2114161716, "to_port": 22}} Aug 30 16:07:21.127808 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid port range 2114161716:22. Former value cannot be greater than the later Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0c471d7f-e456-4e26-9e18-26a3ddfbfe22', 'ip_protocol': 'tcp', 'from_port': 2114161716, 'to_port': 22}}} Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2114161716:22. Former value cannot be greater than the later Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.128982 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2114161716:22. Former value cannot be greater than the later Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2114161716:22. Former value cannot be greater than the later Aug 30 16:07:21.131534 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.135740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ea2d4ab-f125-4b9a-844d-4a0cf6e95b2d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: Invalid port range 2114161716:22. Former value cannot be greater than the later {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:21.136897 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ea2d4ab-f125-4b9a-844d-4a0cf6e95b2d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.072686 Aug 30 16:07:21.138051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 473/1023] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:21 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:07:21.146407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:21.148478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:21.157083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.157754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.158251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.159851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.160545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.161198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.203467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:21.294230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:21.309100 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-42bbcf12-027d-480c-a94c-2f5d031bfba6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1312 microversion: 2.1 time: 0.351976 Aug 30 16:07:21.309725 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 551/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:20 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:21.327678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:21.331101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:21.342577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.343452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.344264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.345903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.347387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.348705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.359600 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c524953f-e479-441d-9a43-1b1fe496c482 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 204 len: 0 microversion: 2.1 time: 0.219865 Aug 30 16:07:21.360078 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 474/1025] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:21 2022] DELETE /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:21.367035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14708113-3359-4785-821c-5e96157acda0 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35d2f8820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1657805213", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:21.368851 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:21.369338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-14708113-3359-4785-821c-5e96157acda0 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Security group id should be uuid Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14708113-3359-4785-821c-5e96157acda0 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 131 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:21.370993 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1657805213", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:07:21.372729 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group id should be uuid Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1657805213', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:21.374007 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 30 16:07:21.375352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b HTTP/1.1 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:21.376168 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:21.379114 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '109f4699-4c8a-41d4-89fd-8327bbe72f8b'} Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:21.380678 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:21.383738 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:21.386213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:21.386213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33b595f3-9fd4-41f7-8974-a9add91b5750 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 404 len: 111 microversion: 2.1 time: 0.060740 Aug 30 16:07:21.386213 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 552/1026] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:21 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:21.386213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:21.387051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14708113-3359-4785-821c-5e96157acda0 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: Security group id should be uuid {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:21.387215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:21.387403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14708113-3359-4785-821c-5e96157acda0 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021019 Aug 30 16:07:21.388393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 475/1027] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:21 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:07:21.388985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.389702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.390427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.391405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.392069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.392505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.395873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.169"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:21.400212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:21.412331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.412938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.413421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.414181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.414707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.415270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.460726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:07:21.461128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquired lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:07:21.549681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:21.558132 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35f7b499-bf61-4cc8-a82c-ff5a4de2138c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.183306 Aug 30 16:07:21.558904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 553/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:21 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:21.578394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6c025a9-15ed-4bf4-8d64-e6eb0db604d2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '.version_select at 0x7fd35d242a60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:21.603167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6c025a9-15ed-4bf4-8d64-e6eb0db604d2 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981344258" status: 202 len: 0 microversion: 2.1 time: 0.031107 Aug 30 16:07:21.603980 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 554/1029] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:07:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981344258 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:21.609760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5461eb4-9c33-4df0-815c-af231860309a tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35cda8ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-102193134", "description": "tempest-description-2009044636"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:21.751189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.775912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:21.947187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5461eb4-9c33-4df0-815c-af231860309a tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.341896 Aug 30 16:07:21.948437 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 555/1030] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:07:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:21.953907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:21.954703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:21.965065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.965554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.966170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:21.967069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:21.967707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:21.968390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:22.691272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:22.703287 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88a79792-b690-4edb-aedf-1ac02c770dd8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.753201 Aug 30 16:07:22.704898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 556/1031] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:21 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:22.710506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bd5347b-aac9-4b30-a2e3-e7df2bef6ded tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35d21f4c0>, body: {"security_group_rule": {"parent_group_id": "6f494ab2-a3bd-4b8d-8b4d-da117cb62579", "ip_protocol": "tempest-999-1885601874", "from_port": 22, "to_port": 22}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:22.969273 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2bd5347b-aac9-4b30-a2e3-e7df2bef6ded tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Invalid IP protocol tempest-999-1885601874. Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bd5347b-aac9-4b30-a2e3-e7df2bef6ded tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 157 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:22.970882 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: {"security_group_rule": {"parent_group_id": "6f494ab2-a3bd-4b8d-8b4d-da117cb62579", "ip_protocol": "tempest-999-1885601874", "from_port": 22, "to_port": 22}} Aug 30 16:07:22.972591 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid IP protocol tempest-999-1885601874. Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6f494ab2-a3bd-4b8d-8b4d-da117cb62579', 'ip_protocol': 'tempest-999-1885601874', 'from_port': 22, 'to_port': 22}}} Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1885601874. Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:22.973327 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1885601874. Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1885601874. Aug 30 16:07:22.974514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:22.977435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bd5347b-aac9-4b30-a2e3-e7df2bef6ded tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: Invalid IP protocol tempest-999-1885601874. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:22.977435 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bd5347b-aac9-4b30-a2e3-e7df2bef6ded tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.266411 Aug 30 16:07:22.977435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 557/1032] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:22 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:07:22.978651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:22.979278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:22.996020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:22.998395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:23.000650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:23.007223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:23.011015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:23.012186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:23.472522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:23.481225 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfef31c2-6814-4261-9eb7-d842e263531d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1312 microversion: 2.1 time: 0.506143 Aug 30 16:07:23.497382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 558/1033] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:22 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1312 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:23.504033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:23.504924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:23.516548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:23.520288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:23.520958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:23.521852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:23.524532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:23.525168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:23.963663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:23.973914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-92cb080c-c1e5-4d58-b76b-c28d2fcb8495 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.475135 Aug 30 16:07:23.975196 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 559/1034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:23 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:23.980573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a733334-c8ee-43e5-b79d-687ab38cda11 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35cd510d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1806225908", "description": "tempest-description-1045468713"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:24.168360 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a733334-c8ee-43e5-b79d-687ab38cda11 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.191923 Aug 30 16:07:24.171921 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 560/1035] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:07:23 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:24.179798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca82aa6d-9787-4b0a-a807-d325459f8d8b tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:24.211824 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca82aa6d-9787-4b0a-a807-d325459f8d8b tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1818593437" status: 202 len: 0 microversion: 2.1 time: 0.037634 Aug 30 16:07:24.213955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 561/1036] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:07:24 2022] DELETE /compute/v2.1/flavors/1818593437 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:24.228054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:24.228853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:24.237677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:24.238352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:24.238894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:24.240202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:24.240896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:24.241550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:24.267628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:24.420155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:24.429141 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d938312b-49a0-470b-bf2f-21bdb5f326d3 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.213788 Aug 30 16:07:24.429958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 562/1037] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:24 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:24.435279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06d6e7aa-7e40-4274-ab4d-9077ecc10303 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35ce57f70>, body: {"security_group_rule": {"parent_group_id": "6f3a2522-70e8-425c-8dce-bde850787a78", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:24.503206 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-06d6e7aa-7e40-4274-ab4d-9077ecc10303 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06d6e7aa-7e40-4274-ab4d-9077ecc10303 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 138 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:24.505172 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: {"security_group_rule": {"parent_group_id": "6f3a2522-70e8-425c-8dce-bde850787a78", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 30 16:07:24.506808 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6f3a2522-70e8-425c-8dce-bde850787a78', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:24.507692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 16:07:24.509114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:24.510477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06d6e7aa-7e40-4274-ab4d-9077ecc10303 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:24.510477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06d6e7aa-7e40-4274-ab4d-9077ecc10303 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.078186 Aug 30 16:07:24.511380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 563/1038] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:24 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:07:24.516396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11361406-d9ef-4dc6-a4b2-d1d7fc2023eb tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:24.542179 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11361406-d9ef-4dc6-a4b2-d1d7fc2023eb tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.029468 Aug 30 16:07:24.542932 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 564/1039] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:24 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:24.547907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:24.548583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:24.558894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:24.559397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:24.559835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:24.560547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:24.561008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:24.561436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:24.722808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:24.730933 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dab8c47d-5294-43ef-8e73-047939f5a55a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1312 microversion: 2.1 time: 0.187174 Aug 30 16:07:24.731783 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 565/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:24 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:24.753776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0b5401cd-6fdc-45ca-9bc5-22c3fd9533c6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35ce0fdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2145186357", "description": "tempest-description-1654996018"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:24.945341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0b5401cd-6fdc-45ca-9bc5-22c3fd9533c6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.199653 Aug 30 16:07:24.946027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 566/1041] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:07:24 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:24.952096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb73373c-bdfb-4b31-8faf-22eb0f2a8868 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:24.961330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:24.995752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb73373c-bdfb-4b31-8faf-22eb0f2a8868 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/612907025" status: 202 len: 0 microversion: 2.1 time: 0.048493 Aug 30 16:07:24.997933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 567/1042] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:07:24 2022] DELETE /compute/v2.1/flavors/612907025 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:25.004313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a127a7e-b79e-4281-8f74-f8c90b0741a6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35cda8790>, body: {"security_group_rule": {"parent_group_id": "81ffd392-10d5-4cfd-ab49-954bf985c16f", "ip_protocol": "tcp", "from_port": 22, "to_port": 759716987}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:25.077522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0a127a7e-b79e-4281-8f74-f8c90b0741a6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a127a7e-b79e-4281-8f74-f8c90b0741a6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 145 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:25.079911 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: {"security_group_rule": {"parent_group_id": "81ffd392-10d5-4cfd-ab49-954bf985c16f", "ip_protocol": "tcp", "from_port": 22, "to_port": 759716987}} Aug 30 16:07:25.082111 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'security_group_rule': {'parent_group_id': '81ffd392-10d5-4cfd-ab49-954bf985c16f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 759716987}}} Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.083033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 Aug 30 16:07:25.084485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.085859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a127a7e-b79e-4281-8f74-f8c90b0741a6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 400 to user: Invalid port range 22:759716987. Valid TCP ports should be between 1-65535 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:25.085859 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a127a7e-b79e-4281-8f74-f8c90b0741a6 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.083043 Aug 30 16:07:25.085859 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 568/1043] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:24 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:07:25.092224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.092941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:25.101772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.102637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.103080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.103790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.104278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.104807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.255830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:25.264294 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e57a259-eec2-4aa7-8e13-457d206633a2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1497 microversion: 2.1 time: 0.180510 Aug 30 16:07:25.264878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 569/1044] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:25 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:25.270561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82bf0e9a-e1c2-495d-917e-4630557428b5 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.293295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82bf0e9a-e1c2-495d-917e-4630557428b5 tempest-ServersWithSpecificFlavorTestJSON-537849338 tempest-ServersWithSpecificFlavorTestJSON-537849338-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027045 Aug 30 16:07:25.293890 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 570/1045] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:25.298599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Action: 'create', calling method: .version_select at 0x7fd35ce0fe50>, body: {"security_group_rule": {"parent_group_id": "db3e557b-694d-4133-bbd4-ae4cbca90c33", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:25.335039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:07:25.335742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Neutron security group db3e557b-694d-4133-bbd4-ae4cbca90c33 not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:07:25.336342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.336342 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 138 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:25.338357 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: {"security_group_rule": {"parent_group_id": "db3e557b-694d-4133-bbd4-ae4cbca90c33", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 16:07:25.339618 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'db3e557b-694d-4133-bbd4-ae4cbca90c33', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:07:25.340363 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 30 16:07:25.341550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.342950 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 404 to user: Security group db3e557b-694d-4133-bbd4-ae4cbca90c33 does not exist Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-b679cf7e-69a6-42c8-8920-edd77687c857'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:25.349016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca7e48c7-a9b2-4707-a137-a7cb7bb043e2 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.044919 Aug 30 16:07:25.351156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 571/1046] 10.222.0.47 () {60 vars in 1195 bytes} [Tue Aug 30 16:07:25 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:25.353036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.353547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:25.360610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.361115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.362432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.362591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.363053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.363485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.377925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 HTTP/1.1 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:25.379666 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.381035 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '16929167-e0e7-4a5a-a47f-b9b15900db58'} Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:25.385161 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.386414 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.389591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:25.389591 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61735227-e375-4c1b-9a1f-290e2be7fa93 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 404 len: 111 microversion: 2.1 time: 0.032139 Aug 30 16:07:25.389591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 572/1047] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:25 2022] DELETE /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:25.398355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35ce0f940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.419746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:07:25.421196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Neutron security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 not found {{(pid=122352) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 30 16:07:25.422495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] HTTP exception thrown: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.422495 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Request method failure captured: Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-group-rules/7316347e-b902-4907-bbe4-7e7da41e9514 HTTP/1.1 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjWvILOU4r3zVPzcsHmHoGS0fzCCDSpDd1vw_f5caQfEwubhUEEaqnlkeKHu981QkCSy-l_XXzjS2onIm0enyv3XbawchJD6A4HZhPiGqQYMQx_FdBaf7wHmiwzfRGcsvqPpKRrplv_48SJIYfwKC9MvSrG3v4VnVy1OMmvVZnD5geM Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:25.424502 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7b495e68f52b4538aff54cb123feb026"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7b495e68f52b4538aff54cb123feb026"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7b495e68f52b4538aff54cb123feb026"}]}] Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7b495e68f52b4538aff54cb123feb026 Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021 Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: fc8ac6b64ddd4ea0bc5a7796de223ed6 Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-506535021-project Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.426059 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7316347e-b902-4907-bbe4-7e7da41e9514'} Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.427085 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 30 16:07:25.428335 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.429507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Returning 404 to user: Security group rule 7316347e-b902-4907-bbe4-7e7da41e9514 does not exist Aug 30 16:07:25.430942 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-db377591-5416-49e7-91da-a2e7d8c4ee50'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:25.438401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8b83589-fd9c-400b-9bd7-a51b3324539d tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-group-rules/7316347e-b902-4907-bbe4-7e7da41e9514" status: 404 len: 199 microversion: 2.1 time: 0.055228 Aug 30 16:07:25.440319 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 573/1048] 10.222.0.47 () {58 vars in 1287 bytes} [Tue Aug 30 16:07:25 2022] DELETE /compute/v2.1/os-security-group-rules/7316347e-b902-4907-bbe4-7e7da41e9514 => generated 199 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:25.447249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.448784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 16929167-e0e7-4a5a-a47f-b9b15900db58] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:25.460260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.461026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.461797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.462691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.463296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.463883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.479438 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 HTTP/1.1 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:25.482172 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.483709 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '16929167-e0e7-4a5a-a47f-b9b15900db58'} Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:25.484423 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. Aug 30 16:07:25.485707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:25.488599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 16929167-e0e7-4a5a-a47f-b9b15900db58 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:25.489833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c5db38a6-9f29-4a75-8c9a-9b6b69026eab tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58" status: 404 len: 111 microversion: 2.1 time: 0.048147 Aug 30 16:07:25.491976 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 574/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:25 2022] GET /compute/v2.1/servers/16929167-e0e7-4a5a-a47f-b9b15900db58 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:25.499553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba", "name": "network-vif-deleted", "tag": "73058020-9300-451a-ac67-655df233a5c7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:25.514349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.515136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.516117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.532300 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] Creating event network-vif-deleted:73058020-9300-451a-ac67-655df233a5c7 for instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba on n-h2-830883-28 Aug 30 16:07:25.540558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f793e93d-e3a1-4569-b69b-1447c0cd6f6c req-a152e295-50eb-430e-bf25-8e0cf1f4ec4f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047008 Aug 30 16:07:25.541699 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 575/1050] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:25.547786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86064ee9-2f6f-4f9f-8f32-479b6aeca5ed tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35cdd5820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.888835 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86064ee9-2f6f-4f9f-8f32-479b6aeca5ed tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/81ffd392-10d5-4cfd-ab49-954bf985c16f" status: 202 len: 0 microversion: 2.1 time: 0.345595 Aug 30 16:07:25.889449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 576/1051] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:25 2022] DELETE /compute/v2.1/os-security-groups/81ffd392-10d5-4cfd-ab49-954bf985c16f => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:25.896318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:25.897285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:25.912856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.914063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.915030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.916300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:25.917322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:25.917952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:25.953330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:26.095032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:26.104846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dae1e33a-bbab-4d9e-9839-e80a1bc33a66 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.213706 Aug 30 16:07:26.105434 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 577/1052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:25 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:26.110569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:26.111285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:26.118013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.118939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.119635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.120546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.121015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.121442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.136332 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b HTTP/1.1 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:26.138686 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.140127 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '109f4699-4c8a-41d4-89fd-8327bbe72f8b'} Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:26.140911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.142069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.146841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:26.146841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2032ed36-10e2-4ee1-95d6-b435a3ec3913 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 404 len: 111 microversion: 2.1 time: 0.033694 Aug 30 16:07:26.146841 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 578/1053] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:26 2022] DELETE /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:26.146841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ffe47-9b46-4e64-ad90-b46585de11e5", "name": "network-vif-plugged", "status": "completed", "tag": "f064cf46-a3e2-418c-8ad8-653141ee6a01"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:26.156346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.157129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.160082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.175850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] Creating event network-vif-plugged:f064cf46-a3e2-418c-8ad8-653141ee6a01 for instance 317ffe47-9b46-4e64-ad90-b46585de11e5 on n-h1-830883-28 Aug 30 16:07:26.180903 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-50cb0eb5-80a9-48a9-9204-44d1385b3a86 req-1c33da16-9651-46ff-b6be-2eec1ec1ff6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038460 Aug 30 16:07:26.181853 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 579/1054] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:26.187336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:26.188122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:26.229125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.230993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.231456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.233776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.235533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.237473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.508172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:26.524104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e153bc68-f240-4791-aea5-f98603c5f3b1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1312 microversion: 2.1 time: 0.340566 Aug 30 16:07:26.525599 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 580/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:26 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1312 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:26.552609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e0322c1e-2f41-4746-a05b-479497d1ed66 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35cdd5280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:26.762978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e0322c1e-2f41-4746-a05b-479497d1ed66 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/6f3a2522-70e8-425c-8dce-bde850787a78" status: 202 len: 0 microversion: 2.1 time: 0.235958 Aug 30 16:07:26.766816 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 581/1056] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:26 2022] DELETE /compute/v2.1/os-security-groups/6f3a2522-70e8-425c-8dce-bde850787a78 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:26.773060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:26.773689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] [instance: 109f4699-4c8a-41d4-89fd-8327bbe72f8b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:26.780033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.780748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.781287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.782054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.782636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.783129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.798630 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] HTTP exception thrown: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Request method failure captured: Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b HTTP/1.1 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjT9UlNT_7vaRD6R2G5IxEBGoUam7ZbQ1-HTevWUchsHVlgfNk5KzR24g_MOBS0gnWzyR9m0xUpaUYUfKuQGIEQRJU0T3GX_iLTXL9hO7W3-k_7nOS9V2mWkav8GEplaDsHc1vsDEJW421XJw1QcrKUBvthhM0HqImqxBAH7ADDb2WU Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:26.801508 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4a929e510bc647eaaa73df2a64291566"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4a929e510bc647eaaa73df2a64291566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4a929e510bc647eaaa73df2a64291566"}]}] Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4a929e510bc647eaaa73df2a64291566 Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892 Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 97d70771a4b1486c84483dbf5897bfb3 Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-697464892-project Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.803002 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '109f4699-4c8a-41d4-89fd-8327bbe72f8b'} Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:26.803749 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. Aug 30 16:07:26.805036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:26.806104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] Returning 404 to user: Instance 109f4699-4c8a-41d4-89fd-8327bbe72f8b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:26.806104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4bae6845-212b-4f93-9386-5aa37da180d3 tempest-ServersWithSpecificFlavorTestJSON-697464892 tempest-ServersWithSpecificFlavorTestJSON-697464892-project] 10.222.0.47 "GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b" status: 404 len: 111 microversion: 2.1 time: 0.035178 Aug 30 16:07:26.806104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 582/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:26 2022] GET /compute/v2.1/servers/109f4699-4c8a-41d4-89fd-8327bbe72f8b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:26.809509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:26.810438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:26.817224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.818151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.818316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.819118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:26.819686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:26.820215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:26.943712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Updating instance_info_cache with network_info: [{"id": "32ee36ce-c04a-4df0-9d9d-424f1271454c", "address": "fa:16:3e:cd:44:16", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32ee36ce-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:26.962159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Releasing lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:07:26.963156 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0023e285-5ae9-45a4-b321-70de1be5320f tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action" status: 202 len: 0 microversion: 2.1 time: 5.572176 Aug 30 16:07:26.964079 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 476/1058] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:21 2022] POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action => generated 0 bytes in 5575 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:07:26.973543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d8b16cd8-6199-46d2-8592-d4c37e101374 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35e72bb80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:27.043704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:27.052701 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88107ca6-79e7-4a7e-81e8-9cc8bfb13617 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 200 len: 1474 microversion: 2.1 time: 0.247612 Aug 30 16:07:27.053614 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 583/1059] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:26 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 1474 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:27.059342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f88dc307-31d1-43c6-9c1e-4ba7fd04f2d7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '.version_select at 0x7fd35cceb1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:27.448822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f88dc307-31d1-43c6-9c1e-4ba7fd04f2d7 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/7a88d56f-c9b1-498e-86c6-4f9b572618dc" status: 200 len: 184 microversion: 2.1 time: 0.393975 Aug 30 16:07:27.457020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 584/1060] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:07:27 2022] GET /compute/v2.1/os-floating-ips/7a88d56f-c9b1-498e-86c6-4f9b572618dc => generated 184 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:27.457020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2031125914"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:27.459466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:27.480815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.481710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.487447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d8b16cd8-6199-46d2-8592-d4c37e101374 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/6f494ab2-a3bd-4b8d-8b4d-da117cb62579" status: 202 len: 0 microversion: 2.1 time: 0.521318 Aug 30 16:07:27.488154 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 477/1061] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:26 2022] DELETE /compute/v2.1/os-security-groups/6f494ab2-a3bd-4b8d-8b4d-da117cb62579 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:27.490992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.494893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:27.495516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:27.498962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.499464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.499919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.519258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.519772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.520216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.520934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.521397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.521835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.844149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:27.859814 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f2f14ac-4a09-4f8b-9373-df332d0d0d7d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.369915 Aug 30 16:07:27.860821 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 478/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:27 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:27.894821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be58c5a2-f42f-42f5-b357-de24c621bb7e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834/action" status: 202 len: 0 microversion: 2.1 time: 0.439140 Aug 30 16:07:27.895829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 585/1063] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:27 2022] POST /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:07:27.901404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.169"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:27.906329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b90ebfb0-e468-431c-b036-ad4577fe178a tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35cda85e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:28.151672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:28.163013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.165194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.167347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.171401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.172650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.173449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.230962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:28.616303 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b90ebfb0-e468-431c-b036-ad4577fe178a tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0c471d7f-e456-4e26-9e18-26a3ddfbfe22" status: 202 len: 0 microversion: 2.1 time: 0.719208 Aug 30 16:07:28.616907 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 586/1064] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:27 2022] DELETE /compute/v2.1/os-security-groups/0c471d7f-e456-4e26-9e18-26a3ddfbfe22 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:28.621478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:28.622478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:28.635075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.636029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.636658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.648635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.649145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.649590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.794572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:07:28.795207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquired lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:07:28.900960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:28.911914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-00c6432b-9819-4309-8f5d-c7d87d07c133 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1462 microversion: 2.1 time: 0.293971 Aug 30 16:07:28.914189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 587/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:28 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1462 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:28.949671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:28.997936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.998951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.999622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:29.014993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] Creating event network-changed:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:07:29.022821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-55ad72f6-77db-4cea-9e99-5c6c696fa39b req-df446a42-86e2-4adb-934d-d53c0441f3ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106915 Aug 30 16:07:29.024692 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 588/1066] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:29.034146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ee0744e-1c55-4847-acbf-21411e42ebe5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cceb820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:29.136844 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ee0744e-1c55-4847-acbf-21411e42ebe5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.109510 Aug 30 16:07:29.138317 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 589/1067] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:29 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:29.144357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b4a1e56-2147-4223-b121-50625b9fb511 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] Calling method '.version_select at 0x7fd35cda8790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:29.569553 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b4a1e56-2147-4223-b121-50625b9fb511 tempest-SecurityGroupRulesNegativeTestJSON-506535021 tempest-SecurityGroupRulesNegativeTestJSON-506535021-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/f486ef21-cd0b-4043-89a8-3a67d7a03074" status: 202 len: 0 microversion: 2.1 time: 0.428314 Aug 30 16:07:29.570969 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 590/1068] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:07:29 2022] DELETE /compute/v2.1/os-security-groups/f486ef21-cd0b-4043-89a8-3a67d7a03074 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:29.581305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:29.599762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:29.625230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:29.625872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:29.626487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:29.627393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:29.628066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:29.628747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.005939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:30.020107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d856502-0833-4313-82e6-043f5e6ceef1 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.447857 Aug 30 16:07:30.036412 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 591/1069] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:29 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:30.041833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:30.044821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:30.055154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.056828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.057440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.058394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.059139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.059745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.250276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:30.261741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Old instance type m1.heat2, new instance type m1.heat {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:07:30.275331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:07:30.275803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:07:30.276225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:07:30.276959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:07:30.277098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:07:30.534967 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-363233ca-2b6f-4a79-b5dd-9d4221435555 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5/action" status: 202 len: 0 microversion: 2.1 time: 0.494285 Aug 30 16:07:30.539458 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 592/1070] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:30 2022] POST /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:30.557627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdc8e068-92d5-4310-ac09-759ef59e440d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cce4820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:30.640952 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdc8e068-92d5-4310-ac09-759ef59e440d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.100015 Aug 30 16:07:30.650584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 593/1071] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:30 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:30.653650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:30.655404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:30.692236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.693057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.694899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.698808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.699349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.699792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.762058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:07:31.302104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:31.313477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd5d46da-aa5f-4099-8a06-a16d32a6ae8e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1471 microversion: 2.1 time: 0.667959 Aug 30 16:07:31.315344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 594/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:30 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:31.320521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:31.321539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:31.328943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:31.329728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:31.332600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:31.333929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:31.334673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:31.335276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.198320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Updating instance_info_cache with network_info: [{"id": "32ee36ce-c04a-4df0-9d9d-424f1271454c", "address": "fa:16:3e:cd:44:16", "network": {"id": "23f2e904-2767-475c-acd9-99e9d18555dc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1961429611-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8ea1726b3b30410ab93a0407a77df7a7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap32ee36ce-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:07:32.229142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Releasing lock "refresh_cache-7128abb2-62ff-4b86-adf2-a6bfbf9651cf" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:07:32.230806 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38443eaf-3132-43c9-8ea3-d3f70dbbdf6b tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action" status: 202 len: 0 microversion: 2.1 time: 4.352537 Aug 30 16:07:32.232005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 479/1073] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:27 2022] POST /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf/action => generated 0 bytes in 4370 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:07:32.242142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:32.268345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.269945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.270593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.278460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:32.287555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c43d25e9-a286-446d-8d6b-52225c68646c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1472 microversion: 2.1 time: 0.970935 Aug 30 16:07:32.290976 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] Creating event network-changed:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:07:32.296655 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-09f0d392-5236-4090-92d8-441ee8c37090 req-3c25b940-01e7-413f-881a-b6fc36b09e23 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063268 Aug 30 16:07:32.298045 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 480/1074] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:32.304368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 595/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:31 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1472 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:32.305142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e42c6b32-cc00-479a-ad54-0f4b4b2cbb70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d2f9670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:32.394973 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e42c6b32-cc00-479a-ad54-0f4b4b2cbb70 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.088920 Aug 30 16:07:32.395248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 481/1076] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:32 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:32.413013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:32.413652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:32.447129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.448973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.450238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.455644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.458758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.460519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.467265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe7db4ae-e049-438f-a58b-b6c3687abeae tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Action: 'create', calling method: .version_select at 0x7fd35d183b80>, body: {"keypair": {"name": "tempest-keypair-1400296112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5Adv1NjbUcGpfm0T1dZqhghhXQqytB6gWTn2+FEWSuAvIIizx9pHCyG80FUVQDZMluXrbEFF/wtHk0II1TjQBwN5CxtZgA4d0SXxuWALBIL/LZZwY7v2qpTvTNaT96Pg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:32.509503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] HTTP exception thrown: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.511372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fe7db4ae-e049-438f-a58b-b6c3687abeae tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for project df4ba726b1aa40b5b67d4e74ef74145d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:07:32.518390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fe7db4ae-e049-438f-a58b-b6c3687abeae tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for user e1fc2d74483b47d1ab6c46e47b7582aa and project df4ba726b1aa40b5b67d4e74ef74145d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Request method failure captured: Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba HTTP/1.1 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjV4nv23Pd1ML6CHU1Sndnndk32TDa1S1P9onyP3QU0zb088sblQJ5SlQne9rf_xnpE0KoJXbESwgXy5-HqYnVeiUISTYMTSH-2tNBex1sjJJKup6ZPoBb5q6LECuc6gsVYccZRA74DJmlsN-fG9m0dRMIfKpfW8NSI7XFe3OLaIbK0 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:07:32.518577 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}] Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b31b992df85c411d9e93bec3b8c474d6 Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.519846 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba'} Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:32.520601 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.522086 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.523371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Returning 404 to user: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:32.523371 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8d3b99e-00c4-43e9-bb17-331b26dc463c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 404 len: 111 microversion: 2.1 time: 0.123723 Aug 30 16:07:32.528638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 482/1077] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:32 2022] DELETE /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:32.548196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:32.551569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:32.568450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.569366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.572081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.573474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.575951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.576561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.584777 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe7db4ae-e049-438f-a58b-b6c3687abeae tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.278874 Aug 30 16:07:32.585770 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 596/1078] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:07:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:32.591551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:32.592505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:32.609134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.609677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.610112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.611150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.612274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.612886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.630145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:32.653503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] HTTP exception thrown: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Request method failure captured: Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba HTTP/1.1 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjV4nv23Pd1ML6CHU1Sndnndk32TDa1S1P9onyP3QU0zb088sblQJ5SlQne9rf_xnpE0KoJXbESwgXy5-HqYnVeiUISTYMTSH-2tNBex1sjJJKup6ZPoBb5q6LECuc6gsVYccZRA74DJmlsN-fG9m0dRMIfKpfW8NSI7XFe3OLaIbK0 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:32.655596 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}] Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b31b992df85c411d9e93bec3b8c474d6 Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.656925 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba'} Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:32.657790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. Aug 30 16:07:32.659195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:32.663753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Returning 404 to user: Instance a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:32.663753 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e463ebf-41eb-454a-a1a6-210eb845577a tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba" status: 404 len: 111 microversion: 2.1 time: 0.075799 Aug 30 16:07:32.664360 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 597/1079] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:32 2022] GET /compute/v2.1/servers/a0d89b9b-b5c4-479c-8e60-fa2c8ce489ba => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:32.674127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd26b6d4-6173-4718-80e8-f383e823ec91 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '.version_select at 0x7fd35cdb99d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:33.226162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:33.238659 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e929b7d1-6c8e-4f78-876d-809e95242601 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1471 microversion: 2.1 time: 0.708839 Aug 30 16:07:33.239717 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 483/1080] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:32 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1471 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:33.311918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:33.312716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:33.323640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:33.324516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:33.328325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:33.329328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:33.330075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:33.335042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:33.608927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:33.622135 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa76b394-2cee-4cba-8921-db0e823cce38 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1478 microversion: 2.1 time: 0.312554 Aug 30 16:07:33.625334 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 484/1081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:33 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1478 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:33.638721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e180a4c2-625b-4a6a-a750-e7f90ff1cfa8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cd9b9d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:33.746137 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e180a4c2-625b-4a6a-a750-e7f90ff1cfa8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.119506 Aug 30 16:07:33.754757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 485/1082] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:33 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:34.265127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:34.265765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:34.281846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.284059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.285328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.287332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.288698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.289859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.607616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:34.621113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25793e09-2f68-4d2f-9ed5-864913ec71f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1471 microversion: 2.1 time: 0.355855 Aug 30 16:07:34.621776 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 486/1083] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:34 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:34.646858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:34.647400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:34.656016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.659768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.660461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.662607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.665546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.666669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.701264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:35.040369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:35.055349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e82079b-55b5-47bb-8f2d-5e93c1772af5 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1478 microversion: 2.1 time: 0.412726 Aug 30 16:07:35.056171 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 487/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:34 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1478 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:35.067716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ed71199-9262-47ad-9b99-3b76c45d7631 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ce055e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:35.160880 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ed71199-9262-47ad-9b99-3b76c45d7631 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.102764 Aug 30 16:07:35.161862 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 488/1085] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:35 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:35.172941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84554004-28f8-4e87-8f71-b966acb4a834", "name": "network-vif-plugged", "status": "completed", "tag": "81db1d56-f6cc-45e1-b149-dcb8e85ae63a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:35.184485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:35.185076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:35.185869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:35.202873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] Creating event network-vif-plugged:81db1d56-f6cc-45e1-b149-dcb8e85ae63a for instance 84554004-28f8-4e87-8f71-b966acb4a834 on n-h2-830883-28 Aug 30 16:07:35.210013 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a77c9ef7-4281-408e-a5af-a714efe21b42 req-98e44822-27e9-4592-9895-4b5124ff2e77 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046796 Aug 30 16:07:35.211924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 489/1086] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:35.645418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:35.646253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:35.663409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:35.663992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:35.664538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:35.665352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:35.665910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:35.666505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.063641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:36.077607 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b560a3a7-87a2-43d9-8fcc-5b4374ec159a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1471 microversion: 2.1 time: 0.437967 Aug 30 16:07:36.078204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 490/1087] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:35 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:36.095875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:36.097120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:36.109166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.115137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.115591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.117066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.117937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.118407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.431898 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd26b6d4-6173-4718-80e8-f383e823ec91 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/7a88d56f-c9b1-498e-86c6-4f9b572618dc" status: 202 len: 0 microversion: 2.1 time: 3.763684 Aug 30 16:07:36.432927 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 598/1088] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:07:32 2022] DELETE /compute/v2.1/os-floating-ips/7a88d56f-c9b1-498e-86c6-4f9b572618dc => generated 0 bytes in 3766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:36.436277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:36.441487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fe63339-e298-41c4-ad72-86595619bb09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cce4940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:36.453951 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f147d015-c8eb-4fd7-aa6d-3323c1c98b72 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1478 microversion: 2.1 time: 0.374213 Aug 30 16:07:36.457640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 491/1089] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:36 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1478 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:36.468937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:36.474328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:36.482924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.483753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.484853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.485814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.486995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.488107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.521279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:36.538532 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fe63339-e298-41c4-ad72-86595619bb09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.101640 Aug 30 16:07:36.539364 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 599/1090] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:36 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:36.671744 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-170df275-7f7c-4e8d-a05c-3f327b0335e8 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 204 len: 0 microversion: 2.1 time: 0.212477 Aug 30 16:07:36.673522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 492/1091] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:36 2022] DELETE /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:36.682257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:36.683324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:36.696697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.697919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.698692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:36.699640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:36.700588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:36.701365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.052425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:37.066646 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de005efc-fc66-4701-9202-1e4ba1f4cfbf tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1526 microversion: 2.1 time: 0.388384 Aug 30 16:07:37.072327 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 600/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:36 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1526 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:37.103476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:37.104208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:37.110391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:37.110884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:37.112389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.113286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:37.113913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:37.114355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.244136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930eb535-b9f1-47f0-ba97-086a35fa1f9d", "name": "network-vif-plugged", "status": "completed", "tag": "c20211d3-fc22-4db8-9855-623f0a7db613"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:37.256187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:37.257098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:37.258079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.276803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] Creating event network-vif-plugged:c20211d3-fc22-4db8-9855-623f0a7db613 for instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d on n-h1-830883-28 Aug 30 16:07:37.289563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-35845a87-d10e-4ab2-a63e-603d6f45c7fb req-e0337e07-cb8f-4766-b09a-f36a3f5422ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064703 Aug 30 16:07:37.290187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 601/1093] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:37.482333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:37.484117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:37.492566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:37.493431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:37.494215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.495175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:37.496006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:37.496635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:37.698161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:37.730390 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed58d5f8-5421-4fd5-b723-7ffd83dab831 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.630988 Aug 30 16:07:37.745056 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 493/1094] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:37 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:37.745056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea735d76-99c5-4784-8893-4194c9ed89e1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ce7d8b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:37.803082 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea735d76-99c5-4784-8893-4194c9ed89e1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.066969 Aug 30 16:07:37.812898 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 494/1095] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:37 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:37.940566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:37.960494 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-deabd4a2-76be-483b-acfb-4bbf03e0bd74 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1478 microversion: 2.1 time: 0.486853 Aug 30 16:07:37.974111 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 602/1096] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:37 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:38.094911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:38.096903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:38.116773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:38.124695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:38.125628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:38.127287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:38.128550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:38.131044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:38.620585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:38.635692 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51f8e8dc-2919-4624-ab78-0da1eafe8e04 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1526 microversion: 2.1 time: 0.551040 Aug 30 16:07:38.636453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 495/1097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:38 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1526 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:38.757866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:38.763382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:38.774936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:38.775448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:38.778694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:38.779727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:38.780375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:38.781034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:38.826293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-097b0506-18a9-413d-81cc-164eb6090ff3 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d4f80d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:38.898829 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-097b0506-18a9-413d-81cc-164eb6090ff3 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.081806 Aug 30 16:07:38.900028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 496/1098] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:38 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:38.986858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:38.987781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:39.002710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:39.003458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:39.004093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:39.004976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:39.005577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:39.006263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:39.128257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:39.140044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e181ecf-03ef-4b96-8024-26ef21d58c31 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.390565 Aug 30 16:07:39.142000 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 603/1099] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:38 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:39.381250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:39.389070 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-adb1389a-c839-4139-a5f9-2d81055222ea tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1478 microversion: 2.1 time: 0.408437 Aug 30 16:07:39.408135 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 497/1100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:38 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1478 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:39.662095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:39.663025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:39.675447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:39.676676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:39.679505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:39.683009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:39.686466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:39.687118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:39.916390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7657b863-b9da-4901-b410-539ea4ddfa69 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cdba310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:39.965021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31b992df85c411d9e93bec3b8c474d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea1726b3b30410ab93a0407a77df7a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:39.977431 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-205134bb-50f7-489b-8f4e-e2133163032c tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 200 len: 1484 microversion: 2.1 time: 0.319892 Aug 30 16:07:39.979329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 604/1101] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:39 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 1484 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:40.088866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128abb2-62ff-4b86-adf2-a6bfbf9651cf", "name": "network-vif-deleted", "tag": "32ee36ce-c04a-4df0-9d9d-424f1271454c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:40.115017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:40.115430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:40.115892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:40.160214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] Creating event network-vif-deleted:32ee36ce-c04a-4df0-9d9d-424f1271454c for instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf on n-h2-830883-28 Aug 30 16:07:40.170828 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f1edc462-f29c-46b8-ae54-a81d992a7bc1 req-ec7e32d1-1fbe-4fd1-8bdd-d19ec5cc1c74 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085097 Aug 30 16:07:40.173704 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 605/1102] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:40.207059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:40.208141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:40.238638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:40.239159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:40.239948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:40.240976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:40.241674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:40.242622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:40.756430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:40.770756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d140a46e-dd22-45b2-ba15-ce63de04acb7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.592592 Aug 30 16:07:40.771908 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 606/1103] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:40 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:40.781968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:40.783468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:40.799885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:40.800502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:40.801204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:40.802118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:40.803433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:40.804058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.242137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:41.254285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58a0685f-f7d7-421e-bae4-1fe6fac29ccf tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1463 microversion: 2.1 time: 0.480755 Aug 30 16:07:41.271585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 607/1104] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:40 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1463 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:41.283460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:41.284486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] [instance: 7128abb2-62ff-4b86-adf2-a6bfbf9651cf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:41.304733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.305493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.306196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.307382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.308578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.309230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.340317 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] HTTP exception thrown: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Request method failure captured: Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf HTTP/1.1 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjV4nv23Pd1ML6CHU1Sndnndk32TDa1S1P9onyP3QU0zb088sblQJ5SlQne9rf_xnpE0KoJXbESwgXy5-HqYnVeiUISTYMTSH-2tNBex1sjJJKup6ZPoBb5q6LECuc6gsVYccZRA74DJmlsN-fG9m0dRMIfKpfW8NSI7XFe3OLaIbK0 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:41.342768 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8ea1726b3b30410ab93a0407a77df7a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8ea1726b3b30410ab93a0407a77df7a7"}]}] Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8ea1726b3b30410ab93a0407a77df7a7 Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1592055235 Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b31b992df85c411d9e93bec3b8c474d6 Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1592055235-project Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. Aug 30 16:07:41.344502 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7128abb2-62ff-4b86-adf2-a6bfbf9651cf'} Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:41.345464 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. Aug 30 16:07:41.347144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:41.360616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] Returning 404 to user: Instance 7128abb2-62ff-4b86-adf2-a6bfbf9651cf could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:41.361790 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ebde714e-032e-4180-8e0f-1eeec3c28919 tempest-FloatingIPsAssociationTestJSON-1592055235 tempest-FloatingIPsAssociationTestJSON-1592055235-project] 10.222.0.47 "GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf" status: 404 len: 111 microversion: 2.1 time: 0.087031 Aug 30 16:07:41.362375 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 608/1105] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:41 2022] GET /compute/v2.1/servers/7128abb2-62ff-4b86-adf2-a6bfbf9651cf => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:41.368878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:41.371743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:41.381541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.382317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.382941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.383809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.384420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.385000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.568934 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c7b4bbb-5c7e-4196-83ea-f439184305cf tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 0 microversion: 2.1 time: 0.205223 Aug 30 16:07:41.572119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 609/1106] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:41 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:41.596897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:41.598601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:41.616398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.617150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.617780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.618715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.621203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.625091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.770174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:41.771867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:41.772504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:41.773144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lazy-loading 'fault' on Instance uuid 930eb535-b9f1-47f0-ba97-086a35fa1f9d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:42.538117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:42.688516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b51f2e5f-1c1f-4133-8edc-b743f856711c tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1599 microversion: 2.1 time: 1.100946 Aug 30 16:07:42.689777 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 610/1107] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:41 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1599 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:42.728586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:42.729227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:42.747033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.747536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.747981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.748699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.749159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.749580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.527936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:43.546520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a3b0717-b729-4be0-843c-20912a9243b0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.830474 Aug 30 16:07:43.551728 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 611/1108] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:42 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:43.572199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:43.574740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:43.582561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.583354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.584230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.585130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.586037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.586675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.786428 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5210d29-fb04-4984-b682-3acbe3ade143 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action" status: 202 len: 0 microversion: 2.1 time: 0.217262 Aug 30 16:07:43.787208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 612/1109] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:43 2022] POST /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:43.809492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:43.810110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:43.832121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.832732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.833523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.834842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.835305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.835728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:44.149006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-64a4e533-a082-4539-8c12-8029e88ce127 tempest-ServersAdminTestJSON-744066630 tempest-ServersAdminTestJSON-744066630-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1616 microversion: 2.1 time: 0.357455 Aug 30 16:07:44.149589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 613/1110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:43 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1616 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:44.173435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:44.174221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:44.197798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:44.203581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:44.211121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:44.214875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:44.216029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:44.222468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:44.318531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:44.422522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:44.583871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7954445d-5faf-4744-854e-dccae8c9b259 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 204 len: 0 microversion: 2.1 time: 0.413383 Aug 30 16:07:44.587747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 614/1111] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:44 2022] DELETE /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:44.596122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:44.597700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:44.615717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:44.618173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:44.619373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:44.623000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:44.624167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:44.624702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.402959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:46.415125 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-070f6973-3ba1-4202-8cda-4c3516669fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 1.828838 Aug 30 16:07:46.418487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 615/1112] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:44 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:46.426292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:46.430876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:46.448117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.448882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.452089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.453166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.453941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.471269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:47.124060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:47.136231 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61324a4f-91e9-400e-bdcc-6e2bcab05bf8 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1470 microversion: 2.1 time: 0.715725 Aug 30 16:07:47.153136 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 616/1113] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:46 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1470 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:47.442716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:47.443378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:47.445402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:47.460656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:47.461172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:47.461625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:47.462385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:47.465669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:47.466143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:48.728422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:48.749728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7078fd89-de42-4e21-865d-45a2b108dfbf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 1.310886 Aug 30 16:07:48.759188 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 617/1114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:47 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:48.780774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:48.789546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:48.820298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:48.824100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:48.826836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:48.833498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:48.836754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:48.837689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:48.991367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:49.016514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.021051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.021909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:49.025738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lazy-loading 'fault' on Instance uuid b6c88e14-f05a-4870-bafe-da955a6fd7c4 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:49.178682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:49.214731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c176eed6-34d0-4078-b0a1-60c325bc29be tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 200 len: 1304 microversion: 2.1 time: 0.453556 Aug 30 16:07:49.218920 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 618/1115] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:48 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 1304 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:49.228598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6c88e14-f05a-4870-bafe-da955a6fd7c4", "name": "network-vif-deleted", "tag": "dd0baae3-1a1f-4b7a-8278-6deb36bff2cf"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:49.288216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.290372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.292639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:49.341471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] Creating event network-vif-deleted:dd0baae3-1a1f-4b7a-8278-6deb36bff2cf for instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 on n-h1-830883-28 Aug 30 16:07:49.367994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6eb1a7db-54a9-4ea7-9ce4-1e0dde01f455 req-71ea923f-f99a-45a9-83eb-dbeaee83aa1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143488 Aug 30 16:07:49.372507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 619/1116] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:49.385882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:49.776815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:49.778183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:49.792122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.792623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.793863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:49.799500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.801483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.802998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.581867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:50.591907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26a493e9-6554-4bc2-8d02-2325ff1e7a6f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.820332 Aug 30 16:07:50.604944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 620/1117] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:49 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:50.610052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:50.615025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: b6c88e14-f05a-4870-bafe-da955a6fd7c4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:50.646826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.652798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.653136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.656752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.659922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.663393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.729503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] HTTP exception thrown: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Request method failure captured: Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 HTTP/1.1 Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVUu_bRQQH734zeOVlVTvsPVRKdO-FchBdLjLrfX3GNLqReqpghK9VrOq_KSnW2GHqcePVfxy3h9iihDUSO2WkQWCYyV5M8JaQ_omOIsj5I1HfTmOhZnb7KeQQpJNTJHbOPXtlViSeRsAgW8NxBx3weIfsPPXLDMNvsxVJXsNrbxIc Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:50.731188 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}] Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b9b2f53d6296454faac1c0c7a45860f0 Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. Aug 30 16:07:50.732636 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b6c88e14-f05a-4870-bafe-da955a6fd7c4'} Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:50.733475 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. Aug 30 16:07:50.735930 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:50.738579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Returning 404 to user: Instance b6c88e14-f05a-4870-bafe-da955a6fd7c4 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:50.738579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af4293a1-cb4d-408f-a3ad-8938f5d3daca tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4" status: 404 len: 111 microversion: 2.1 time: 0.131239 Aug 30 16:07:50.746345 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 621/1118] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:50 2022] GET /compute/v2.1/servers/b6c88e14-f05a-4870-bafe-da955a6fd7c4 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:50.751850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:50.752379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:50.801674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.817879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.821152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.824799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.828408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.829813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.931323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:51.227138 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e00affe-4cb2-40f9-997e-dd5317fc4b9c tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 204 len: 0 microversion: 2.1 time: 0.479400 Aug 30 16:07:51.232316 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 622/1119] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:50 2022] DELETE /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:51.255953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:51.256673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:51.287157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:51.287669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:51.288109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:51.295274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:51.298578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:51.299584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:52.148232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:52.171854 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f6a4e36-07a6-4604-b758-01f3e034d7a2 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1470 microversion: 2.1 time: 0.932313 Aug 30 16:07:52.172478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 623/1120] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:51 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1470 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:52.211565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:52.212228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:52.239233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:52.239888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:52.240363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:52.241402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:52.242383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:52.243158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:53.057211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:53.067724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f21bffbe-243a-4a5b-89d0-1b896fb5818b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.889354 Aug 30 16:07:53.088735 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 624/1121] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:52 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:53.424331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b27f14d4-c8ec-4f59-9cd4-113ec178893c tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-581396214", "id": 66781235, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:53.488326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b27f14d4-c8ec-4f59-9cd4-113ec178893c tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.397839 Aug 30 16:07:53.490796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 625/1122] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:53 2022] POST /compute/v2.1/flavors => generated 423 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:53.512235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:53.516052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:53.537039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:53.538356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:53.540754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:53.541783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:53.543534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:53.545986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:54.379865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:54.387906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f19aee0-4c8d-4d99-b8b3-9c3b3b0519aa tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1470 microversion: 2.1 time: 0.888994 Aug 30 16:07:54.388492 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 626/1123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:53 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1470 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:54.413972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24fe569c-b332-454f-8b47-c999b8dea098 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:54.456550 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24fe569c-b332-454f-8b47-c999b8dea098 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/66781235" status: 202 len: 0 microversion: 2.1 time: 0.066966 Aug 30 16:07:54.457451 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 627/1124] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:07:54 2022] DELETE /compute/v2.1/flavors/66781235 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:54.486796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:54.487533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:54.505868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:54.506751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:54.507391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:54.511463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:54.512158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:54.513218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:54.812179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:54.852320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-434ee1b8-6b9c-4013-aeac-265487941778 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.388407 Aug 30 16:07:54.853222 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 628/1125] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:54 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:54.860284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-567c4bf8-62b1-4562-abcb-b7ec6cb8049e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:54.918755 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-567c4bf8-62b1-4562-abcb-b7ec6cb8049e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064072 Aug 30 16:07:54.925125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 629/1126] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:54.947112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4dbf903c-8bb4-4db2-94b8-7ba302a89a54 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-401830883", "id": 607029882, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:55.009713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4dbf903c-8bb4-4db2-94b8-7ba302a89a54 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.066859 Aug 30 16:07:55.010585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 630/1127] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:55.032332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a14b4f7-e178-4110-8f9a-5b2eedbf0257 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:55.120270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a14b4f7-e178-4110-8f9a-5b2eedbf0257 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.100736 Aug 30 16:07:55.127349 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 631/1128] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:55 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:55.140112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c835f06-fe57-4f33-b7b3-c93898220835 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:55.187781 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c835f06-fe57-4f33-b7b3-c93898220835 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/607029882" status: 202 len: 0 microversion: 2.1 time: 0.051801 Aug 30 16:07:55.189592 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 632/1129] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:07:55 2022] DELETE /compute/v2.1/flavors/607029882 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:55.223465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa201370-ed81-45f7-a513-66f408a5ece6 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:55.301886 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa201370-ed81-45f7-a513-66f408a5ece6 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095965 Aug 30 16:07:55.306695 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 633/1130] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:56.054948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b329afe0-c878-4568-9b7f-7427811c7174 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Action: 'create', calling method: .version_select at 0x7fd35cc13310>, body: {"keypair": {"name": "tempest-keypair-1096245663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD69zWrqFg1bo5uJP4eAxDOjhVHqaNdJpFejauu5dFatKXefaRO6L+L92BZVB4T5WErmkRzZM8tn1PYZxQh51pMRLzVx4nGFuZfuxCWLq5K9oF4x1OyxXXcdbj+0IjRKtw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:56.123859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b329afe0-c878-4568-9b7f-7427811c7174 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for project 424770733741472b8fc0208b6fc63d56. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:07:56.159802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b329afe0-c878-4568-9b7f-7427811c7174 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for user 3c3b967a4cd840179929ed0bdf2ccc8f and project 424770733741472b8fc0208b6fc63d56. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:07:56.288819 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b329afe0-c878-4568-9b7f-7427811c7174 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.980784 Aug 30 16:07:56.289448 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 634/1131] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:07:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:56.300743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-191d4e1f-0544-4db3-8ef8-9ea56b32bb74 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1909050083", "id": 1343139249, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:56.401972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-191d4e1f-0544-4db3-8ef8-9ea56b32bb74 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.111220 Aug 30 16:07:56.413813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 635/1132] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:56 2022] POST /compute/v2.1/flavors => generated 429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:56.426082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:56.430995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:56.444920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.445423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.445871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.446631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.447089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.447526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.553557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.555963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.559403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.559952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lazy-loading 'fault' on Instance uuid f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:56.765392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:56.777640 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ddc1c5f1-c6f1-415d-99ae-46d2c9ee5815 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 200 len: 1304 microversion: 2.1 time: 0.359944 Aug 30 16:07:56.781724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 636/1133] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:56 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:56.800858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a", "name": "network-vif-deleted", "tag": "4aab3995-e449-4499-88f5-8199af975e20"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:56.820755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.821366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.821821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.852872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] Creating event network-vif-deleted:4aab3995-e449-4499-88f5-8199af975e20 for instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a on n-h1-830883-28 Aug 30 16:07:56.861565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-df7036ec-0b3b-4d9b-9128-c1972b981a25 req-bea8127a-44d9-40f4-915e-a5bfb573aaf5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 Aug 30 16:07:56.861565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 637/1134] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:56.878330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:56.878722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:56.915944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.918203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.924052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.929104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.930793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.933368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:57.660039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:57.664708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:57.677488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-206fa740-9834-4f4b-99a0-9da3bf76f3e7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.814790 Aug 30 16:07:57.692262 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 638/1135] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:56 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:57.698955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-337e46d0-1f15-4c4c-8a77-7fc5973c9518 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:57.769040 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-337e46d0-1f15-4c4c-8a77-7fc5973c9518 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1343139249" status: 202 len: 0 microversion: 2.1 time: 0.075205 Aug 30 16:07:57.772466 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 639/1136] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:07:57 2022] DELETE /compute/v2.1/flavors/1343139249 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:57.785992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85e990d1-c2b9-469c-9f7b-d59791d92f36 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:57.849425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85e990d1-c2b9-469c-9f7b-d59791d92f36 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072754 Aug 30 16:07:57.857276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 640/1137] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:57.885413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:57.888338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:57.904871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:57.905735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:57.906527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:57.908407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:57.909122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:57.909790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:57.928840 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] HTTP exception thrown: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Request method failure captured: Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a HTTP/1.1 Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVUu_bRQQH734zeOVlVTvsPVRKdO-FchBdLjLrfX3GNLqReqpghK9VrOq_KSnW2GHqcePVfxy3h9iihDUSO2WkQWCYyV5M8JaQ_omOIsj5I1HfTmOhZnb7KeQQpJNTJHbOPXtlViSeRsAgW8NxBx3weIfsPPXLDMNvsxVJXsNrbxIc Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:07:57.930974 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}] Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b9b2f53d6296454faac1c0c7a45860f0 Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. Aug 30 16:07:57.932347 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a'} Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:57.933172 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. Aug 30 16:07:57.934439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:07:57.937373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Returning 404 to user: Instance f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:57.938783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-945c0ff8-2030-45fd-9741-36080f244571 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a" status: 404 len: 111 microversion: 2.1 time: 0.075043 Aug 30 16:07:57.939974 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 641/1138] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:57 2022] GET /compute/v2.1/servers/f2ac1ebc-a9f8-4f9f-b88f-58f57453fd2a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:57.944916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c312134b-53c1-4e82-8855-34db1559db09 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-708032050", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:57.983812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c312134b-53c1-4e82-8855-34db1559db09 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.041344 Aug 30 16:07:57.985754 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 642/1139] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:57 2022] POST /compute/v2.1/flavors => generated 506 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:57.999008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.000563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:58.021543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.022063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.022548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.025658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.026147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.026626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.100646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:58.315033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:58.334026 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e8baa5d-218a-4c5b-81d3-93168ba4724d tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 204 len: 0 microversion: 2.1 time: 0.346518 Aug 30 16:07:58.336801 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 643/1140] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:57 2022] DELETE /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:58.353856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07a497e1-c14e-4d2f-8366-bc671b621738 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.510901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07a497e1-c14e-4d2f-8366-bc671b621738 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/23314226-69ca-4cc9-855a-a8b9c4558cfa" status: 202 len: 0 microversion: 2.1 time: 0.167130 Aug 30 16:07:58.519219 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 644/1141] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:58 2022] DELETE /compute/v2.1/flavors/23314226-69ca-4cc9-855a-a8b9c4558cfa => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:58.531571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.536947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:58.558376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.559239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.559884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.560757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.561495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.562442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.905920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:58.920514 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1dcb649-d58c-46f1-a48e-dbc612e1574b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1469 microversion: 2.1 time: 0.398377 Aug 30 16:07:58.922419 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 645/1142] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:58 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1469 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:58.935805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba192db5-fa1c-4206-a706-44bb3dd4b764 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.989975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba192db5-fa1c-4206-a706-44bb3dd4b764 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064080 Aug 30 16:07:58.991119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 646/1143] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:58.998432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.999301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:59.006827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:59.007940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:59.008721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:59.010140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:59.010860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:59.011731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:59.266159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:59.279464 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b13595f-786e-4acb-8e45-c114372bf5d9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1476 microversion: 2.1 time: 0.287040 Aug 30 16:07:59.281287 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 647/1144] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:58 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:59.288402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-278f338f-927b-428d-9de7-6b18987c8a73 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-933039428", "id": "58d31d39-d6b7-4ada-9331-00a1d3bc525e", "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:59.338154 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-278f338f-927b-428d-9de7-6b18987c8a73 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.053622 Aug 30 16:07:59.340170 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 648/1145] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:59 2022] POST /compute/v2.1/flavors => generated 506 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:59.358075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73703222-9d6a-49e1-ae4b-a27ebfefa30e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:59.398515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73703222-9d6a-49e1-ae4b-a27ebfefa30e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/58d31d39-d6b7-4ada-9331-00a1d3bc525e" status: 202 len: 0 microversion: 2.1 time: 0.044585 Aug 30 16:07:59.399428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 649/1146] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:59 2022] DELETE /compute/v2.1/flavors/58d31d39-d6b7-4ada-9331-00a1d3bc525e => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:59.409767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-512b3201-61c6-4665-80c7-565249609c46 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:59.442293 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-512b3201-61c6-4665-80c7-565249609c46 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038714 Aug 30 16:07:59.450389 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 650/1147] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:59.465586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a09ed5e1-a5ca-48b0-b4ae-df375146a54b tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1391080649", "id": 227036677, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:59.502785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a09ed5e1-a5ca-48b0-b4ae-df375146a54b tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.042066 Aug 30 16:07:59.509676 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 651/1148] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:59.518028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4cd0e54-e4e9-4f4b-8c81-1f182dc8a1f1 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:59.530595 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4cd0e54-e4e9-4f4b-8c81-1f182dc8a1f1 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/227036677" status: 200 len: 411 microversion: 2.1 time: 0.019068 Aug 30 16:07:59.538520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 652/1149] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:07:59 2022] GET /compute/v2.1/flavors/227036677 => generated 411 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:59.988463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-538fec6f-bcc8-4336-bc2c-4d3fe62380c2 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:00.062854 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-538fec6f-bcc8-4336-bc2c-4d3fe62380c2 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.521856 Aug 30 16:08:00.067396 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 653/1150] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:07:59 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:00.076631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:00.078810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:00.101826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.102487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.107306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:00.108120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.108614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.109054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:00.859935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:00.869971 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f40b65f-de6a-43b8-846b-df205ec6e306 tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1469 microversion: 2.1 time: 0.801022 Aug 30 16:08:00.886578 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 654/1151] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:00 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1469 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:00.886578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f9d0a3d-fe50-4937-ba6a-9b0889bf4d0e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:00.936189 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f9d0a3d-fe50-4937-ba6a-9b0889bf4d0e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/227036677" status: 202 len: 0 microversion: 2.1 time: 0.060364 Aug 30 16:08:00.940889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 655/1152] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:08:00 2022] DELETE /compute/v2.1/flavors/227036677 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:00.953366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:00.956464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:00.973455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.973987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.974514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:00.975226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.979346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.979800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.092825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7657b863-b9da-4901-b410-539ea4ddfa69 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 22.179786 Aug 30 16:08:02.096905 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 498/1153] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:07:39 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 22186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.110698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cb768b0-728e-488f-a579-99b55e0eb7c4 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:02.167253 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8cb768b0-728e-488f-a579-99b55e0eb7c4 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066429 Aug 30 16:08:02.168064 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 499/1154] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.176704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930eb535-b9f1-47f0-ba97-086a35fa1f9d", "name": "network-vif-deleted", "tag": "c20211d3-fc22-4db8-9855-623f0a7db613"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.210739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.211530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.212138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.232621 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] Creating event network-vif-deleted:c20211d3-fc22-4db8-9855-623f0a7db613 for instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d on n-h1-830883-28 Aug 30 16:08:02.249210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1451ee2f-7a07-4a8d-bd73-1cddd0e68d04 req-8885f322-d385-4e89-89f4-42b50697f273 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079087 Aug 30 16:08:02.253580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 500/1155] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:02.273950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:02.280920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:02.305966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.312174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.312693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.314533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.316386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.317887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.381917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:02.395751 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4790d111-5446-4903-a70f-fb94558b22aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1475 microversion: 2.1 time: 1.457430 Aug 30 16:08:02.412080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 656/1156] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:00 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1475 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.421651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fc74cfd-5228-4696-ba2a-302e014e091e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-148440906", "id": 862087192, "os-flavor-access:is_public": "False"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.489678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.490190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.490659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.491137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lazy-loading 'fault' on Instance uuid 930eb535-b9f1-47f0-ba97-086a35fa1f9d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:08:02.497630 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9fc74cfd-5228-4696-ba2a-302e014e091e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.083339 Aug 30 16:08:02.499348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 657/1157] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/flavors => generated 426 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:02.538796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a293e28-4d7b-4e1a-b5d0-604628e72f51 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "862087192"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.575329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4a293e28-4d7b-4e1a-b5d0-604628e72f51 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] HTTP exception thrown: Flavor 862087192 could not be found. Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a293e28-4d7b-4e1a-b5d0-604628e72f51 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Request method failure captured: Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 106 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjXWE9eF6x0V-37vPHAx9sn9Gno_yK9LuMCizpEk0zpk2yW6Vf4937m2yBQfpmArAlBv_Ybi6vvCXNN8G5Y48_0OxpyCpD5v73HYt305C48w6dkY_P-BJ6-opnHvjqTzQZqnIBhmDcyxLJs8i1jFyjM7dnRf0tfwhjrENt8NirifIZ4 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: b5f9d0396c9540ad938effa78e87eafe Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FlavorsAdminTestJSON-358346804 Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:02.588218 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b5f9d0396c9540ad938effa78e87eafe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b5f9d0396c9540ad938effa78e87eafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b5f9d0396c9540ad938effa78e87eafe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b5f9d0396c9540ad938effa78e87eafe"}]}] Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FlavorsAdminTestJSON-358346804 Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: b5f9d0396c9540ad938effa78e87eafe Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-358346804 Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FlavorsAdminTestJSON-358346804-project Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 6ae2f0c5f8f6423dac20fa563f8a3b5e Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FlavorsAdminTestJSON-358346804-project Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "test", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "862087192"}} Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:08:02.589936 n-d-830883-28 devstack@n-api.service[122352]: exception: Flavor 862087192 could not be found. Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '862087192'}}} Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 862087192 could not be found. Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:02.590983 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 862087192 could not be found. Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:02.593443 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:02.596500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:02.596500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:02.596500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:02.596500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 862087192 could not be found. Aug 30 16:08:02.596500 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:02.600568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a293e28-4d7b-4e1a-b5d0-604628e72f51 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Returning 400 to user: Flavor 862087192 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:02.602769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a293e28-4d7b-4e1a-b5d0-604628e72f51 tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.094831 Aug 30 16:08:02.605998 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 658/1158] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/servers => generated 80 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:08:02.626116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-152871672", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "88baaee6-1a36-4f9c-a288-84d3eef8b9da"}], "security_groups": [{"name": "tempest-securitygroup--150398259"}], "key_name": "tempest-keypair-1096245663", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.642347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9b2f53d6296454faac1c0c7a45860f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f74557b03a43d98507b0328fcae35b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:02.665804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6defe40-5462-4abc-9112-d3c9945f02fe tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 200 len: 1303 microversion: 2.1 time: 0.407711 Aug 30 16:08:02.666847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 501/1159] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:02 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 1303 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.678754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7343585e-1ce5-4d42-9c20-8aa5aa8a1ebe tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:02.727951 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7343585e-1ce5-4d42-9c20-8aa5aa8a1ebe tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/862087192" status: 202 len: 0 microversion: 2.1 time: 0.059945 Aug 30 16:08:02.728876 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 502/1160] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:08:02 2022] DELETE /compute/v2.1/flavors/862087192 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:02.755541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ffe47-9b46-4e64-ad90-b46585de11e5", "name": "network-vif-unplugged", "status": "completed", "tag": "f064cf46-a3e2-418c-8ad8-653141ee6a01"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.778111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.778888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.779479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.803181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Creating event network-vif-unplugged:f064cf46-a3e2-418c-8ad8-653141ee6a01 for instance 317ffe47-9b46-4e64-ad90-b46585de11e5 on n-h1-830883-28 Aug 30 16:08:02.819580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:08:02.827964 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6cfb5123-9ffd-49ee-bb6e-34f5b6046d26 req-8386847b-7e17-49b2-bd21-967991e22ee0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097673 Aug 30 16:08:02.829622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 503/1161] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:02.836800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef31fcbe-c3cf-4945-aa5e-93ba8db04409 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:02.869927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef31fcbe-c3cf-4945-aa5e-93ba8db04409 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038389 Aug 30 16:08:02.872961 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 504/1162] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.896773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b913d5a0-f1b3-4348-95ff-5d8dcf1d3708 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-779235523", "id": 1678392057, "os-flavor-access:is_public": "False"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:02.947595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b913d5a0-f1b3-4348-95ff-5d8dcf1d3708 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057795 Aug 30 16:08:02.949811 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 505/1163] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:02.966150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95b6c0af-4069-4c6e-aada-0ee03ab8d587 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1327173360", "id": 42248581, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:03.035223 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95b6c0af-4069-4c6e-aada-0ee03ab8d587 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.078124 Aug 30 16:08:03.074413 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 506/1164] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:03.086068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d99d265-aad5-4d54-85c5-f11ab2c7758d tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.155342 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d99d265-aad5-4d54-85c5-f11ab2c7758d tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.078263 Aug 30 16:08:03.157555 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 507/1165] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:03.171614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d27894d-343d-4a85-a12b-2f2e242cd6b7 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ce48700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.262790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d27894d-343d-4a85-a12b-2f2e242cd6b7 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.103962 Aug 30 16:08:03.263626 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 508/1166] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:03.269149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38502ea1-118a-40c8-96c1-7b1ed5696130 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.281543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38502ea1-118a-40c8-96c1-7b1ed5696130 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.016678 Aug 30 16:08:03.292524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 509/1167] 10.222.0.47 () {58 vars in 1177 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:03.299470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1307b723-18a6-427e-aac6-eae9c9856ce4 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.311605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1307b723-18a6-427e-aac6-eae9c9856ce4 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017573 Aug 30 16:08:03.326959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 510/1168] 10.222.0.47 () {58 vars in 1171 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:03.333939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-540bc46b-c951-45d7-a51b-65a305139e44 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.346591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] validate_networks() for [('88baaee6-1a36-4f9c-a288-84d3eef8b9da', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:03.370465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-540bc46b-c951-45d7-a51b-65a305139e44 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.041826 Aug 30 16:08:03.380996 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 511/1169] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:03.386101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-941dbeee-04b5-4d61-870e-69884c2531b3 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.441202 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-941dbeee-04b5-4d61-870e-69884c2531b3 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5389 microversion: 2.1 time: 0.054662 Aug 30 16:08:03.455404 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 512/1170] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5389 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:03.462519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.463619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:03.483272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.483783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.484234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:03.490763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.491380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.491846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:03.819158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:03.828677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f69ac01-e8c0-4679-a21c-2643fcbb3f51 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1475 microversion: 2.1 time: 0.371654 Aug 30 16:08:03.843732 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 513/1171] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:03.851164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c3bb1c7-5129-4969-87a1-86ba997b3e44 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.888427 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c3bb1c7-5129-4969-87a1-86ba997b3e44 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5389 microversion: 2.1 time: 0.042914 Aug 30 16:08:03.904998 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 514/1172] 10.222.0.47 () {58 vars in 1175 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5389 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:03.917742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.918416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] [instance: 930eb535-b9f1-47f0-ba97-086a35fa1f9d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:03.947455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.947955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.948404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:03.949140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.949848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.950284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:03.979083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] HTTP exception thrown: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Request method failure captured: Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d HTTP/1.1 Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVUu_bRQQH734zeOVlVTvsPVRKdO-FchBdLjLrfX3GNLqReqpghK9VrOq_KSnW2GHqcePVfxy3h9iihDUSO2WkQWCYyV5M8JaQ_omOIsj5I1HfTmOhZnb7KeQQpJNTJHbOPXtlViSeRsAgW8NxBx3weIfsPPXLDMNvsxVJXsNrbxIc Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:03.980783 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_42f74557b03a43d98507b0328fcae35b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/42f74557b03a43d98507b0328fcae35b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/42f74557b03a43d98507b0328fcae35b"}]}] Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 42f74557b03a43d98507b0328fcae35b Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAdminTestJSON-1287501041 Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b9b2f53d6296454faac1c0c7a45860f0 Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAdminTestJSON-1287501041-project Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. Aug 30 16:08:03.982431 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '930eb535-b9f1-47f0-ba97-086a35fa1f9d'} Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:03.983291 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. Aug 30 16:08:03.984653 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:03.988202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] Returning 404 to user: Instance 930eb535-b9f1-47f0-ba97-086a35fa1f9d could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:03.989258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de48cbab-edb8-4f86-8dc1-7a08d658217b tempest-ServersAdminTestJSON-1287501041 tempest-ServersAdminTestJSON-1287501041-project] 10.222.0.47 "GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d" status: 404 len: 111 microversion: 2.1 time: 0.082961 Aug 30 16:08:03.990487 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 515/1173] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/servers/930eb535-b9f1-47f0-ba97-086a35fa1f9d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:03.997251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8eda958b-a687-497b-b665-1e7dc630a6d8 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.026794 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8eda958b-a687-497b-b665-1e7dc630a6d8 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5389 microversion: 2.1 time: 0.034631 Aug 30 16:08:04.053249 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 516/1174] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5389 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.064504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a092c6c-cdc0-42b9-b34d-fb9844676646 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.110043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a092c6c-cdc0-42b9-b34d-fb9844676646 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5389 microversion: 2.1 time: 0.054332 Aug 30 16:08:04.111198 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 517/1175] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5389 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.129099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba9518e5-01aa-4720-bdf7-5fa821b646c9 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.152505 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba9518e5-01aa-4720-bdf7-5fa821b646c9 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/42248581" status: 202 len: 0 microversion: 2.1 time: 0.027331 Aug 30 16:08:04.153839 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 518/1176] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:08:04 2022] DELETE /compute/v2.1/flavors/42248581 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:04.162826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a686232-976f-4dfd-9990-976d60946056 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.192542 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a686232-976f-4dfd-9990-976d60946056 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033473 Aug 30 16:08:04.193734 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 519/1177] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.211744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7dc146ba-9a15-4247-af04-cab83341fe03 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.254295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7dc146ba-9a15-4247-af04-cab83341fe03 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/1678392057" status: 202 len: 0 microversion: 2.1 time: 0.046849 Aug 30 16:08:04.260426 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 520/1178] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:08:04 2022] DELETE /compute/v2.1/flavors/1678392057 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:08:04.268744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1bc98f33-4943-4031-afb5-10ac1530200e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.310360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1bc98f33-4943-4031-afb5-10ac1530200e tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048801 Aug 30 16:08:04.311508 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 521/1179] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.317307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-233f83fd-de97-4020-bbe1-0abc19a9895a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cd9b8b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.437173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-233f83fd-de97-4020-bbe1-0abc19a9895a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1412 microversion: 2.1 time: 0.124166 Aug 30 16:08:04.439815 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 522/1180] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.454733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-427e6833-c92a-45d3-aef7-39696f71bac0 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-786546174", "id": 840577326, "os-flavor-access:is_public": "False"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:04.560943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-427e6833-c92a-45d3-aef7-39696f71bac0 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.117257 Aug 30 16:08:04.564444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for project 424770733741472b8fc0208b6fc63d56. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:04.565511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 523/1181] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:04 2022] POST /compute/v2.1/flavors => generated 411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:04.609025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0846012-4ebb-404b-b4ef-60ccdb2c303b tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.613633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for user 3c3b967a4cd840179929ed0bdf2ccc8f and project 424770733741472b8fc0208b6fc63d56. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:04.644375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:04.645101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:04.645701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:04.646593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:04.647214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:04.659600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:04.660257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:04.660812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:04.661741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:04.662943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:04.663815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:04.691495 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0846012-4ebb-404b-b4ef-60ccdb2c303b tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099917 Aug 30 16:08:04.691996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for project 424770733741472b8fc0208b6fc63d56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:04.701260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Getting quotas for user 3c3b967a4cd840179929ed0bdf2ccc8f and project 424770733741472b8fc0208b6fc63d56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:04.701518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 524/1182] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.718179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a76551bd-9a85-4640-ad80-a222efbb37bb tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.727075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:04.729792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:04.793852 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a76551bd-9a85-4640-ad80-a222efbb37bb tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070638 Aug 30 16:08:04.795021 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 525/1183] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:04.823427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bacb7af5-0bc3-410d-b0fc-70c166e447a1 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.834887 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6387d95-c48f-4270-8459-973fde0212c6 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.224975 Aug 30 16:08:04.843809 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 659/1184] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:04.872183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-beffc782-4614-4963-8b2a-81b4428d069c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.872567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bacb7af5-0bc3-410d-b0fc-70c166e447a1 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/840577326" status: 202 len: 0 microversion: 2.1 time: 0.059639 Aug 30 16:08:04.872826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-beffc782-4614-4963-8b2a-81b4428d069c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:04.880350 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 526/1185] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:08:04 2022] DELETE /compute/v2.1/flavors/840577326 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:04.896325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:04.896949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:04.903550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:04.904246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:04.904864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:04.905729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:04.906366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:04.907021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.097090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-beffc782-4614-4963-8b2a-81b4428d069c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:05.105410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-beffc782-4614-4963-8b2a-81b4428d069c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1269 microversion: 2.1 time: 0.259087 Aug 30 16:08:05.110724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:05.131229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 660/1186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1269 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.134158 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-507ddf12-ebc1-44a8-933f-fabd6bea275c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1473 microversion: 2.1 time: 0.252670 Aug 30 16:08:05.134790 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 527/1187] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:04 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1473 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.146823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01df16ca-bdec-4ad4-9767-9aa00f23ee42 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.179763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01df16ca-bdec-4ad4-9767-9aa00f23ee42 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047082 Aug 30 16:08:05.180816 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 661/1188] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.203228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ad891f4-6b0d-4ec9-be67-1ba18448edd8 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1170972840", "id": 662230166, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:05.262052 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ad891f4-6b0d-4ec9-be67-1ba18448edd8 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.064907 Aug 30 16:08:05.263308 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 528/1189] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:05 2022] POST /compute/v2.1/flavors => generated 411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:05.276825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bdf60caf-daea-4181-a644-9f3faf2cb92a tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.309545 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bdf60caf-daea-4181-a644-9f3faf2cb92a tempest-FlavorsAdminTestJSON-358346804 tempest-FlavorsAdminTestJSON-358346804-project] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.037793 Aug 30 16:08:05.313439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 662/1190] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.329785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-478acaf6-6c38-4663-add5-cfaeaa70a456 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.359304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-478acaf6-6c38-4663-add5-cfaeaa70a456 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/662230166" status: 202 len: 0 microversion: 2.1 time: 0.033399 Aug 30 16:08:05.360781 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 529/1191] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:08:05 2022] DELETE /compute/v2.1/flavors/662230166 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:05.369140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3a4dbcc-aa9e-4ac4-bcf5-848aa9fdf3f0 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.414276 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3a4dbcc-aa9e-4ac4-bcf5-848aa9fdf3f0 tempest-FlavorsAdminTestJSON-1277453072 tempest-FlavorsAdminTestJSON-1277453072-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049130 Aug 30 16:08:05.423556 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 663/1192] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.455080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-354b5b82-d32a-4b44-b876-fae39d69c459 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cd9bdc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.527422 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-354b5b82-d32a-4b44-b876-fae39d69c459 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1421 microversion: 2.1 time: 0.077104 Aug 30 16:08:05.532405 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 530/1193] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1421 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.545713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2b6ddcd-49a7-41a7-9daa-7a9dcabfcfc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cda81f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.614296 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2b6ddcd-49a7-41a7-9daa-7a9dcabfcfc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 200 len: 1421 microversion: 2.1 time: 0.073198 Aug 30 16:08:05.615378 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 664/1194] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 1421 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.631543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c306662-e07a-41c7-a2fc-e8722c907035 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d10e700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:06.142155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:06.143553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:06.162607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.163120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.177805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:06.178707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.179212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.179663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:06.717913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:06.731240 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d11aaa65-12b5-4310-a06c-be2c98294d38 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1265 microversion: 2.1 time: 0.600494 Aug 30 16:08:06.746871 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 665/1195] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:06 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1265 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:06.754513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:06.755371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:06.764374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.765740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.767565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:06.768545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.769679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.771122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.335015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c306662-e07a-41c7-a2fc-e8722c907035 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 204 len: 0 microversion: 2.1 time: 1.709852 Aug 30 16:08:07.337342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 531/1196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:05 2022] DELETE /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 0 bytes in 1713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:08:07.347067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:07.348394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:07.367109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.367739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.370408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.380198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.380682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.381125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.491896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:08:07.698495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:07.708505 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a88ca844-8f9d-4e8c-8367-73e968a184bb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 204 len: 0 microversion: 2.1 time: 0.366439 Aug 30 16:08:07.710206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 532/1197] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:08:07 2022] DELETE /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:08:07.756787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:07.757768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:07.783645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.784142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.784555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.788130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.788827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.791163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.807912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:07.825173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8499c574-93aa-44dc-b885-29a8ad41cf50 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1470 microversion: 2.1 time: 1.074952 Aug 30 16:08:07.827948 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 666/1198] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:06 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1470 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:07.855209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:07.856248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:07.869588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.870244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.871783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:07.872670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:07.874155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:07.876607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:08.002582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:08.018045 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03026467-ae64-4f54-acf1-0d755132bf42 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1327 microversion: 2.1 time: 0.265985 Aug 30 16:08:08.022433 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 533/1199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:07 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1327 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:08.070705 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5f8221f-65ce-4622-ac1b-954aebe57ac0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5/action" status: 204 len: 0 microversion: 2.1 time: 0.219973 Aug 30 16:08:08.071603 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 667/1200] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:07 2022] POST /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:08:08.082259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:08.083066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:08.094083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:08.097587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:08.099136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:08.101389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:08.102395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-3136447", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:08.103009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:08.105664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:08.242321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] validate_networks() for [('0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:08.450015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:08.461840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9198c95-0a37-419c-8579-ff9ff395394f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1470 microversion: 2.1 time: 0.384346 Aug 30 16:08:08.464141 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 534/1201] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:08 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:08.962672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84554004-28f8-4e87-8f71-b966acb4a834", "name": "network-vif-unplugged", "status": "completed", "tag": "81db1d56-f6cc-45e1-b149-dcb8e85ae63a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:08.977081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:08.981618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:08.982084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.003752 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] Creating event network-vif-unplugged:81db1d56-f6cc-45e1-b149-dcb8e85ae63a for instance 84554004-28f8-4e87-8f71-b966acb4a834 on n-h2-830883-28 Aug 30 16:08:09.015549 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3985bed4-8f98-4400-879b-2b69aa760a55 req-9704e979-6fa7-43ab-9452-138df757bc62 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056406 Aug 30 16:08:09.020311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 535/1202] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:09.039661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:09.040627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:09.050532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.051024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.051458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.052160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.052606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.060548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.355859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:09.374344 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c2f17f59-6fa1-4bb6-a382-c84329b2c65d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1327 microversion: 2.1 time: 0.339148 Aug 30 16:08:09.377054 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 536/1203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:09 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1327 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:09.489762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:09.491326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:09.503042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.507111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.507762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.508666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.511853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.512701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.561111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:09.562153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:09.563412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:09.564027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:09.564636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:09.615094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.615867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.619390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.621154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:09.624176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:09.625464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:09.682008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:09.723602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:09.733553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for user 51cc027d79fe4ae0b644e49473acbd71 and project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:09.756863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:09.760410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:09.886561 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e81b52b-e6ac-47aa-a50c-88d5655ef95f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796229 Aug 30 16:08:09.898060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 668/1204] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:09.913462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5dee684-fb40-4964-b7d3-b7c89695bd1e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:09.914502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5dee684-fb40-4964-b7d3-b7c89695bd1e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:10.250572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5dee684-fb40-4964-b7d3-b7c89695bd1e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:10.264911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5dee684-fb40-4964-b7d3-b7c89695bd1e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1205 microversion: 2.1 time: 0.359829 Aug 30 16:08:10.286893 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 669/1205] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:09 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1205 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:10.401958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:10.403717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:10.421573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:10.424512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:10.427318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:10.429716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:10.431611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:10.436879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:10.827526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:10.845579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d4d4be7-997f-4039-a285-7b414e97d886 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1327 microversion: 2.1 time: 0.450955 Aug 30 16:08:10.847190 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 670/1206] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:10 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1327 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:11.111174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:11.124781 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa6ef351-d9fe-49e3-ad33-a834b09a61d1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1470 microversion: 2.1 time: 1.641208 Aug 30 16:08:11.125812 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 537/1207] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:09 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1470 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:11.143995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ffe47-9b46-4e64-ad90-b46585de11e5", "name": "network-vif-plugged", "status": "completed", "tag": "f064cf46-a3e2-418c-8ad8-653141ee6a01"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:11.164112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.164934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.170990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:11.200322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Creating event network-vif-plugged:f064cf46-a3e2-418c-8ad8-653141ee6a01 for instance 317ffe47-9b46-4e64-ad90-b46585de11e5 on n-h1-830883-28 Aug 30 16:08:11.226694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:08:11.272871 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-808a0f3e-9e21-4455-9373-0236d7fd8645 req-a78feff5-d98b-4f08-9ff4-66f6a90c3f86 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145368 Aug 30 16:08:11.279368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 538/1208] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:11.296354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:11.304546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1796126736", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:11.311696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:11.326582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.330431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.331061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:11.331973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.332587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.339321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:11.435807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:11.538213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:11.555419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-63983e9b-99cc-42ac-9a6a-94d813e13d61 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1209 microversion: 2.1 time: 0.266562 Aug 30 16:08:11.566610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 539/1209] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:11 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1209 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:11.818985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84554004-28f8-4e87-8f71-b966acb4a834", "name": "network-vif-deleted", "tag": "81db1d56-f6cc-45e1-b149-dcb8e85ae63a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:11.842915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.843619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.845235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:11.884604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] Creating event network-vif-deleted:81db1d56-f6cc-45e1-b149-dcb8e85ae63a for instance 84554004-28f8-4e87-8f71-b966acb4a834 on n-h2-830883-28 Aug 30 16:08:11.902985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d48285fe-a32c-4645-b0ae-7c50344c6fec req-6e0f124f-ea0f-4906-af0e-8a082b8359b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088765 Aug 30 16:08:11.904578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 540/1210] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:11.911270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:11.917623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:11.930534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.933797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.937124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:11.939048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:11.941873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:11.942994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.363650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:12.368791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:12.369535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:12.370106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:12.370786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:12.404505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.405349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.407849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.409581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.410255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.411691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.498729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Getting quotas for project 06e6ee40de9a4761a24bdc98e8719524. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:12.524447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Getting quotas for user ee9f90f703964681a96c3985e88365fa and project 06e6ee40de9a4761a24bdc98e8719524. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:12.567237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:12.581238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:12.591263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:12.600587 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7a701c5-2318-40eb-bab1-d56bd4b52e79 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.693936 Aug 30 16:08:12.601212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 541/1211] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:11 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:12.639153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:12.643035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:12.678772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.681102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.681680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.682583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.684430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.689609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.779845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1989f5b2-5494-49bc-9756-8f5ece24d26f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929812 Aug 30 16:08:12.792913 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 671/1212] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:12.807253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:12.815815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:12.835490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.838938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.840050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.843433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:12.845407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:12.846816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:12.985828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:12.995612 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7dd89ec2-14de-4a7e-8aa5-836093e7d193 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1275 microversion: 2.1 time: 0.201270 Aug 30 16:08:12.999963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 672/1213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:12 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:13.269351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35cbbf040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:13.273171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.275547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.277607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.313194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.314838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.315389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.356147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.359100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.361800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.372248 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-722e91b3-480a-4296-b3ae-647fd942e8be tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.367141 Aug 30 16:08:13.374339 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 673/1214] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:13.382456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74c97d2a-be87-406c-8570-cd2ed2e5b80e tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:13.384261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74c97d2a-be87-406c-8570-cd2ed2e5b80e tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:13.473808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74c97d2a-be87-406c-8570-cd2ed2e5b80e tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:13.482534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74c97d2a-be87-406c-8570-cd2ed2e5b80e tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1214 microversion: 2.1 time: 0.105821 Aug 30 16:08:13.484335 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 674/1215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:13 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:13.620220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d4f8ca1-f094-4cfc-8d9f-88e62b15bd61 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Calling method '.version_select at 0x7fd35cbbf0d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:13.688825 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d4f8ca1-f094-4cfc-8d9f-88e62b15bd61 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.201373 Aug 30 16:08:13.689216 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 675/1216] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:08:13 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:08:13.694676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35cceb0d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:13.697889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.698869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.699751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.717904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.718501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.719168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.732396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.733078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.733842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.742893 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cac3ad0a-fd14-49e5-8ca9-b1909765772d tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.052383 Aug 30 16:08:13.743829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 676/1217] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:08:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:13.749120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:13.751328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:13.761592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.777672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.778151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.778942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:13.779408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:13.779848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:13.819667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:13.844300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:13.858632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbae6b3e-8576-4b73-a2d8-04a527e09caa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1462 microversion: 2.1 time: 1.252512 Aug 30 16:08:13.860332 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 542/1218] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:12 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1462 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:13.880156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587b0d66-0022-41e7-8b01-7cba7ccb3b0d tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Action: 'create', calling method: .version_select at 0x7fd35ce7d700>, body: {"pool": "non_exist_pool"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:14.085362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:14.099931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de32c096-6bcc-4d9d-9240-5531eb82f4b4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.348788 Aug 30 16:08:14.101961 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 677/1219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:13 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:14.121724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35cc04af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.123792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.124291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.124738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.147959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.148756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.149380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.182087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.182967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.184434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.208087 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b93aaee3-1144-489a-8ecc-fccd700fc877 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.103367 Aug 30 16:08:14.209100 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 678/1220] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:14.215792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.216632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:14.228060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.228803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.229579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.230506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.231184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.231780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.268180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-587b0d66-0022-41e7-8b01-7cba7ccb3b0d tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] HTTP exception thrown: Floating IP pool not found. Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587b0d66-0022-41e7-8b01-7cba7ccb3b0d tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Request method failure captured: Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 26 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjXsAmkQWPPqkIvKS_Rj8mzi-vjJTzwxfYb3yWD_dOf31CCXONLw2PPwAz_fV_Cm7OtI3uk3T4HVCvNAbpSDdTe68klYAVXe7oix3SP12vnsp2bIWbwjwsmOye0A3LAMCkH5yEfeDVgmKOrSBzLPNg8oz4wCQEWSZ5wO-T5vQftQVP0 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ecda32a904eb47aebc0ddec1abed559a Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:14.270385 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ecda32a904eb47aebc0ddec1abed559a"}]}] Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ecda32a904eb47aebc0ddec1abed559a Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FloatingIPsNegativeTestJSON-1032257515-project Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ddc446444f8e4245b04c19325c8b1530 Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1032257515-project Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: {"pool": "non_exist_pool"} Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: exception: Floating IP pool not found. Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 30 16:08:14.271976 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:14.273141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 30 16:08:14.274624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.275759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587b0d66-0022-41e7-8b01-7cba7ccb3b0d tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Returning 404 to user: Floating IP pool not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:14.276882 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-587b0d66-0022-41e7-8b01-7cba7ccb3b0d tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.414913 Aug 30 16:08:14.277752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 543/1221] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:08:13 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:08:14.284872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.292556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:14.317931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.327466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.330626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.334711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.336957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.337491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.550708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:14.559746 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38df189a-7d17-4f9d-aaa6-c88166b5a5bc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1462 microversion: 2.1 time: 0.349318 Aug 30 16:08:14.560890 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 679/1222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1462 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:14.579199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd36104a550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.581262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.581744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.582216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.601062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.601737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.602397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.610083 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9562be2d-c7c0-4082-ba8e-bb50d9488851 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.047179 Aug 30 16:08:14.610970 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 680/1223] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:14.616244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Calling method '.version_select at 0x7fd36104a940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.660579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 could not be found", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:08:14.661521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] HTTP exception thrown: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Request method failure captured: Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-floating-ips/3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 HTTP/1.1 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjXsAmkQWPPqkIvKS_Rj8mzi-vjJTzwxfYb3yWD_dOf31CCXONLw2PPwAz_fV_Cm7OtI3uk3T4HVCvNAbpSDdTe68klYAVXe7oix3SP12vnsp2bIWbwjwsmOye0A3LAMCkH5yEfeDVgmKOrSBzLPNg8oz4wCQEWSZ5wO-T5vQftQVP0 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ecda32a904eb47aebc0ddec1abed559a Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:14.663904 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ecda32a904eb47aebc0ddec1abed559a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ecda32a904eb47aebc0ddec1abed559a"}]}] Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ecda32a904eb47aebc0ddec1abed559a Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1032257515 Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsNegativeTestJSON-1032257515-project Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ddc446444f8e4245b04c19325c8b1530 Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1032257515-project Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: exception: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448'} Aug 30 16:08:14.665683 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:08:14.666715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 could not be found Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df9259d9-72f6-49f3-826e-feda678f59c4'] Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448. Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:14.668152 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:14.669647 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:14.671175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 Aug 30 16:08:14.671175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:14.676132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] Returning 404 to user: Floating IP not found for ID 3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:14.677334 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c2eab2a-2035-4b31-aa9d-e28cd1091538 tempest-FloatingIPsNegativeTestJSON-1032257515 tempest-FloatingIPsNegativeTestJSON-1032257515-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448" status: 404 len: 111 microversion: 2.1 time: 0.064909 Aug 30 16:08:14.678513 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 681/1224] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:08:14 2022] DELETE /compute/v2.1/os-floating-ips/3e6ea0b0-ae5c-49e0-9c59-5b6d895a2448 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:14.689448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:14.690269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:14.704640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.712607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.713274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.714191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:14.715041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:14.715644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:14.871029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:14.882006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d99c8a99-c057-4fc9-8f5c-c320baeab081 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1266 microversion: 2.1 time: 0.201889 Aug 30 16:08:14.882830 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 682/1225] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:14.889506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d6ed072-938d-44ee-82aa-11e1dff28420 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'create', calling method: .version_select at 0x7fd36104aa60>, body: {"keypair": {"name": "tempest-keypair-525349389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnBebE0CD+oIRE0hbADdfAIDDYQ/BOJLUdCSfmtdkUT+1829CXV006U8/5kzRn4B9F1EbW0sXeKUyPwP9ZiZ2SgHYK9Q/hD+HzTlarg4tB0AmLvWMv8sXMi7TTSX3iAlw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:14.914832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6d6ed072-938d-44ee-82aa-11e1dff28420 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:14.921174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6d6ed072-938d-44ee-82aa-11e1dff28420 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:14.994031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d6ed072-938d-44ee-82aa-11e1dff28420 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109931 Aug 30 16:08:14.994841 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 683/1226] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:08:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:15.007064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eca75272-b80c-4e22-a237-9a665d5eeae0 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35ce47280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.009403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca75272-b80c-4e22-a237-9a665d5eeae0 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.010125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca75272-b80c-4e22-a237-9a665d5eeae0 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.010816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca75272-b80c-4e22-a237-9a665d5eeae0 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.056584 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eca75272-b80c-4e22-a237-9a665d5eeae0 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.059826 Aug 30 16:08:15.058039 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 684/1227] 10.222.0.47 () {58 vars in 1179 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:15.072301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35d242a60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.075151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.076091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.077053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.101433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.102650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.104242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.120190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.121083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.121943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.127316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:15.131669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:15.133961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-012208e5-12ba-48b2-b9e8-e849837506c5 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.066415 Aug 30 16:08:15.135186 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 685/1228] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:15.143469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.144105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:15.151450 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe187625-6ec3-4837-b5c4-524c3985a77a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1263 microversion: 2.1 time: 0.872521 Aug 30 16:08:15.151806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.152315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.153033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.153190 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 544/1229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:14 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1263 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:15.153853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.154347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.154838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.159135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35d4f89d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.160898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.161376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.161808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.229453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.229977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.230466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.254548 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b0a4b27-87ea-4a6c-9d12-4517822e9474 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.094611 Aug 30 16:08:15.257673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 545/1230] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:15.271803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35cd5c3a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.274117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.274794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.275414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.311742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.312269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.314008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.332668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-648d8491-a03a-451d-b539-bc0ec68553d9 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.064984 Aug 30 16:08:15.333317 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 546/1231] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:15.347287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Calling method '.version_select at 0x7fd35cd5c0d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.349045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.349518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.350127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.372823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.373378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.373813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.405227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.405720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.406295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.454000 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-abf103d8-63a7-48a5-8079-07aa718f9782 tempest-HypervisorAdminTestJSON-1221656475 tempest-HypervisorAdminTestJSON-1221656475-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.109838 Aug 30 16:08:15.455541 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 547/1232] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:15.853677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1", "tag": "3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:15.879330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.887290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.889380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.928454 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] Creating event network-changed:3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3 for instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 on n-h2-830883-28 Aug 30 16:08:15.936906 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1a7e3503-8504-4511-ad80-ed84049ee927 req-a87074d9-7eb0-4928-bf9b-3993af65b78b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087143 Aug 30 16:08:15.941704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 548/1233] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:15.948914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:15.949873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:15.970109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.973621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.974350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:15.975102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:15.975564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:15.977463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:16.126380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:16.139416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d136b19f-aca8-43b1-9bf3-98ae18864497 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1272 microversion: 2.1 time: 0.194549 Aug 30 16:08:16.140333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 549/1234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:16.173401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:16.174363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:16.185129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:16.185636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:16.189344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:16.190119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:16.190628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:16.191067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:16.337077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:16.352263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0798dc95-9644-47d8-be79-e2b926a52e2a tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 1.215639 Aug 30 16:08:16.354128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 686/1235] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:15 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:16.519124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-386218530", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "88f79734-ff1c-4f30-a3a8-a1ec909b23ff"}], "security_groups": [{"name": "tempest-securitygroup--455966766"}], "key_name": "tempest-keypair-1400296112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f26a03f7-00fa-4e1b-8c4a-b036e2f6947a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:16.677245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:16.688535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7ce5f98-d71a-426c-8107-7169599b37b4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.518878 Aug 30 16:08:16.689861 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 550/1236] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:16 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:16.928229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] validate_networks() for [('88f79734-ff1c-4f30-a3a8-a1ec909b23ff', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:17.163488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:17.164005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:17.177536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.178594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.179161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:17.179946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.180610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.181211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:17.327209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:17.340163 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-005a1b1c-d567-4853-9a25-12a91a7c0994 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1272 microversion: 2.1 time: 0.179103 Aug 30 16:08:17.341796 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 551/1237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:17 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:17.379201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:17.380070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:17.394152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.395006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.395620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:17.396912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.397551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.398205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:17.690478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:17.707890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f46f8953-093c-4a22-b92a-9f27f4794e85 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.337669 Aug 30 16:08:17.708507 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 552/1238] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:17 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:17.723715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:17.724696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:17.752013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.755116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.755772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:17.757457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:17.758981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:17.765135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.041572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for project df4ba726b1aa40b5b67d4e74ef74145d. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:18.050648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for user e1fc2d74483b47d1ab6c46e47b7582aa and project df4ba726b1aa40b5b67d4e74ef74145d. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:18.075439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:18.076216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:18.076886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:18.077488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:18.078620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:18.087758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.088594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.089342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.090274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.090968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.091599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.101788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:18.117080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for project df4ba726b1aa40b5b67d4e74ef74145d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:18.117325 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45854e86-3dfd-46da-abf3-aac83be77f82 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.406502 Aug 30 16:08:18.118701 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 553/1239] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:17 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:18.123262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Getting quotas for user e1fc2d74483b47d1ab6c46e47b7582aa and project df4ba726b1aa40b5b67d4e74ef74145d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:18.129767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dadb30e7-3b3d-4125-8b72-7fac1b4df260", "tag": "c9d6904a-9312-4349-9029-6576aa8a5d37"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:18.153767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.154362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.155844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.174329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] Creating event network-changed:c9d6904a-9312-4349-9029-6576aa8a5d37 for instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 on n-h2-830883-28 Aug 30 16:08:18.181283 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1f77e34a-a368-4036-a8d1-92016ad15417 req-0092dd0d-e0b6-4b1f-99ea-e72c8b56a58b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059891 Aug 30 16:08:18.183510 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 554/1240] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:18.205634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:18.207812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f26a03f7-00fa-4e1b-8c4a-b036e2f6947a',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:18.363789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:18.364736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:18.374045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.375759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.376362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.377284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.377914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.378554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.480851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:18.544169 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0963d510-4990-464d-85f1-895400f299a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.030309 Aug 30 16:08:18.553520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 687/1241] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:18.560566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21682701-b42d-4179-b37c-4b2c93bdf90a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:18.561482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21682701-b42d-4179-b37c-4b2c93bdf90a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:18.671566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21682701-b42d-4179-b37c-4b2c93bdf90a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:18.680420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21682701-b42d-4179-b37c-4b2c93bdf90a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1121 microversion: 2.1 time: 0.125807 Aug 30 16:08:18.695463 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 688/1242] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:18 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1121 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:18.729483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:18.730451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:18.741069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.752473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.753022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.753899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:18.754267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:18.764442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:18.815402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:18.827173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71dd6626-d238-4a04-aca1-f3b525136de0 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.467507 Aug 30 16:08:18.836549 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 555/1243] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:18 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:19.142783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.143764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:19.152582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.155192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.157293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.159150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.159849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.160651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.223662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:19.251931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11ac96ee-1c21-4f2a-a744-665748f0371d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.526512 Aug 30 16:08:19.252499 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 689/1244] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:18 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:19.268011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8bb95b1c-8bd8-4fbb-9ce1-0f81b24fba4b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '.version_select at 0x7fd35cbbf3a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.272418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb95b1c-8bd8-4fbb-9ce1-0f81b24fba4b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.273138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb95b1c-8bd8-4fbb-9ce1-0f81b24fba4b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.273591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb95b1c-8bd8-4fbb-9ce1-0f81b24fba4b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.298046 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8bb95b1c-8bd8-4fbb-9ce1-0f81b24fba4b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.040416 Aug 30 16:08:19.299109 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 690/1245] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:19.318078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53dba281-8a1d-4c1c-8ec9-97ea218844b8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.333065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53dba281-8a1d-4c1c-8ec9-97ea218844b8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018899 Aug 30 16:08:19.334171 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 691/1246] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:19.352228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-713c183e-46c7-46bf-b112-3b0fe49f0e0f tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1346717033", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:19.388420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-713c183e-46c7-46bf-b112-3b0fe49f0e0f tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.041967 Aug 30 16:08:19.389967 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 692/1247] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Aug 30 16:08:19 2022] POST /compute/v2.1/flavors => generated 499 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:19.400484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:19.408150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e05ed1e0-d1c1-4db6-af73-8f8a160c536f tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.409588 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b9f9252-3a4f-489b-9b3f-02e28da6f258 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.273683 Aug 30 16:08:19.410787 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 556/1248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:19.422571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e05ed1e0-d1c1-4db6-af73-8f8a160c536f tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023445 Aug 30 16:08:19.423803 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 693/1249] 10.222.0.47 () {58 vars in 1182 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:08:19.589219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1019587803", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "55399ee3-6a92-473c-af3c-780bbf102264"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:19.669936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:19.705106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.706587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:19.717588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.718695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.720143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.721112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.721749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.722591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.861681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:19.880015 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2233fe94-a6b9-46c4-99a9-f2e3394bd656 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1163 microversion: 2.1 time: 0.182857 Aug 30 16:08:19.896187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 694/1250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1163 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:19.902904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:19.903749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:19.910661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.911699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.912965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:19.913897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:19.914596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:19.915254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:20.982589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:20.983070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:20.983477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:20.983888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:20.984423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:21.023240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.023749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.024199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.024953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.025420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.025848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.076656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:21.084868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:21.102836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:21.106583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:21.164315 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a999ec79-60b5-4cad-aebf-f8c4c90fa11c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579227 Aug 30 16:08:21.165618 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 557/1251] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:21.171116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:21.172123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:21.179060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.179790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.180437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.181437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.182048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.182703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.216368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:21.225817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9fe8fbd-b95a-4c59-8fdb-9b2343186efb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 1.328146 Aug 30 16:08:21.226428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 695/1252] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:19 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:21.250952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:21.251593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:21.272819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.273326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.273953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.274866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.275332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.275767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.613242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:21.626742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-74670c21-8576-4cca-8cf8-cd177413739c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.456364 Aug 30 16:08:21.627704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 558/1253] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:21 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:21.661605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:21.664924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:21.679963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.681992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.683609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.685982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.688854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.689542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.855371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:21.861998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:21.864461 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9549cb71-42e9-4acd-a3e3-7b4540ca2f0d tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1237 microversion: 2.1 time: 0.221251 Aug 30 16:08:21.868468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 559/1254] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:21 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1237 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:21.873165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5043ba-34cd-4166-84f5-33644a25e8c2", "tag": "565eff1b-6746-4e0a-9306-ec413c0c6070"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:21.899830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:21.900152 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d2b2826-6468-4638-86e9-96f43da0284d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.654816 Aug 30 16:08:21.901171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:21.913867 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 696/1255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:21 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:21.914109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:21.914208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7b504019-16bd-473b-8f42-741aea478f91 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:21.914208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7b504019-16bd-473b-8f42-741aea478f91 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:21.929209 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] Creating event network-changed:565eff1b-6746-4e0a-9306-ec413c0c6070 for instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 on n-h1-830883-28 Aug 30 16:08:21.935568 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0ad3193e-bc6e-456c-adad-b73105c962b9 req-1435a5e7-8c0e-4d5e-9ac9-48684fcdf35b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065585 Aug 30 16:08:21.937755 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 560/1256] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:22.127933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7b504019-16bd-473b-8f42-741aea478f91 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.137988 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7b504019-16bd-473b-8f42-741aea478f91 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1279 microversion: 2.1 time: 0.230724 Aug 30 16:08:22.139952 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 697/1257] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:21 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1279 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:22.246862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.247644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:22.262955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.264373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.267041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.267886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.268458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.269753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.371119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d49b9583-c228-4321-a0b1-d6bf7d5e63d2 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Calling method '.version_select at 0x7fd35cd80e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.372899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d49b9583-c228-4321-a0b1-d6bf7d5e63d2 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ec741a88652a4e789d49cb86d0568b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c301b9a6c4ce9a3455cfd9f93a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d49b9583-c228-4321-a0b1-d6bf7d5e63d2 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Request method failure captured: Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjX0TJuyDF6W3xFb1goZho6ShQ70adMeOfukgJQRK0gNZTqbLcbONWcW6Sewlavc5Pi3cS5gild_yLClJR8meLUlYr8ZqegV3n9b0bsm61jGAFRwDLtauODlSRO9dG_eQiPfXF46yLrruEOpvMH71bcMMKPPGryyZ3uck1ZX-ZHAGK8 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:22.374935 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}] Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ec741a88652a4e789d49cb86d0568b10 Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:08:22.376515 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:08:22.377456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 16:08:22.378865 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.393924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d49b9583-c228-4321-a0b1-d6bf7d5e63d2 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:22.394824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d49b9583-c228-4321-a0b1-d6bf7d5e63d2 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.454687 Aug 30 16:08:22.401418 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 561/1258] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:08:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:22.407329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68dbe0c8-e39a-4e80-875d-bbe31a549808 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Calling method '.version_select at 0x7fd35cdc68b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.409298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-68dbe0c8-e39a-4e80-875d-bbe31a549808 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ec741a88652a4e789d49cb86d0568b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c301b9a6c4ce9a3455cfd9f93a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68dbe0c8-e39a-4e80-875d-bbe31a549808 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Request method failure captured: Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjX0TJuyDF6W3xFb1goZho6ShQ70adMeOfukgJQRK0gNZTqbLcbONWcW6Sewlavc5Pi3cS5gild_yLClJR8meLUlYr8ZqegV3n9b0bsm61jGAFRwDLtauODlSRO9dG_eQiPfXF46yLrruEOpvMH71bcMMKPPGryyZ3uck1ZX-ZHAGK8 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:22.411111 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}] Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ec741a88652a4e789d49cb86d0568b10 Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:08:22.413327 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:08:22.415503 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 16:08:22.417691 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.422425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68dbe0c8-e39a-4e80-875d-bbe31a549808 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:22.422425 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68dbe0c8-e39a-4e80-875d-bbe31a549808 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009591 Aug 30 16:08:22.422425 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 562/1259] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:22.424889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c68f208-17c0-4ec4-8a53-76e49942c6c6 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Calling method '.version_select at 0x7fd35d2f9310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.426848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0c68f208-17c0-4ec4-8a53-76e49942c6c6 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ec741a88652a4e789d49cb86d0568b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c301b9a6c4ce9a3455cfd9f93a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c68f208-17c0-4ec4-8a53-76e49942c6c6 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Request method failure captured: Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjX0TJuyDF6W3xFb1goZho6ShQ70adMeOfukgJQRK0gNZTqbLcbONWcW6Sewlavc5Pi3cS5gild_yLClJR8meLUlYr8ZqegV3n9b0bsm61jGAFRwDLtauODlSRO9dG_eQiPfXF46yLrruEOpvMH71bcMMKPPGryyZ3uck1ZX-ZHAGK8 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:22.428569 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}] Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ec741a88652a4e789d49cb86d0568b10 Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:08:22.429925 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:08:22.432786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 16:08:22.436857 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.438598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c68f208-17c0-4ec4-8a53-76e49942c6c6 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:22.438598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c68f208-17c0-4ec4-8a53-76e49942c6c6 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.012781 Aug 30 16:08:22.439948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 563/1260] 10.222.0.47 () {58 vars in 1179 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:22.516185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Calling method '.version_select at 0x7fd35cde7ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.518932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.519481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.519922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.556006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.564644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.565964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.580694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.581260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.581772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.614641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e769be7-5430-49df-bd78-79330cee7493 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.173469 Aug 30 16:08:22.615685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 564/1261] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:22.627710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48cad719-e1aa-4f03-a898-24b872a2cdc9 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Calling method '.version_select at 0x7fd35cdc6d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.630521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-48cad719-e1aa-4f03-a898-24b872a2cdc9 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ec741a88652a4e789d49cb86d0568b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c301b9a6c4ce9a3455cfd9f93a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48cad719-e1aa-4f03-a898-24b872a2cdc9 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Request method failure captured: Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjX0TJuyDF6W3xFb1goZho6ShQ70adMeOfukgJQRK0gNZTqbLcbONWcW6Sewlavc5Pi3cS5gild_yLClJR8meLUlYr8ZqegV3n9b0bsm61jGAFRwDLtauODlSRO9dG_eQiPfXF46yLrruEOpvMH71bcMMKPPGryyZ3uck1ZX-ZHAGK8 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:22.632517 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}] Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ec741a88652a4e789d49cb86d0568b10 Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1'} Aug 30 16:08:22.633893 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:08:22.634822 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 16:08:22.635976 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.639666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48cad719-e1aa-4f03-a898-24b872a2cdc9 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:22.640824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48cad719-e1aa-4f03-a898-24b872a2cdc9 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.018603 Aug 30 16:08:22.643419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 565/1262] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:22.650687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.651736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:22.660105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.660914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.661557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.662493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.663204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.663858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.830087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.842997 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf947f8b-2fa8-4eea-99b7-0019a6a424d1 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.599802 Aug 30 16:08:22.843630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 698/1263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:22.856630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70c70dba-845b-4031-86d2-e58aba925767 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Calling method '.version_select at 0x7fd35ce47dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.858529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-70c70dba-845b-4031-86d2-e58aba925767 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] HTTP exception thrown: Hypervisor with ID '49ea0128-4410-432f-abf4-16db6fef0de4' could not be found. Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70c70dba-845b-4031-86d2-e58aba925767 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Request method failure captured: Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hypervisors/49ea0128-4410-432f-abf4-16db6fef0de4/uptime HTTP/1.1 Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjX1WLqeWJAIuEdrMFqxXq1zl5df9WYwFd2bHtwV6Axmo2F0p5p_ODICdzLJsVKQ_0kQW_nhV-iHn7rqKqWSzQ0rfkwUdZ5OPmmc35CeNn6tOEUnCeMU7Cqr0X1ED-yzxROuo1_I7GsCSCoE6bPaj6Ie6QVNGOxaNS9mptkErlQ7amE Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 93730bd1ff3d43ab96947daa6caed63d Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:08:22.863958 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93730bd1ff3d43ab96947daa6caed63d"}]}] Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 93730bd1ff3d43ab96947daa6caed63d Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: c08af901db6445fba1ddb363d94dc537 Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: exception: Hypervisor with ID '49ea0128-4410-432f-abf4-16db6fef0de4' could not be found. Aug 30 16:08:22.865639 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '49ea0128-4410-432f-abf4-16db6fef0de4'} Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '49ea0128-4410-432f-abf4-16db6fef0de4' Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 16:08:22.866799 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '49ea0128-4410-432f-abf4-16db6fef0de4' could not be found. Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:22.868633 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '49ea0128-4410-432f-abf4-16db6fef0de4' could not be found. Aug 30 16:08:22.870200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:22.872101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70c70dba-845b-4031-86d2-e58aba925767 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Returning 404 to user: Hypervisor with ID '49ea0128-4410-432f-abf4-16db6fef0de4' could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:22.873284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70c70dba-845b-4031-86d2-e58aba925767 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/49ea0128-4410-432f-abf4-16db6fef0de4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.028379 Aug 30 16:08:22.874349 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 699/1264] 10.222.0.47 () {58 vars in 1278 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors/49ea0128-4410-432f-abf4-16db6fef0de4/uptime => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:22.878284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:22.881831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1", "name": "network-vif-plugged", "status": "completed", "tag": "3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:22.894149 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e84313d-311c-4c2e-bc88-4f0c58d796a4 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.247535 Aug 30 16:08:22.895081 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 566/1265] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:22.907456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.907456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.907660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Calling method '.version_select at 0x7fd35cde7b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.907756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.907880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.907880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.907880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.913778 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] Creating event network-vif-plugged:3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3 for instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 on n-h2-830883-28 Aug 30 16:08:22.919854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.920494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.921035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.921273 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0c2d890c-6a68-4cf1-8a87-feea05013b12 req-15aaa993-46e2-4f97-a32a-33612c5abf27 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044445 Aug 30 16:08:22.928533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 700/1266] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:22.938985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.939619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.940324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.947067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.947783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:22.948372 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c208b08b-6a29-4313-a662-46d3e574ce94 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051996 Aug 30 16:08:22.949726 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 567/1267] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:22.954959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:22.955889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:22.961881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.962415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.962855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.963535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.963942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.964156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.964662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.964898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.965483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:22.965635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:22.966072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:22.966592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.086681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:23.097477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ae14a9a-b96a-4bb4-a968-b314ec406018 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1237 microversion: 2.1 time: 0.166659 Aug 30 16:08:23.107580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 701/1268] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:23.115178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f8b648a-17ea-4130-8fdf-42b94fe1a602 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Calling method '.version_select at 0x7fd360fd6b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:23.117741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f8b648a-17ea-4130-8fdf-42b94fe1a602 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ec741a88652a4e789d49cb86d0568b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c301b9a6c4ce9a3455cfd9f93a5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f8b648a-17ea-4130-8fdf-42b94fe1a602 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Request method failure captured: Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjX0TJuyDF6W3xFb1goZho6ShQ70adMeOfukgJQRK0gNZTqbLcbONWcW6Sewlavc5Pi3cS5gild_yLClJR8meLUlYr8ZqegV3n9b0bsm61jGAFRwDLtauODlSRO9dG_eQiPfXF46yLrruEOpvMH71bcMMKPPGryyZ3uck1ZX-ZHAGK8 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:23.121870 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/131c301b9a6c4ce9a3455cfd9f93a5db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/131c301b9a6c4ce9a3455cfd9f93a5db"}]}] Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 131c301b9a6c4ce9a3455cfd9f93a5db Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902 Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ec741a88652a4e789d49cb86d0568b10 Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1460408902-project Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1'} Aug 30 16:08:23.123278 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:08:23.124061 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 16:08:23.125358 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.128360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f8b648a-17ea-4130-8fdf-42b94fe1a602 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:23.129291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f8b648a-17ea-4130-8fdf-42b94fe1a602 tempest-HypervisorAdminNegativeTestJSON-1460408902 tempest-HypervisorAdminNegativeTestJSON-1460408902-project] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020286 Aug 30 16:08:23.130018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 702/1269] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:08:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:23.141865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9eca6252-a43d-4224-90e8-d7fe6b529cf9 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Calling method '.version_select at 0x7fd35cd2c4c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:23.144446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9eca6252-a43d-4224-90e8-d7fe6b529cf9 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] HTTP exception thrown: Hypervisor with ID '68508554-da86-4f89-acd3-470493d9415e' could not be found. Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9eca6252-a43d-4224-90e8-d7fe6b529cf9 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Request method failure captured: Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-hypervisors/68508554-da86-4f89-acd3-470493d9415e HTTP/1.1 Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjX1WLqeWJAIuEdrMFqxXq1zl5df9WYwFd2bHtwV6Axmo2F0p5p_ODICdzLJsVKQ_0kQW_nhV-iHn7rqKqWSzQ0rfkwUdZ5OPmmc35CeNn6tOEUnCeMU7Cqr0X1ED-yzxROuo1_I7GsCSCoE6bPaj6Ie6QVNGOxaNS9mptkErlQ7amE Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 93730bd1ff3d43ab96947daa6caed63d Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:08:23.147608 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/93730bd1ff3d43ab96947daa6caed63d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/93730bd1ff3d43ab96947daa6caed63d"}]}] Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 93730bd1ff3d43ab96947daa6caed63d Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491 Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: c08af901db6445fba1ddb363d94dc537 Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: exception: Hypervisor with ID '68508554-da86-4f89-acd3-470493d9415e' could not be found. Aug 30 16:08:23.149545 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '68508554-da86-4f89-acd3-470493d9415e'} Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '68508554-da86-4f89-acd3-470493d9415e' Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 16:08:23.150586 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:08:23.152398 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '68508554-da86-4f89-acd3-470493d9415e' could not be found. Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '68508554-da86-4f89-acd3-470493d9415e' could not be found. Aug 30 16:08:23.154618 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:23.155861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9eca6252-a43d-4224-90e8-d7fe6b529cf9 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] Returning 404 to user: Hypervisor with ID '68508554-da86-4f89-acd3-470493d9415e' could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:23.157768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9eca6252-a43d-4224-90e8-d7fe6b529cf9 tempest-HypervisorAdminNegativeTestJSON-1056106491 tempest-HypervisorAdminNegativeTestJSON-1056106491-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors/68508554-da86-4f89-acd3-470493d9415e" status: 404 len: 123 microversion: 2.1 time: 0.022080 Aug 30 16:08:23.161381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 703/1270] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:08:23 2022] GET /compute/v2.1/os-hypervisors/68508554-da86-4f89-acd3-470493d9415e => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:08:23.177981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:23.180703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:23.194491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:23.195363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.195979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.196926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.197906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.198768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.199797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.204417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:23.216626 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-467f0c49-80b9-445f-a124-9afb7f538cb1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.263997 Aug 30 16:08:23.251829 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 568/1271] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:22 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:23.328899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:23.338940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f0adb4f-4b29-46b4-8edc-71bb69ccab73 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1331 microversion: 2.1 time: 0.176030 Aug 30 16:08:23.339878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 704/1272] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:23 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:23.875532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:23.876815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:23.883085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.883593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.890718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.891484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.891958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.892378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.914847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:23.915584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:23.924443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.925728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.926176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:23.928800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:23.929292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:23.929738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.294007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:24.308833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-537c78e0-0868-4b0a-9815-ba2c72d3fa6e tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.397487 Aug 30 16:08:24.309758 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 705/1273] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:23 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:24.315514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:24.323347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:24.336468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.337822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.338902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.339960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.340791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.341502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.440871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:24.452376 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e444dbe-a35f-4775-8f1b-1c1f6ae99c75 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.588180 Aug 30 16:08:24.454113 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 569/1274] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:23 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:24.459236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:24.460214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:24.466789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.467500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.468093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.469679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.470147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.470595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.879879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:24.896204 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f44dbc30-791f-4f78-a1d2-5752117506e0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.440158 Aug 30 16:08:24.901179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 570/1275] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:24 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:24.910210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:24.911268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:24.920607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.921545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.922568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:24.923867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:24.924571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:24.925399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.048468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:25.058280 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a6e0401-23ec-41d5-b4ef-f52dffc738fb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1337 microversion: 2.1 time: 0.154958 Aug 30 16:08:25.059844 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 571/1276] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:24 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1337 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:25.222161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:25.238292 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-964ab8ea-6e1d-41bf-8009-155d6fedaec0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1304 microversion: 2.1 time: 0.927192 Aug 30 16:08:25.239811 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 706/1277] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:24 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1304 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:25.332042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:25.332799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:25.342026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.344999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.345466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.348792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.351700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.352207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.477416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:25.480305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:25.496527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.498447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.500522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.504663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.505146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.507537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.526272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:25.926070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:25.936374 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ade8190-418e-4277-8402-df8a3eb2ba8c tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1394 microversion: 2.1 time: 0.610025 Aug 30 16:08:25.937043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 572/1278] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:25 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1394 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:25.944297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:25.945591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:25.948279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:25.962225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.964798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd718f63-0996-4a1e-9d38-f5b8b14d4dcb tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.491904 Aug 30 16:08:25.966215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.967447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 707/1279] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:25 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:25.981069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:25.982174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:25.984922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:25.985458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.084671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:26.087032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:26.117900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:26.118549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:26.119012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.119749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:26.122527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:26.123208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.339257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:26.350442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-039e2dfe-1af1-4797-aac6-8f9889491951 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.412148 Aug 30 16:08:26.351043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 573/1280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:25 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:26.361461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:26.365932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:26.383001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:26.384337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:26.385378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.386631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:26.387253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:26.387897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.755441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:26.768747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de0de0f8-68ec-48bb-813a-302a92abf2b3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.690587 Aug 30 16:08:26.769343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 708/1281] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:26 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:26.927595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcacc7f-8ceb-4ff8-bdb4-0022ef760940", "tag": "5e56f21b-5b46-4550-ac58-c692ce7dbc24"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:26.953712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:26.954958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:26.959393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:26.981869 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] Creating event network-changed:5e56f21b-5b46-4550-ac58-c692ce7dbc24 for instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 on n-h2-830883-28 Aug 30 16:08:26.998360 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-33c6d05f-c433-47cf-877c-8b028fe6f10b req-00d073fe-6c30-4660-8d1a-7d6f9b26ffb2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072081 Aug 30 16:08:26.998360 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 709/1282] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:27.010274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:27.011036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:27.028912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.029623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.030239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.033687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.034585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.036094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.090075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:27.101116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d73245c9-e28c-48d2-8a51-53d35e7f5e1f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1304 microversion: 2.1 time: 0.746975 Aug 30 16:08:27.102465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 574/1283] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:26 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1304 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:27.108355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:27.109414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:27.116774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.117608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.118251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.119228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.119900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.120493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.426518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:27.439323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cbc7a6b8-68ff-4862-bc52-864d03c4b1a2 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.335134 Aug 30 16:08:27.439917 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 575/1284] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:27 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:27.453720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:27.455204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:27.462421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.463363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.463986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.465245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.465922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.466554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.591080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:27.611903 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0eb96c14-b739-413a-abb5-efb527077bf8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1576 microversion: 2.1 time: 0.612513 Aug 30 16:08:27.613545 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 710/1285] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:26 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1576 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:27.635300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:27.642165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:27.651118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.652342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.653196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.654869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.656751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.657569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.789338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:27.803683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e20afd0-8cbe-4b03-991d-9c20b3693d6c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.361403 Aug 30 16:08:27.806125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 576/1286] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:27 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:27.818551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:27.821325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:27.833925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:27.840331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.842503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.843209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.846159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.848771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.849329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.900329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32be0a2e-00a3-4beb-809b-9a50a6f88868 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270136 Aug 30 16:08:27.900960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 711/1287] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:08:27 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:27.920000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:27.940405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:27.961511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:27.963638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:27.989316 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] Creating event network-changed:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:08:27.995623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d2beb638-e8a2-45aa-83fb-efe1032a6a7e req-505e8ec3-3b9a-480d-ae52-3859fd1a2fa3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081911 Aug 30 16:08:27.997134 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 712/1288] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:28.123765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:28.129335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:28.130471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:28.146142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:28.146987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:28.152319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:28.153095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:28.153583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:28.154027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:28.328295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:28.351359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f35a6280-9b4b-4b54-a4a5-4f57240c3ae2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.543969 Aug 30 16:08:28.366479 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 577/1289] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:27 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:28.465705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:28.466548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:28.479922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:28.480650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:28.481264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:28.482727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:28.484257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:28.485652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:28.491268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:28.501950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eeb58179-de73-4c36-b4a8-2fc47c496e79 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1304 microversion: 2.1 time: 0.379221 Aug 30 16:08:28.518731 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 713/1290] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:28 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1304 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:28.935813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:28.944961 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b1a1beb-2e35-438c-b0ef-2b5b51e235fc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.483038 Aug 30 16:08:28.945550 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 578/1291] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:28 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:28.966244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:28.974596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:28.990532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:28.991039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:28.998596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.000728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.001507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.002130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.231067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0f392ae-eb4c-4cf5-ad8c-adb9dde00a50 tempest-ListImageFiltersNegativeTestJSON-1640980955 tempest-ListImageFiltersNegativeTestJSON-1640980955-project] Calling method '.version_select at 0x7fd360fb6af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:29.259623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d0f392ae-eb4c-4cf5-ad8c-adb9dde00a50 tempest-ListImageFiltersNegativeTestJSON-1640980955 tempest-ListImageFiltersNegativeTestJSON-1640980955-project] HTTP exception thrown: Image not found. Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0f392ae-eb4c-4cf5-ad8c-adb9dde00a50 tempest-ListImageFiltersNegativeTestJSON-1640980955 tempest-ListImageFiltersNegativeTestJSON-1640980955-project] Request method failure captured: Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/images/6503ff57-8c74-468e-a482-8f3ca02a2ae2 HTTP/1.1 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjX8JPJOfn-cK3eZCeMhQOKyn5LtD6VpnU8zBQSYHNmzLQqlmq_bBvWvHvI_sPza37ZvyQSaVmYWdpoTztNqV5-3VkapWiov3kNYWPvHOkllf4BG69-x0lbuohFZkFWvgTAIwO_rzMjixGRo6FuUV8FVU9iP_NToG34me9g6TgB9prM Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8d8e0ce93fef4c358a597afe394f3430 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1640980955 Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:29.261972 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8d8e0ce93fef4c358a597afe394f3430"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8d8e0ce93fef4c358a597afe394f3430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8d8e0ce93fef4c358a597afe394f3430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8d8e0ce93fef4c358a597afe394f3430"}]}] Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1640980955 Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8d8e0ce93fef4c358a597afe394f3430 Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1640980955 Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListImageFiltersNegativeTestJSON-1640980955-project Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 84f8f32a8c9646158df461779d82e066 Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1640980955-project Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '6503ff57-8c74-468e-a482-8f3ca02a2ae2'} Aug 30 16:08:29.263621 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:08:29.264681 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6503ff57-8c74-468e-a482-8f3ca02a2ae2 Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:08:29.266890 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6503ff57-8c74-468e-a482-8f3ca02a2ae2 could not be found. Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:29.268385 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:29.269945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0f392ae-eb4c-4cf5-ad8c-adb9dde00a50 tempest-ListImageFiltersNegativeTestJSON-1640980955 tempest-ListImageFiltersNegativeTestJSON-1640980955-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:29.271488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0f392ae-eb4c-4cf5-ad8c-adb9dde00a50 tempest-ListImageFiltersNegativeTestJSON-1640980955 tempest-ListImageFiltersNegativeTestJSON-1640980955-project] 10.222.0.47 "GET /compute/v2.1/images/6503ff57-8c74-468e-a482-8f3ca02a2ae2" status: 404 len: 62 microversion: 2.1 time: 0.611801 Aug 30 16:08:29.276714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 714/1292] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:28 2022] GET /compute/v2.1/images/6503ff57-8c74-468e-a482-8f3ca02a2ae2 => generated 62 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 16:08:29.298746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5043ba-34cd-4166-84f5-33644a25e8c2", "name": "network-vif-plugged", "status": "completed", "tag": "565eff1b-6746-4e0a-9306-ec413c0c6070"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:29.328406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.328406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.330124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.356042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] Creating event network-vif-plugged:565eff1b-6746-4e0a-9306-ec413c0c6070 for instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 on n-h1-830883-28 Aug 30 16:08:29.368018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f65df4dd-0cd7-4776-9c32-8d0d8abb855f req-9a0049b0-327c-4f8d-ace5-caf36fedef20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087813 Aug 30 16:08:29.368652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 715/1293] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:29.383021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:29.383736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:29.397177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.400546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.400890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.401712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.404597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.408524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.525072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:29.536789 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2074232b-499b-4b7d-8e98-91038ac2509a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.590201 Aug 30 16:08:29.551705 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 579/1294] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:28 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:29.551705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:29.551705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:29.565182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.565695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.566212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.567207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.567739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.568171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.841171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:29.844958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:29.850111 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9208ee01-1c8a-4ffa-9dc7-7f97e86ac0f5 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1304 microversion: 2.1 time: 0.309957 Aug 30 16:08:29.853415 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b0223f7-da9a-4048-a117-63b14fef252e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.480594 Aug 30 16:08:29.853988 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 716/1295] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:29 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:29.864677 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 580/1296] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:29 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:29.975700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:29.976325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:29.983180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.984607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.985292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:29.986283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:29.986963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:29.987558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.195355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:30.205814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a98328ae-33d9-41d0-88e6-795fd72b0ba3 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.233889 Aug 30 16:08:30.207797 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 717/1297] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:29 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:30.561321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:30.561831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:30.570796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:30.571293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:30.572046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.572768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:30.573677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:30.574421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.842468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:30.843684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:30.853987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:30.854834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:30.855697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.856415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:30.858647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:30.859443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.895991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:30.931139 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b082ee7-a80d-4c1d-b168-c63ff471a365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.366667 Aug 30 16:08:30.931807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 581/1298] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:30 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:30.945854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1", "tag": "3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:30.969131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:30.971026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:30.973903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:30.996384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] Creating event network-changed:3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3 for instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 on n-h2-830883-28 Aug 30 16:08:31.008000 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a55d716d-9bbf-4b43-8abe-e2726c2cabc5 req-f1e4e6cd-3047-476f-95b6-05facf0d7ab6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073298 Aug 30 16:08:31.008863 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 582/1299] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:31.028048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:31.034838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:31.042882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.043874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.044521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.045424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.046071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.047296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.064639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:31.097789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:31.114666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:31.123852 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80381cc3-cb06-40ae-b4ea-55c7c0a7edfa tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1576 microversion: 2.1 time: 0.285179 Aug 30 16:08:31.141182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 718/1300] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:30 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:31.149560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:31.150204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:31.168928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.169540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.174125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.175174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.175676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.176477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.470638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:31.482491 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bbd665b7-e1bb-4217-8e22-00a80300c0c3 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.471015 Aug 30 16:08:31.486449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 583/1301] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:31 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:31.503088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:31.503713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:31.509690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.510423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.511046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.512568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.514909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.515755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.571354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:31.588333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6c822cc-1c9f-41aa-9131-a76822f3d61d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.450348 Aug 30 16:08:31.589269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 719/1302] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:31 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:31.607812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb30e7-3b3d-4125-8b72-7fac1b4df260", "name": "network-vif-plugged", "status": "completed", "tag": "c9d6904a-9312-4349-9029-6576aa8a5d37"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:31.641694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.644099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.646203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.678489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] Creating event network-vif-plugged:c9d6904a-9312-4349-9029-6576aa8a5d37 for instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 on n-h2-830883-28 Aug 30 16:08:31.690580 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-44a60e5f-570a-449c-a544-d1001ca797e6 req-5f70b40b-3e3f-425b-a28b-f8e726c2ddaa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098401 Aug 30 16:08:31.695515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 720/1303] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:31.956372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:31.957042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:31.958266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:31.967731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d6ab620-2c22-43f6-9589-ab9924009f6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1314 microversion: 2.1 time: 0.479893 Aug 30 16:08:31.968588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 584/1304] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:31 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:31.976103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.976916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.980406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:31.984219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:31.985003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:31.988735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:32.132308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=50 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:32.311047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:32.327120 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32983a43-db3a-422d-a634-574386c1e1d4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.375843 Aug 30 16:08:32.332943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 721/1305] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:31 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:32.506672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:32.507594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:32.517327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:32.518156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:32.519659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:32.520632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:32.521583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:32.522179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:32.622448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:32.623424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:32.633435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:32.636132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:32.637180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:32.638180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:32.640639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:32.643103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:32.892212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:32.919018 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebde5257-6c3f-438a-b840-10140f507019 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.415910 Aug 30 16:08:32.922713 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 585/1306] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:32 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:32.990897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:32.991872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:32.998341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.006224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.006926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.007839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.008483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.009082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.050411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:33.081376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:33.091674 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a07ca667-0a08-4707-9275-744fb0e4fb76 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.477931 Aug 30 16:08:33.092858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 722/1307] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:32 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:33.350121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:33.350772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:33.357223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.357730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.358444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.360721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.361182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.361787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.446862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:33.461053 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb3c9209-b07f-4646-9b1e-a109451f79dc tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1464 microversion: 2.1 time: 0.474801 Aug 30 16:08:33.461724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 586/1308] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:32 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1464 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:33.539833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:33.550568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-936cdeba-6754-43d2-a11a-8a6e03851948 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1305 microversion: 2.1 time: 0.204545 Aug 30 16:08:33.564002 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 723/1309] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:33 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1305 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:33.901655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Calling method '.version_select at 0x7fd35cdc3ca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:33.938966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.943798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.944592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:33.945124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.945592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:33.964314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.965054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.968974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.977445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.981292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.983040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:33.989570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:33.990566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:33.991198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.036194 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8bd15268-a7ec-49c3-b4c3-ba0d4c6213ed tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/06e6ee40de9a4761a24bdc98e8719524?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007" status: 200 len: 695 microversion: 2.1 time: 0.552569 Aug 30 16:08:34.037298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 587/1310] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Aug 30 16:08:33 2022] GET /compute/v2.1/os-simple-tenant-usage/06e6ee40de9a4761a24bdc98e8719524?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007 => generated 695 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:34.055597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '.version_select at 0x7fd35cdc6940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.073263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.076349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.079709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.097518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.098602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.099523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.131557 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f294c7c9-fb31-4a56-9cf3-5d40e00d1bb7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/06e6ee40de9a4761a24bdc98e8719524?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007" status: 200 len: 695 microversion: 2.1 time: 0.080208 Aug 30 16:08:34.135429 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 588/1311] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/os-simple-tenant-usage/06e6ee40de9a4761a24bdc98e8719524?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:34.148057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.152871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:34.162369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.163703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.165407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.166617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.167408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.168082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.321734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:34.335688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ae13a87-e0ab-4030-9760-d77614cd5176 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.395026 Aug 30 16:08:34.349991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 724/1312] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:33 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:34.354487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Calling method '.version_select at 0x7fd35cc13670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.370012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.371520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.371520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.391923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.392638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.393267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.443095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:34.454202 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3bfb4724-9c68-4634-bdc5-9843399e9f8c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.317237 Aug 30 16:08:34.457873 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 589/1313] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:34.489709 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6c6429f-326f-45a3-ae28-73e7b8bc4886 tempest-TenantUsagesTestJSON-1074781154 tempest-TenantUsagesTestJSON-1074781154-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007&detailed=1" status: 200 len: 13602 microversion: 2.1 time: 0.152092 Aug 30 16:08:34.490347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 725/1314] 10.222.0.47 () {58 vars in 1335 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T16%3A08%3A33.480007&end=2022-08-31T16%3A08%3A33.480007&detailed=1 => generated 13602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:08:34.522532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.523102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:34.536075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.537610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.538346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.541557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.542900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.543507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.553151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.553780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:34.566638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.567400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.569969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.570956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.571378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.571815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.605039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:08:34.789579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b1470bc-8cac-4e3e-91f9-3935c7700499 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 204 len: 0 microversion: 2.1 time: 0.271815 Aug 30 16:08:34.790470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 590/1315] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:08:34 2022] DELETE /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:08:34.807063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.808011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:34.815191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.815681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.816116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.816837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.822188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.822592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.004362 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fee508df-7a4f-4b88-a891-bea97fa28e05 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1813 microversion: 2.1 time: 0.455664 Aug 30 16:08:35.004954 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 726/1316] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1813 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:35.012480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:35.013094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:35.020568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.025105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.025787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.032908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.035682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.037966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.134441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:35.147408 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96373b8f-cac2-41cc-959a-d636474850ca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1485 microversion: 2.1 time: 0.355614 Aug 30 16:08:35.149318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 591/1317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1485 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:35.156377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:35.160759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.161525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.162340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.163823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.164518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.165162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.194820 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f74d73a-22d7-4716-90aa-d2a4a2b51003 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044191 Aug 30 16:08:35.195830 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 592/1318] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:08:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:35.201202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:35.202058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:35.212209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.213131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.214038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.215543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.216077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.216605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.254539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lazy-loading 'flavor' on Instance uuid dadb30e7-3b3d-4125-8b72-7fac1b4df260 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:08:35.264713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:35.283251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5393713-b868-4fe7-9d68-9bc178ae56f7 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1470 microversion: 2.1 time: 0.274686 Aug 30 16:08:35.284518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 727/1319] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:35 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1470 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:35.356669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:35.357999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:35.369820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.370634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.371222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.372130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.372742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.376577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.419890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:35.516925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc6d32b3-01f8-4112-a5c0-3bb9f597abf4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260/action" status: 202 len: 0 microversion: 2.1 time: 0.314540 Aug 30 16:08:35.518648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 593/1320] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:35 2022] POST /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:35.532171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:35.535155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:35.552460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.558084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.560834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.565658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.566232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.566696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.034033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:36.047858 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cab92a8d-8c5f-49db-8881-06f46d92ddbc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.526931 Aug 30 16:08:36.054361 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 594/1321] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:35 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:36.055832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:36.056454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:36.069681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:36.070467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:36.071379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.074693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:36.075266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:36.075705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.093643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:36.104469 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c94761df-26c2-48b0-bfe7-8c9b498b027e tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.751409 Aug 30 16:08:36.107759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 728/1322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:35 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:36.122164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-plugged", "status": "completed", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:36.141772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:36.142647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:36.143299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.174387 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] Creating event network-vif-plugged:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:08:36.187946 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-09d6923b-200d-4470-9763-bc4f90e7c4a3 req-17a16407-c9e4-4886-9562-8680cd17f898 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074674 Aug 30 16:08:36.188994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 729/1323] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:36.308425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:36.309941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:36.324092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:36.325819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:36.326521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.328208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:36.332172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:36.332855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:36.864362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:36.879940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:36.892773 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6589435d-3554-46c8-ad72-f7e695962bb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1493 microversion: 2.1 time: 0.842731 Aug 30 16:08:36.893165 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 595/1324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:36 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1493 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:36.894098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa9df4f2-3a39-4194-86bf-511ef5e13bf5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1470 microversion: 2.1 time: 0.592372 Aug 30 16:08:36.896453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 730/1325] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:36 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:37.070647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:37.071601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:37.080848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.081188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.081636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.086243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.086806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.087257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.129096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:37.129740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:37.138779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.142786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.143494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.144397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.145025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.149167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.506447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:37.515162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-214b5bc0-6bf5-48a7-8e2b-4dcc443c0fab tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1379 microversion: 2.1 time: 0.448477 Aug 30 16:08:37.519121 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 596/1326] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:37 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1379 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:37.773005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:37.785382 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c57dc96f-ef46-490d-8cca-633a9c244535 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.659390 Aug 30 16:08:37.786408 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 731/1327] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:37 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:37.944660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:37.945216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:37.946285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:37.947149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:37.969375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.971974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.973145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.975177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.976040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.976695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.979277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.980405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.981618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.983042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.984482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.987210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.436287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:38.456827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eeb7c10d-1c9b-4bd5-993f-0a9da019ac6f tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1470 microversion: 2.1 time: 0.525780 Aug 30 16:08:38.460044 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 597/1328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:37 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1470 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:38.555036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:38.561531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:38.563832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:38.566796 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c417b5a-1a64-4684-b685-9de27f597fbe tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1493 microversion: 2.1 time: 0.635694 Aug 30 16:08:38.567709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 732/1329] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:37 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1493 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:38.596328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.600590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.601473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.602696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.607026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.610202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.714205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5043ba-34cd-4166-84f5-33644a25e8c2", "name": "network-vif-deleted", "tag": "565eff1b-6746-4e0a-9306-ec413c0c6070"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:38.744009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.747034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.747774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.772649 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] Creating event network-vif-deleted:565eff1b-6746-4e0a-9306-ec413c0c6070 for instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 on n-h1-830883-28 Aug 30 16:08:38.784389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3a5f2d60-b7ce-4185-8848-43dd52721491 req-40bfbcd1-8579-4ad4-bb15-70e36733ba38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073865 Aug 30 16:08:38.785005 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 733/1330] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:38.811189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:38.813588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:38.824556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.828368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.829059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.832538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.834680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.837658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.923896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:38.934295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93a01036-7c6c-4ed0-9175-4b70cc89376a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1529 microversion: 2.1 time: 0.394912 Aug 30 16:08:38.938707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 598/1331] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:38 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1529 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:38.944222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b58fc13c-cd23-41dc-8b4d-b65c3759a9a0", "device": "/dev/xvdb"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:38.949928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:38.957802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.958985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.959668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.960779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.961466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.962113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.487668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c68a394-35f4-4174-b403-c842345f7d51 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547369 Aug 30 16:08:39.493264 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 599/1332] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:08:38 2022] POST /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:39.524945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:39.525658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:39.552224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.552987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.553666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.556469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.558119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.558935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.627748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:39.677177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:39.686102 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a16a68dc-1e59-4e0d-b25a-cc44ed59e671 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.879309 Aug 30 16:08:39.687519 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 734/1333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:38 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:39.714812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:39.715452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:39.732390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.732899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.734218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.735356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.736184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.736918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.821675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.825298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.825761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.826603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lazy-loading 'fault' on Instance uuid 7f5043ba-34cd-4166-84f5-33644a25e8c2 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:08:39.887302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:39.900757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31b27930-39f2-4d0f-9121-1fc5a5396be9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1529 microversion: 2.1 time: 0.408083 Aug 30 16:08:39.901707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 600/1334] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:39 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1529 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:39.907281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:39.908083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:39.914531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.915018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.915453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.916147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.916602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.917026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.969158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee9f90f703964681a96c3985e88365fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e6ee40de9a4761a24bdc98e8719524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:39.977467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dcbdf448-17bf-45d3-9bf8-af7f744473f5 tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 200 len: 1304 microversion: 2.1 time: 0.276757 Aug 30 16:08:39.983259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 735/1335] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:39 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 1304 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:39.994022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b29d7875-f9d2-4624-a8c5-dd35e8f9ebdd tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.017747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:40.028754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b29d7875-f9d2-4624-a8c5-dd35e8f9ebdd tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/55399ee3-6a92-473c-af3c-780bbf102264" status: 202 len: 0 microversion: 2.1 time: 0.041603 Aug 30 16:08:40.032466 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 736/1336] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:08:39 2022] DELETE /compute/v2.1/flavors/55399ee3-6a92-473c-af3c-780bbf102264 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:40.048740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd722a55-68e2-4378-a405-fcaabac2303a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.083347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:40.091768 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a76f5606-5020-495c-ba15-f5656b51e6b9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 200 len: 1476 microversion: 2.1 time: 0.188936 Aug 30 16:08:40.092362 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 601/1337] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:39 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:40.094234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd722a55-68e2-4378-a405-fcaabac2303a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054693 Aug 30 16:08:40.096524 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 737/1338] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:08:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:40.116930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-267295600"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:40.117166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:40.119984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:40.121856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:40.130374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.131281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.131970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.132351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.132853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.133298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.133632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.134002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.134591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.135334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.136941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.137397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.361893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:40.374134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Old instance type tempest-test_resize_flavor_-1346717033, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:08:40.386210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:40.386898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:40.387947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:40.388516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:40.389139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:40.533227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfa26cdc-da6c-4e03-83c5-fb03c873da2e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260/action" status: 202 len: 0 microversion: 2.1 time: 0.419682 Aug 30 16:08:40.535313 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 738/1339] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:40 2022] POST /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:08:40.550093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af436f83-78dd-4e60-90e4-b76b6e77209c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cda88b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.622212 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af436f83-78dd-4e60-90e4-b76b6e77209c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.080244 Aug 30 16:08:40.623447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 739/1340] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:40 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:40.710410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.711927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:40.718474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a287102c-613a-4cde-b3bb-113a63ccbb92 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794/action" status: 202 len: 0 microversion: 2.1 time: 0.590998 Aug 30 16:08:40.723484 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 602/1341] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:40 2022] POST /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:40.730098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.731390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.735270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.736597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.737434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.738536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.739205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:40.739830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.757407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.757908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.759478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.762531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.763226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.765550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:41.295417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:41.306657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4365877e-fb46-4781-9a62-bd157aab7963 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.600011 Aug 30 16:08:41.310289 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 740/1342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:40 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:41.340499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:41.340946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:41.340946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] [instance: 7f5043ba-34cd-4166-84f5-33644a25e8c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:41.346678 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5787595c-48d9-4792-827a-84990c1cb57e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1538 microversion: 2.1 time: 0.621756 Aug 30 16:08:41.350539 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 603/1343] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:40 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1538 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:41.350715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:41.351277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:41.351848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:41.352668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:41.353236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:41.353778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:41.393947 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] HTTP exception thrown: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Request method failure captured: Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 HTTP/1.1 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjXowC52QRyg9rZ0MN_pqR3pdn_d6MvtLOPCuRgSRWI5fIbgF16qzj1aHeeUhzVm-yxfxN09ZeWtX3-NltBMX0j2JSAw-FBbKn9xdTaFGUmtKMGjhHzUaroLoJnqrNoRJci_W6YzvCub47RBOM8FG5CTsdHA7lkPXMZhQxcXTpgQbnE Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 06e6ee40de9a4761a24bdc98e8719524 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TenantUsagesTestJSON-202766733 Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:41.398711 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/06e6ee40de9a4761a24bdc98e8719524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_06e6ee40de9a4761a24bdc98e8719524"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/06e6ee40de9a4761a24bdc98e8719524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/06e6ee40de9a4761a24bdc98e8719524"}]}] Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TenantUsagesTestJSON-202766733 Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 06e6ee40de9a4761a24bdc98e8719524 Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TenantUsagesTestJSON-202766733 Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TenantUsagesTestJSON-202766733-project Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ee9f90f703964681a96c3985e88365fa Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TenantUsagesTestJSON-202766733-project Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. Aug 30 16:08:41.400589 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7f5043ba-34cd-4166-84f5-33644a25e8c2'} Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:41.401550 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. Aug 30 16:08:41.403131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:41.405763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] Returning 404 to user: Instance 7f5043ba-34cd-4166-84f5-33644a25e8c2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:41.408157 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17d0d91d-2dc9-485d-a0f8-1b22727850af tempest-TenantUsagesTestJSON-202766733 tempest-TenantUsagesTestJSON-202766733-project] 10.222.0.47 "GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2" status: 404 len: 111 microversion: 2.1 time: 0.096659 Aug 30 16:08:41.409993 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 741/1344] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:41 2022] GET /compute/v2.1/servers/7f5043ba-34cd-4166-84f5-33644a25e8c2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:41.640285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4c2159ce-7d86-47eb-a5ed-196c2d2e7ebd tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ccc8790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:41.727404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4c2159ce-7d86-47eb-a5ed-196c2d2e7ebd tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.091985 Aug 30 16:08:41.742692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 604/1345] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:41 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:42.331382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:42.332009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:42.345612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.346120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.346628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.347333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.347800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.348225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.372360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:42.372991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:42.398933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.399765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.401878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.403739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.408275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.410760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:43.102750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:43.137828 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd4fd5f9-a738-4bf1-bdea-7dcd2fc620da tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.790805 Aug 30 16:08:43.139043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 742/1346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:42 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:43.162581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cefbfe59-0b95-4969-8970-714b085df641 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f8bc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:43.283780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cefbfe59-0b95-4969-8970-714b085df641 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.129171 Aug 30 16:08:43.293413 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 743/1347] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:43 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:43.379540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:43.397417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ab9df67-d85b-42a6-a7cb-7f463c48cfd1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1538 microversion: 2.1 time: 1.030097 Aug 30 16:08:43.398006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 605/1348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:42 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1538 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:44.161838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.162590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:44.174788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Calling method '.version_select at 0x7fd360f6a1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.195136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.204318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.210347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.212484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.233454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.234055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.246029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:08:44.246689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Neutron security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:08:44.247215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] HTTP exception thrown: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.247215 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Request method failure captured: Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-groups/bfc13ef7-090f-43ac-9c34-ed08b927ee5a HTTP/1.1 Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYLMVzwyB5RpQRGupJMODxNTqxtw4g3nxX-HvNj7vSXENZcObx8hjBNc6HU4Sfw2SZjBwG56tqj0rZKBjljNNcz6-ea1QFNgEiqiRxpt4gUrt7SFsrWm5ElBnL3U1OfGZNxFkWQ1Fm5_0WUfp10D57lkLcVoEwJlWRGl5gTq72PMQI Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:44.249863 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}] Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9d169d4331d6442cba8279cad7528096 Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.251509 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bfc13ef7-090f-43ac-9c34-ed08b927ee5a'} Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:44.252456 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:08:44.253668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.255218 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Returning 404 to user: Security group bfc13ef7-090f-43ac-9c34-ed08b927ee5a does not exist Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-cd9c4225-4201-4854-a2fd-89b8c9c72ff6'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:44.256873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a934cc1e-b898-4c1c-a661-83edc244b807 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/bfc13ef7-090f-43ac-9c34-ed08b927ee5a" status: 404 len: 194 microversion: 2.1 time: 0.341450 Aug 30 16:08:44.257977 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 744/1349] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:08:43 2022] DELETE /compute/v2.1/os-security-groups/bfc13ef7-090f-43ac-9c34-ed08b927ee5a => generated 194 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:44.273226 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e7741f5-b69d-4968-91b1-0fc74d25c455 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010493 Aug 30 16:08:44.273808 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 745/1350] 10.222.0.47 () {58 vars in 1164 bytes} [Tue Aug 30 16:08:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:08:44.298659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b2f3823-da57-4d40-b1e5-12dde1c9ec1c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Calling method '.version_select at 0x7fd360f6adc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.391292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:44.723739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:44.741299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-afa4ef3e-2bef-4c65-bcf0-55903bdc0915 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.583829 Aug 30 16:08:44.743284 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 606/1351] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:44 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:44.760163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ea357a0-f956-4f24-a963-e16e2cf4c6fa tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cbce280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.844846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ea357a0-f956-4f24-a963-e16e2cf4c6fa tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.099173 Aug 30 16:08:44.845480 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 607/1352] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:44 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:44.860047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.863730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:44.888210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.888724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.889163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.890042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.890569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.891004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.171998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:45.268904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b2f3823-da57-4d40-b1e5-12dde1c9ec1c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.988691 Aug 30 16:08:45.269863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 746/1353] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:08:44 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:45.274751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcacc7f-8ceb-4ff8-bdb4-0022ef760940", "name": "network-vif-plugged", "status": "completed", "tag": "5e56f21b-5b46-4550-ac58-c692ce7dbc24"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:45.306054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.306578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.307018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.324612 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] Creating event network-vif-plugged:5e56f21b-5b46-4550-ac58-c692ce7dbc24 for instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 on n-h2-830883-28 Aug 30 16:08:45.340054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-150c4c8b-d18c-4ee8-9bda-07b7861aa883 req-74a57e6d-2c1d-4e72-b1c7-2477b0425dc2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068722 Aug 30 16:08:45.340696 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 747/1354] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:45.360952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Calling method '.version_select at 0x7fd36104adc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:45.805840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:08:45.807578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 30 16:08:45.807578 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Request method failure captured: Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-security-groups/0cbf5384-f353-4be5-bb60-764a1d8a38a4 HTTP/1.1 Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYLMVzwyB5RpQRGupJMODxNTqxtw4g3nxX-HvNj7vSXENZcObx8hjBNc6HU4Sfw2SZjBwG56tqj0rZKBjljNNcz6-ea1QFNgEiqiRxpt4gUrt7SFsrWm5ElBnL3U1OfGZNxFkWQ1Fm5_0WUfp10D57lkLcVoEwJlWRGl5gTq72PMQI Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:45.809508 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}] Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9d169d4331d6442cba8279cad7528096 Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: exception: Insufficient rights for removing default security group. Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.811735 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '0cbf5384-f353-4be5-bb60-764a1d8a38a4'} Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:45.813246 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 30 16:08:45.820277 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:45.821838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-7a06dc9d-63a8-4068-be34-cc16c2745165'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1cc807a6-6253-414e-96be-7af12f9f6772 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/0cbf5384-f353-4be5-bb60-764a1d8a38a4" status: 400 len: 182 microversion: 2.1 time: 0.469028 Aug 30 16:08:45.826785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 748/1355] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:08:45 2022] DELETE /compute/v2.1/os-security-groups/0cbf5384-f353-4be5-bb60-764a1d8a38a4 => generated 182 bytes in 471 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:08:45.828886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:45.828886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:45.847005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.847456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.847912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.848636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.849183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.849616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:46.378847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:46.389173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e401a18-75cb-487d-95f1-68a95ccabb7c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1538 microversion: 2.1 time: 1.539492 Aug 30 16:08:46.403177 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 608/1356] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:44 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1538 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:46.422944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Calling method '.version_select at 0x7fd35d544310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:46.545617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG neutronclient.v2_0.client [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist", "detail": ""}} {{(pid=122351) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:08:46.546288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Neutron security group c19f173a-1b01-4599-844f-b74bb89f1eb4 not found {{(pid=122351) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:08:46.546871 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] HTTP exception thrown: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.546871 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Request method failure captured: Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-security-groups/c19f173a-1b01-4599-844f-b74bb89f1eb4 HTTP/1.1 Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjYLMVzwyB5RpQRGupJMODxNTqxtw4g3nxX-HvNj7vSXENZcObx8hjBNc6HU4Sfw2SZjBwG56tqj0rZKBjljNNcz6-ea1QFNgEiqiRxpt4gUrt7SFsrWm5ElBnL3U1OfGZNxFkWQ1Fm5_0WUfp10D57lkLcVoEwJlWRGl5gTq72PMQI Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:08:46.548827 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}] Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9d169d4331d6442cba8279cad7528096 Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: exception: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.550234 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'c19f173a-1b01-4599-844f-b74bb89f1eb4'} Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.551123 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:08:46.552326 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.554106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Returning 404 to user: Security group c19f173a-1b01-4599-844f-b74bb89f1eb4 does not exist Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: Neutron server returns request_ids: ['req-e29bb80e-7c54-4bd8-9c1b-d1c2d453a725'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71d29669-d1e8-4480-a14d-d495ee98e583 tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups/c19f173a-1b01-4599-844f-b74bb89f1eb4" status: 404 len: 194 microversion: 2.1 time: 0.145900 Aug 30 16:08:46.555609 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 609/1357] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:08:46 2022] GET /compute/v2.1/os-security-groups/c19f173a-1b01-4599-844f-b74bb89f1eb4 => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:46.581367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdd60f76-9dcf-4db4-9dd2-06276500f30b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb60820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:46.663276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:46.683088 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-44efd575-ad8f-4898-9581-7fb1ab290f24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.869530 Aug 30 16:08:46.685184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdd60f76-9dcf-4db4-9dd2-06276500f30b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.117138 Aug 30 16:08:46.696648 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 749/1358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:45 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:46.700630 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 610/1359] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:46 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:46.712678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Action: 'update', calling method: .version_select at 0x7fd360fe6700>, body: {"security_group": {"name": "tempest-sg-512545164", "description": "tempest-description-2144317912"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:46.759441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:08:46.761085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.security_group_api [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Neutron security group dbda1c30-9273-4211-b84e-706eb564ce2c not found {{(pid=122352) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 16:08:46.762771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] HTTP exception thrown: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.762771 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Request method failure captured: Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-security-groups/dbda1c30-9273-4211-b84e-706eb564ce2c HTTP/1.1 Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 101 Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYLMVzwyB5RpQRGupJMODxNTqxtw4g3nxX-HvNj7vSXENZcObx8hjBNc6HU4Sfw2SZjBwG56tqj0rZKBjljNNcz6-ea1QFNgEiqiRxpt4gUrt7SFsrWm5ElBnL3U1OfGZNxFkWQ1Fm5_0WUfp10D57lkLcVoEwJlWRGl5gTq72PMQI Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:08:46.766094 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7e7f8dafc5b44ba3ac9adc2cc1e5d32c"}]}] Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7e7f8dafc5b44ba3ac9adc2cc1e5d32c Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062 Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9d169d4331d6442cba8279cad7528096 Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1284329062-project Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: {"security_group": {"name": "tempest-sg-512545164", "description": "tempest-description-2144317912"}} Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:08:46.767787 n-d-830883-28 devstack@n-api.service[122352]: exception: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'dbda1c30-9273-4211-b84e-706eb564ce2c', 'body': {'security_group': {'name': 'tempest-sg-512545164', 'description': 'tempest-description-2144317912'}}} Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:08:46.769110 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 16:08:46.770490 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.772701 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] Aug 30 16:08:46.774189 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:08:46.776608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] Returning 404 to user: Security group dbda1c30-9273-4211-b84e-706eb564ce2c does not exist Aug 30 16:08:46.776608 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-8e01f5d5-6302-48db-a68c-21a1c6cb6d0f'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:08:46.777516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f7b0322-d541-437d-b7a4-2f686586a31c tempest-SecurityGroupsNegativeTestJSON-1284329062 tempest-SecurityGroupsNegativeTestJSON-1284329062-project] 10.222.0.47 "PUT /compute/v2.1/os-security-groups/dbda1c30-9273-4211-b84e-706eb564ce2c" status: 404 len: 194 microversion: 2.1 time: 0.077294 Aug 30 16:08:46.778157 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 750/1360] 10.222.0.47 () {60 vars in 1290 bytes} [Tue Aug 30 16:08:46 2022] PUT /compute/v2.1/os-security-groups/dbda1c30-9273-4211-b84e-706eb564ce2c => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:08:47.425474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:47.426099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:47.443986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.445435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.448633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.449482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.451612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.453084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.701279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5299bdca-1516-4485-b315-0f6c54e77cfd tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f82a60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:47.794739 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5299bdca-1516-4485-b315-0f6c54e77cfd tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.098705 Aug 30 16:08:47.798685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 751/1361] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:47 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:47.803546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:47.820226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:47.832599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.834825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.839335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.840842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.841085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.841585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:48.356901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:48.381275 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a417d3b7-15e2-4139-b5d4-0c4bf820a4fe tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1292 microversion: 2.1 time: 0.581350 Aug 30 16:08:48.381871 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 752/1362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:47 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1292 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:48.816016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbaefc0c-adf1-4ed6-af71-c7379cc9c420 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd36104a430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:48.899540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bbaefc0c-adf1-4ed6-af71-c7379cc9c420 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.090805 Aug 30 16:08:48.900438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 753/1363] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:48 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:49.026880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:49.044045 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-067f216c-ee89-4cbe-ab73-f3af978706f9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 1.631305 Aug 30 16:08:49.058328 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 611/1364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:47 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:49.403107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:49.403816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:49.415085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.415613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.416031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.416757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.417220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.417659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.914244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b474a5e4-f3b0-4d68-b633-5ccb39043543 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb7e160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:49.992523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b474a5e4-f3b0-4d68-b633-5ccb39043543 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.081973 Aug 30 16:08:49.993739 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 612/1365] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:49 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:50.071019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:50.073778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:50.089519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.090423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.091185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.092123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.095046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.095799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.232222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:50.249826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c357359-e41c-43ed-98a3-b24aad13e76c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1482 microversion: 2.1 time: 0.843131 Aug 30 16:08:50.259271 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 754/1366] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:49 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1482 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:50.319883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb30e7-3b3d-4125-8b72-7fac1b4df260", "name": "network-vif-plugged", "status": "completed", "tag": "c9d6904a-9312-4349-9029-6576aa8a5d37"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:50.365465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.378276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.379986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.403927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] Creating event network-vif-plugged:c9d6904a-9312-4349-9029-6576aa8a5d37 for instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 on n-h2-830883-28 Aug 30 16:08:50.411554 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-62cf81ac-f4da-4bff-a6b4-9c2fddd4f7f0 req-d0104428-8bcd-4cb1-8b15-7a112b856409 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149292 Aug 30 16:08:50.412371 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 755/1367] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:50.419447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:50.420257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:50.444860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.445586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.446217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.447128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.447751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.448601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.641995 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b40814b2-0bc1-475a-98df-8f6c9498bb8a tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.228138 Aug 30 16:08:50.642633 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 756/1368] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:08:50 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:51.007666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ea9e1a2-5efb-49e8-b35d-48869ecf347c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f8b3a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:51.171444 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ea9e1a2-5efb-49e8-b35d-48869ecf347c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.166822 Aug 30 16:08:51.173023 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 757/1369] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:51 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:52.022252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:52.049616 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebba697f-c7b0-4484-bca8-15ec41fe7489 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 1.981732 Aug 30 16:08:52.054588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 613/1370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:50 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:52.191001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f02dc1c2-9fe4-4b91-85f2-42bd3fe15784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f6aee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:52.280239 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f02dc1c2-9fe4-4b91-85f2-42bd3fe15784 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.097650 Aug 30 16:08:52.280940 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 758/1371] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:52 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:53.083640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:53.085122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:53.101736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:53.106415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:53.106886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:53.109036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:53.109682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:53.113627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:53.295238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2ace5e8-f78d-4618-9bf1-ac441f056bca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f82790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:53.392302 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2ace5e8-f78d-4618-9bf1-ac441f056bca tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.100505 Aug 30 16:08:53.393311 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 759/1372] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:53 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:53.654473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:53.666740 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c59bbee8-07fb-47aa-8d52-bf9928ccb2d3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 0.593121 Aug 30 16:08:53.667889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 614/1373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:53 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:54.384150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:54.390921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fcacc7f-8ceb-4ff8-bdb4-0022ef760940", "tag": "5e56f21b-5b46-4550-ac58-c692ce7dbc24"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:54.392662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:54.414040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.414581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.415032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.415757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.416225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.416658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.439768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.441757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.453233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.500482 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] Creating event network-changed:5e56f21b-5b46-4550-ac58-c692ce7dbc24 for instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 on n-h2-830883-28 Aug 30 16:08:54.528311 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-77de3ab3-6312-4264-a8ee-9ae023fd534f req-bdb6dd74-d05b-4462-bdc7-7ce68918be57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142378 Aug 30 16:08:54.530673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 615/1374] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:08:54.546574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b242a44f-463f-40cd-8bc3-b8b2d9b0f7a6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb913a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:55.215388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:55.247160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cd0dc71-0585-4f2f-b906-3147ff409eb2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1482 microversion: 2.1 time: 0.866786 Aug 30 16:08:55.248347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 760/1375] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:54 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1482 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:55.262051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:55.271559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:55.304025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:55.304710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:55.305654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:55.320972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:55.321923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:55.322577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:55.463188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:55.508127 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b242a44f-463f-40cd-8bc3-b8b2d9b0f7a6 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.974977 Aug 30 16:08:55.511060 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 616/1376] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:54 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:55.889925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:55.902811 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daeeaa9d-51e6-4036-8fc0-b84d23513618 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 0.649156 Aug 30 16:08:55.903601 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 761/1377] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:55 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:55.981359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-952261591", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "13ae43f5-f65e-41d3-a1c8-61637c2e23b1"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:56.085908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] validate_networks() for [('13ae43f5-f65e-41d3-a1c8-61637c2e23b1', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:56.525573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3565fc1a-b5c3-435c-bb29-7b873864e9c8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:56.682517 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3565fc1a-b5c3-435c-bb29-7b873864e9c8 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.154764 Aug 30 16:08:56.687386 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 762/1378] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:56 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:08:56.927321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:56.928019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:56.964095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:56.968104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:56.979767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:56.980678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:56.981184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:56.981717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:58.447364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:58.461699 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9eacb6de-8bca-4c0c-8d7e-cd0c20b5888c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 1.539124 Aug 30 16:08:58.477701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 763/1379] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:56 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:58.489175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-243fb423-3a79-4e2c-9539-85e042dce365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:58.577977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-243fb423-3a79-4e2c-9539-85e042dce365 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.098536 Aug 30 16:08:58.586009 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 764/1380] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:08:58 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:58.603250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:58.603882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:58.618368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:58.618937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:58.619388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:58.620119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:58.620582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:58.621011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:58.674385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:58.675562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:58.676903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:58.677622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:58.678291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:58.687685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:58.704113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:58.708427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:58.709108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:58.714465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:58.715202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:58.715804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:58.744580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:58.760143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for user 81b24fcdb0a749caa02a34817e8fe9f8 and project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:58.809599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:58.824716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:58.944709 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0b4a9a4-4e49-40df-819d-9aab65f9eed8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.123653 Aug 30 16:08:58.954900 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 617/1381] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3134 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 16:08:58.967811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:58.968433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:59.095446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:59.107867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:59.115384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:59.117279 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9eaf15a7-fc21-4d5e-98ae-6aea243f80cc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1261 microversion: 2.25 time: 0.154184 Aug 30 16:08:59.142799 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 618/1382] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:08:58 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:08:59.408204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98fe48cd-39b0-4a15-a79f-d2b94acca1c9 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1859 microversion: 2.1 time: 0.814192 Aug 30 16:08:59.408700 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 765/1383] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:58 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1859 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:59.433910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-830883-28", "block_migration": true, "disk_over_commit": false}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:59.443476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:59.485044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:59.486417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:59.493057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:59.503049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:59.507937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:59.510274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:59.510832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:59.511291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:59.516400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:59.516924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:59.517373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:59.519181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:59.520599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:59.521890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:59.572911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lazy-loading 'flavor' on Instance uuid 7107d12b-8cc0-427d-b719-6c87935dd178 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:08:59.597939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Going to try to live migrate instance to n-h1-830883-28 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:09:00.169058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:00.178662 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8c02a1a-0609-4bc9-9e92-3c68b52ebf30 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 0.699054 Aug 30 16:09:00.187670 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 766/1384] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:59 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:00.203355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d3a31d9-b638-4501-a566-964458a7621a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f53160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:00.392993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d3a31d9-b638-4501-a566-964458a7621a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.204145 Aug 30 16:09:00.402836 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 767/1385] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:00 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:00.410866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:00.411528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:00.434520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:00.437714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:00.438666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:00.439854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:00.441003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:00.441876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:00.721802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:00.735235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:00.739996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:00.750834 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-657770eb-024c-4a74-ad49-cbcadaf0349c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1265 microversion: 2.25 time: 0.346750 Aug 30 16:09:00.752555 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 768/1386] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:00 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:01.203221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:01.203839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:01.253961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:01.257063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:01.261323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:01.266339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:01.275336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:01.281095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:02.238197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc47b8af-879b-4a0f-90b1-310adf5def0d tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/action" status: 202 len: 0 microversion: 2.1 time: 2.808725 Aug 30 16:09:02.239698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 619/1387] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:59 2022] POST /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/action => generated 0 bytes in 2811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:09:02.250671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30831e04-3887-4819-a18d-adaa9bf8addc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cd80160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:02.364403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30831e04-3887-4819-a18d-adaa9bf8addc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.122401 Aug 30 16:09:02.377313 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 620/1388] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:02 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:02.398037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:02.399188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:02.418077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:02.424076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:02.424905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:02.425801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:02.427725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:02.435998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:02.625164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:02.643851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:02.653252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:02.657615 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3ae5ee5-d945-4995-b0be-01bd055da1ea tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1319 microversion: 2.25 time: 0.278245 Aug 30 16:09:02.659586 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 621/1389] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:02 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:02.674237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:02.677239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:02.692549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:02.693562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:02.694245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:02.695491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:02.696417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:02.697462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:02.795403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:02.806121 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75d2e0e9-562d-432c-ab3b-fd4833824e6d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 1.608306 Aug 30 16:09:02.823833 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 769/1390] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:01 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:03.142989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:03.154013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:03.161413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36f3fd61-5b4c-4c76-88e2-6a0383397fb8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.497741 Aug 30 16:09:03.164271 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 622/1391] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:02 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:03.393791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac58c39d-fdb7-4407-9011-3a3d16d6d3a5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:03.511359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac58c39d-fdb7-4407-9011-3a3d16d6d3a5 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.134639 Aug 30 16:09:03.520928 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 770/1392] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:03 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:03.688121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:03.688608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:03.705585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:03.706580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:03.707228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:03.708132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:03.710237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:03.710893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:03.834953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:03.836909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:03.852614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:03.853765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:03.854599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:03.855556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:03.856254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:03.856868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:03.954879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:03.973211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:03.975803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:03.977622 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4c32674-c880-4f97-98f1-4845c7072bce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1319 microversion: 2.25 time: 0.296374 Aug 30 16:09:03.978740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 623/1393] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:03 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:04.184578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:04.186039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:04.222697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:04.234920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:04.235503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:04.237017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:04.238336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:04.242026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:04.660453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:04.675425 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-353f44cf-6db0-489a-bffd-627adc4ecc69 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.495456 Aug 30 16:09:04.676070 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 624/1394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:04 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:04.689420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a96e59dc-6086-439e-bef4-48c635503b3c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb31dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:04.818993 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a96e59dc-6086-439e-bef4-48c635503b3c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.141697 Aug 30 16:09:04.820937 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 625/1395] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:04 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:05.015142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:05.016602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:05.028247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:05.035160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:05.035996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:05.036801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:05.037501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:05.038241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:05.073999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:05.087479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77517b9c-c9ce-41d1-b57d-7b9bcb0c30c0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1543 microversion: 2.1 time: 1.257324 Aug 30 16:09:05.088079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 771/1396] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:03 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1543 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:05.140612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:05.149455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:05.151449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:05.152618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-462cb781-027a-428c-9a54-3f443f0fb42a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1319 microversion: 2.25 time: 0.147302 Aug 30 16:09:05.153521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 626/1397] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:05 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:05.696953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:05.697595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:05.720258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:05.720775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:05.721229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:05.721956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:05.722456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:05.722916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:05.834582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d3a5a1d-8e68-44f4-b7fa-eb26ac569c00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb911f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:05.932506 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d3a5a1d-8e68-44f4-b7fa-eb26ac569c00 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.101697 Aug 30 16:09:05.933245 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 627/1398] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:05 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:06.111239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:06.111868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:06.133292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:06.133896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:06.134411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:06.138335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:06.139583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:06.140032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:06.781268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:06.802961 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc865aae-0250-4b2f-af58-03ccad63f7cb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1542 microversion: 2.1 time: 0.693652 Aug 30 16:09:06.807164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 628/1399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:06 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1542 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:06.816914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:06.819816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:06.837013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:06.838384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:06.843244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:06.847016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:06.849269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:06.849953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:07.152237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:07.163395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3994f1b6-086c-4df8-8915-9c42d8d14d59 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 1.470192 Aug 30 16:09:07.177807 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 772/1400] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:05 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:07.191688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3408eb19-da83-4daa-aee2-2b6329620746 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fd6f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:07.339746 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3408eb19-da83-4daa-aee2-2b6329620746 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.160375 Aug 30 16:09:07.340221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:07.340573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 773/1401] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:07 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:07.363557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:07.367814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:07.370597 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-145301b8-7f73-433c-a6cd-3576755f5ebf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.561888 Aug 30 16:09:07.374769 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 629/1402] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:06 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:07.831874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:07.832945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:07.847132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:07.853975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:07.854831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:07.855802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:07.857817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:07.858548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:07.942662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-unplugged", "status": "completed", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:07.971779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:07.973147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:07.973846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:08.004056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Creating event network-vif-unplugged:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:09:08.025149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] Instance fe06bce6-994a-4727-b936-ed96ccca1794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:09:08.047855 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1e0abdeb-9a4a-4c4c-af12-72052e15c6a1 req-d1fd3b7e-9f07-4665-9198-72a9407f5267 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109832 Aug 30 16:09:08.062223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 630/1403] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:08.203624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:08.204716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:08.220019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:08.220919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:08.221591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:08.226791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:08.227663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:08.228343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:08.731817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:08.910891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:08.920936 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bf63113-2858-46c5-bc2a-39b854436c9a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1474 microversion: 2.1 time: 1.093681 Aug 30 16:09:08.930399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 774/1404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:07 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1474 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:08.935916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01af107b-9678-4f0c-a27e-b6aac2c7736b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:09.004147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:09.022205 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69199ed4-0940-443d-b7df-95ab5cdb9c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.823489 Aug 30 16:09:09.026501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 631/1405] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:08 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:09.032347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:09.033314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:09.050132 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01af107b-9678-4f0c-a27e-b6aac2c7736b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.118459 Aug 30 16:09:09.054925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 775/1406] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:08 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:09.063207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:09.064092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:09.064790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:09.065759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:09.067548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:09.070347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:09.128427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:09.503044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:09.527936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:09.536934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:09.548260 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ef7e63d-eb4c-4f44-bd78-5bc24829bcee tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.517332 Aug 30 16:09:09.567333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 632/1407] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:09 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:09.965445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:09.966112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:09.982917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:09.984517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:09.995647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:09.996441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:09.996995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:09.997352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:10.051854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:10.056012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:10.080293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:10.080786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:10.081219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:10.089449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:10.090407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:10.090848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:10.397335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:10.412323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c08a0f7-7472-4acf-8927-e8741b265331 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.369934 Aug 30 16:09:10.415213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 633/1408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:10 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:10.424838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4330ecd7-434a-408b-8d32-1273ebe25b6e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ccc2790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:10.495525 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4330ecd7-434a-408b-8d32-1273ebe25b6e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.079021 Aug 30 16:09:10.506984 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 634/1409] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:10 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:10.574021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:10.574971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:10.586741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:10.590814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:10.595557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:10.596614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:10.598755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:10.599393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:10.948244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:10.964116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0769693a-bfff-4762-9987-8b29cc5cc55d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1471 microversion: 2.1 time: 1.008036 Aug 30 16:09:10.965383 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 776/1410] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:09 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1471 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:10.993655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:10.995157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:10.999226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=47 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:11.017184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.017949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.018628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.019647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.020116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.020554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.070874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.071806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.072425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.073590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.074232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.074855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.132881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:11.145351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:11.251106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:11.270086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:11.278434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:11.282441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14bae8f7-2948-450f-ad03-9c2de6fc845d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.712546 Aug 30 16:09:11.285765 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 635/1411] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:10 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:11.441629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:11.442670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:11.447017 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3ddfd4b-cbfb-49a6-b2ce-855f1b30aaa1 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794/action" status: 202 len: 0 microversion: 2.1 time: 0.456780 Aug 30 16:09:11.448457 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 777/1412] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:09:10 2022] POST /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:09:11.458179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:11.459200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:11.471167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.472573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.473704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.475025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.475776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.476326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.477101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.477577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.478010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:11.478337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:11.479272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:11.485769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:12.303581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:12.317396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0dd913f2-afb4-4e6b-9de0-3a95cccb25b6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1470 microversion: 2.1 time: 0.861000 Aug 30 16:09:12.319799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 778/1413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:11 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1470 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:12.338913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ea26dde4-deab-4824-9634-ab5e3aed0d4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f151f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:12.438279 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ea26dde4-deab-4824-9634-ab5e3aed0d4a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.117263 Aug 30 16:09:12.455622 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 779/1414] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:12 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:12.476249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d099e350-f039-4f9c-bc02-ca37ebe42d0d", "tag": "5c85db8f-e596-48fe-a929-7968141fd055"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:12.527225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:12.527853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:12.528375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:12.598213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] Creating event network-changed:5c85db8f-e596-48fe-a929-7968141fd055 for instance d099e350-f039-4f9c-bc02-ca37ebe42d0d on n-h2-830883-28 Aug 30 16:09:12.605977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:12.621040 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-55eee772-18bd-4cc9-9565-a0b0d1a6f290 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 1.184130 Aug 30 16:09:12.626790 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 636/1415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:11 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:12.628156 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4a9384db-f74b-45d9-888c-366a7794b38f req-018ec366-a94f-4efa-bee7-f867d9e91403 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159223 Aug 30 16:09:12.629118 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 780/1416] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:12.643361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:12.644063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:12.666728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:12.677890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:12.678753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:12.682208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:12.682948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:12.683395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:13.345491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:13.347054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:13.360881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:13.364006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:13.367123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:13.368819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:13.369532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:13.371702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:14.032314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:14.042339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:14.056483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:14.063106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dd118f5-2d29-4d29-b887-8623febfa679 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 1.434798 Aug 30 16:09:14.069311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 637/1417] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:12 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:14.085637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b08c1fd-f578-407d-90c9-c3173ae8858b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb41b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:14.223776 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b08c1fd-f578-407d-90c9-c3173ae8858b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.153177 Aug 30 16:09:14.229929 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 638/1418] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:14 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:14.240834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:14.241496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:14.268818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:14.269343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:14.269786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:14.281456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:14.282080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:14.282576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:14.607232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:14.615766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-252bad04-4c4e-4880-b0d2-55afd1986cc0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1470 microversion: 2.1 time: 1.276287 Aug 30 16:09:14.631022 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 781/1419] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:13 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1470 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:14.652949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:14.677007 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b07aa94-c0ea-4299-918d-4eb1cb8864f3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.445781 Aug 30 16:09:14.681220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 639/1420] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:14 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:15.090419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:15.092427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:15.104519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:15.105454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:15.110103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:15.111206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:15.112006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:15.112639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:15.176633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:15.244677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28c1dea3-be85-4473-98f1-1a0cad813a19 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cb850d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:15.384854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28c1dea3-be85-4473-98f1-1a0cad813a19 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.148136 Aug 30 16:09:15.388752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 640/1421] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:15 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:15.645684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:15.646762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:15.660610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:15.665621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:15.666546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:15.667547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:15.668829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:15.670507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:16.030815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:16.042922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61d920d6-084a-431f-9844-eb1557f01801 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1470 microversion: 2.1 time: 0.402075 Aug 30 16:09:16.046065 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 641/1422] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:15 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:16.058475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:16.061258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:16.078155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:16.079713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:16.082855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:16.084589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:16.085306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:16.085910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:16.142487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:16.161294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:16.185810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:16.201386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2b53bbc-015c-4b63-8412-b0f9bfe90912 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 1.110035 Aug 30 16:09:16.211185 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 782/1423] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:15 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:16.482994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0b386e71-56ad-40b0-82e5-430060ea3fb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fd6280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:16.556091 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0b386e71-56ad-40b0-82e5-430060ea3fb2 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.087410 Aug 30 16:09:16.566164 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 783/1424] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:16 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:16.735788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:16.754934 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30191ba2-67b0-4091-9d39-3220db6e49e8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.702788 Aug 30 16:09:16.788275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 642/1425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:16 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:17.071653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:17.076588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:17.106826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:17.112339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:17.113167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:17.120242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:17.122344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:17.125083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:17.231579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:17.232280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:17.254567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:17.255084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:17.255524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:17.256247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:17.256715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:17.257140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:18.104722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:18.119224 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7184245-59b7-43cd-b6e5-23a9f8721a26 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1470 microversion: 2.1 time: 1.052517 Aug 30 16:09:18.120552 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 784/1426] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:17 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1470 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:18.129322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c13620e-9658-4f0b-8755-d8d75fe40922 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f531f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:18.195668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:18.208980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:18.218402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:18.219593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8271c38a-1243-4b77-8c23-3943ca7b2b2e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.994443 Aug 30 16:09:18.225856 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 643/1427] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:17 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:18.260482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:18.262135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:18.279241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c13620e-9658-4f0b-8755-d8d75fe40922 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1437 microversion: 2.1 time: 0.156948 Aug 30 16:09:18.280223 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 785/1428] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:18 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:18.282770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:18.283267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:18.283717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:18.284404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:18.284858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:18.285276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:18.375454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-plugged", "status": "completed", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:18.399513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:18.415316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:18.421008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:18.462432 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Creating event network-vif-plugged:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:09:18.503599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] Instance fe06bce6-994a-4727-b936-ed96ccca1794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:09:18.557186 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4642e945-59cb-4f37-ba69-4262e44f3c9c req-6241cadc-91cd-4002-8534-ae95a4fdaf08 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181722 Aug 30 16:09:18.557979 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 786/1429] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 16:09:18.741403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:18.745411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:18.756589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13de502e-73a7-47f0-88d4-3da3d25a5b4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.527516 Aug 30 16:09:18.787940 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 644/1430] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:18 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:19.151184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:19.152672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:19.164222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:19.165008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:19.165786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:19.167394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:19.168065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:19.168667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:19.250541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:19.251774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:19.260101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:19.263468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:19.265471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:19.267948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:19.268601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:19.271210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:19.543489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:19.568752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5533ee28-e480-4f16-bb85-dc4e95873adf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1536 microversion: 2.1 time: 0.428980 Aug 30 16:09:19.569381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 787/1431] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:19 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1536 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:19.587130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-436d02d8-56b4-41a4-8b02-9b5cfb782390 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:19.658396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-436d02d8-56b4-41a4-8b02-9b5cfb782390 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1446 microversion: 2.1 time: 0.086681 Aug 30 16:09:19.659577 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 788/1432] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:19 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1446 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:19.843896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9bd99d52-4361-4b37-8e06-9ade39bb54c2 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Action: 'create', calling method: .version_select at 0x7fd360f531f0>, body: {"keypair": {"name": "tempest-keypair-1784607634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvumQNHfrqLIAI4M/lOyx5nl+ctfUt0ULARZ4Fn17gzs7DbARxADhg21dXsMcjwwSlzsFh3d8gGbsQhe8CRCJiQ/nxuML/L/5S6QVWqTmsBfCX38VmjcQ4QTiNxXMkGgg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:19.863387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9bd99d52-4361-4b37-8e06-9ade39bb54c2 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for project 09d46d8c36e449bbab8e141dd38b8188. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:19.870871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9bd99d52-4361-4b37-8e06-9ade39bb54c2 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for user e7e37cc1074c428ebc01957eb31b1e2c and project 09d46d8c36e449bbab8e141dd38b8188. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:19.918706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9bd99d52-4361-4b37-8e06-9ade39bb54c2 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257765 Aug 30 16:09:19.921508 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 789/1433] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:09:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:19.927108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c625edf-671d-4264-9192-89c43c6fe72f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360f08820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:20.009613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c625edf-671d-4264-9192-89c43c6fe72f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 200 len: 1446 microversion: 2.1 time: 0.086610 Aug 30 16:09:20.010202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 790/1434] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:19 2022] GET /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 1446 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:20.022840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:20.023891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:20.039088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:20.039866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:20.041164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:20.045547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:20.046269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:20.047259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:20.109604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:20.130025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:20.144481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:20.147843 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d15d586e-45a4-4448-be94-f11a3b0f304c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.901267 Aug 30 16:09:20.149171 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 645/1435] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:19 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:20.155337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-523ef1d2-ad5c-472d-9cf8-f2ffed1d7a96 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cc5f5e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:20.476965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:20.517709 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f65d663-8629-4b1e-acb0-e57796a118f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.506293 Aug 30 16:09:20.532322 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 791/1436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:20 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:20.601495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:20.618927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:20.631107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:20.633997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:20.634596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:20.636802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:20.638898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:20.639464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:20.944441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:20.956494 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff725447-4e8c-4c5a-89f4-5c71d8c87029 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1536 microversion: 2.1 time: 0.366117 Aug 30 16:09:20.957652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 792/1437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:20 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1536 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:20.962458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-unplugged", "status": "completed", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:20.994181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:20.994862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:20.995377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.029936 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Creating event network-vif-unplugged:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:09:21.045748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] Instance fe06bce6-994a-4727-b936-ed96ccca1794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:09:21.052390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b7fd183d-61c6-45a4-abc1-3435220e8996 req-c13e450b-1d89-4f75-9b61-78820a148afb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093567 Aug 30 16:09:21.053319 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 793/1438] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:21.175715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:21.187818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:21.188712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:21.198151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.199287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.200042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.201977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.202730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.203442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.412875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-523ef1d2-ad5c-472d-9cf8-f2ffed1d7a96 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 204 len: 0 microversion: 2.1 time: 1.261901 Aug 30 16:09:21.413715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:21.415082 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 646/1439] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:20 2022] DELETE /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 0 bytes in 1265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:21.425758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:21.426310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:21.429031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:21.431098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:21.432432 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1174787-02d6-46f7-b09d-6db3321eadc5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.258093 Aug 30 16:09:21.433506 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 794/1440] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:21 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:21.448492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.449021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.449477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.450243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.454370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.455002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.491977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:21.555570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:21.556188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:21.564911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.565692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.566384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.567281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:21.567898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:21.568447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:21.624466 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbf2b40c-c8e4-4752-94dc-4a9abb460b51 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 204 len: 0 microversion: 2.1 time: 0.203035 Aug 30 16:09:21.626935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 647/1441] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:21 2022] DELETE /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:09:21.862054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:21.876391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57a8f450-946f-42b9-bc40-b07421bbc36a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Action: 'create', calling method: .version_select at 0x7fd35cb85820>, body: {"keypair": {"name": "tempest-keypair-1450340041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEWlT1ywGUyGyEJv9poi6T9UNosiZz+FLG0dYPdHkq27Mixq+C+5c+ORGLOPd2Tc9Du5HmzMNHFj5IqfnQ0lJHaZRZn4aUWujr0+MSRFYKsHS9k6IUHnB54O4Q0yOTuwA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:21.889348 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-107c8050-189a-4082-9b5a-aa0e759b36a0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.337811 Aug 30 16:09:21.893067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 795/1442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:21 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:21.910177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1120115129", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:21.953044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-57a8f450-946f-42b9-bc40-b07421bbc36a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:21.965029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-57a8f450-946f-42b9-bc40-b07421bbc36a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for user ae6d5176489540329d05947f06c6ccfc and project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:22.017342 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57a8f450-946f-42b9-bc40-b07421bbc36a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.343754 Aug 30 16:09:22.018679 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 648/1443] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:09:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:09:22.023809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:22.030788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:22.048247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] validate_networks() for [('0cf83e0a-3fb5-4ff4-b43a-3d2119fecd11', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:09:22.053932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:22.058891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:22.062911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:22.063681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:22.064416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:22.064815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:22.379745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:22.391553 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7bb5fb8c-f686-41ed-bddc-9534d926de00 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1536 microversion: 2.1 time: 0.371362 Aug 30 16:09:22.393786 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 649/1444] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:22 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1536 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:22.458375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:22.459858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:22.486070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:22.486611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:22.497100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:22.505009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:22.505677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:22.506121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:22.961309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:22.978642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:22.982440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:22.984181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a32c33e-9749-441f-aced-14886fc3eda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.530070 Aug 30 16:09:22.994746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 650/1445] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:22 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:23.005992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:23.010831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:23.026713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.029255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.031521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.034787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.036280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.037020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.090048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:09:23.090970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:09:23.091693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:09:23.092258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:09:23.092818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:09:23.119431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.120315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.121128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.121899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.125538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.126667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.162216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:23.171774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Getting quotas for user 51cc027d79fe4ae0b644e49473acbd71 and project 78bfd0982cc744498d3791b8622590b7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:23.208196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:09:23.225195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:09:23.302461 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66acc4d2-8eef-43a8-ace6-1b1a8701046a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408014 Aug 30 16:09:23.303944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 796/1446] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:09:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:09:23.309956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2029077735", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4b448f3f-f22f-4de0-b541-69e366f2a6a5"}], "security_groups": [{"name": "tempest-securitygroup--832674320"}], "key_name": "tempest-keypair-1784607634", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:23.353579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:23.371931 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a4bcefed-9547-40eb-aa66-ea300f53fe7b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.375259 Aug 30 16:09:23.372833 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 651/1447] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:22 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:23.378978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d099e350-f039-4f9c-bc02-ca37ebe42d0d", "name": "network-vif-plugged", "status": "completed", "tag": "5c85db8f-e596-48fe-a929-7968141fd055"}, {"server_uuid": "dadb30e7-3b3d-4125-8b72-7fac1b4df260", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d6904a-9312-4349-9029-6576aa8a5d37"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:23.406798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.407670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.408365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.456567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Creating event network-vif-plugged:5c85db8f-e596-48fe-a929-7968141fd055 for instance d099e350-f039-4f9c-bc02-ca37ebe42d0d on n-h2-830883-28 Aug 30 16:09:23.457521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] Creating event network-vif-unplugged:c9d6904a-9312-4349-9029-6576aa8a5d37 for instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 on n-h2-830883-28 Aug 30 16:09:23.505730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] validate_networks() for [('4b448f3f-f22f-4de0-b541-69e366f2a6a5', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:09:23.506923 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-86e1b345-70fc-4afc-96c1-030a91ce01d3 req-a655f7f1-feec-491f-bf67-b8a6caa16d6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.129539 Aug 30 16:09:23.508462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 652/1448] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:23.517335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ca39a5b-011d-4a1e-a784-1156d8fe3cf9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:23.518267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ca39a5b-011d-4a1e-a784-1156d8fe3cf9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:23.665451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ca39a5b-011d-4a1e-a784-1156d8fe3cf9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:23.682722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ca39a5b-011d-4a1e-a784-1156d8fe3cf9 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1208 microversion: 2.1 time: 0.172698 Aug 30 16:09:23.684177 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 653/1449] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:23 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:23.696067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:23.697757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:23.708663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.709285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.709799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:23.712134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:23.712459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:23.713714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.195331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:24.235737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3df3bd81-955a-4c4a-ac73-abf5967ce121 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1529 microversion: 2.1 time: 0.549478 Aug 30 16:09:24.237365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 654/1450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:23 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1529 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:24.252805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:24.253832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:24.288785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.294269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.296314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.298216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.300034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.302040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.544896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for project 09d46d8c36e449bbab8e141dd38b8188. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:24.562673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for user e7e37cc1074c428ebc01957eb31b1e2c and project 09d46d8c36e449bbab8e141dd38b8188. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:24.589708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:09:24.590136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:09:24.590668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:09:24.597032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:09:24.597508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:09:24.624437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.625166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.625798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.626730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.627359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.627977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.669437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for project 09d46d8c36e449bbab8e141dd38b8188. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:24.679897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Getting quotas for user e7e37cc1074c428ebc01957eb31b1e2c and project 09d46d8c36e449bbab8e141dd38b8188. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:24.706503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:09:24.718564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:09:24.775590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:24.792573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:24.795173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:24.796337 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-873f88c2-ecd5-47a4-b331-9f1d86563a7b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1361 microversion: 2.25 time: 0.557646 Aug 30 16:09:24.812501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 655/1451] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:24 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:24.821895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:24.834197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:24.840648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.841587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.842113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.842906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.843557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.844154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.892774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba04826e-6b75-46f3-9ce8-8b547c22c8a7 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.584738 Aug 30 16:09:24.895425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 797/1452] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:09:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:09:24.907027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:24.909014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:24.921691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.923192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.934051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:24.937193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:24.938036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:24.939557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.282228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:25.290816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d7c8371-71c7-40cd-b0b9-3846ea1dcf4e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1529 microversion: 2.1 time: 0.477230 Aug 30 16:09:25.297798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 656/1453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:24 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1529 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:25.303000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:25.308604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:25.312459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:25.329166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:25.330730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f768c621-f324-472f-a75e-dfeae1b629d0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.433907 Aug 30 16:09:25.348057 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 798/1454] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:24 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:25.351298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:25.353545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:25.354000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.354741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dadb30e7-3b3d-4125-8b72-7fac1b4df260", "name": "network-vif-deleted", "tag": "c9d6904a-9312-4349-9029-6576aa8a5d37"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:25.354877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:25.355214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:25.355647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.385828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:25.389219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:25.390074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.414274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] Creating event network-vif-deleted:c9d6904a-9312-4349-9029-6576aa8a5d37 for instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 on n-h2-830883-28 Aug 30 16:09:25.421523 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9c973054-016f-47ea-8e13-f49113d01cc3 req-2fc8ca88-87e8-4959-b019-9d44ebc930cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071181 Aug 30 16:09:25.422565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 799/1455] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:25.437234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fcda754-e76d-4603-8cf4-1d76608f55b5 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:25.440554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fcda754-e76d-4603-8cf4-1d76608f55b5 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:25.444719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:25.487971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:25.496266 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e39848a0-e598-4772-b54e-91fc09fd05d0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1260 microversion: 2.1 time: 0.197034 Aug 30 16:09:25.497797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 657/1456] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:25 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:25.506291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3119ae2e-f0e7-4eaa-8223-9e59f4c613c8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:25.520707 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3119ae2e-f0e7-4eaa-8223-9e59f4c613c8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] HTTP exception thrown: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3119ae2e-f0e7-4eaa-8223-9e59f4c613c8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Request method failure captured: Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/flavors/55399ee3-6a92-473c-af3c-780bbf102264 HTTP/1.1 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVnOY2gGv93tVh0CYLZ4Hyq_8wUqdShOJONolUfKQXb3nlZBsaDXDybGIhL5SUHupiHRG9mTlUIoad9oRfXYgNvD1t8rfkWiAq33Fl8Q0LNljhDbztYSoQ4PjWo_vmc1cF2j_OXqIdYTd2-B7x3DVUpYdkzy84eFqS2rRL6tPbq64Y Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: bacc7c5c86a642c29515e888fdf7ffd4 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MigrationsAdminTest-600528418 Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:09:25.532226 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bacc7c5c86a642c29515e888fdf7ffd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bacc7c5c86a642c29515e888fdf7ffd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bacc7c5c86a642c29515e888fdf7ffd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bacc7c5c86a642c29515e888fdf7ffd4"}]}] Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MigrationsAdminTest-600528418 Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: bacc7c5c86a642c29515e888fdf7ffd4 Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MigrationsAdminTest-600528418 Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MigrationsAdminTest-600528418-project-admin Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 0311c8b6b57f42a49ede546f73115c83 Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MigrationsAdminTest-600528418-project-admin Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: exception: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. Aug 30 16:09:25.534077 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '55399ee3-6a92-473c-af3c-780bbf102264'} Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:25.536440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. Aug 30 16:09:25.538141 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:25.539523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3119ae2e-f0e7-4eaa-8223-9e59f4c613c8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Returning 404 to user: Flavor 55399ee3-6a92-473c-af3c-780bbf102264 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:25.540152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3119ae2e-f0e7-4eaa-8223-9e59f4c613c8 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/55399ee3-6a92-473c-af3c-780bbf102264" status: 404 len: 109 microversion: 2.1 time: 0.033552 Aug 30 16:09:25.540930 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 658/1457] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:25 2022] DELETE /compute/v2.1/flavors/55399ee3-6a92-473c-af3c-780bbf102264 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:25.615276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fcda754-e76d-4603-8cf4-1d76608f55b5 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:25.634999 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fcda754-e76d-4603-8cf4-1d76608f55b5 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1278 microversion: 2.1 time: 0.206299 Aug 30 16:09:25.639953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 800/1458] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:25 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:25.768343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-155934781", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:25.824143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:25.824904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:25.847822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:25.849113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:25.850129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.860057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:25.864051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:25.867324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:25.952428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:09:26.164253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:26.174188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:26.175692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:26.176966 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ce01fc9-5181-4c79-9bf8-3a1f6eaf69c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1558 microversion: 2.25 time: 0.357508 Aug 30 16:09:26.177526 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 801/1459] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:25 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1558 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:26.182771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-596589502", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c5357068-36c9-46c3-a74f-2a1439cb265a"}], "security_groups": [{"name": "tempest-securitygroup--1303902995"}], "key_name": "tempest-keypair-1450340041", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:26.380751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] validate_networks() for [('c5357068-36c9-46c3-a74f-2a1439cb265a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:09:26.396988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:09:26.397632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:09:26.398414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:09:26.399071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:09:26.400050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:09:26.414614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:26.415496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:26.416516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:26.417547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:26.418687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:26.420187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:26.441645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:26.448042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Getting quotas for user f7b57e0f6afe46e9b6d11985e8ff56c6 and project 84a394898e8f492db0d8174a3ce3eeb9. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:26.462231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:09:26.464955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:09:26.590002 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95de2bec-408e-420a-b191-14d9ce2bdc78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826031 Aug 30 16:09:26.598690 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 659/1460] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:09:26.895617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:26.901921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:26.913777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:26.914443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:26.922160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:26.923154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:26.926694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:26.928156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.127489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid d099e350-f039-4f9c-bc02-ca37ebe42d0d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:27.263998 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-91b6a9ed-f81b-447a-85c3-b126a5e768c6 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 2052 microversion: 2.25 time: 0.669351 Aug 30 16:09:27.274722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 660/1461] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:26 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 2052 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:27.287723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:27.288694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:27.295516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.296358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.297008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.297951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.298655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.299285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.376725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:09:27.378085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:09:27.378833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:09:27.379429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:09:27.380033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:09:27.392849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.393753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.394413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.395452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.396199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.396636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.415813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:27.422540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for user ae6d5176489540329d05947f06c6ccfc and project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:27.444624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:09:27.447534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:09:27.567983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85cd7091-d845-4a61-b63f-d29989498017 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.386338 Aug 30 16:09:27.576075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 802/1462] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:09:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:09:27.583005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:27.584274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:27.593316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.595056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.595629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.596543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.597263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.598007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.670585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:27.685925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7bd056b4-59e3-478d-bdbb-0e8c23ba04cc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.409679 Aug 30 16:09:27.687861 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 661/1463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:27 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:27.692579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:27.703386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:27.720074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.722907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.723646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.726154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:27.726940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:27.727670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:27.944126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:27.956348 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d411830-f1ee-48e0-8ca6-e3499007b798 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1216 microversion: 2.1 time: 0.266961 Aug 30 16:09:27.972323 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 662/1464] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:27 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:27.994915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:27.995576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:28.018777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.021115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.021583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.024370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.025119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.025787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.334082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:28.342903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:28.351101 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61eeffa9-2b56-4cb8-99f2-ade447dd2e9a tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1336 microversion: 2.1 time: 0.377543 Aug 30 16:09:28.351374 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24e1adee-9eeb-4a24-82c2-94046ade7334 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1266 microversion: 2.1 time: 0.771609 Aug 30 16:09:28.354533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 663/1465] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:27 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1336 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:28.364753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:28.365664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:28.366623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 803/1466] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:27 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1266 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:28.379926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.382932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.383617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.385079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.390744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.391171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04c58c09-d0e9-4fd3-8694-158dadca71f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:28.391805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04c58c09-d0e9-4fd3-8694-158dadca71f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:28.392359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.557838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-04c58c09-d0e9-4fd3-8694-158dadca71f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:28.567726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04c58c09-d0e9-4fd3-8694-158dadca71f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1241 microversion: 2.1 time: 0.199976 Aug 30 16:09:28.568551 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 804/1467] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:28 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:28.710518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-plugged", "status": "completed", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:28.730153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.731038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.732336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.751108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] Creating event network-vif-plugged:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:09:28.763885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-604898e9-e35e-4ee4-a016-17a833a8166d req-53e32264-f1ad-49f2-92b3-82c258be762c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191218 Aug 30 16:09:28.765042 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 805/1468] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:28.770913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:28.772065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:28.780022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.781780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.782848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.785491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.788707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.789397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.860841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:28.868731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid d099e350-f039-4f9c-bc02-ca37ebe42d0d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:28.905920 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f0c37955-ca68-4918-add5-ef900597faae tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 2052 microversion: 2.25 time: 0.549978 Aug 30 16:09:28.907187 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 664/1469] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:28 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 2052 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:28.935194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:28.943619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.953685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.956314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:28.958088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:28.960203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:28.960886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.018956 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-212f0aef-49c5-48ba-9dec-89b73332a798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.091376 Aug 30 16:09:29.027373 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 665/1470] 10.222.0.47 () {60 vars in 1217 bytes} [Tue Aug 30 16:09:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:09:29.034060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:29.034958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:29.043550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.045497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.047478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.048672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.049350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.050412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.275587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:29.297954 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a695214-e811-487f-98d2-af54603f71a8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1272 microversion: 2.1 time: 0.263314 Aug 30 16:09:29.298793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 666/1471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:29 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:29.305363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-830883-28", "block_migration": "auto"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:29.308141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:29.319908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.320835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.321280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.322189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.323214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.325552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.390585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'flavor' on Instance uuid d099e350-f039-4f9c-bc02-ca37ebe42d0d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:29.408635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Going to try to live migrate instance to n-h1-830883-28 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:09:29.618049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:29.640847 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eeff0386-79e4-4df0-aca3-df70cf263190 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.874218 Aug 30 16:09:29.642135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 806/1472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:28 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:29.646949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "name": "network-vif-unplugged", "status": "completed", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:29.675395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.676376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.676991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.710673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] Creating event network-vif-unplugged:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h2-830883-28 Aug 30 16:09:29.725499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bb2248f4-85e3-4236-8dce-aaefbbcab060 req-431a8dcf-a0ea-47a9-af9c-ca34fc2511e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081855 Aug 30 16:09:29.726458 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 807/1473] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:29.733011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:29.744207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:29.754341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.755123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.758212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.759239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.759880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.765687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.937444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:29.957322 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c61a36e-531a-4e08-b021-a0b5011290df tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1336 microversion: 2.1 time: 0.226835 Aug 30 16:09:29.958029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 808/1474] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:29 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1336 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:29.976773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:29.983512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:29.990774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.991294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:29.991742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:29.992492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:29.992918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.004006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.414911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:30.435534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-144835b9-7271-4210-b21a-0e4705fb209f tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.469036 Aug 30 16:09:30.438849 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 809/1475] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:29 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:30.445822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.446768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.458901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.462725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.463286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.464043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.464533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.464978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.599962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:30.602288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:30.619897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9e884c0-dc50-4cfe-bb5c-e6bac095c589 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1299 microversion: 2.1 time: 0.179834 Aug 30 16:09:30.620817 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 810/1476] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:30 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:30.626670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.627527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.646401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.647027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.647706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.648757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.649244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.649719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.791857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:30.808455 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17195991-abc4-4183-a21a-4ecb507f5b2f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1270 microversion: 2.1 time: 0.186563 Aug 30 16:09:30.822019 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 811/1477] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:30 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:30.841230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.843313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.851183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.852234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.852866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.854776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.855434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.858371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.307756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:31.318655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14faa441-e641-4d07-9b2e-87461c626fae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.487690 Aug 30 16:09:31.319946 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 812/1478] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:30 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:31.325321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:31.326138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:31.335550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.335973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.336415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.337138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.337832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.338447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.677723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:31.693052 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7f810e4-8b3b-423c-b338-ecffc30d732e tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.371845 Aug 30 16:09:31.693538 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 813/1479] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:31 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:31.785894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92664237-df56-4c4d-986d-f5e52bf29051 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d/action" status: 202 len: 0 microversion: 2.25 time: 2.485483 Aug 30 16:09:31.788523 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 667/1480] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:09:29 2022] POST /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d/action => generated 0 bytes in 2489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:31.795564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:31.803010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:31.817628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.818162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.818644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.820035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.820798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.822994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.825614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac59801-2c18-42e8-a51d-6c3d0c309426", "tag": "ad2622a0-4626-4d3b-ab42-38296c263e9c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:31.847594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.848020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.849291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.868818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] Creating event network-changed:ad2622a0-4626-4d3b-ab42-38296c263e9c for instance bac59801-2c18-42e8-a51d-6c3d0c309426 on n-h1-830883-28 Aug 30 16:09:31.875498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1e4580ac-3b76-4481-9a6a-b788ddcad24f req-22fc5f3f-a2b6-41a0-bddc-7eb72a751952 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180775 Aug 30 16:09:31.876707 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 814/1481] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:31.881970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:31.883000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:31.889418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.890107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.890765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.891639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.892103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.892535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.991626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.001337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87d2a183-be24-452d-81ce-f0bc133511e8 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1299 microversion: 2.1 time: 0.123267 Aug 30 16:09:32.002581 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 815/1482] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:31 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:32.008056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:32.008861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:32.030130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.030927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.031579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.032986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.033738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.034638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.291672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.305170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.306572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.308759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee5d0595-9c5b-401a-8f2a-1ec739536820 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.304495 Aug 30 16:09:32.310127 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 816/1483] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:32 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:32.329269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:32.345207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.345578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.346001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.366192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] Creating event network-changed:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h2-830883-28 Aug 30 16:09:32.371053 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-75522d11-4ce2-4a68-9cf8-52b7fb82fec5 req-2a74af2b-ba79-472e-b3e3-7caef40bd837 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047255 Aug 30 16:09:32.375923 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 817/1484] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:32.381977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:32.382991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:32.397159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.397769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.401003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.411951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.413001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.415267 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da9337ba-19be-454a-ad90-d20d83b6a129 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.624238 Aug 30 16:09:32.415985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.416529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.419698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 668/1485] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:31 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:32.426267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:32.427031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:32.454559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.455217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.459005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.459885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.460464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.460998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.779285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.792884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eda88948-3dab-40bd-908b-87f725d08192 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.415369 Aug 30 16:09:32.797516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 818/1486] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:32 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:32.807015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:32.810673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:32.818454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.819424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.819867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.820626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.821128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.821563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.059632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.069555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1db33f5c-7814-4812-917a-98f57c8b66b8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.270519 Aug 30 16:09:33.083604 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 819/1487] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:32 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.083604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.083604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.083604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Searching by: {'deleted': False, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:09:33.089707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.090869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.091638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.092610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.093165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.093757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.189176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:09:33.251737 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ba7d03f-a806-4119-b44f-d33d1321b206 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.180317 Aug 30 16:09:33.252331 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 820/1488] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:33.261230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.261230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:33.265832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.266356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.266808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.267526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.268004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.268427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.336863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.347649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ccde9404-c716-4f02-9d8f-979e18060a4d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.925559 Aug 30 16:09:33.358746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 669/1489] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:32 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.367229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.372680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.374039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Searching by: {'deleted': False, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:09:33.379654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.380340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.381058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.382138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.382978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.383571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.415036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:09:33.426024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.436963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10444faf-3fb6-4467-8f2c-a58715749c43 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.183564 Aug 30 16:09:33.437731 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 821/1490] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.442098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.442739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:33.451462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.452614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.453437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.454410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.455102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.455893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.513744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.520200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.520686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.521242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.626779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.658741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.660231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.662116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4ad5693-6825-4a39-b26f-1cf8f69656a7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.223013 Aug 30 16:09:33.662116 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 822/1491] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:33.670325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.671022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:33.677397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.678006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.678793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.679502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.679990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.680411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.818785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:33.827211 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d3d00b5-1e07-4f23-a804-a0ce36670c8c tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.164012 Aug 30 16:09:33.827781 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 823/1492] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.846741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.847374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:33.853304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.853799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.854245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.855277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.855628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.855860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.884506 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78d7943d-8687-421b-a167-6129ae7d1de2 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.524607 Aug 30 16:09:33.885480 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 670/1493] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.907328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-772052e9-2a0c-456e-9410-d87b9f396bfd tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.916184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-772052e9-2a0c-456e-9410-d87b9f396bfd tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013582 Aug 30 16:09:33.916676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 671/1494] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:09:34.010004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.018710 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ad01cb4-eca0-4561-8cf7-e9cc0dc29491 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.179092 Aug 30 16:09:34.019549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 824/1495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:34.092487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.093827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.100058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.100624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.101163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.101923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.102477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.102911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.266926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:34.277561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.279254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.279729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.408567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.418497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dde10e5b-a430-4e22-aae4-82123eed1170 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.331537 Aug 30 16:09:34.419786 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 672/1496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:34.424665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.425268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.432101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.432599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.433034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.433747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.435127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.435580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.511954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] Creating event network-changed:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:09:34.518404 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9358e197-579a-480f-94c3-a62ca840960f req-46f2178f-156e-431b-8c4a-474c46c22976 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256076 Aug 30 16:09:34.518404 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 825/1497] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:34.523816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d6ab39-466a-4469-b695-46ae394858ef", "tag": "59d269b2-51d6-4629-af79-e7baa0459c19"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:34.534759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.535245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.535671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.548655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] Creating event network-changed:59d269b2-51d6-4629-af79-e7baa0459c19 for instance 53d6ab39-466a-4469-b695-46ae394858ef on n-h2-830883-28 Aug 30 16:09:34.554647 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-27e36c57-9624-4f4d-a049-c0db200b4020 req-ea3d05dc-71d1-4164-8980-8ba36da77575 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034938 Aug 30 16:09:34.555563 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 826/1498] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:34.560981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.561847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.567898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.568682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.569138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.569845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.570343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.570855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.641184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.649695 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf6757bc-0363-41ad-b6ab-3a60ba65f779 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.228601 Aug 30 16:09:34.650275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 673/1499] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:34.655285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.655778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.661586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.662069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.662532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.663415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.663849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.664274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.737309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.747398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ab36bfe-3669-4108-b2b9-83b05d9ccc2d tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.190365 Aug 30 16:09:34.748065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 827/1500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:34.752949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.753566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.760103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.760605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.761048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.761762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.762848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.763318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.888653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:34.914283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.923413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.925205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:34.926500 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd3b2b05-c29b-4b6d-9a5d-d116ad1599c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.177496 Aug 30 16:09:34.927147 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 828/1501] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:34.931717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.932578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.939556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.940580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.941214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.942168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.942664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.943143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.987655 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-171a8eff-c7b9-4f18-936b-d688e8f2acde tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 204 len: 0 microversion: 2.1 time: 0.335912 Aug 30 16:09:34.988650 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 674/1502] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:34 2022] DELETE /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:34.998082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.999027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.005707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.006325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.006912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.007761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.008264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.008768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.098519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.100961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:35.108419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54cb63b2-c406-4449-8fd9-2d12c08e3ece tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.180236 Aug 30 16:09:35.109011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 829/1503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:35.113899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:35.114173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.120133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.121161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.121161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.121760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.122448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.122876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.234868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.245040 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-184881da-7b1e-45c8-a4b1-dcc06b6561a8 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1607 microversion: 2.1 time: 0.251584 Aug 30 16:09:35.245993 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 675/1504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:34 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1607 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:35.261955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.269780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-690eff6c-f0c0-47ca-9977-900997f54a77 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.159735 Aug 30 16:09:35.270380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 830/1505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:35 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:35.440475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:35.441286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.447821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.448315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.449209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.450123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.450616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.451049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.617084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.626908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29115add-636b-4e5a-9152-fc3200ed4ad4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.190532 Aug 30 16:09:35.627575 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 676/1506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:35 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:35.672364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:35.672977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.679565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.680044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.680483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.681169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.681621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.682043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.769152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:35.769772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.775792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.776278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.776717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.777410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.777867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.778935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.818409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.827117 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60c330cb-c9f3-402e-a116-ccfa7ba6545c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.159566 Aug 30 16:09:35.827679 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 831/1507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:35 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:35.914616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:35.923496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b02ea719-425a-4615-9471-301a0c8e7e23 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.158244 Aug 30 16:09:35.924057 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 677/1508] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:35 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:35.953002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:35.953667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:35.959715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.960185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.960620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:35.961338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:35.961793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:35.962215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.095678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.103879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.105304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.106721 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5ef67a4-549c-4edd-b692-9558c28ee440 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.158160 Aug 30 16:09:36.107289 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 832/1509] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:35 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:36.129054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.129671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.135603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.136086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.136521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.137929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.138455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.138893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.156806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:36.271753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.272203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.274189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.278345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.278839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.279278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.279967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.280428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.280855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.283092 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2cd2fab6-542d-4fc9-bece-cef36a0e7a50 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.157858 Aug 30 16:09:36.283724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 678/1510] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:36.290069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.290842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.297285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.297770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.298202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.298928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.299375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.299869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.415889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.424097 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29a3f203-65c4-4177-8a35-3d8f682e9220 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1607 microversion: 2.1 time: 0.156389 Aug 30 16:09:36.424677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 833/1511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1607 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:36.439013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.446751 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b995c86-1b1d-48fa-b556-b512322c222a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.160276 Aug 30 16:09:36.447619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 679/1512] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:36.533743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89b5b78-2cb8-4afc-848b-023f5fb86548", "tag": "0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:36.543100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.543583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.544019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.555163 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] Creating event network-changed:0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc for instance a89b5b78-2cb8-4afc-848b-023f5fb86548 on n-h2-830883-28 Aug 30 16:09:36.562243 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-91de37a7-23bf-4848-b445-a8d2648783c8 req-eb02d38b-2e0d-4eca-89a2-8f594ade46f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032127 Aug 30 16:09:36.562902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 834/1513] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:36.648967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.649578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.656126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.656605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.657066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.657748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.658199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.658665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.786997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:36.794718 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed67f1e9-faa0-4d38-aa56-357f5afdc024 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.149843 Aug 30 16:09:36.795292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 680/1514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:36.850530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.851249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.857717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.858209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.858685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.859411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.859877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.860309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.945075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.945728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:36.953771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.954270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.954740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.955451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.956109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.956542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.997442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.006577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-652fe8a4-fc77-4643-80ff-6af0f7805923 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.160490 Aug 30 16:09:37.007356 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 835/1515] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:37.129352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:37.130406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.131873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.136469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.136960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.137435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.138137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.138626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.139061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.140118 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1b2d872-c769-47d6-ad3b-fd49fd31ca8f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.198997 Aug 30 16:09:37.140722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 681/1516] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:37.272103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.280950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.282460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.283621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2e30d91-ab3d-4aec-9b39-13e66cad5e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.158276 Aug 30 16:09:37.284184 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 836/1517] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:37 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:37.304277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:37.304899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.310957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.311450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.311887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.312582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.313039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.313471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.452216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:37.453214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.459741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.460161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.460652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.461361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.461827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.463405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.599135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.607224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.608448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-052f69b8-be9d-4d9f-b637-ce52e12ce992 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.307954 Aug 30 16:09:37.609545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 682/1518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:37 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:37.614524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:37.615266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.620955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-13ba399f-2554-4626-a49b-9d1cbab76882 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1607 microversion: 2.1 time: 0.179310 Aug 30 16:09:37.622091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.622832 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 837/1519] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:37 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1607 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:37.622973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.623502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.624306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.624957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.625419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.817848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:37.818599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.832004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.832598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.833058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:37.833796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:37.836380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:37.838040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.020351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:38.031946 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d240ac06-14da-4e23-b1a1-db2c93b0cb04 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.421170 Aug 30 16:09:38.034967 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 683/1520] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:37 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:38.046706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:38.047048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:38.057588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.058090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.062938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.063819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.071047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.071618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.563028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=30 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:38.568596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:38.579163 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-523f459a-2907-43a0-9eb9-09fe65db311d tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.766229 Aug 30 16:09:38.580015 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 838/1521] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:37 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:38.586058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:38.586971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:38.593864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.595722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.596172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.596888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.597352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.597780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.847381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:38.856977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d3bd861-2a86-4932-94e9-e13dfe7970ff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.274750 Aug 30 16:09:38.858264 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 839/1522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:38 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:38.878139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:38.878713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:38.881768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:38.885319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.885817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.891030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.892089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.892768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.893819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.066951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.072844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.088073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.091235 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8146ae02-9f91-4303-b2a2-7c30c370807a tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 1.055123 Aug 30 16:09:39.092952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.093687 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 684/1523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:38 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.098787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b047345-45f3-45b5-9b3a-5f759d33f070 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.238568 Aug 30 16:09:39.113753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 840/1524] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:38 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:39.115309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.116290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.119578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.120439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.127507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.128282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.128636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.129151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.129278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.129759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.130433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.130654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.131283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.131860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.132255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.132771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.290966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.300853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-946ba047-b8c6-446e-a7ea-5f0ad5a3ae36 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1607 microversion: 2.1 time: 0.185481 Aug 30 16:09:39.302052 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 841/1525] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1607 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.307802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.308537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.317007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.317661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.318465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.319321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.319978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.320493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.385670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.394659 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f5d3653-ffcc-4071-9323-2a2f099c8a0d tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.299081 Aug 30 16:09:39.395928 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 685/1526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.468365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.476870 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-870b0c7e-0cf4-4a1e-8fd6-3b59cca22e85 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.173548 Aug 30 16:09:39.490766 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 842/1527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.599516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.600376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.607218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.607936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.608570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.609282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.609900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.610538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.828102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.838316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59f39b89-17e9-4b36-a725-bd8b433d9562 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.242792 Aug 30 16:09:39.839045 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 686/1528] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.881208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.881844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.889211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.889718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.890167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.890921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.891570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.892171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.903159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fcacc7f-8ceb-4ff8-bdb4-0022ef760940", "name": "network-vif-deleted", "tag": "5e56f21b-5b46-4550-ac58-c692ce7dbc24"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:39.924955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.925445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.925884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.941416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] Creating event network-vif-deleted:5e56f21b-5b46-4550-ac58-c692ce7dbc24 for instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 on n-h2-830883-28 Aug 30 16:09:39.959149 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9ac73bfa-c78a-48a6-8c3c-3bfe6e289df2 req-4140e499-98f0-4049-9222-32a585288611 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055676 Aug 30 16:09:39.963653 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 687/1529] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:40.067437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.076153 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb7772b6-6556-4d8e-9873-c3b0d7dd56a3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.198868 Aug 30 16:09:40.076732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 843/1530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:40.114935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.116509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.121418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.122048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.123829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.124428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.124927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.125693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.126216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.126775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.129803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.130520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.133243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.134510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.135156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.135767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.288523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.299046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-201f1365-adf7-4697-9a4d-f759fedf3b16 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.188674 Aug 30 16:09:40.299789 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 688/1531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:40.315356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.326355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.326520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.326801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.328034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.329302 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32458508-c167-4c9e-916d-6b278a45d54b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.212147 Aug 30 16:09:40.330344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 844/1532] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:40.333359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.333855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.334507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.335360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.335974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.336674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.411780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.416072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.416701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.420287 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3fc8c492-b8aa-4a5a-84e2-8def8ce5d789 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1540 microversion: 2.1 time: 0.101132 Aug 30 16:09:40.421065 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 689/1533] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1540 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:40.424173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.424679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.425119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.425831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.426289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.426749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.501090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.501715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.508267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.508755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.509342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.510041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.510941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.511109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.567798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.577654 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3625e1cf-3d90-4518-8d97-4d15928ca5ed tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.165231 Aug 30 16:09:40.578376 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 845/1534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:40.583458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac59801-2c18-42e8-a51d-6c3d0c309426", "name": "network-vif-plugged", "status": "completed", "tag": "ad2622a0-4626-4d3b-ab42-38296c263e9c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:40.597122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.597791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.598521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.611613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] Creating event network-vif-plugged:ad2622a0-4626-4d3b-ab42-38296c263e9c for instance bac59801-2c18-42e8-a51d-6c3d0c309426 on n-h1-830883-28 Aug 30 16:09:40.617246 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-816fb36d-e886-46e3-a9c6-144c06ec32c9 req-42feea05-bec8-4447-8cf7-945f3b3e52da service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037611 Aug 30 16:09:40.618211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 846/1535] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:40.686030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.695710 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53ec1442-12c5-480b-b96c-05ce1a656c59 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.200307 Aug 30 16:09:40.696382 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 690/1536] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:40.859329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.860043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.867092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.867523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.867973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.868676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.869145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.869579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.008516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.010854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:41.018598 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c854aca2-f578-4a1a-b924-a2a5e82a8f16 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.163703 Aug 30 16:09:41.019393 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 847/1537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.097451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.098063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.104778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.105252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.105687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.106403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.106852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.107276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.247513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.255241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-67f91143-85db-4e48-b13e-e656e6c257d1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.161800 Aug 30 16:09:41.255798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 691/1538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.320913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.321524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.328196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.328685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.329122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.329832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.330280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.337553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.363984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.364816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.373936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.374473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.374926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.375652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.376117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.376556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.536942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.549053 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9330b3d-4b82-491a-add3-61afa1d6adf4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.231748 Aug 30 16:09:41.562889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 848/1539] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.562889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.562889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.570280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.570804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.571273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.572858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.572858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.573114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.648512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.658587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b79d2dea-7247-4e72-8f80-2a55541ecc9f tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1252 microversion: 2.1 time: 0.107615 Aug 30 16:09:41.659756 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 849/1540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1252 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.664630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.665763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.672013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.672521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.672971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.674757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.675191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.676107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.858744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.867316 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a8f5710-89be-4b37-babf-a6f9c781dd09 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1308 microversion: 2.1 time: 0.206396 Aug 30 16:09:41.867903 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 850/1541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.873355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.873973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.881817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.882347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.882816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.883646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.883990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.884424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.018199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.033300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.047540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.052204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.054161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e0cc818-a5d9-4a73-9b49-7e8a8dd3dadc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.185181 Aug 30 16:09:42.055700 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1db4711b-6673-4322-abed-f2eb4f0d579a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.707012 Aug 30 16:09:42.056488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 851/1542] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:42.070551 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 692/1543] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:42.070719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.070719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.076587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.077212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.077757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.078625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.079209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.079738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.257624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.269019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-311c03e1-2a43-4e0c-b931-b4be21534a27 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.210511 Aug 30 16:09:42.270362 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 852/1544] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:42.277430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.279025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.287769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.288763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.289415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.290357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.291122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.291630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.576134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.576664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.582751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.583241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.583880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.584588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.585063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.585471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.689903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.698497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cca3fe14-16d7-428d-bec1-70b7efce3b5f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.425841 Aug 30 16:09:42.712599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 693/1545] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:42.717828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.718675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.721786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:42.725677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.726388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.727079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.727944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.728578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.729161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.749904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.763484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad3abe68-1172-4b9f-9550-3947fe64d2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.191984 Aug 30 16:09:42.764094 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 853/1546] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:42.769303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d6ab39-466a-4469-b695-46ae394858ef", "name": "network-vif-plugged", "status": "completed", "tag": "59d269b2-51d6-4629-af79-e7baa0459c19"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:42.780093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.780584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.781215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.796270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] Creating event network-vif-plugged:59d269b2-51d6-4629-af79-e7baa0459c19 for instance 53d6ab39-466a-4469-b695-46ae394858ef on n-h2-830883-28 Aug 30 16:09:42.801288 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8b685f9b-51f0-4400-9080-52fcc65fb889 req-2ca8b968-9c12-40e8-b6a4-bc412b41f3a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035406 Aug 30 16:09:42.801881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 854/1547] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:42.838522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.847393 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e6f1466-acaa-4dae-b07d-988a0dcdc600 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1252 microversion: 2.1 time: 0.133377 Aug 30 16:09:42.847957 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 694/1548] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1252 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:42.889630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.890369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.896698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.897183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.897623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.898354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.898818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.899246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.050177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.058054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f96d2b8d-c616-4eaa-a26c-1964768d3dc1 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1487 microversion: 2.1 time: 0.173217 Aug 30 16:09:43.059753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 855/1549] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1487 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:43.078291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.078937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.085608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.086098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.086560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.087267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.087719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.088142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.096958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-111176637"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:43.099369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.105400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.106993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.107602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.108501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.109122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.109725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.127219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.267533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.272265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.277360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16471901-daf7-4e23-abfe-9afd53fedf6e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.203170 Aug 30 16:09:43.278124 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 695/1550] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:43.285057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.285899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.295211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.295715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.296151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.296858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.297536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.297971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.332519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67989985-bc27-44ef-b53c-656cd7db303a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "POST /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426/action" status: 202 len: 0 microversion: 2.1 time: 0.239266 Aug 30 16:09:43.338545 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 856/1551] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:09:43 2022] POST /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:09:43.340103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.340859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.347490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.348059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.348572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.349333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.349875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.350393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.397765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.464071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.473186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.474734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.475913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8616242-6127-48a5-acab-3958cd005073 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.196234 Aug 30 16:09:43.476825 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 696/1552] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:43.483505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-108fee8c-17a5-428f-bff4-4eaee82b94c0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35ca798b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.510870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:43.514082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.522570 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06506dbb-8473-4080-bf60-5b8df4b63e36 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.187845 Aug 30 16:09:43.527174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 857/1553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:43.553312 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-108fee8c-17a5-428f-bff4-4eaee82b94c0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1" status: 200 len: 1411 microversion: 2.1 time: 0.075230 Aug 30 16:09:43.553908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 697/1554] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:43.567757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-517c79ff-687f-4297-919b-3e9b28106eb4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fe6550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.613018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-517c79ff-687f-4297-919b-3e9b28106eb4 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1" status: 200 len: 1411 microversion: 2.1 time: 0.049426 Aug 30 16:09:43.613596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 858/1555] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 => generated 1411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:43.626571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce54d325-db94-4d40-9bd5-d160cc1fd235 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cc73430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.720678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.721615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.729167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.729738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.731270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.732211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.732670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.733102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.747962 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce54d325-db94-4d40-9bd5-d160cc1fd235 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1" status: 204 len: 0 microversion: 2.1 time: 0.125122 Aug 30 16:09:43.748565 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 698/1556] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] DELETE /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:43.756663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70f858e2-7574-4ff7-9fc4-f025fec03042 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35cc73160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.780538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-70f858e2-7574-4ff7-9fc4-f025fec03042 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Image not found. Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70f858e2-7574-4ff7-9fc4-f025fec03042 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 HTTP/1.1 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:09:43.782730 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '77c04b95-4b37-4025-b0cc-60c48ac2ddd1'} Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:43.784311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 77c04b95-4b37-4025-b0cc-60c48ac2ddd1 Aug 30 16:09:43.785281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:43.786487 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77c04b95-4b37-4025-b0cc-60c48ac2ddd1 could not be found. Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:09:43.788476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70f858e2-7574-4ff7-9fc4-f025fec03042 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:43.791356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70f858e2-7574-4ff7-9fc4-f025fec03042 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1" status: 404 len: 62 microversion: 2.1 time: 0.031679 Aug 30 16:09:43.794664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 699/1557] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 16:09:43.794664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.794664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.798085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.798709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.799259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.800051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.800607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.801131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.882285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.892441 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35db1b79-1ebd-4257-bee6-8e888065bc85 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.175892 Aug 30 16:09:43.893104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 859/1558] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:43.898094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.898726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.904873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.905360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.905802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.906530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.906988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.907415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.949120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:43.958149 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e771c997-8426-402e-a6a7-6fbf4e8b3b8b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.171874 Aug 30 16:09:43.958781 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 700/1559] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:43.963761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:43.964591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:43.972163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.972980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.973669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:43.974506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:43.974964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:43.975392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.046070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.054162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57f6bf8b-7c1a-4ba0-bef4-f772c449fb3c tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1252 microversion: 2.1 time: 0.094142 Aug 30 16:09:44.054983 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 701/1560] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:44.055237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.064672 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d15bca8f-8d75-460c-bea5-bad69722579a tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1499 microversion: 2.1 time: 0.170377 Aug 30 16:09:44.065422 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 860/1561] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:43 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:44.299993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.301205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.308135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.309157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.309776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.310885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.311527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.312174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.455498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.463178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11f06c04-d03c-447a-bd0f-bd07293fdb9c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.167141 Aug 30 16:09:44.463740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 702/1562] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:44.501183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.501939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.508034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.508523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.508999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.509696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.510158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.510617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.548141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.548758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.555100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.555517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.555952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.556677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.557309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.557732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.644827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.654114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.655598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.656788 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-307a4bf4-5786-4911-b8db-d8bb0321b631 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.159627 Aug 30 16:09:44.657348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 861/1563] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:44.703243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.712077 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1bbf2f66-c56b-4bdd-b3fe-537e9860731b tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.167643 Aug 30 16:09:44.712647 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 703/1564] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:44.913158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.914055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.920474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.921318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.922195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.922707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.923209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.923648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.980834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.981627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.987953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.988692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.989195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.989986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.990534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.991075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.072748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.081625 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad5e24ee-0e3d-42a7-89d1-b89d7750a0ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.172247 Aug 30 16:09:45.082415 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 862/1565] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:45.087521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.088451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.096213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.097049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.097741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.098620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.099177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.099736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.169617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.179030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-425152d9-a623-435f-aa8d-bf3fe7f415a4 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1252 microversion: 2.1 time: 0.094862 Aug 30 16:09:45.179925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 863/1566] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1252 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:45.185324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.186139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.192820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.193558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.194160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.195121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.195877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.196471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.361020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.364029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:45.372820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc4142da-8ed7-4d25-93b6-3282a99c280e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1505 microversion: 2.1 time: 0.191673 Aug 30 16:09:45.373598 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 864/1567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:45.486736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.487678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.495297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.496098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.497227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.498034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.498907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.499269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.585015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.595895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6c3a96e-c277-4e6f-99f1-68bb24b6ecdf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.619350 Aug 30 16:09:45.609311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 704/1568] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:45.657077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.665534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c63dd2c-3f31-4929-b50c-ae80831cc8a4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.184720 Aug 30 16:09:45.666135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 865/1569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:45.682348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.683169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.690524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.691166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.691838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.692652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.693215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.693746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.733873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.734542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.740835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.741338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.741786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.742551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.743021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.743455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.886021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.894752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b220a5d-6d40-4dfe-8219-1aedb9b32f23 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.165433 Aug 30 16:09:45.895336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 866/1570] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:45.929747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.938660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.940095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.941252 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f401d570-fe10-4835-b217-8f9e28521056 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.263818 Aug 30 16:09:45.941805 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 705/1571] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:46.106336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.107861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.114897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.115561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.116083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.116901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.117596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.118113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.200858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.201788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.209144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.215870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.216555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.217884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.218391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.218849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.292363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.302151 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f82b350-b420-48ff-8276-f01f4bd7df42 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.200898 Aug 30 16:09:46.303189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 867/1572] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:46.365628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.385288 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-210da903-0717-4ad9-bf82-de08282dece0 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1252 microversion: 2.1 time: 0.188742 Aug 30 16:09:46.386331 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 706/1573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1252 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:46.394183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.395144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.407008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.407512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.408241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.408943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.409493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.409926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.467352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89b5b78-2cb8-4afc-848b-023f5fb86548", "name": "network-vif-plugged", "status": "completed", "tag": "0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:46.503081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.503938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.505286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.535630 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] Creating event network-vif-plugged:0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc for instance a89b5b78-2cb8-4afc-848b-023f5fb86548 on n-h2-830883-28 Aug 30 16:09:46.552417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-093582ee-83bf-4fca-9f4a-712d75949c90 req-dbd053a2-57f2-4bee-b0ee-263f2d500ead service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101510 Aug 30 16:09:46.554364 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 707/1574] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:46.626763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.628268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.629584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.635414 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82f1e36a-d9fb-4533-8e84-087c0dbb9137 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1500 microversion: 2.1 time: 0.245371 Aug 30 16:09:46.635984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 868/1575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:46.638894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.639627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.640308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.641188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.641942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.642610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.687349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.688073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.701640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.702137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.715718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.716999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.717497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.718173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.967916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.976176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f40b0ba-341b-4108-99b7-e1cd81271d07 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.293043 Aug 30 16:09:46.990684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 869/1576] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:46.994650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.998999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.999624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.004503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebad4842-e3e5-4eb7-bfd2-f75315d625f8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1716 microversion: 2.1 time: 0.389618 Aug 30 16:09:47.009044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.010592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.012693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.013440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.013952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.014429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.020120 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 708/1577] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1716 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.025805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.026277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.033388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.034006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.034563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.035380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.035939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.036463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.241145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.249288 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-969bfa66-0cdc-4ef8-a33b-30d72facae1c tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1403 microversion: 2.1 time: 0.257462 Aug 30 16:09:47.249862 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 870/1578] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1403 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.263537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.274053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.275994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.277947 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dd68bcf-cbe4-4e18-b710-d8b82f3aeb5e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.255939 Aug 30 16:09:47.278895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 709/1579] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:47.323704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.325229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.331411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.332002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.332509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.333220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.333687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.334119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.382625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.388490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.389261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Searching by: {'deleted': False, 'project_id': '424770733741472b8fc0208b6fc63d56'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:09:47.395318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.395724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.396160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.396886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.397340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.397771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.473989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.483804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9aa8a58f-3143-4ed5-9b22-4b0b140f8774 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.164316 Aug 30 16:09:47.484706 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 871/1580] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.484844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:09:47.490135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.490929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.497540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.498257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.498917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.499790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.500551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.501154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.535912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.536400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.536838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.537295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lazy-loading 'fault' on Instance uuid 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:47.556478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e6ea405-07d1-4513-9ccf-b4e815f6b953 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.177761 Aug 30 16:09:47.558343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 710/1581] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers => generated 333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:47.570546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.576802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.577981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Searching by: {'deleted': False, 'project_id': '424770733741472b8fc0208b6fc63d56'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:09:47.584726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.585151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.585640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.586079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.586832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.587283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.587906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.594693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fec7c1ed-55b4-46f1-8d14-7d16922d5864 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1257 microversion: 2.1 time: 0.107632 Aug 30 16:09:47.598434 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 872/1582] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1257 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.614352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:09:47.648588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.655372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.655871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.656312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.657685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.658546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.664791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.665344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.665808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.666559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.667029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.667515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.777428 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-97cf8026-9043-40f8-9e62-610cde125a32 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.210736 Aug 30 16:09:47.779203 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 711/1583] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.801465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-afe2216e-41e6-4f53-9453-0b1db1f4109d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.811429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-afe2216e-41e6-4f53-9453-0b1db1f4109d tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013777 Aug 30 16:09:47.812326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 712/1584] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:09:47.818766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.828128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74ce339d-0f95-42bb-a382-85d4331b70af tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1487 microversion: 2.1 time: 0.174730 Aug 30 16:09:47.828753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 873/1585] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1487 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:47.848112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.848693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.855186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.856447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.856904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.857622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.858088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.858652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.888461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:47.970717 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a92cdff6-20aa-4943-9775-c1171d1bf7cb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 204 len: 0 microversion: 2.1 time: 0.125792 Aug 30 16:09:47.971524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 713/1586] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:47 2022] DELETE /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:09:47.983591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a3a5dd4-2fec-4c30-8740-0ada3df15acc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fe6d30>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.001895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.002844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.010742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.011902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.011902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.013614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.014155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.015017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.031291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5a3a5dd4-2fec-4c30-8740-0ada3df15acc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Image not found. Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a3a5dd4-2fec-4c30-8740-0ada3df15acc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 HTTP/1.1 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:48.033577 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '77c04b95-4b37-4025-b0cc-60c48ac2ddd1'} Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:48.035326 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 77c04b95-4b37-4025-b0cc-60c48ac2ddd1 to delete Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.036424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77c04b95-4b37-4025-b0cc-60c48ac2ddd1 could not be found. Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:48.037901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:09:48.039466 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:48.041253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a3a5dd4-2fec-4c30-8740-0ada3df15acc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:48.042280 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a3a5dd4-2fec-4c30-8740-0ada3df15acc tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1" status: 404 len: 62 microversion: 2.1 time: 0.064467 Aug 30 16:09:48.043721 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 874/1587] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] DELETE /compute/v2.1/images/77c04b95-4b37-4025-b0cc-60c48ac2ddd1 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:09:48.052744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.053384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.062257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.062898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.063351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.064074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.064546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.064985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.098656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:48.226999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.236094 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef89f54a-7ec2-4128-9067-e0f304c1c145 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1706 microversion: 2.1 time: 0.187826 Aug 30 16:09:48.251523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 875/1588] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1706 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:48.261252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.262947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.271492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.273177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.273907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.274640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.275578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.276261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.276914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.281598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9dd41ba-ed4f-4c70-b202-9bb7526ef138 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.287046 Aug 30 16:09:48.290455 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 714/1589] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:48.299677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2bde9b45-8972-49c1-859f-eaf7e467165b tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '.version_select at 0x7fd35cc98310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.305644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bde9b45-8972-49c1-859f-eaf7e467165b tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.306880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bde9b45-8972-49c1-859f-eaf7e467165b tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.307427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bde9b45-8972-49c1-859f-eaf7e467165b tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.319248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:48.323918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2bde9b45-8972-49c1-859f-eaf7e467165b tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 2753 microversion: 2.1 time: 0.032045 Aug 30 16:09:48.334924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 715/1590] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/os-migrations => generated 2753 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:48.341627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.342360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.350431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.351100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.352013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.352310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.352851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.353475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.373706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.compute.api [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Instance is already in deleting state, ignoring this request Aug 30 16:09:48.374601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f91c7e1-95ba-40f2-bc17-585389696f63 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 204 len: 0 microversion: 2.1 time: 0.121312 Aug 30 16:09:48.375636 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 876/1591] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:48 2022] DELETE /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:48.381781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.382430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.390722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.391225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.391658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.392575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.393039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.393470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.523042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.532588 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfba564f-ec11-476c-8429-3bec88de7463 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1590 microversion: 2.1 time: 0.196317 Aug 30 16:09:48.533736 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 716/1592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1590 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:48.555581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.556355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.564484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.565236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.565971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.566692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.568386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.569091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.569762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.578231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.579797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.581004 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-720a2f0f-5415-4ffe-bf9a-90559dac8102 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.204134 Aug 30 16:09:48.582008 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 877/1593] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:48.586959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.587575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.595995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.597173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.597841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.599017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.599815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.600717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.781046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5231e25-430d-4081-8b54-3ff40410521a tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1859 microversion: 2.1 time: 0.232692 Aug 30 16:09:48.781722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 717/1594] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1859 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:48.800435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.802419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.813730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.814605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.815321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.817072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.818356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.819009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.831679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:48.843016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cd9f3c1-e791-47df-b0dc-bab75da101a0 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1493 microversion: 2.1 time: 0.259924 Aug 30 16:09:48.843606 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 878/1595] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:48.859275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.860151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:48.867430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.868237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.868897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.869847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:48.870580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:48.871796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:48.983030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8446e49-f796-4e3f-b58a-02b3398ae4ab tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138337 Aug 30 16:09:48.991104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 879/1596] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:48.997323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:48.998115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.004845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.005106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.005538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.006122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.007007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.007734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.008393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.017203 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14ddbaa7-c775-4152-a6b4-28cd2bb8a7a9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1367 microversion: 2.1 time: 0.228491 Aug 30 16:09:49.031460 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 718/1597] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:49.036480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.036985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.043613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.044148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.044591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.044738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.045056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lazy-loading 'fault' on Instance uuid 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:49.045186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.045582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.046293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.046769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.047306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.083956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:49.103678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.106064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:49.119622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74d0106e-2e2b-4f31-993e-8fd152440622 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1257 microversion: 2.1 time: 0.132386 Aug 30 16:09:49.119817 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 880/1598] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:48 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1257 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:49.133818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.137211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.150370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.151021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.151467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.154101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.154673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.155170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.197582 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b9d4c18-953c-45bc-a305-7476e0e755d1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 204 len: 0 microversion: 2.1 time: 0.163405 Aug 30 16:09:49.198639 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 719/1599] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:49 2022] DELETE /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:49.208513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.209429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.216994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.217593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.218110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.218982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.220305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.220872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.450980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.461758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ac0dc35-bbf7-49f9-b553-e718dcd54dfd tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1700 microversion: 2.1 time: 0.257956 Aug 30 16:09:49.462758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 720/1600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1700 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:49.468750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.469715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.476935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.477436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.477879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.478718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.479175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.479772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27766a54-b611-4bed-bd2a-e32385440558 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1859 microversion: 2.1 time: 0.352034 Aug 30 16:09:49.480936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.481516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 881/1601] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1859 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:49.607053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.607729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.613984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.614653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.615199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.616009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.616710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.617360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.665417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.677733 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e8a89db-b003-4a00-9d7e-61ee58229a4d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.213249 Aug 30 16:09:49.678831 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 721/1602] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:49.687072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.687863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.703035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.703493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.703857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.704968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.705443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.705877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.763557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'services' on Instance uuid 7107d12b-8cc0-427d-b719-6c87935dd178 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:49.885613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.894551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.900247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:49.901674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24416080-b002-422e-842b-9f02a8603443 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.221655 Aug 30 16:09:49.903244 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 722/1603] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:49.909001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.909935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.916644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.917616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.918986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.919995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.920632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.921227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.927429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4985dde-1d1c-4feb-9348-4990d985bc33 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments/b58fc13c-cd23-41dc-8b4d-b65c3759a9a0" status: 202 len: 0 microversion: 2.1 time: 0.322292 Aug 30 16:09:49.930350 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 882/1604] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:09:49 2022] DELETE /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments/b58fc13c-cd23-41dc-8b4d-b65c3759a9a0 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:09:49.954580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:49.978021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:49.993214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.993964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.994495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.995770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.997198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.999874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.047724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f63a5dc-56c2-475a-b30e-33c9eb1682e9 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104245 Aug 30 16:09:50.049493 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 883/1605] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:50.055026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.056122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.063350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.064133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.064674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.065468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.066027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.066591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.190389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:50.203954 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2cc63a8a-3676-4200-a920-754ac1850925 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1493 microversion: 2.1 time: 0.299337 Aug 30 16:09:50.206729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 723/1606] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:49 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1493 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:50.219721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.220488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.240807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.241520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.242915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.244283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.244777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.246523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.327462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.327876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.328512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.328774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lazy-loading 'fault' on Instance uuid 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:50.390158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc2d74483b47d1ab6c46e47b7582aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4ba726b1aa40b5b67d4e74ef74145d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:50.401105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bfcbfc28-f0fd-4f8c-b222-bdadf2f56d24 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 200 len: 1257 microversion: 2.1 time: 0.192837 Aug 30 16:09:50.404578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 724/1607] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 1257 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:50.417547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:50.420188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac59801-2c18-42e8-a51d-6c3d0c309426", "name": "network-vif-plugged", "status": "completed", "tag": "ad2622a0-4626-4d3b-ab42-38296c263e9c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:50.428915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5fcbd73d-abf4-44b3-af03-905b52f3cd12 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1558 microversion: 2.1 time: 0.378118 Aug 30 16:09:50.429815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 884/1608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1558 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:50.444760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.445213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.445798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.452373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.452972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.459208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.459784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.460556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.461339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.461899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.462076 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] Creating event network-vif-plugged:ad2622a0-4626-4d3b-ab42-38296c263e9c for instance bac59801-2c18-42e8-a51d-6c3d0c309426 on n-h1-830883-28 Aug 30 16:09:50.462356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.482101 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2d4a799b-7f84-49af-941f-ec7292d2d86f req-648f728d-c29c-4011-b7ae-98bd11f44b5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074745 Aug 30 16:09:50.485935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 725/1609] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:50.494922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.495761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.504155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.506056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.506592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.507391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.507913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.508541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.595301 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67158107-ffd3-473a-9780-a36d272cec0b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148721 Aug 30 16:09:50.595943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 885/1610] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:50.701766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.702401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.708943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.709428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.709863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.710593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.711048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.711471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.744506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:50.758095 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72698dcf-f5d4-4d78-a9a0-11e700f0df71 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1700 microversion: 2.1 time: 0.267380 Aug 30 16:09:50.761504 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 726/1611] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1700 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:50.817019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:50.818380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:50.836200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.836831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.841605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:50.844039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:50.847845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:50.848356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.207880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.218413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a69deec8-9141-466b-9501-a04316ee35e4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1590 microversion: 2.1 time: 0.406216 Aug 30 16:09:51.219289 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 727/1612] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1590 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:51.241930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d6ab39-466a-4469-b695-46ae394858ef", "tag": "59d269b2-51d6-4629-af79-e7baa0459c19"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:51.259874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.260760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.262367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.288866 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] Creating event network-changed:59d269b2-51d6-4629-af79-e7baa0459c19 for instance 53d6ab39-466a-4469-b695-46ae394858ef on n-h2-830883-28 Aug 30 16:09:51.300504 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3569328a-7cef-4dc0-99d3-a77df64d3242 req-3f1d7fc7-7c65-48fb-88a8-588bf550b4e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067697 Aug 30 16:09:51.301343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 728/1613] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:51.307579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.309384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:51.319115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.319872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.320507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.321451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.322488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.323272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.412217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.421839 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3590b08a-8854-45db-a8fb-42e93c11f629 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.724896 Aug 30 16:09:51.434982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 886/1614] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:50 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:51.449583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.456947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:51.472415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.473566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.474382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.478554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.479632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.480859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.533775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.549122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.550621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.550969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-958fad88-1403-4ad8-9494-a9bdc9b71e72 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112791 Aug 30 16:09:51.551874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 887/1615] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:51 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:51.556420 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72a86abe-cb63-4c91-b26f-817c14ceb34e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.249182 Aug 30 16:09:51.570589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac59801-2c18-42e8-a51d-6c3d0c309426", "name": "network-vif-deleted", "tag": "ad2622a0-4626-4d3b-ab42-38296c263e9c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:51.584132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 729/1616] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:51 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:51.592674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.595449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.596027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.597884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.600791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:51.613857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] Creating event network-vif-deleted:ad2622a0-4626-4d3b-ab42-38296c263e9c for instance bac59801-2c18-42e8-a51d-6c3d0c309426 on n-h1-830883-28 Aug 30 16:09:51.616581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.620350 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-167f620d-2b74-4f8d-9124-df9025182117 req-c4b6ee57-93c8-455f-88b9-caa66f6ad0ea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065159 Aug 30 16:09:51.620891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.621603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.621934 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 888/1617] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:51.622876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.623961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.624605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.628236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.629585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] [instance: 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:51.637148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.638020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.638716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.639919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.640673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.641414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.661492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] HTTP exception thrown: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Request method failure captured: Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 HTTP/1.1 Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjXDj8KjJ_xsM1atj3njUBNiXZfyit4ynQ7q8Yo_Nx5jOBEFemWCzmPgewvKfthv-c6AmPcyP-Nz1OvBPfG5IsFdEBMN03phRDqXizWdwWwmKGev5zB3P9GkDAtbxZBK56SPyoUhLB4zPHC9B7M95G6YQN2n3VK3y3pWXBvZxj5Fe9c Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: df4ba726b1aa40b5b67d4e74ef74145d Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestBootFromVolume-277684467 Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:51.664488 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df4ba726b1aa40b5b67d4e74ef74145d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_df4ba726b1aa40b5b67d4e74ef74145d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/df4ba726b1aa40b5b67d4e74ef74145d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df4ba726b1aa40b5b67d4e74ef74145d"}]}] Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestBootFromVolume-277684467 Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: df4ba726b1aa40b5b67d4e74ef74145d Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestBootFromVolume-277684467 Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestBootFromVolume-277684467-project Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e1fc2d74483b47d1ab6c46e47b7582aa Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestBootFromVolume-277684467-project Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. Aug 30 16:09:51.665998 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '8fcacc7f-8ceb-4ff8-bdb4-0022ef760940'} Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:51.667504 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. Aug 30 16:09:51.669548 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:51.671815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Returning 404 to user: Instance 8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:51.671815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d2802fa-fe84-4225-b3ec-a3141ce27c3b tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940" status: 404 len: 111 microversion: 2.1 time: 0.048077 Aug 30 16:09:51.671815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 889/1618] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:51 2022] GET /compute/v2.1/servers/8fcacc7f-8ceb-4ff8-bdb4-0022ef760940 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:51.680773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81c4dde9-3d84-4316-a357-2a0cf8f258c7 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] Calling method '.version_select at 0x7fd35cbec820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.724267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:51.737335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.738073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.738814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.739490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lazy-loading 'fault' on Instance uuid bac59801-2c18-42e8-a51d-6c3d0c309426 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:51.752260 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81c4dde9-3d84-4316-a357-2a0cf8f258c7 tempest-ServersTestBootFromVolume-277684467 tempest-ServersTestBootFromVolume-277684467-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400296112" status: 202 len: 0 microversion: 2.1 time: 0.074037 Aug 30 16:09:51.756003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 890/1619] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400296112 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:09:51.783728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:51.784824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:51.792709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.793487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.794846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.797876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:51.802969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:51.803662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:51.944624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cc027d79fe4ae0b644e49473acbd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bfd0982cc744498d3791b8622590b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:51.950705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:51.963696 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ea2fb4f-3e69-4058-8884-6ca86313b537 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 200 len: 1298 microversion: 2.1 time: 0.377969 Aug 30 16:09:51.966962 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 730/1620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:51 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 1298 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:52.182717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:52.196099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff7ff745-e1f7-4df8-b1f1-351332de1872 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1700 microversion: 2.1 time: 0.417793 Aug 30 16:09:52.197871 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 891/1621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:51 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1700 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:52.450474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:52.451921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:52.466331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.482976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.483176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.483785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.484242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.484666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.521022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "name": "network-vif-plugged", "status": "completed", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:52.542394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.543136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.548169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.579782 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] Creating event network-vif-plugged:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:09:52.585696 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c19bde3c-6917-4f3f-ac33-e62a01b9dcb0 req-a57d1b56-1dc7-4d64-a8b2-8c53cc84315b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068226 Aug 30 16:09:52.587130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 892/1622] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:09:52.829982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:52.833922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:52.843438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.844227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.845559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.846511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.847182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.847909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.887496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1c13fd7-5244-45f4-9834-55d519e28bfc tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.297889 Aug 30 16:09:52.888366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 893/1623] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:52 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:52.893438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:52.894440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:52.902508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.903496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.904172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:52.905066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:52.905790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:52.906357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.395845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:53.406615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:53.408583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:53.409900 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0640b574-6dc8-4a06-8418-2acc9bf3598b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.520264 Aug 30 16:09:53.414500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:53.422924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 894/1624] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:52 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:53.432005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.432499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: bac59801-2c18-42e8-a51d-6c3d0c309426] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.436103 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c771ea07-13e7-4f5e-85fc-aaffc13ba8c3 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.989948 Aug 30 16:09:53.436731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 731/1625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:52 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:53.440377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.441147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.441817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.441943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.442526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.443177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.443862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.444518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.455789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.456929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.457562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.459522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.460185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.460819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.471234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 HTTP/1.1 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.475878 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. Aug 30 16:09:53.477352 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bac59801-2c18-42e8-a51d-6c3d0c309426'} Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.482271 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. Aug 30 16:09:53.483614 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.484771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance bac59801-2c18-42e8-a51d-6c3d0c309426 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.484771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-52721347-d19e-4a98-88de-6a4e08e2cdaf tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426" status: 404 len: 111 microversion: 2.1 time: 0.053346 Aug 30 16:09:53.484771 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 895/1626] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/bac59801-2c18-42e8-a51d-6c3d0c309426 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:53.492259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8139e91c-3256-448b-99fb-74d25ad78afb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fe6430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.534796 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8139e91c-3256-448b-99fb-74d25ad78afb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Image not found. Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8139e91c-3256-448b-99fb-74d25ad78afb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc HTTP/1.1 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.536688 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '080a385e-2505-41bb-878f-ca69150143dc'} Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.538212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 080a385e-2505-41bb-878f-ca69150143dc to delete Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.539163 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 080a385e-2505-41bb-878f-ca69150143dc could not be found. Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.540990 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8139e91c-3256-448b-99fb-74d25ad78afb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8139e91c-3256-448b-99fb-74d25ad78afb tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc" status: 404 len: 62 microversion: 2.1 time: 0.055925 Aug 30 16:09:53.543294 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 896/1627] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/images/080a385e-2505-41bb-878f-ca69150143dc => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:09:53.548888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.549548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.557644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.558419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.559008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.559982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.560657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.561314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.585175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 HTTP/1.1 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.587152 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.588991 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'dadb30e7-3b3d-4125-8b72-7fac1b4df260'} Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.590650 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.592620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.596370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.597479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c13f8d20-036b-4777-bffd-93e420515883 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 404 len: 111 microversion: 2.1 time: 0.052827 Aug 30 16:09:53.601595 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 897/1628] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:53.607059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.607972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: dadb30e7-3b3d-4125-8b72-7fac1b4df260] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.614622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.615402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.616107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.617043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.617731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.618471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.636217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 HTTP/1.1 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.639525 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.641054 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'dadb30e7-3b3d-4125-8b72-7fac1b4df260'} Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.641858 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. Aug 30 16:09:53.646847 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.650514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance dadb30e7-3b3d-4125-8b72-7fac1b4df260 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.651645 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b30e3416-bb20-46ad-81dc-b46ae5819d0e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260" status: 404 len: 111 microversion: 2.1 time: 0.048786 Aug 30 16:09:53.656619 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 898/1629] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/dadb30e7-3b3d-4125-8b72-7fac1b4df260 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:53.661631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8ca1c3e-59b3-4c0c-b1ee-597d2f2528ae tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd360fe6430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.698262 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f8ca1c3e-59b3-4c0c-b1ee-597d2f2528ae tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Image not found. Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8ca1c3e-59b3-4c0c-b1ee-597d2f2528ae tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 HTTP/1.1 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.702411 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '3f342aa3-6e3f-4909-b95a-74ec27279634'} Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.703931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3f342aa3-6e3f-4909-b95a-74ec27279634 to delete Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.704880 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f342aa3-6e3f-4909-b95a-74ec27279634 could not be found. Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.706143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:09:53.708830 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.711487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8ca1c3e-59b3-4c0c-b1ee-597d2f2528ae tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.712611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8ca1c3e-59b3-4c0c-b1ee-597d2f2528ae tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634" status: 404 len: 62 microversion: 2.1 time: 0.054760 Aug 30 16:09:53.713414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 899/1630] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/images/3f342aa3-6e3f-4909-b95a-74ec27279634 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:09:53.722804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.723637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.732373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.733216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.733890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.734887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.735584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.736247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.752648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 HTTP/1.1 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.754362 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.755934 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '84554004-28f8-4e87-8f71-b966acb4a834'} Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.757406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.761381 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.764478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.764478 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a5ab82e-d45f-4011-8f06-ed810465e608 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 404 len: 111 microversion: 2.1 time: 0.037431 Aug 30 16:09:53.764478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 900/1631] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:53.770417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.771336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 84554004-28f8-4e87-8f71-b966acb4a834] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.780822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.781715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.782435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.785351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.786716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.787863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.806919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 HTTP/1.1 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.811057 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.812517 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '84554004-28f8-4e87-8f71-b966acb4a834'} Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.813512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. Aug 30 16:09:53.814871 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.818186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance 84554004-28f8-4e87-8f71-b966acb4a834 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.819390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dc024319-0861-4516-b7c2-3ab48b164230 tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834" status: 404 len: 111 microversion: 2.1 time: 0.058455 Aug 30 16:09:53.820799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 901/1632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/84554004-28f8-4e87-8f71-b966acb4a834 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:09:53.831116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-482ec263-e5ac-4d9a-b51a-73aac2ecb9df tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '.version_select at 0x7fd35d3ff8b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.856291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-482ec263-e5ac-4d9a-b51a-73aac2ecb9df tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Image not found. Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-482ec263-e5ac-4d9a-b51a-73aac2ecb9df tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 HTTP/1.1 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.858236 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'f5a0732e-24ed-460e-86ce-03379bc72557'} Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.859959 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5a0732e-24ed-460e-86ce-03379bc72557 to delete Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.861002 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5a0732e-24ed-460e-86ce-03379bc72557 could not be found. Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.862924 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-482ec263-e5ac-4d9a-b51a-73aac2ecb9df tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-482ec263-e5ac-4d9a-b51a-73aac2ecb9df tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557" status: 404 len: 62 microversion: 2.1 time: 0.033163 Aug 30 16:09:53.866767 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 902/1633] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/images/f5a0732e-24ed-460e-86ce-03379bc72557 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:09:53.871058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.871897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.882541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.883254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.884067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.885074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.885583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.886142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.905524 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 HTTP/1.1 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:53.907285 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:53.909100 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '6ecdfd15-1ebd-4fbb-ae11-99ea22767c09'} Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:53.910389 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:53.911982 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:53.914051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:53.914051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6111816f-7887-49d9-915a-f9578b214d8e tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 404 len: 111 microversion: 2.1 time: 0.044855 Aug 30 16:09:53.914051 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 903/1634] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:53 2022] DELETE /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:53.917424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89b5b78-2cb8-4afc-848b-023f5fb86548", "tag": "0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:53.931390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.931884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.932321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.948940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] Creating event network-changed:0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc for instance a89b5b78-2cb8-4afc-848b-023f5fb86548 on n-h2-830883-28 Aug 30 16:09:53.959724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:53.965704 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9e942da0-f0d7-4428-a574-69337fff0a9c req-2f866eb3-bdfe-436a-ba94-6bf2c8c0f5ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041692 Aug 30 16:09:53.967030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 904/1635] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:53.974840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:53.976798 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29487ec4-0009-4276-82ae-bb1344bd27e1 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1700 microversion: 2.1 time: 0.539229 Aug 30 16:09:53.978520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:53.985858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.986613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.987274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.988135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:53.988900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:53.989484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:53.995556 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 732/1636] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1700 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:54.014341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:54.015778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] [instance: 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:54.024871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-911f52d8-7ab2-42e9-a6f2-63852f42cb56 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055491 Aug 30 16:09:54.025780 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 905/1637] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:54.039376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.040136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.047098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:54.048146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.048814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.050170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:54.116265 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] HTTP exception thrown: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Request method failure captured: Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 HTTP/1.1 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVAcGvmkhGJWNofmgEL9zeyjImapLTwgZUKONWO0e-bFIU2hkcUdGs8mV_Gf5IKJJLvvxb30bkPYOFxAAMs6QE6P37FCJqWdwo43ZK_Xz1IBb9qYvv-eqD5Cpzjcxi5zjVBTOqVilX5YfGUV3lidmcvGFO6u1HZuQJkhR0u1AJ3IM4 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:09:54.119367 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_78bfd0982cc744498d3791b8622590b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/78bfd0982cc744498d3791b8622590b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/78bfd0982cc744498d3791b8622590b7"}]}] Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesTestJSON-870393798 Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 78bfd0982cc744498d3791b8622590b7 Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesTestJSON-870393798 Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 51cc027d79fe4ae0b644e49473acbd71 Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesTestJSON-870393798-project Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:54.122987 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6ecdfd15-1ebd-4fbb-ae11-99ea22767c09'} Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:54.123961 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. Aug 30 16:09:54.126386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:09:54.131256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] Returning 404 to user: Instance 6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:54.133310 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4e6b948-e241-4f31-8f0e-d707ecdcf54b tempest-ImagesTestJSON-870393798 tempest-ImagesTestJSON-870393798-project] 10.222.0.47 "GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09" status: 404 len: 111 microversion: 2.1 time: 0.131450 Aug 30 16:09:54.136079 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 733/1638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:53 2022] GET /compute/v2.1/servers/6ecdfd15-1ebd-4fbb-ae11-99ea22767c09 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:54.437179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:54.438842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:54.451202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.457075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:54.458441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:54.465619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.471129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:54.474110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.474896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.476062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.476796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.477447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:54.478087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:54.482528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:54.483239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:54.483846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:55.241678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:55.255946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:55.266556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:55.267670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9820941e-d456-4acb-b0ca-25cf8f630967 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.836399 Aug 30 16:09:55.268561 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 906/1639] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:54 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:55.273184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:55.288358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:55.313917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:55.314466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:55.314920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:55.318116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:55.318634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:55.319069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:55.328733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:55.342106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfdb7bb0-9762-476e-91d2-5ff44ebcd9ad tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1312 microversion: 2.1 time: 0.888272 Aug 30 16:09:55.343105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 734/1640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:54 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1312 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:55.353072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:55.356486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:55.376717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:55.377732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:55.380201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:55.382238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:55.383017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:55.383714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:55.435281 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85506421-4e29-4ad3-b4b9-ce708ea78b08 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088187 Aug 30 16:09:55.436151 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 735/1641] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:55 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:55.476301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:55.479243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:55.489183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6f59ec4-d61d-4674-8d69-cdfddf7d1074 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1633 microversion: 2.1 time: 0.219338 Aug 30 16:09:55.502880 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 907/1642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:55 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1633 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:56.127010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1", "name": "network-vif-deleted", "tag": "3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:56.142805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.143436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.144022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.161012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] Creating event network-vif-deleted:3d6ed765-2aae-4baf-b1f0-4dc16a26b6d3 for instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 on n-h2-830883-28 Aug 30 16:09:56.190392 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b0a9a447-bcf7-4f32-9abd-71a19c7a52ed req-b9ba1df8-33cf-417b-a845-fb1e6dba3dad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056997 Aug 30 16:09:56.193032 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 736/1643] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:09:56.292511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:56.293142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:56.309592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.310276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.317896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.319426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.320029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.320603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.368183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:56.369306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:56.392422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.394767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.396539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.400749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.402882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.405140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.648046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:56.664644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:56.670659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:56.672577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86b58551-1dce-4e3a-8392-60587d50a228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.384436 Aug 30 16:09:56.675343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 908/1644] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:56 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:09:56.701730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:56.706937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:56.717437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.717870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.718334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.719048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.719690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.720295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.756216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88eda6c4-4586-411c-b340-594f77aed70c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062437 Aug 30 16:09:56.757751 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 909/1645] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:56 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:56.766263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:56.767774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:56.775884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.776795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.778093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.779033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.779873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.780486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.899633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:56.900410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:56.908651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:56.909503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lazy-loading 'fault' on Instance uuid f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:09:56.981435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c3b967a4cd840179929ed0bdf2ccc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424770733741472b8fc0208b6fc63d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:56.996251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d59d1ab0-f0c7-421a-8b51-5e4d1727ba01 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 200 len: 1359 microversion: 2.1 time: 0.234172 Aug 30 16:09:57.010854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 910/1646] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:56 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:57.594339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.646260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.702934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:57.705906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:57.719989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.722989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.723438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:57.724380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.727872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:57.728767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.729423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:57.748005 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0002588b-a50d-465e-99be-a8d39a1db5eb tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1462 microversion: 2.1 time: 1.385439 Aug 30 16:09:57.749155 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 737/1647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:56 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1462 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:09:57.768974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:57.771181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:57.777637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.778475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.779097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:57.779974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.780591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.781175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:57.814369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f12fa75a-2e9a-4365-93d5-ac2f20af080f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049264 Aug 30 16:09:57.815495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 738/1648] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:57 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:09:57.821220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:57.822399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:57.830105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:57.831751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.832255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.832687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:57.833390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:57.833889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:57.834556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.055038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:58.064534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:58.066103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:58.068645 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5923973-729c-400b-8303-abdc47424424 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.370789 Aug 30 16:09:58.092538 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 911/1649] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:57 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:09:58.097942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:58.098858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] [instance: f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:58.110151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:58.111084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:58.111722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.112440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:58.113072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:58.113677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.132694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] HTTP exception thrown: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Request method failure captured: Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 HTTP/1.1 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjXbtQ1IuxUXNRNsIRZgxnftczl4xcsa7fO9GsDpmMT32z4jNJsapXP4l3cXSulsQhKzxNji3RdUbr-HZpMQwNzPTLDRGB3Db3dCKN-Y-ORCgLFgTsBmzSxZCVqm77EXKUQLEUFG9_9VyMd_vgdwg68KF2dS6d--3bxbqNpftHNY7rM Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 424770733741472b8fc0208b6fc63d56 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-245900092 Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:09:58.134595 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/424770733741472b8fc0208b6fc63d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_424770733741472b8fc0208b6fc63d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/424770733741472b8fc0208b6fc63d56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/424770733741472b8fc0208b6fc63d56"}]}] Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-245900092 Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 424770733741472b8fc0208b6fc63d56 Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-245900092 Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-245900092-project Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3c3b967a4cd840179929ed0bdf2ccc8f Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-245900092-project Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. Aug 30 16:09:58.137295 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1'} Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:58.138524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. Aug 30 16:09:58.140269 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:09:58.144722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Returning 404 to user: Instance f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:58.145875 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7b653bb-bfdd-4ec0-9e97-2745132a07c7 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1" status: 404 len: 111 microversion: 2.1 time: 0.052058 Aug 30 16:09:58.146955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 912/1650] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:58 2022] GET /compute/v2.1/servers/f0e33d31-11ec-4e47-83a9-11ccb9c0c6c1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:58.157844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35914f87-9030-4749-be7a-8460c0a2fce8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] Calling method '.version_select at 0x7fd360f563a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:58.196211 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35914f87-9030-4749-be7a-8460c0a2fce8 tempest-ServersTestJSON-245900092 tempest-ServersTestJSON-245900092-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096245663" status: 202 len: 0 microversion: 2.1 time: 0.044984 Aug 30 16:09:58.200910 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 913/1651] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096245663 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:09:58.251703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d099e350-f039-4f9c-bc02-ca37ebe42d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "5c85db8f-e596-48fe-a929-7968141fd055"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:58.267442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:58.267931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:58.268364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.281765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] Creating event network-vif-unplugged:5c85db8f-e596-48fe-a929-7968141fd055 for instance d099e350-f039-4f9c-bc02-ca37ebe42d0d on n-h2-830883-28 Aug 30 16:09:58.288678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-354c3946-3ffc-4476-9c3b-be4ef727d3ef req-5706edaf-9515-4df3-86cc-3d950be40377 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041018 Aug 30 16:09:58.290658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 914/1652] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:58.460304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4cf3affe-9649-465f-9324-6e00c02e532a tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1615 microversion: 2.1 time: 0.642370 Aug 30 16:09:58.484291 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 739/1653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:57 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1615 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:58.522954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:58.523671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:58.540245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:58.540748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:58.541571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.543468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:58.544039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:58.545434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:58.643288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0311c8b6b57f42a49ede546f73115c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bacc7c5c86a642c29515e888fdf7ffd4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:58.644185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] flavor_id is None. Assuming migration. {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4206}} Aug 30 16:09:58.644807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:09:59.100850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:59.102199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:59.123516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:59.124769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:59.132259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:59.133377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:59.134689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:59.135267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:59.385195 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-554357a7-6b34-4bb4-a119-48e1574c1e06 tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374/action" status: 202 len: 0 microversion: 2.1 time: 0.877242 Aug 30 16:09:59.395191 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 915/1654] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:09:58 2022] POST /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:09:59.404911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:59.405970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:59.420981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:59.422098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:59.422798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:59.423807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:59.424600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:59.425227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:59.712923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:59.725335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:59.729066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67862d41-2b4d-402e-856b-320c4cd24d95 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1471 microversion: 2.1 time: 0.330501 Aug 30 16:09:59.732067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 916/1655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:59 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:59.744792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:59.744792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:59.744792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e52e57ee-eeaa-4b48-b824-7849fcfc27b0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.645470 Aug 30 16:09:59.748918 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 740/1656] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:09:59 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:00.359814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d099e350-f039-4f9c-bc02-ca37ebe42d0d", "tag": "5c85db8f-e596-48fe-a929-7968141fd055"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:00.383046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:00.390821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:00.392631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:00.444806 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] Creating event network-changed:5c85db8f-e596-48fe-a929-7968141fd055 for instance d099e350-f039-4f9c-bc02-ca37ebe42d0d on n-h2-830883-28 Aug 30 16:10:00.474557 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-11dd24d3-9103-4e25-948a-a5f10e7504c8 req-73a5a0db-3a36-4545-868a-fe6b10667faf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117099 Aug 30 16:10:00.485775 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 741/1657] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:00.758448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:00.759773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:00.768844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:00.769821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:00.794949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:00.795444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:00.803109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:00.803615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:00.804056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:00.804768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:00.806389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:00.811469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:00.813562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:00.814079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:00.814732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:00.815360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:01.543789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:01.572981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae07efb6-04fa-42fe-8a94-19319dd6c534 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1471 microversion: 2.1 time: 0.819701 Aug 30 16:10:01.574190 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 917/1658] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:00 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1471 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:01.797235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:01.815087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:01.819870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:01.822805 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4deb30bb-f28a-44f2-9ff7-d0be1edb286c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 1.059243 Aug 30 16:10:01.823341 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 742/1659] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:00 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:02.597407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:02.598450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:02.617374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:02.624862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:02.625685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:02.626997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:02.627642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:02.629833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:02.851354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:02.852008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:02.860947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:02.861441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:02.861885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:02.862631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:02.863088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:02.863515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:03.078590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:03.092288 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2b5ec25-8493-485c-bcbc-69955b948245 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1471 microversion: 2.1 time: 0.500180 Aug 30 16:10:03.093723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 918/1660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:02 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1471 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:03.379881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:03.399239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:03.400781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:03.403567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a3f75a4a-7d36-4109-9fb9-7d640a0abe24 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.556909 Aug 30 16:10:03.404162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 743/1661] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:02 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:04.121671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:04.122398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:04.129346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:04.129835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:04.130275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:04.135126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:04.136714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:04.138089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:04.427870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:04.428486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:04.440585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:04.443924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:04.444670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:04.445931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:04.449578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:04.457524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:04.458626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:04.477180 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3501b30-dead-4a78-bf58-5b36111516af tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.361457 Aug 30 16:10:04.487425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 919/1662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:04 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:04.802784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:04.816438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:04.817950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:04.820867 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28c7186c-61f0-4671-a783-9f99f4809805 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.397470 Aug 30 16:10:04.821709 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 744/1663] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:04 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:05.512450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:05.513774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:05.534338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:05.537865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:05.539032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:05.540045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:05.546055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:05.557073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:05.860946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:05.862737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:05.878318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:05.879165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:05.880427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:05.881479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:05.886958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:05.888284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:06.018647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:06.039717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2ce4e8b-c502-4d48-bd47-6be946a35b42 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.533752 Aug 30 16:10:06.043510 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 920/1664] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:05 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:06.224251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:06.241781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:06.249381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:06.251292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78e321d3-621c-4da1-8e7e-b7f7226c645a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1568 microversion: 2.25 time: 0.403880 Aug 30 16:10:06.267446 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 745/1665] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:05 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1568 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:07.063526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:07.064452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:07.076803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.078669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.079294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.080205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.080835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.081445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.283461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:07.284265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:07.298582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.299338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.300245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.301496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.302240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.302909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.485986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:07.496196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:07.511183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:07.512919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e98ae14-b9b9-4641-aca7-9e3cac366f71 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1558 microversion: 2.25 time: 0.239915 Aug 30 16:10:07.513792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 746/1666] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:07 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:07.537015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-009c9e9f-7886-4ecb-999d-ed9d59e11624 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '.version_select at 0x7fd35d2f9160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:07.542004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-009c9e9f-7886-4ecb-999d-ed9d59e11624 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.544251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-009c9e9f-7886-4ecb-999d-ed9d59e11624 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.545506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-009c9e9f-7886-4ecb-999d-ed9d59e11624 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.565715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-009c9e9f-7886-4ecb-999d-ed9d59e11624 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 3661 microversion: 2.25 time: 0.032687 Aug 30 16:10:07.579347 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 747/1667] 10.222.0.47 () {60 vars in 1184 bytes} [Tue Aug 30 16:10:07 2022] GET /compute/v2.1/os-migrations => generated 3661 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:07.584545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:07.585177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:07.592593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.593086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.593791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.598746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:07.599497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:07.600223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:07.692101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:07.707856 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5186272-8957-4df9-8618-edcd2d94f9e9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.648066 Aug 30 16:10:07.722968 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 921/1668] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:07 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:07.795619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid d099e350-f039-4f9c-bc02-ca37ebe42d0d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:07.827239 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-efd3276e-3526-4b57-ab05-c9e611a92d35 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 2052 microversion: 2.25 time: 0.246253 Aug 30 16:10:07.844094 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 748/1669] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:07 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 2052 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:08.145025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1986871184", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "13ae43f5-f65e-41d3-a1c8-61637c2e23b1"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:08.278544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] validate_networks() for [('13ae43f5-f65e-41d3-a1c8-61637c2e23b1', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:08.625818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Calling method '.version_select at 0x7fd35ccc8700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:08.654643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:08.656295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:08.658239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:08.659183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:08.659663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:08.660114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:08.725269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d2cfa76b-1c78-4807-be15-264ad56864f8 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] 10.222.0.47 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.355657 Aug 30 16:10:08.726164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 749/1670] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 16:10:08 2022] GET /compute/v2.1/limits => generated 511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:08.737397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:08.738284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:08.763434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:08.764384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:08.764996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:08.766001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:08.767179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:08.768236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:08.813863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:09.485290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:09.498997 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0e81e698-379d-44b3-b4fb-e2d0fc8bcce9 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.765586 Aug 30 16:10:09.504568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 750/1671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:08 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:09.513110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2115312702", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:09.613660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:09.685794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:09.686261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:09.686583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:09.687181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:09.687754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:09.697985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:09.699018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:09.699701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:09.700659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:09.701317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:09.701926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:09.723709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:09.730566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for user 81b24fcdb0a749caa02a34817e8fe9f8 and project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:09.744512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:09.748457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:09.828291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cea1b2ff-bb11-4e8d-a679-6b36fa221776 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.688617 Aug 30 16:10:09.832983 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 922/1672] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:10:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:10:09.846251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:09.848820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:09.971934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:09.987079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:09.991117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:09.992517 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-92090687-edab-4d11-ba26-b437b62d67eb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1262 microversion: 2.25 time: 0.155816 Aug 30 16:10:09.998839 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 923/1673] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:09 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:10.212096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Getting quotas for project efb81e0d17ef4b60887c5b1dc4d11b4d. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:10.222882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Getting quotas for user fba67f82a465489cae4c41705195263d and project efb81e0d17ef4b60887c5b1dc4d11b4d. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:10.247957 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Request method failure captured: Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 1752 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjZgDc_HsoGy0id3JuOsh2Pxl_NfXyVG77FK_1tgNrzROkqwb8lmjwZ0dBgvzhE4C8AWLgRvKV8AoH9Vztty-9J1uU73Q45NAClU0bnMequNEdzo021GpGmijFLU_Xw0lnummBH8jA2g1Uuef0TRDXFKPVGP2XUyltKNxjEmz0sn25E Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: efb81e0d17ef4b60887c5b1dc4d11b4d Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-677125467 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/efb81e0d17ef4b60887c5b1dc4d11b4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_efb81e0d17ef4b60887c5b1dc4d11b4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/efb81e0d17ef4b60887c5b1dc4d11b4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/efb81e0d17ef4b60887c5b1dc4d11b4d"}]}] Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-677125467 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: efb81e0d17ef4b60887c5b1dc4d11b4d Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-677125467 Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-677125467-project Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: fba67f82a465489cae4c41705195263d Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-677125467-project Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2115312702", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:10:10.395152 n-d-830883-28 devstack@n-api.service[122351]: exception: Maximum number of metadata items exceeds 128 Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2115312702', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:10:10.397811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-387d8762-1420-4b60-a96e-846be198cd05 tempest-AbsoluteLimitsNegativeTestJSON-677125467 tempest-AbsoluteLimitsNegativeTestJSON-677125467-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.891153 Aug 30 16:10:10.403964 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 751/1674] 10.222.0.47 () {60 vars in 1148 bytes} [Tue Aug 30 16:10:09 2022] POST /compute/v2.1/servers => generated 87 bytes in 895 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:10:10.525561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:10.527078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:10.553994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:10.561281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:10.561778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:10.575733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:10.576264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:10.576710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:11.024502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:11.025668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:11.038966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:11.041424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:11.042379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:11.043788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:11.049649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:11.050544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:11.161517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:11.176615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:11.178772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:11.180766 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db8fd43f-1ef6-42aa-9cb9-caa574e1180c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1258 microversion: 2.25 time: 0.162247 Aug 30 16:10:11.181930 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 752/1675] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:11 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:11.387434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:11.397571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a374fe2-cbe7-46cc-bdba-877509ef8cbd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.875778 Aug 30 16:10:11.403040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 924/1676] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:10 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:12.210215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:12.211459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:12.232451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:12.232948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:12.233386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:12.241237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:12.241866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:12.242788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:12.421640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:12.423328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:12.445475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:12.446378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:12.473513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:12.474311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:12.475048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:12.475494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:12.604124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:12.623263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:12.624823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:12.629974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f40f539-eb70-4eeb-8e75-ef645401d743 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1314 microversion: 2.25 time: 0.421371 Aug 30 16:10:12.633170 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 753/1677] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:12 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:13.069807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:13.082558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3a1a900-b4bf-40b9-978b-4aaf3c4f7e38 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.666761 Aug 30 16:10:13.111073 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 925/1678] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:12 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:13.650264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1475863068", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "eaa7c7ee-5e45-4bb6-a1f2-160709fd5645"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:13.656194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:13.657578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:13.665694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:13.666220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:13.666745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:13.667894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:13.668796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:13.670840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:13.705743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:13.743649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] validate_networks() for [('eaa7c7ee-5e45-4bb6-a1f2-160709fd5645', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:13.779070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:13.788244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:13.795077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:13.797512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac37ebec-1274-421f-a983-53112a2ee8f4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1320 microversion: 2.25 time: 0.145998 Aug 30 16:10:13.799039 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 926/1679] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:13 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:14.108231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:14.109825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:14.124434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:14.125332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:14.125896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:14.127075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:14.127812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:14.128509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:14.502445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:14.518099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0559d5f2-b148-4028-937c-80b73f567328 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.413767 Aug 30 16:10:14.520516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 927/1680] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:14 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:14.822715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:14.823581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:14.842160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:14.842701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:14.843415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:14.844139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:14.844595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:14.845033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:14.986713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:14.987793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:14.988435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:14.989076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:14.989849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:15.005469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:15.005964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:15.006438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:15.008950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:15.009363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:15.009791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:15.054033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Getting quotas for project a89e76490a1b41d3afc8c91868c9db21. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:15.064088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Getting quotas for user ccbd7bb33734440aa3b4a81f5cfdf653 and project a89e76490a1b41d3afc8c91868c9db21. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:15.105326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:15.112296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:15.233926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-755e5a92-6aa7-4960-9d89-c6b1c1f0c0f2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780543 Aug 30 16:10:15.235311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 754/1681] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:10:15.247426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf4313b6-25d6-402d-b95e-11cf9c11fd35 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:15.248434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf4313b6-25d6-402d-b95e-11cf9c11fd35 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:15.451947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf4313b6-25d6-402d-b95e-11cf9c11fd35 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:15.465270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf4313b6-25d6-402d-b95e-11cf9c11fd35 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1225 microversion: 2.1 time: 0.223216 Aug 30 16:10:15.480447 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 755/1682] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:15 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1225 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:15.543081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:15.543907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:15.555802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:15.556891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:15.560385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:15.562132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:15.563987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:15.565309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:15.774884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:15.805003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:15.811654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:15.813629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3bad08f5-b038-481c-b579-079baa710cd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.995488 Aug 30 16:10:15.827420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 928/1683] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:14 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:15.930224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:15.942196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a34c25a-cc81-4bf2-bfb6-4bf5dc382f05 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.403742 Aug 30 16:10:15.943410 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 756/1684] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:15 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:16.167326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:16.196340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.196834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.197279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.237970 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] Creating event network-changed:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h1-830883-28 Aug 30 16:10:16.245557 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e766db21-1c82-42ef-a45d-ae328ff19b4d req-f7c1ac21-584e-43a1-be1a-0072e2e6d94c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086922 Aug 30 16:10:16.246959 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 929/1685] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:16.487228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:16.489066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:16.503538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.505564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.507039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.508479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.509761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.512117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.693416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:16.711340 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-586a6155-db7a-4d2c-94bd-cc4fc3100015 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1221 microversion: 2.1 time: 0.225400 Aug 30 16:10:16.713038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 757/1686] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:16 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1221 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:16.846404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:16.847501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:16.868747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.871102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.872645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.873430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.875210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.875675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.965904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:16.966721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:16.976390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.981794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.984358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:16.988444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:16.989363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:16.991334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:17.174211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:17.220122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:17.238131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:17.248070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1520830-cff6-43ec-b82e-f6f7a2a9a7e5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.406420 Aug 30 16:10:17.249278 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 930/1687] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:16 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:17.735885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:17.737997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:17.753587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:17.763494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:17.764730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:17.766244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:17.771049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:17.772073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:17.773196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:17.935838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:17.950659 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36aa0d57-6596-405b-a9d0-80c3266ebeca tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1283 microversion: 2.1 time: 0.219252 Aug 30 16:10:17.976216 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 931/1688] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:17 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1283 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:18.093381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:18.117421 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a0fd366-8e10-43d0-8c31-ee23305fcf89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 1.156702 Aug 30 16:10:18.128985 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 758/1689] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:16 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:18.276228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:18.277357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:18.299531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:18.303365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:18.304388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:18.308057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:18.316666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:18.317477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:18.684156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:18.701671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:18.703159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:18.704307 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c56144a8-3799-497c-bb08-c8bd9a1da285 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.434467 Aug 30 16:10:18.714863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 932/1690] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:18 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:18.985155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:18.985792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:19.000037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.003643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.004324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.008429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.009139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.009777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.145108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:19.145842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:19.162740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.173207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.174056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.175108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.177076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.178461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.248612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:19.257290 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e55f56d5-ee1c-4e6a-8659-8eb831da4170 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1283 microversion: 2.1 time: 0.277440 Aug 30 16:10:19.263738 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 759/1691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:18 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1283 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:19.712936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:19.732090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:19.732714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:19.739979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.740485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.740937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.741651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:19.742114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:19.742681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:19.824971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:19.840528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ccd3ec7f-e8c7-4246-83b3-0464c63b3b46 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.698123 Aug 30 16:10:19.843627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 933/1692] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:19 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:20.280866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:20.281482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:20.295747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:20.300764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:20.301267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:20.301714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:20.321281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:20.321928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:20.324781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:20.508337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:20.518843 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08983313-721a-4947-b6af-9d7e8f35ae58 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1283 microversion: 2.1 time: 0.243533 Aug 30 16:10:20.522845 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 934/1693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:20 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:20.868482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:20.869113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:20.884574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:20.885077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:20.885593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:20.906522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:20.907475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:20.908091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:20.927129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:20.944606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:20.951349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:20.952898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f133114-3fbc-489c-b632-194a89d2bec9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 1.225446 Aug 30 16:10:20.970868 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 760/1694] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:19 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:21.493847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:21.513225 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2da40c52-6564-4df5-9f0f-875afca2b4fe tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.648941 Aug 30 16:10:21.522568 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 935/1695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:20 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:21.539474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:21.540267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:21.549528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:21.553563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:21.554343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:21.555337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:21.563478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:21.564186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:21.986945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:21.987722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:22.031696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:22.032513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:22.038188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:22.039735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:22.041215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:22.043697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:22.531240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:22.531841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:22.548096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:22.549565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:22.550763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-319cd8d7-bfd0-490c-ba7a-81ed32284adc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.568888 Aug 30 16:10:22.551330 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 936/1696] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:21 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:22.566209 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3daef780-9837-4ef8-a370-104a0559ecf2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 1.019474 Aug 30 16:10:22.572287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:22.572804 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 761/1697] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:21 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:22.573494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:22.580543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:22.581329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:22.581943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:22.582877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:22.583513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:22.584112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:22.959743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:22.969165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5199c286-dd30-4e26-9582-9c1ea666c6dc tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.401009 Aug 30 16:10:22.970130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 937/1698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:22 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:23.573822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:23.575357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:23.591009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:23.591817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:23.592439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:23.593344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:23.599444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-450148734", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4de14652-45ba-4b70-ad9d-f6ca0b39ea5e"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:23.617805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:23.619000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:23.709631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] validate_networks() for [('4de14652-45ba-4b70-ad9d-f6ca0b39ea5e', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:23.948113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:23.960354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:23.969429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:23.970987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd491a3b-40bb-40e4-a52d-6072549f527c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.401928 Aug 30 16:10:23.974672 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 938/1699] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:23 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:23.986675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:24.003020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:24.009635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:24.010783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:24.011243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:24.011969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:24.012434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:24.012865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:24.455863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:24.479827 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8caeebc0-1a1f-44f2-9a1c-31730dd3c7da tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.503196 Aug 30 16:10:24.486410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 939/1700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:23 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:24.495617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7", "tag": "c47c55d3-cc34-4631-a187-8fa8293358e5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:24.517134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:24.517620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:24.518062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:24.531826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] Creating event network-changed:c47c55d3-cc34-4631-a187-8fa8293358e5 for instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 on n-h2-830883-28 Aug 30 16:10:24.558803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c39726c3-ed7a-4846-8d6e-283490d3d17f req-55949e50-ff52-4b73-85f8-c56d9410b1a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076557 Aug 30 16:10:24.560218 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 940/1701] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:24.568967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:24.577920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:24.590644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:24.593695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:24.594340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:24.595273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:24.595899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:24.596493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.024885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:25.332639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:25.333064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:25.333534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:25.333941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:25.334395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:25.352728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.353178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.353614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.354430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.354890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.355319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.405146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Getting quotas for project 14d2a1fc6c9a4fcbad99a89e45ef3947. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:25.411013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Getting quotas for user 47167989fb3e4cca9938f3ddf0f8b221 and project 14d2a1fc6c9a4fcbad99a89e45ef3947. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:25.423500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:25.439191 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f82e648-44b1-4a36-af87-bcdf7378584f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.877541 Aug 30 16:10:25.445488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:25.452791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:25.457790 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 941/1702] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:24 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:25.467240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:25.468176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:25.487247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.488985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.489707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.490794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.491553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.492295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.564857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0653306b-ac44-47b9-8871-5f8210655b46 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207865 Aug 30 16:10:25.565535 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 762/1703] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:10:25.581509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "name": "network-vif-plugged", "status": "completed", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:25.597358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.598166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.599900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.643000 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] Creating event network-vif-plugged:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h1-830883-28 Aug 30 16:10:25.653462 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-24cf423b-6b42-4690-807d-d9e23062cbc3 req-d933c3bc-6c7e-4efe-aff5-9324f5a06f4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084192 Aug 30 16:10:25.654099 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 763/1704] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:25.661572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:25.662502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:25.670651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.671148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.671856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.672829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.673293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.673725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:26.001007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.011703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.013165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.018860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-426983b9-7899-4ca4-bdd7-ec350e4141bd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.554991 Aug 30 16:10:26.020225 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 942/1705] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:25 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:26.030063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c840966f-5095-4d03-808d-e5cc7da11b63 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:26.031675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c840966f-5095-4d03-808d-e5cc7da11b63 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:26.120092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c840966f-5095-4d03-808d-e5cc7da11b63 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.130901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c840966f-5095-4d03-808d-e5cc7da11b63 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1216 microversion: 2.1 time: 0.107671 Aug 30 16:10:26.132106 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 943/1706] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:26 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:26.228983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.245375 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b9c3e87-9582-472e-b321-5c018b39ba11 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.589432 Aug 30 16:10:26.258752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 764/1707] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:25 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:26.460998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:26.461995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:26.472331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:26.474679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:26.476102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:26.477386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:26.481878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:26.482657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:26.811643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:26.820926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a30bcd99-965b-4059-b75a-13980143fd78 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.363441 Aug 30 16:10:26.821523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 944/1708] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:26 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:27.062697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:27.064874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:27.105797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.107179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.109923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.112048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.115548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.116019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.158626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:27.159317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:27.173057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.173562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.174020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.180508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.181016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.188365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.280657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:27.401959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:27.410292 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05135b1f-4304-4f85-a46b-671a6e2f2750 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1212 microversion: 2.1 time: 0.261928 Aug 30 16:10:27.421210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 945/1709] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:27 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1212 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:27.451744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:27.455649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:27.468842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.474918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.475649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.484826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.485822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.486527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.570209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:27.607276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:27.609193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:27.610474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f88ba9b-56bc-450b-93ad-6286f85e54fc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1362 microversion: 2.25 time: 0.567778 Aug 30 16:10:27.623988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 765/1710] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:27 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1362 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:27.821325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:27.843294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:27.846821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-637c7d24-ee64-4419-82e0-5b415171780a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.423730 Aug 30 16:10:27.848818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:27.849152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 946/1711] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:27 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:27.873518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:27.877217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.878252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.882449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.883551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:27.884328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:27.885549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.199306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2645045-bb6f-4b7b-87ef-dbf3f76719e2 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Action: 'create', calling method: .version_select at 0x7fd35cdf6a60>, body: {"keypair": {"name": "tempest-keypair-339675483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvE7ZZTibMNhT1vLwAzgYSlOWWgJgcH+nrZdHJYdoNTq6tAgxkALc6lVPTpUJsRT0JSAKmlcvqD0CE1VwB+x3Mf7sj5R0UNz2YogJpBm9ttBDhhat6DP2blNS6NS+qyzg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:28.233831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d2645045-bb6f-4b7b-87ef-dbf3f76719e2 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Getting quotas for project f39724a7b0b54a2eb35417dcfef2f4f2. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:28.240332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:28.244089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d2645045-bb6f-4b7b-87ef-dbf3f76719e2 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Getting quotas for user e48fab0861464f0e8642d023b410bf5e and project f39724a7b0b54a2eb35417dcfef2f4f2. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:28.249215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b278cc6-11b3-4e92-94dc-608330394bb0 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.410819 Aug 30 16:10:28.270968 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 766/1712] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:27 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:28.282883 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2645045-bb6f-4b7b-87ef-dbf3f76719e2 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.242198 Aug 30 16:10:28.284071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 947/1713] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:10:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:10:28.434791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:28.435933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:28.476023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.477556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.483861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.486593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.487395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.489782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.637514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:28.638426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:28.683140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.683912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.686708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.689175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.691032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.691615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.758190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:28.789067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-639a63f4-cc73-449d-ac4a-1022d24b8442 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1268 microversion: 2.1 time: 0.361178 Aug 30 16:10:28.796542 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 767/1714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:28 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1268 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:28.870465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:28.871197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:28.882550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.885110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.885589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:28.886380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:28.886847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:28.887968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.065816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:29.081146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:29.084463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:29.089168 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d472de48-f21a-45c1-aa1e-de70f6bb0951 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1558 microversion: 2.25 time: 0.456865 Aug 30 16:10:29.090709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 948/1715] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:28 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:29.118424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:29.120271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:29.137009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.137536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.143673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.145750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.146500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.146967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.170560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:29.178941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8760b611-7908-4efd-8f71-701a6744b82a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.313429 Aug 30 16:10:29.196771 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 768/1716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:28 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:29.276878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:29.277645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:29.289075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.290069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.290880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.292989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.295143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.295936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.587381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:29.589711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:29.598124 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4722374f-c999-43e2-b99b-733169a66287 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.328319 Aug 30 16:10:29.598882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 769/1717] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:29 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:29.662926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6c8f593-ba8a-443f-98c3-63f348c487df tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 2053 microversion: 2.25 time: 0.550302 Aug 30 16:10:29.663978 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 949/1718] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:29 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 2053 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:29.687467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:29.689102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:29.698002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.701055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.702864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.703928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.705753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.707493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.821910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:29.822638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:29.845357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.847850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.849149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:29.850610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:29.851827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:29.851827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.022359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:30.026621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:30.026802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:30.035074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67a263ae-80b8-4dab-93ab-191d1181afbf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1274 microversion: 2.1 time: 0.219945 Aug 30 16:10:30.037605 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 950/1719] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:29 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:30.040099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b83883a-69e3-4dae-b9d9-d02ff58d4c25 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 2053 microversion: 2.25 time: 0.358224 Aug 30 16:10:30.041591 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 770/1720] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:29 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 2053 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:30.064703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:30.068931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.069681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.070389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.071614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.072382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.073585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.100465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3afd4822-8bd8-4733-8faa-50d38420bb98 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039439 Aug 30 16:10:30.101132 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 951/1721] 10.222.0.47 () {60 vars in 1217 bytes} [Tue Aug 30 16:10:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:10:30.113503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:30.114488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:30.124896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.125578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.126191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.127094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.127580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.128038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.208298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:30.209726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:30.218423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.219117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.219817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.221109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.221762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.222844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14bfa0d4-ce2d-4282-ae33-bd1566131144 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060/action" status: 202 len: 0 microversion: 2.25 time: 0.113221 Aug 30 16:10:30.223069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.226557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 771/1722] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:10:30 2022] POST /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:30.233130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:30.233886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:30.240484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.242212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.243058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.244013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.244942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.245570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.471908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:30.481095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-186502f7-fc6d-4b04-ae59-67d45c4150b2 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.278013 Aug 30 16:10:30.497115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:30.500734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 952/1723] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:30 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:30.528326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a21b20f-dfa2-43ac-9748-805f2c58156c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 2058 microversion: 2.25 time: 0.300416 Aug 30 16:10:30.539499 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 772/1724] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:30 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 2058 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:30.620092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:30.621467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:30.629659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.630479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.631719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.632607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:30.633236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:30.633832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:30.741745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "6f9c8ed4-aee7-4a9d-b910-cd466e0da566"}], "security_groups": [{"name": "tempest-securitygroup--194221208"}], "key_name": "tempest-keypair-339675483", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:30.836106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:30.847957 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2db2771-8ca6-4922-956f-e82742c3deb5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1476 microversion: 2.1 time: 0.232270 Aug 30 16:10:30.849543 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 953/1725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:30 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:30.917716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-83519928", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4e9da5ca-14d4-482f-90c9-bfeef67ee437"}], "block_device_mapping_v2": [{"uuid": "9f0b0e35-6213-42f0-beba-70c54fa204f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:30.939410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] validate_networks() for [('6f9c8ed4-aee7-4a9d-b910-cd466e0da566', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:31.030586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] validate_networks() for [('4e9da5ca-14d4-482f-90c9-bfeef67ee437', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:31.675106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:31.675645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:31.675933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:31.676536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:31.677173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:31.703024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:31.705031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:31.710511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:31.711905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:31.712775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:31.714450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:31.741974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:31.751155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Getting quotas for user 43d55a1e4a9f4f2b9cb85e010154f284 and project 6505a4e8b8e24a71abd1559dfeb05e2a. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:31.768051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:31.768638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:31.769408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:31.770154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:31.770832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:31.795258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:31.797108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:31.797779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:31.798766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:31.802432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:31.803106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:31.837494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:31.840170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f0b0e35-6213-42f0-beba-70c54fa204f1',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:31.849669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Getting quotas for project f39724a7b0b54a2eb35417dcfef2f4f2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:31.863366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Getting quotas for user e48fab0861464f0e8642d023b410bf5e and project f39724a7b0b54a2eb35417dcfef2f4f2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:31.894954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:31.899766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:31.977367 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-587cd179-710c-4161-bac7-b4d7c092169e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.243985 Aug 30 16:10:31.985055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 773/1726] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:10:31.991094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:31.991964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.003719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.004500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.005345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.006531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.007166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.007768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.111705 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4b6814a-d28d-4fe0-b10d-bd95307fabab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198501 Aug 30 16:10:32.115511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 954/1727] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:10:32.131248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.132586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.155586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.158912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.159483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.160630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.162684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.163316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.339455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:32.349944 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc994be4-aadd-48fd-8221-6e1d301dac69 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.362936 Aug 30 16:10:32.351101 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 774/1728] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:31 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:32.357037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4d5226-9a5a-42c7-b382-437063dca39e", "tag": "29c406b4-b424-4bc0-acb4-17ccea246631"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:32.371688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.372467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.374225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.389062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] Creating event network-changed:29c406b4-b424-4bc0-acb4-17ccea246631 for instance dd4d5226-9a5a-42c7-b382-437063dca39e on n-h1-830883-28 Aug 30 16:10:32.394808 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f6b2380e-44a8-4b4f-aba2-a4b0b27b1a69 req-c298a851-1f2d-4ae1-b7ce-81fbb48cacc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042349 Aug 30 16:10:32.398598 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 775/1729] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:32.404259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.405065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.412242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.412742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.413226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.414654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.415013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.415522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.623142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:32.639985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6018db11-1fbc-4911-8d83-d948e15d5e1d tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 2038 microversion: 2.25 time: 0.239928 Aug 30 16:10:32.641002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 776/1730] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 2038 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:32.655483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:32.656935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.658134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.665451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.666329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.667126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.668396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.669266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.669954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.671120 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-abc8332b-ac25-4a99-ba6c-005aaba0b437 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.549006 Aug 30 16:10:32.671951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 955/1731] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:32.690050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8cbfcb21-f10e-4926-a3cd-83946f8f3704 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.690804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8cbfcb21-f10e-4926-a3cd-83946f8f3704 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.876995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:32.889041 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-490d07b4-0c78-4f20-a651-f36ab93082d8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1475 microversion: 2.1 time: 0.246658 Aug 30 16:10:32.890271 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 777/1732] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:32.896284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:32.897375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:32.905312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.910453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.911271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.915421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:32.916708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:32.917394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:32.927403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8cbfcb21-f10e-4926-a3cd-83946f8f3704 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:32.935497 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8cbfcb21-f10e-4926-a3cd-83946f8f3704 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1225 microversion: 2.1 time: 0.259267 Aug 30 16:10:32.940078 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 956/1733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1225 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:33.031682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:33.037818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "name": "network-vif-unplugged", "status": "completed", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:33.043831 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-324255e5-5fa5-4bd4-8826-88d579ea7207 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1101 microversion: 2.1 time: 0.151905 Aug 30 16:10:33.044665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 778/1734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:32 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1101 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:33.052299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-830883-28", "block_migration": "auto"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:33.053343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.053892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.054703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.071060 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Creating event network-vif-unplugged:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h1-830883-28 Aug 30 16:10:33.071356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:33.079847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:10:33.080437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.081175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.083491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.086186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.086404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.090124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.102081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9a8c3655-6840-4413-9d59-418cf5d6e8dd req-a0f28f0d-3221-43e9-97ba-f5e88c111ea4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160556 Aug 30 16:10:33.103580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 957/1735] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:33.125279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'flavor' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:33.138716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Going to try to live migrate instance to n-h2-830883-28 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:10:33.177053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7", "name": "network-vif-plugged", "status": "completed", "tag": "c47c55d3-cc34-4631-a187-8fa8293358e5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:33.190084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.190724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.191240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.204474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] Creating event network-vif-plugged:c47c55d3-cc34-4631-a187-8fa8293358e5 for instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 on n-h2-830883-28 Aug 30 16:10:33.212284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ede287f5-1e30-4cc9-8f4d-1ca3c89f8516 req-931446a7-8b34-4f6d-845a-78e61f924b37 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039767 Aug 30 16:10:33.214622 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 958/1736] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:10:33.374116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:33.375327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:33.395153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.396529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.398520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.399772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:33.401823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:33.404859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:33.973048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:33.983531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ae65a95-42bc-4fe9-89ca-a30225fa5b5e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.615225 Aug 30 16:10:33.984152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 959/1737] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:33 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:33.992676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:33.993546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.024525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.025103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.025847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.028339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.029693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.030151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.308846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:34.319646 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b49bbe0-8587-40de-8cf3-a8b54a083288 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1325 microversion: 2.1 time: 0.334017 Aug 30 16:10:34.320162 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 960/1738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:33 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:34.325558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:34.326181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.332521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.333014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.333466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.334168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.334874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.335711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.513846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:34.526650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a93d1ec-ce2d-480b-902c-1ab5af06a26f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1475 microversion: 2.1 time: 0.204676 Aug 30 16:10:34.527947 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 961/1739] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:34.533835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:34.534962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.549057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.549688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.550247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.551645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.552756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.553728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.640504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:34.649852 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08920502-a068-4409-8a41-653fe7b30e60 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1277 microversion: 2.1 time: 0.120551 Aug 30 16:10:34.651488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 962/1740] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:34.656421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:34.657034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.663567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.664052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.664704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.665401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.665934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.666918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.737448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:34.746110 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8839513-85f6-4c98-a6b2-920110651031 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1149 microversion: 2.1 time: 0.093390 Aug 30 16:10:34.746737 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 963/1741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:35.004999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.005636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.012447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.012935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.013372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.014078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.014559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.014983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.182993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:35.190674 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-051fa172-ce29-44f9-a930-f7e334284aea tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.189658 Aug 30 16:10:35.191452 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 964/1742] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:35.196300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:35.215558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.219761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.220179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.234096 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Creating event network-changed:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h1-830883-28 Aug 30 16:10:35.240299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:10:35.252177 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-20f46dca-29af-4528-9f97-461ef524638a req-57c3fd4e-a170-475f-80a8-f8343213c5d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059507 Aug 30 16:10:35.252875 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 965/1743] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:35.341146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.341998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.345198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:35.349114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.349598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.350035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.350786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.351236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.351657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.367493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:35.493796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:35.503563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cd1f55c-04e4-41b0-8041-be845489bd2f tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1523 microversion: 2.1 time: 0.167060 Aug 30 16:10:35.504504 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 966/1744] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:35.532337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.532879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.552727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.553243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.553693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.556789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.557495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.558172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.596017 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] HTTP exception thrown: Action 999 not found Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Request method failure captured: Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7/os-instance-actions/999 HTTP/1.1 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjZlD2oagccxJlkoOlCh8PjR1iB_J8Zm2IqVPumG_wTwNs356x2xNL2JOYNUKDAHKB6LriGa-K149wRMT3s7teBharw9-sX6X-f635WBLpTOuSyo52IKyMpuW1Pg2QzqYmBw7LN1-awrtxNfHq4VAtAxe2xLiMzHL9rlWZ2lmXBx3vY Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}] Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ccbd7bb33734440aa3b4a81f5cfdf653 Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: exception: Action 999 not found Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': 'a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7', 'id': '999'} Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 30 16:10:35.600617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.604963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Returning 404 to user: Action 999 not found {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:35.604963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f377784-e918-426f-b19f-894e1e81c98e tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.073878 Aug 30 16:10:35.604963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 967/1745] 10.222.0.47 () {58 vars in 1308 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7/os-instance-actions/999 => generated 66 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:10:35.611770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.612500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.619124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.619827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.620486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.621276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.621748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.622184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.794503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:35.802929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3ffd4bf-3630-4408-94d6-409b27af4383 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1473 microversion: 2.1 time: 0.195058 Aug 30 16:10:35.803510 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 968/1746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:35.809188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '.version_select at 0x7fd35cd2c280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.809758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: 42fd45a9-c8e4-44c9-897a-cb4b0e205787] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.815332 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] HTTP exception thrown: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Request method failure captured: Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/42fd45a9-c8e4-44c9-897a-cb4b0e205787/os-instance-actions HTTP/1.1 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjZlD2oagccxJlkoOlCh8PjR1iB_J8Zm2IqVPumG_wTwNs356x2xNL2JOYNUKDAHKB6LriGa-K149wRMT3s7teBharw9-sX6X-f635WBLpTOuSyo52IKyMpuW1Pg2QzqYmBw7LN1-awrtxNfHq4VAtAxe2xLiMzHL9rlWZ2lmXBx3vY Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}] Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ccbd7bb33734440aa3b4a81f5cfdf653 Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': '42fd45a9-c8e4-44c9-897a-cb4b0e205787'} Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:35.816876 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Returning 404 to user: Instance 42fd45a9-c8e4-44c9-897a-cb4b0e205787 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc4892b1-43a3-4db8-b01d-d673cad8958a tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/42fd45a9-c8e4-44c9-897a-cb4b0e205787/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013630 Aug 30 16:10:35.821543 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 969/1747] 10.222.0.47 () {58 vars in 1296 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/42fd45a9-c8e4-44c9-897a-cb4b0e205787/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:35.824058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.824371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.831602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.832337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.832988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.833713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.834184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.834667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.906992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:35.915734 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f9a56b3-4ac0-47b7-92f5-6e9d291d011a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1283 microversion: 2.1 time: 0.095932 Aug 30 16:10:35.917269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 970/1748] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:35.922542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:35.923453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:35.930529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.931437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.932491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:35.933269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:35.933795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:35.934289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.001577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:36.010320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60b80024-21df-4b8a-bc95-1181d54207d4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1167 microversion: 2.1 time: 0.091129 Aug 30 16:10:36.011560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 971/1749] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:35 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1167 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:36.016899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:36.017611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:36.025610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.026223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.026819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.028923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.029699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.030234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.058224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:10:36.155049 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7dd9c3d3-9b0e-4d50-b8a1-b0824938fe42 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 204 len: 0 microversion: 2.1 time: 0.141931 Aug 30 16:10:36.155569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 972/1750] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:36 2022] DELETE /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:36.164632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:36.165697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:36.172478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.173351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.174143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.175132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.175817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.176474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.452173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:36.461137 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8420f67-076a-4d65-b8ee-4c1d07c9fdc5 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1529 microversion: 2.1 time: 0.300979 Aug 30 16:10:36.461717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 973/1751] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:36 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1529 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:36.477356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:36.477356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:36.492196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.493094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.495009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.495793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.496286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.499654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.767218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:36.776854 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ac6d4d4-d566-442a-b796-a4dd5782b421 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.309905 Aug 30 16:10:36.777446 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 974/1752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:36 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:36.827069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:36.827728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:36.835455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.835944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.836378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.837076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.837527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.837998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.062656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:37.074677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c019b5b-4a04-4f25-ab9f-0d783174ac36 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1470 microversion: 2.1 time: 0.252972 Aug 30 16:10:37.075708 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 975/1753] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:36 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:37.081721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:37.082639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:37.090560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.091518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.092828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.094150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.094732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.095241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.164975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:37.173487 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c642d85a-59ce-489a-b8d7-edc8fa63c41b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1283 microversion: 2.1 time: 0.096469 Aug 30 16:10:37.174061 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 976/1754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:37 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:37.178531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:37.179144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:37.185365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.185849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.186531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.187423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.187887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.188317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.255988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:37.267998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49405c8e-1ca9-4433-994d-dd32fd4e5048 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1167 microversion: 2.1 time: 0.092833 Aug 30 16:10:37.269630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 977/1755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:37 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1167 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:37.278416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:37.279575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:37.288361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.288871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.289324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.290032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.290610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.291261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.443567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c9cc68b-fb16-46a7-9519-9ba57593272a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "POST /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374/action" status: 202 len: 0 microversion: 2.1 time: 0.172287 Aug 30 16:10:37.444575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 978/1756] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:10:37 2022] POST /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:10:37.466782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:37.470333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:37.483114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.483737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.484349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:37.485037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:37.485593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:37.486227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.022954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:38.035792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a546c07e-b147-48c7-875a-9f1018b5605a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.574589 Aug 30 16:10:38.036787 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 979/1757] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:37 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:38.042002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:38.042638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:38.063951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.065204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.065832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.066562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.067302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.067890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.094450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:38.436983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:38.446508 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2728484-7dff-48de-b688-4e355362c3b3 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1529 microversion: 2.1 time: 0.408828 Aug 30 16:10:38.452952 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 980/1758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:38 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1529 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:38.462387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:38.463594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:38.479273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.480044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.482685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.483841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.484485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.486133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.778195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:38.796214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bbf14c1-0bc9-4e25-8240-f94e819c30d7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.341858 Aug 30 16:10:38.810141 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 981/1759] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:38 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:38.810141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:38.810141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:38.814418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.814776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.815227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.815957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:38.816550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:38.816848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:38.995650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.013043 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2b997e0-4b7e-47b2-8f29-4f8347880388 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1283 microversion: 2.1 time: 0.215144 Aug 30 16:10:39.013647 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 982/1760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:38 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:39.019639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:39.023049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:39.047801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.050983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.053885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.055812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.058752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.059888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.064666 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c5ca22d-254d-4582-901e-65f772481502 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060/action" status: 202 len: 0 microversion: 2.25 time: 6.017015 Aug 30 16:10:39.072735 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 779/1761] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:10:33 2022] POST /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060/action => generated 0 bytes in 6025 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:39.078128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d5226-9a5a-42c7-b382-437063dca39e", "name": "network-vif-plugged", "status": "completed", "tag": "29c406b4-b424-4bc0-acb4-17ccea246631"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:39.109350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.116099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.119247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.163055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] Creating event network-vif-plugged:29c406b4-b424-4bc0-acb4-17ccea246631 for instance dd4d5226-9a5a-42c7-b382-437063dca39e on n-h1-830883-28 Aug 30 16:10:39.170269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7db85de5-a6c9-4f9c-94dc-192f866b0893 req-ccab202d-2008-4d51-b1d4-536fcf6fb4f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095724 Aug 30 16:10:39.171309 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 780/1762] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:39.178259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:39.180667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:39.189254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.190134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.192065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.193085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.194881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.196855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.244817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.254616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc93494d-f616-4117-89fa-8bf3689b4ed6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1167 microversion: 2.1 time: 0.238526 Aug 30 16:10:39.272218 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 983/1763] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:39 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1167 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:39.296796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:39.296796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:39.303294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.304260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.304260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.305482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.305639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.306170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.572220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.575943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.581974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.583903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.584843 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d17fb9a-3ee0-4516-b3dc-6e0d41540624 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.412174 Aug 30 16:10:39.593117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 781/1764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:39 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:39.598068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7", "name": "network-vif-deleted", "tag": "c47c55d3-cc34-4631-a187-8fa8293358e5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:39.599708 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7aa7ab88-277c-42e5-8651-b5d6b72c9a65 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.312342 Aug 30 16:10:39.600909 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 984/1765] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:39 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:39.607888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:39.608692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:39.616536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.617139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.617745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.625655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.626318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.627755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.628595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.630237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] Creating event network-vif-deleted:c47c55d3-cc34-4631-a187-8fa8293358e5 for instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 on n-h2-830883-28 Aug 30 16:10:39.631196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.633065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.636750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cbe8b219-3945-4d35-9735-2634ca8540ee req-8f7613b5-2351-4872-ae17-2d17a77e446d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Aug 30 16:10:39.637874 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 782/1766] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:39.675857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.676350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.676788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.677240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lazy-loading 'fault' on Instance uuid a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:39.732443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd7bb33734440aa3b4a81f5cfdf653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89e76490a1b41d3afc8c91868c9db21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:39.742437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a61785c-b517-4320-9bb0-8267cc1a1633 tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 200 len: 1315 microversion: 2.1 time: 0.140333 Aug 30 16:10:39.743187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 985/1767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:39 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:39.816698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:39.817610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:39.825491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.826331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.827102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:39.828023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:39.828708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:39.829345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.034522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:40.035266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:40.053571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.059811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.060448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.061459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.075723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.082443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.361766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.376283 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b935c761-b38d-4f7d-a9b6-9c37d895d7ab tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.346357 Aug 30 16:10:40.377103 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 986/1768] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:40 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:40.405692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:40.406529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:40.416793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.417317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.417769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.418528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.419145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.419597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.551493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.582094 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aea9ea5f-c389-49d8-af7e-52536ab07db9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.769665 Aug 30 16:10:40.586653 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 783/1769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:39 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:40.609135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:40.610108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:40.618014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.626342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.626953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.627995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.628522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.629018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.684128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.696787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4f6b4f8e-05ad-4700-a9d4-75f61a0dc67d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1209 microversion: 2.1 time: 0.318295 Aug 30 16:10:40.708935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 987/1770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:40 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1209 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:40.720353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:40.720976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:40.727956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.728593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.729035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.729757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.730217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.730676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.918889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.929010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.930578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:40.931820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-51248601-f206-4e25-b960-dc3b35e4f155 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.220448 Aug 30 16:10:40.942872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 988/1771] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:40 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:40.942872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:40.942872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] [instance: a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:40.944947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.951761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.951761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.951761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:40.951761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:40.951761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:40.973173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] HTTP exception thrown: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Request method failure captured: Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 HTTP/1.1 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjZlD2oagccxJlkoOlCh8PjR1iB_J8Zm2IqVPumG_wTwNs356x2xNL2JOYNUKDAHKB6LriGa-K149wRMT3s7teBharw9-sX6X-f635WBLpTOuSyo52IKyMpuW1Pg2QzqYmBw7LN1-awrtxNfHq4VAtAxe2xLiMzHL9rlWZ2lmXBx3vY Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a89e76490a1b41d3afc8c91868c9db21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a89e76490a1b41d3afc8c91868c9db21"}]}] Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: a89e76490a1b41d3afc8c91868c9db21 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1794662343 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ccbd7bb33734440aa3b4a81f5cfdf653 Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1794662343-project Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7'} Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:40.974991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] Returning 404 to user: Instance a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:40.980378 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-499e54f3-3920-4f40-859c-63fda301fd8d tempest-InstanceActionsNegativeTestJSON-1794662343 tempest-InstanceActionsNegativeTestJSON-1794662343-project] 10.222.0.47 "GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7" status: 404 len: 111 microversion: 2.1 time: 0.042624 Aug 30 16:10:40.986460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 989/1772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:40 2022] GET /compute/v2.1/servers/a0c40df9-e5b3-4d7e-b1bf-a2de00f756e7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:41.222332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:41.230621 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05a40701-2baa-4241-a031-a9163dad4d57 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.625755 Aug 30 16:10:41.245202 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 784/1773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:40 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:41.397974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:41.399839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:41.411637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.412410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.413220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.414158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.415071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.416468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.609984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:41.611289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:41.628588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.631087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.632048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.635232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.635970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.636648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.705108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:41.722037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aaa0c8f2-b6a8-4f84-91d3-1c302593e921 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.328727 Aug 30 16:10:41.722678 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 990/1774] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:41 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:41.730144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:41.731116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:41.734225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:41.756315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.757192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.760170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.769393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:41.776473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:41.777194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:41.826250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:41.879317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=26 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:42.082790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.095187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70072cb6-f6a5-4063-9887-d2c4e0904ff2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1209 microversion: 2.1 time: 0.370607 Aug 30 16:10:42.096823 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 991/1775] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:41 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1209 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:42.105504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.128227 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c876e8e-834f-4d7b-b800-305784ad0dca tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1316 microversion: 2.1 time: 0.520559 Aug 30 16:10:42.129205 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 785/1776] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:41 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:42.130706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:42.134703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:42.176484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.180272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.183486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.184353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.184934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.187042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.254950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:42.255575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:42.265204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.265918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.266557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.287540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.291595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.292280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.318244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:42.470697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.487849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.497107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.499850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0627e0b7-ae1d-467f-8f7a-f8fd81455f2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.399651 Aug 30 16:10:42.501035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 992/1777] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:42 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:42.593661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef29e24-0a83-4765-8c63-53fe06015c4b", "tag": "01b9c527-1507-4770-a8fc-d2153f61039c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:42.607302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.607842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.608497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.624273 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] Creating event network-changed:01b9c527-1507-4770-a8fc-d2153f61039c for instance 9ef29e24-0a83-4765-8c63-53fe06015c4b on n-h2-830883-28 Aug 30 16:10:42.631488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-275fd8e3-b539-4acc-b3e0-1ece3d524c53 req-73495b60-ab16-43f8-9025-cacd873a380e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041537 Aug 30 16:10:42.633799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 993/1778] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:42.748459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:42.749629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:42.758138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.759013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.760313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.761193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:42.761823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:42.762440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:42.797879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.811987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4980aa1c-6ec9-44bc-96f8-e7e76d43647e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.562173 Aug 30 16:10:42.828751 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 786/1779] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:42 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:42.935001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=14 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:42.961462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:42.971616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7987590-5875-4449-81de-f1a909d1e997 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.230548 Aug 30 16:10:42.972522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 994/1780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:42 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:43.126551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.127608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:43.141202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.153129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.155465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:43.160665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.161901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.166086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.166602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.171695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.171914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.174623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.176604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.180451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.184432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.185073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.484838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:43.501430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a690408-ff92-4eab-84e0-3d574e9d11f7 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1505 microversion: 2.1 time: 0.354212 Aug 30 16:10:43.502603 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 995/1781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:43.523746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.524040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:43.531194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.531705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.532157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.532881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.533351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.533788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.560614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e560dfec-c334-4888-a0fa-0af405aaea2c tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips" status: 200 len: 109 microversion: 2.1 time: 0.041031 Aug 30 16:10:43.568843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 996/1782] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips => generated 109 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:10:43.573960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.574612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:43.580895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.581497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.581845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.582817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.583323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.583763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.091092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.111667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.115690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.121168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.122383 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21142656-c83d-4f11-98de-8951e080745d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 1.001917 Aug 30 16:10:44.122566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32b0d2bc-0af1-4ce3-b8e2-7ef21dc51a8c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.552750 Aug 30 16:10:44.123810 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 997/1783] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:44.129395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.130160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.139468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 787/1784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:44.139743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.140377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.141004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.143010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.143613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.144062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.145922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.146815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.155861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.156720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.163124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.164159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.164798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.165421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.171965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:44.183907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a8706c2-bae8-435e-b4c2-c9498491521e tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips" status: 200 len: 109 microversion: 2.1 time: 0.058925 Aug 30 16:10:44.192479 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 998/1785] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips => generated 109 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:44.204199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.205139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.222380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.223401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.224517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.225352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.225913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.226505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.526622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.536296 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68d9e5b0-7477-44fa-83fd-56f456f8275e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.342282 Aug 30 16:10:44.537082 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 999/1786] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:44.555057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.555539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.563541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.564410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.565078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.566010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.566713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.567788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.627529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f786b3cb-3ba0-40d5-a3d1-4c37f12a949f tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips/tempest-ServerAddressesTestJSON-935447420-network" status: 200 len: 94 microversion: 2.1 time: 0.079940 Aug 30 16:10:44.629244 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1000/1787] 10.222.0.47 () {58 vars in 1398 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e/ips/tempest-ServerAddressesTestJSON-935447420-network => generated 94 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:10:44.641906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.644739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.650683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:44.663843 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a68a7914-ab7a-49c0-80b4-45dbff6ca3ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.522511 Aug 30 16:10:44.667492 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 788/1788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:44.675469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.679533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.679533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.681959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.684019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc87614e-eb7b-4815-95ba-59617a76643e", "tag": "8a3a9b50-d9f6-4246-939c-9f2fc7c3d309"}, {"server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "name": "network-vif-unplugged", "status": "completed", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:44.686978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.691232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.721588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.722226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.722798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.752854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Creating event network-changed:8a3a9b50-d9f6-4246-939c-9f2fc7c3d309 for instance cc87614e-eb7b-4815-95ba-59617a76643e on n-h2-830883-28 Aug 30 16:10:44.753662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] Creating event network-vif-unplugged:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h1-830883-28 Aug 30 16:10:44.771778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:10:44.777515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-76882bfc-bc04-4094-9037-b8a88e95e3b8 req-fde9044b-1e08-44d0-963c-d34b77f6a5f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.108094 Aug 30 16:10:44.781640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 789/1789] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:44.936467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36b3ec6a-891d-454c-aaaf-4713e9e0c2cf tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 204 len: 0 microversion: 2.1 time: 0.298997 Aug 30 16:10:44.937443 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1001/1790] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:44 2022] DELETE /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:44.951556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.953141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.968341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.969285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.970712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.973137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.973862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.974606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.151553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.152557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.174480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.174988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.177012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.179723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.180218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.180660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.299935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.309385 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b6c1c90-860f-4496-9250-bdd8224814b8 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1511 microversion: 2.1 time: 0.367144 Aug 30 16:10:45.309986 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 790/1791] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:45.327046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.327737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.334544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.335155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.335720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.336502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.337217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.337973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.480708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.482281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.492724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac5a996a-35f9-4f72-baba-5fab84dcea17 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.173895 Aug 30 16:10:45.496989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.500106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.500687 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 791/1792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:45 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:45.505109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7e7562c-5c36-415b-be77-dd8ea2faac2d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.356271 Aug 30 16:10:45.514355 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1002/1793] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:45 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:45.558958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.559582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.565664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.566159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.566627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.567330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.567788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.568309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.688663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.689335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.697849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.698505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.699009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.699989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.700516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.701298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.727568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.738116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88b0abc8-b258-4713-aa8f-9efd4a5c107c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.183135 Aug 30 16:10:45.738743 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 792/1794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:45 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:45.840978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:45.849771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca24a81c-0a53-4dcb-b871-2b5e1582c87f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.164932 Aug 30 16:10:45.850526 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1003/1795] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:45 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:46.331987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.332620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.342861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.343360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.343797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.344495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.345174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.345611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.515008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.515679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.527076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.527708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.528033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.528894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.532138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.538695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.539935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.541851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5249c393-1665-4547-8ff0-973062b90d96 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1511 microversion: 2.1 time: 0.213772 Aug 30 16:10:46.558016 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 793/1796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:46.567904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.568146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.584932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.590699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.591339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.592175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.592717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.593158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.749369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.758545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.760960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.762247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de4dc6e3-872d-4ac9-a92f-8a25fef39ccf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.199727 Aug 30 16:10:46.762835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 794/1797] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:46.768385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.769256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.778689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.779285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.779785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.780553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.781071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.781558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.789958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.798997 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f0f3869-0593-40af-be7a-b67c36fdeacf tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.289815 Aug 30 16:10:46.799913 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1004/1798] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:46.828494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}, {"name": "network-changed", "server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:46.841864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.842641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.843535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.864302 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Creating event network-changed:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:10:46.865626 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Creating event network-changed:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h1-830883-28 Aug 30 16:10:46.872881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:10:46.887028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-edf72cb6-1efc-44c0-9a61-ed5676238b94 req-f8f5e884-a3ed-47a5-9b02-538b911bc5bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062904 Aug 30 16:10:46.893302 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1005/1799] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:10:46.899206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.900111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.906876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.907388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.907828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.908726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.909353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.909950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.968353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:46.977500 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d702550f-56c1-41f4-b4b8-dc727685dff1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.213234 Aug 30 16:10:46.983324 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 795/1800] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:47.145684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:47.158398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8481a6f9-195e-4bd3-ac56-c6e41e8f55ec tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.263315 Aug 30 16:10:47.168060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1006/1801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:47.271354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4d5226-9a5a-42c7-b382-437063dca39e", "name": "network-vif-deleted", "tag": "29c406b4-b424-4bc0-acb4-17ccea246631"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:47.289295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.291083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.291898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.313043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] Creating event network-vif-deleted:29c406b4-b424-4bc0-acb4-17ccea246631 for instance dd4d5226-9a5a-42c7-b382-437063dca39e on n-h1-830883-28 Aug 30 16:10:47.319765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-29411240-1607-416d-ad25-e5b819ae1925 req-d99a7f3e-7590-4ed9-b764-c926d997b25d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056737 Aug 30 16:10:47.321636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 796/1802] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:47.566737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.567889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.575584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:47.577232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.577721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.578258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.579201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.579727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.580441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.621708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.622955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.623134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.623632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lazy-loading 'fault' on Instance uuid dd4d5226-9a5a-42c7-b382-437063dca39e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:47.681455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47167989fb3e4cca9938f3ddf0f8b221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14d2a1fc6c9a4fcbad99a89e45ef3947', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:47.693252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7155fd7-e6fe-4c53-81e9-c64bce75fab5 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 200 len: 1306 microversion: 2.1 time: 0.133442 Aug 30 16:10:47.693846 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1007/1803] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 1306 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:47.786011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.786745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.794226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.794827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.795458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.796320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.796777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.797196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.827381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.832106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.841807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.843290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.843816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.844906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.845608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.847044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.984771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:47.997488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d557018-5d48-4883-9fc8-4b8bb98a3187 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.177119 Aug 30 16:10:47.998156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1008/1804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:48.002814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.003794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.013410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.013911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.014574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.015341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.016013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.016358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.155254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.177559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.179066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.180635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.184744 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4598f28a-001c-4146-b850-b629fc829333 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.403054 Aug 30 16:10:48.185443 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 797/1805] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:48.196370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.203237 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d8c3b32-c4a9-4bab-8f04-947eb7351620 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.203676 Aug 30 16:10:48.204407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.204824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1009/1806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:48.221313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.222294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.223028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.224118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.225537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.226220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.716735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.717374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] [instance: dd4d5226-9a5a-42c7-b382-437063dca39e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.724946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.726792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.727265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.728009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.728494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.729374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.749693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] HTTP exception thrown: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Request method failure captured: Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e HTTP/1.1 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjZvtAmAF-O2n9_7gVjlBnw6ABz7aISMErm1R3KVT3iovygiGyX5Eu4nOP3o99-_Wbglf7gs5QGxbNvZwbb6cyRc5fHoV36QfzzApvpNi0L_srkLMFPI_Za4-oDSUt6tWE_Qb1IDcEraRahAdbZ8MJSW9_gg3UxRYI__xMBr_fUqnyM Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 14d2a1fc6c9a4fcbad99a89e45ef3947 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerAddressesTestJSON-1923143670 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14d2a1fc6c9a4fcbad99a89e45ef3947"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_14d2a1fc6c9a4fcbad99a89e45ef3947"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/14d2a1fc6c9a4fcbad99a89e45ef3947"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14d2a1fc6c9a4fcbad99a89e45ef3947"}]}] Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerAddressesTestJSON-1923143670 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 14d2a1fc6c9a4fcbad99a89e45ef3947 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1923143670 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerAddressesTestJSON-1923143670-project Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 47167989fb3e4cca9938f3ddf0f8b221 Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerAddressesTestJSON-1923143670-project Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'dd4d5226-9a5a-42c7-b382-437063dca39e'} Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:48.751428 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] Returning 404 to user: Instance dd4d5226-9a5a-42c7-b382-437063dca39e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40853052-8045-4512-a2cd-e53bdc169ac9 tempest-ServerAddressesTestJSON-1923143670 tempest-ServerAddressesTestJSON-1923143670-project] 10.222.0.47 "GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e" status: 404 len: 111 microversion: 2.1 time: 0.041503 Aug 30 16:10:48.756518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1010/1807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:48 2022] GET /compute/v2.1/servers/dd4d5226-9a5a-42c7-b382-437063dca39e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:49.018717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:49.019413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:49.027905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.028627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.029404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.031258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.032530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.033152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.045356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.053427 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95aec5a3-0452-4211-8f96-ac598d170d12 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.866717 Aug 30 16:10:49.054010 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 798/1808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:48 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:49.213488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:49.214436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:49.233995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.234764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.235208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.236195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.236825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.237413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.474954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.484420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c20b8aa7-1c36-46f8-8509-d1bc257e7835 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.469998 Aug 30 16:10:49.485399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1011/1809] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:49 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:49.491573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:49.492411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:49.500080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.501424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.502152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.506898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.507616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.508272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.843712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.864811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.866190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.869322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af65e3ba-c5d7-4554-ac11-82e6e81d36a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.660706 Aug 30 16:10:49.871578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 799/1810] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:49 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:49.878869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.887535 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bab26a2-d200-433d-a3f5-79fa9836a4dd tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.400878 Aug 30 16:10:49.888116 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1012/1811] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:49 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:50.080290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.082398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.093214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.094225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.094993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.095963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.096657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.098722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.505202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.505929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.521917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.522601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.523147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.523298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:50.524075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.524801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.525612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.535015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14a68d96-d7ec-441a-bd7c-6ac2c9ad3fd5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.462369 Aug 30 16:10:50.536160 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 800/1812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:50.892943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.893838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.901404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.902172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.902956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:50.903193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.904243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.904875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.905300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.916035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5aeb4365-ed82-4c07-ade4-5f06b0921484 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.414026 Aug 30 16:10:50.926212 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1013/1813] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:50.931854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.937362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.960322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.961226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.961777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.963230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.964295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.964955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.255825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.273110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.275780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.277972 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76163ddc-fc44-458f-b1f5-aad3945fd20b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.388923 Aug 30 16:10:51.279145 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 801/1814] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:51.447828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.452300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:51.464123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-067fdd69-1b73-4588-bfe8-01f66b9466c0 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.536477 Aug 30 16:10:51.466774 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1014/1815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:51.536497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc87614e-eb7b-4815-95ba-59617a76643e", "name": "network-vif-plugged", "status": "completed", "tag": "8a3a9b50-d9f6-4246-939c-9f2fc7c3d309"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:51.558615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:51.560255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:51.565359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.567899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.568893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.579121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.579821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.580340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.583088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.584257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.588021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.602323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] Creating event network-vif-plugged:8a3a9b50-d9f6-4246-939c-9f2fc7c3d309 for instance cc87614e-eb7b-4815-95ba-59617a76643e on n-h2-830883-28 Aug 30 16:10:51.615882 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6305ce73-8bae-4183-b9d3-280439b6c942 req-a4aa3714-efe0-4ca0-8e2b-cf2bf6e1fde0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088094 Aug 30 16:10:51.616867 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 802/1816] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:51.951692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:51.953771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:51.959209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.965370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.966199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.967023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.968350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.969181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.969827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.969951 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e32fa98f-2b85-4120-8a49-13c648604265 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.415857 Aug 30 16:10:51.976602 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1015/1817] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:51 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:52.272296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.282768 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1d1a35d-78d5-451b-8afc-f567cfc66498 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.337514 Aug 30 16:10:52.283524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 803/1818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:51 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:52.301468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:52.302093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:52.309822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.313749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.314243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.315019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.317772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.318258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.485310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:52.486209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:52.496859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.497604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.500770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.502200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.504802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.505440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.651027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.664698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.674761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.679126 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6aee4135-2bc9-4625-a9fe-8f6206bb41c7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.380360 Aug 30 16:10:52.696162 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1016/1819] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:52 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:52.785670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.796046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29ea2f1a-1dff-4ad9-84ba-273e60ad128a tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.314659 Aug 30 16:10:52.796632 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 804/1820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:52 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:52.998241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:52.999235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.008407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.009485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.010993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.014248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.014830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.015201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.304264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.305611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.315369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.316157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.316835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.317806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.318522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.319180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.325083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:53.526575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:53.538412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e44ddc6-65b2-499a-92a6-a10f10c1f4b7 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.543919 Aug 30 16:10:53.539894 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1017/1821] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:52 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:53.705217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.705976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.716628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.717287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.718040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.720566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.721147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.723089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.868167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:53.879066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e64071a3-3786-4d4d-b1da-9d256080f851 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.578924 Aug 30 16:10:53.880704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 805/1822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:53 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:53.886015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.887070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.894452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.895218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.896169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.897090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.897759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.898449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.013762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.031460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.033480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.035051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d484068e-eed0-482e-82c4-7dd1c61ecd49 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.333886 Aug 30 16:10:54.047027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1018/1823] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:53 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:54.500371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.508502 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f96e37f4-e466-46e4-80d0-93b9c72a634b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.626303 Aug 30 16:10:54.522548 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 806/1824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:53 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:54.566464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:54.568839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:54.579556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.580445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.583844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.585820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.586681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.587411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.905761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:54.906944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:54.960131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.982054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:54.985712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.986667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.991235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.992144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-90493754-a8b6-44aa-aeae-381c1d2e121d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1469 microversion: 2.1 time: 0.432683 Aug 30 16:10:54.992408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.993057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.994222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.994366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1019/1825] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:54 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1469 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:55.063959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:55.064782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:55.077952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.081596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.088186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.088915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.089398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.090049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.526694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.541970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.547698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.550795 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0b9d5166-f107-4ec2-b32f-451af84ecbbc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.492301 Aug 30 16:10:55.551449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1020/1826] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:55 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:55.566634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:55.567624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:55.579709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.582748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.583554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.584466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.585364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.585966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.686408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.695851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03237cf0-3657-472f-a42f-7d9b11db06a6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.799338 Aug 30 16:10:55.702376 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 807/1827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:54 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:55.798452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.808745 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25ae4131-f84e-45f6-b608-19aa4e8afc5e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.256108 Aug 30 16:10:55.809682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1021/1828] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:55 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:56.017180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.017650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.028797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.029304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.029750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.030503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.030971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.031408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.579166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.579802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.594045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.594919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.595884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.596018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:56.599077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.603289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.604201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.621001 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfd2f771-8bf7-4615-9316-bc8a94f55c0d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1462 microversion: 2.1 time: 0.607486 Aug 30 16:10:56.623895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 808/1829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1462 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:56.645110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.646141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.653513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.654190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.655066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.656307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.656945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.657657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.830018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:56.830885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0dffa2af-f1d0-4120-be7e-5a9d9a31f02b tempest-MigrationsAdminTest-600528418 tempest-MigrationsAdminTest-600528418-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1615 microversion: 2.1 time: 0.191720 Aug 30 16:10:56.831486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 809/1830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1615 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:56.839231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:56.854443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:56.855865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e384fee8-20b1-4f5f-aadf-9524dc6b96c3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.285908 Aug 30 16:10:56.862441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1022/1831] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:10:56.862441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.862441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.869287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.869776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.870431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.871359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.871971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.872544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.035943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:57.045912 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4f1c63b-0f0a-4f9c-abb5-808d9c79dc2f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.188112 Aug 30 16:10:57.058342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1023/1832] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:57.058342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.058342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.064586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.065112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.065567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.066325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.066921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.071779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.089849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: .version_select at 0x7fd35d5014c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1129915084", "policies": ["affinity"]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:57.113252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.120643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.186852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.193593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.210861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70086502-6d12-41a6-aa1d-8c1524d7df5e tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.377811 Aug 30 16:10:57.211953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 810/1833] 10.222.0.47 () {60 vars in 1174 bytes} [Tue Aug 30 16:10:56 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.216518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.217628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.223787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.224281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.224730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.225400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.225855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.226278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.247316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:57.255748 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2abd757e-477a-49d3-afae-4d2b5947f1ac tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.206725 Aug 30 16:10:57.265069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:10:57.271331 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1024/1834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:57.284602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: .version_select at 0x7fd35ce523a0>, body: {"server_group": {"name": "tempest-server-group-851793487", "policies": ["affinity"]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:57.304894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.311243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.407444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.412110 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-211d0c7c-d322-4ced-8025-5467f5a98ecd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 204 len: 0 microversion: 2.1 time: 0.198545 Aug 30 16:10:57.413877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.415819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 811/1835] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:57 2022] DELETE /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:57.425860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.427341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.434328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.435208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.436101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.437165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.437295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5dec0bd8-6188-4da1-96a7-2e6c7b4c89b9 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.163748 Aug 30 16:10:57.437992 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1025/1836] 10.222.0.47 () {60 vars in 1173 bytes} [Tue Aug 30 16:10:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.443318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.445781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.449894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: .version_select at 0x7fd35cc53dc0>, body: {"server_group": {"name": "tempest-server-group-851793487", "policies": ["affinity"]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:57.469683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.475265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.533930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.540330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.555238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75da2588-aeb7-4814-8178-902463245bbc tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.110797 Aug 30 16:10:57.561001 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1026/1837] 10.222.0.47 () {60 vars in 1173 bytes} [Tue Aug 30 16:10:57 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.566911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-153c7c2f-2952-43e7-bb57-f08235d45d87 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.623036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:57.623413 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-153c7c2f-2952-43e7-bb57-f08235d45d87 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/41b93147-f34b-46e4-98ce-358c202cd0ce" status: 204 len: 0 microversion: 2.1 time: 0.060874 Aug 30 16:10:57.627058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1027/1838] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:10:57 2022] DELETE /compute/v2.1/os-server-groups/41b93147-f34b-46e4-98ce-358c202cd0ce => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:10:57.636378 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ca058bf-0072-43fe-8c27-97f06d61333c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1468 microversion: 2.1 time: 0.216236 Aug 30 16:10:57.636606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9544ec1b-8d08-42ce-8972-e17230e8b0e1 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.637174 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 812/1839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:57.652476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:57.655799 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9544ec1b-8d08-42ce-8972-e17230e8b0e1 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.025766 Aug 30 16:10:57.656389 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1028/1840] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.668582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76157326-d350-452c-9327-7c7366c0cf87 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.714414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76157326-d350-452c-9327-7c7366c0cf87 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/7af7b986-c987-406f-a6fb-0d66077de2ab" status: 204 len: 0 microversion: 2.1 time: 0.050854 Aug 30 16:10:57.715041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 813/1841] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:10:57 2022] DELETE /compute/v2.1/os-server-groups/7af7b986-c987-406f-a6fb-0d66077de2ab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:57.724007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c6afdb5-8a86-4e78-80cd-1bbcb9ada2a5 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.738672 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c6afdb5-8a86-4e78-80cd-1bbcb9ada2a5 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019196 Aug 30 16:10:57.739624 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1029/1842] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.752289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: .version_select at 0x7fd35d096c10>, body: {"server_group": {"name": "tempest-server-group-1808405301", "policies": ["affinity"]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:57.778794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.784379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.835857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:57.841425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:57.854530 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3fa6add1-9050-4ff7-bd14-6da13672289c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.106025 Aug 30 16:10:57.855457 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 814/1843] 10.222.0.47 () {60 vars in 1173 bytes} [Tue Aug 30 16:10:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:10:57.866138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a00f2ea-bb04-4880-9eb7-000969970e18 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.885877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.887768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.899012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.899787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.900204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.901759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a00f2ea-bb04-4880-9eb7-000969970e18 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/3dc47eaf-aee6-4afd-8e03-f9c59bdd5908" status: 204 len: 0 microversion: 2.1 time: 0.038936 Aug 30 16:10:57.901908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.902470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.902982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.906659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1030/1844] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:10:57 2022] DELETE /compute/v2.1/os-server-groups/3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:57.911633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9269b860-77a0-4977-8c75-957715236780 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.935904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9269b860-77a0-4977-8c75-957715236780 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.028044 Aug 30 16:10:57.948209 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1031/1845] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.958215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: .version_select at 0x7fd35d1119d0>, body: {"server_group": {"name": "tempest-server-group-1181712269", "policies": ["anti-affinity"]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:58.005170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:58.015009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:58.076585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:58.082940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:58.101602 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bb0c508-20e7-4cd9-8480-0bba759f97b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.151920 Aug 30 16:10:58.103622 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1032/1846] 10.222.0.47 () {60 vars in 1173 bytes} [Tue Aug 30 16:10:57 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:58.112854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:58.113843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:58.127462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.128315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.129284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.130400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.131134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.132939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.147056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.163123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.167513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.170459 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82e5f1e8-3868-440a-b1fd-ee3d07186b4a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.290988 Aug 30 16:10:58.171452 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 815/1847] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:58.195400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9fa3c7a6-2d8b-46c4-9c5f-986ce9aa3d86 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:58.251365 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9fa3c7a6-2d8b-46c4-9c5f-986ce9aa3d86 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/af26f118-b459-43f9-a624-72594e369ede" status: 204 len: 0 microversion: 2.1 time: 0.059895 Aug 30 16:10:58.253442 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 816/1848] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:10:58 2022] DELETE /compute/v2.1/os-server-groups/af26f118-b459-43f9-a624-72594e369ede => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:58.268820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6bbbff6b-3cc0-4b3f-891d-e93c00a619d2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:58.300587 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6bbbff6b-3cc0-4b3f-891d-e93c00a619d2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043169 Aug 30 16:10:58.303281 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 817/1849] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:10:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:58.309751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:58.310351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:58.328198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.335835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.336062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.337419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.340725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.341293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.415832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.425509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6c5651c-758d-491f-affa-8510575deb88 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.318189 Aug 30 16:10:58.438093 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1033/1850] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:58 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:58.454171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-4853927", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "adc79b07-4ead-417e-962c-90e6c0e474bb"}]}, "os:scheduler_hints": {"group": "8bb2e4f9-32d1-4e47-96a2-335e990bed8e"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:58.530101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] validate_networks() for [('adc79b07-4ead-417e-962c-90e6c0e474bb', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:58.605572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.618953 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5f063ab-e1fe-4551-b6c6-aaa8d5c9d7e9 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1350 microversion: 2.1 time: 0.310647 Aug 30 16:10:58.620724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 818/1851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:58 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1350 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:58.658895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:58.659512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:58.670684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.671235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.671754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.672597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:58.673067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:58.673509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:58.829951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.840327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-526cb9e6-3a76-4aa6-b4ea-0f21482dd799 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1468 microversion: 2.1 time: 0.185867 Aug 30 16:10:58.841026 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 819/1852] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:58 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:59.179163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:59.180135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:59.182013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:59.182791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:59.183285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:59.200149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.200964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.201896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.203018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.203684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.204332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.228967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:59.234682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:59.248172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:59.250548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:59.288298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:59.289296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:59.291021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122352) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 16:10:59.296485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.297250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.298035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.299033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.300513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.301155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.369618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:59.380401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:59.492604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:59.505997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Getting quotas for user a4da3bee37e74f56951a4671ce6e3f5f and project c78dbd8a64b944d8b1895fe048eaddae. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:59.546549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e72f4a45-e91e-4dca-9d70-b8d0e5a93bdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098036 Aug 30 16:10:59.550447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1034/1853] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:10:59.557497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:59.558127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:59.565718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.566225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.566808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.567584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.568084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.569223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.718604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:59.728515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:59.729964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:59.743693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-853639c1-8f2c-4640-a7a0-ab16fd215e48 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.459683 Aug 30 16:10:59.744937 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 820/1854] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:10:59 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:10:59.765143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04d11909-47af-4168-bb30-2cad032cdaa2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:59.765762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04d11909-47af-4168-bb30-2cad032cdaa2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:59.844467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04d11909-47af-4168-bb30-2cad032cdaa2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:59.852059 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04d11909-47af-4168-bb30-2cad032cdaa2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1210 microversion: 2.1 time: 0.105633 Aug 30 16:10:59.853725 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 821/1855] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:59 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:59.867654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:59.878296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:59.880992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:59.887937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.888699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.889649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.890581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.891207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.892304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.093773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:00.110702 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24312403-f9b8-491d-a0d0-cad97519a616 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.562088 Aug 30 16:11:00.115048 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1035/1856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:59 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:00.207954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:00.266174 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41b31316-44dc-490e-985c-cefe86120978 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1540 microversion: 2.1 time: 0.408866 Aug 30 16:11:00.278736 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 822/1857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:59 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1540 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:00.303671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:00.304481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:00.320448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.321792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.324967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.326350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.329057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.329901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.521358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:00.522657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:00.532219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.532796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.533313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.534321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.534871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.535789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.189078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:01.209022 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32eb9b74-2494-44f9-b66f-8928ce5a4642 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1468 microversion: 2.1 time: 1.091838 Aug 30 16:11:01.215144 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1036/1858] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:00 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1468 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:01.244428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "name": "network-vif-plugged", "status": "completed", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:01.287538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.292727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.295634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.343971 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] Creating event network-vif-plugged:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:11:01.367888 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ffeccde3-d7c2-4456-a191-096037343bd9 req-c4e92855-20a0-4e59-a973-16c57a85b914 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133583 Aug 30 16:11:01.381853 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1037/1859] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:01.403956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:01.426269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:01.460623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.461530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.462284 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7cd2a28c-6ae4-458c-9aef-fd8fd4159bef tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.163895 Aug 30 16:11:01.463254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.463645 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 823/1860] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:11:00 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e/os-interface => generated 285 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:01.464508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.465215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.466873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.482098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:01.484876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:01.519905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.520248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.520704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.527105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.528003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.529350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.747026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:01.755613 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f273ccb7-ab19-4ea2-9592-832779ec03fb tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1262 microversion: 2.1 time: 0.278976 Aug 30 16:11:01.758507 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 824/1861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:01 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1262 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:01.766633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:01.772380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:01.790387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.793330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.794239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.799125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.799715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.800257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.078346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.091198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.097185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.100575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bcdf3bac-3dfc-4296-b190-d59564642764 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1568 microversion: 2.25 time: 0.717034 Aug 30 16:11:02.103663 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1038/1862] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:01 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1568 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:02.241020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:02.242122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:02.255544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.256193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.259404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.260290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.266807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.267872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.643889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.665894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c26f2d4-90a4-47df-9876-d8bd32c81476 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.903202 Aug 30 16:11:02.679199 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 825/1863] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:01 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:02.780329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:02.780568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:02.789419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.790499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.790951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.800160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.802978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.803445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.842060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.873930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b32da1b4-9325-4eec-ab2f-ec021409594f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1468 microversion: 2.1 time: 0.633488 Aug 30 16:11:02.876161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1039/1864] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:02 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1468 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:02.889924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:03.128216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:03.128850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:03.145951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.146403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.146855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.148262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.148736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.149723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.481353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:03.485594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:03.492417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:03.497527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:03.506150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:03.509400 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-42d8b5e9-3551-461e-91ca-db114aff230f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1543 microversion: 2.25 time: 0.383298 Aug 30 16:11:03.509989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fcb33df7-54f3-484a-bd02-753721702806 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1268 microversion: 2.1 time: 0.731898 Aug 30 16:11:03.511183 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 826/1865] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:02 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1268 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:03.527665 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1040/1866] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:03 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1543 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:03.532029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "name": "network-vif-plugged", "status": "completed", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}, {"server_uuid": "9ef29e24-0a83-4765-8c63-53fe06015c4b", "name": "network-vif-plugged", "status": "completed", "tag": "01b9c527-1507-4770-a8fc-d2153f61039c"}, {"server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "name": "network-vif-unplugged", "status": "completed", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:03.543201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3cd63389-2a03-41cc-9b6d-a85779d92de9 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '.version_select at 0x7fd35d0ad8b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:03.553410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cd63389-2a03-41cc-9b6d-a85779d92de9 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.557634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cd63389-2a03-41cc-9b6d-a85779d92de9 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.559557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cd63389-2a03-41cc-9b6d-a85779d92de9 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.562605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.563223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.564040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.601359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Creating event network-vif-plugged:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h2-830883-28 Aug 30 16:11:03.602358 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Creating event network-vif-plugged:01b9c527-1507-4770-a8fc-d2153f61039c for instance 9ef29e24-0a83-4765-8c63-53fe06015c4b on n-h2-830883-28 Aug 30 16:11:03.603134 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] Creating event network-vif-unplugged:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:11:03.605408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3cd63389-2a03-41cc-9b6d-a85779d92de9 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 4084 microversion: 2.25 time: 0.067809 Aug 30 16:11:03.606142 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1041/1867] 10.222.0.47 () {60 vars in 1184 bytes} [Tue Aug 30 16:11:03 2022] GET /compute/v2.1/os-migrations => generated 4084 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:03.617645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-00c8a9e5-98a3-400c-a328-ae40c99ef2d1 req-0d4c60b9-1009-44e2-b8cb-954a364f5a56 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.104623 Aug 30 16:11:03.622321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 827/1868] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:03.629355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:03.630174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:03.643444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.643953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.645067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.645298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.645627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.646054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.692386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:03.694109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:03.709917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.712468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.713607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.714414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.714892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.715331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:04.388042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:04.404499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e376a85-9504-4ed2-976c-5221f6abb4e4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 2038 microversion: 2.25 time: 0.780629 Aug 30 16:11:04.442106 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1042/1869] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:03 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 2038 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:04.461194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:04.468774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:04.473045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:04.476790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:04.478643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:04.479407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:04.480847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:04.481502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:04.482104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:04.675170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:04.698453 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f8b9f84-9d52-410b-8628-88b5402d5d8a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1426 microversion: 2.1 time: 0.254196 Aug 30 16:11:04.700055 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1043/1870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:04 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1426 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:04.709119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f948cd6-f242-4f5a-9017-cf9085f9cf37 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: .version_select at 0x7fd35d51f9d0>, body: {"keypair": {"name": "tempest-keypair-1361998287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/PsLhO8/aSidLEV0s/1CF92L7D0iGYf9Tvn1Y7o99e4jEyQVPNRUD9AxeDpmTbFZgUErHP8hnbMFDXb6/y1cFp6UP3KDc4zVJ+61r7/NbpaCPgxFtX8Ek5SbLOPqsqCw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:04.746598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6f948cd6-f242-4f5a-9017-cf9085f9cf37 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for project 7f8325d53f9148ab83a9416259312f4d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:04.760513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6f948cd6-f242-4f5a-9017-cf9085f9cf37 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for user 81b24fcdb0a749caa02a34817e8fe9f8 and project 7f8325d53f9148ab83a9416259312f4d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:04.819054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f948cd6-f242-4f5a-9017-cf9085f9cf37 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.113097 Aug 30 16:11:04.823892 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1044/1871] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:11:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:11:04.833490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:04.834068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:04.842164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:04.842982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:04.843722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:04.844782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:04.846143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:04.847225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.034121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:05.053461 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4733ecfd-0dac-4bfb-a413-573beb64e089 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1268 microversion: 2.1 time: 0.228315 Aug 30 16:11:05.055034 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1045/1872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:04 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1268 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:05.078162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "421db09b-8e9d-4e76-8d8b-6fce6efb0374", "name": "network-vif-deleted", "tag": "9a5c272b-076b-4844-b548-d7839715cce9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:05.123032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.125788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.127815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.151001 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] Creating event network-vif-deleted:9a5c272b-076b-4844-b548-d7839715cce9 for instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 on n-h2-830883-28 Aug 30 16:11:05.157066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-33a6e4b5-d901-4b56-9ab5-a8b51f1d8bfc req-0ca3f37b-2e50-4e1b-9f2a-8d9b8724743f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099362 Aug 30 16:11:05.157972 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1046/1873] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:05.162562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:05.173303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d831689-24ee-4e4b-8776-bf459ce3f757 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 1.486603 Aug 30 16:11:05.189558 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 828/1874] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:03 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:05.794526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:05.796710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:05.809649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.810164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.811220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.813454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.814414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.815031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.909004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.909758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.927133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.927960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 421db09b-8e9d-4e76-8d8b-6fce6efb0374 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:06.084551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:06.085422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:06.095010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.099225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.100872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.102480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.104917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.105360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.206135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:06.218765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5ff8ad5-0ac3-420a-b37b-dedf89224c18 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1302 microversion: 2.1 time: 0.431041 Aug 30 16:11:06.220304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1047/1875] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:05 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1302 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:06.231784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:06.233191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:06.253877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.254418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.259697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.260337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.260814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.261939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.651411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:06.654804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:06.663256 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3600f602-c951-4dda-bd98-55c920ea3165 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1197 microversion: 2.1 time: 0.441450 Aug 30 16:11:06.668215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d917e393-3ce4-42c6-adf6-3c5bfe34a069 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.591143 Aug 30 16:11:06.672568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 829/1876] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:06 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:06.685189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1048/1877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:06 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1197 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:06.879066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1440718864", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:06.949097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] validate_networks() for [('22476a82-fde6-46b2-80f5-9062d8cf2e18', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:07.194484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc87614e-eb7b-4815-95ba-59617a76643e", "tag": "8a3a9b50-d9f6-4246-939c-9f2fc7c3d309"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:07.213696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.235885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.236649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.264448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] Creating event network-changed:8a3a9b50-d9f6-4246-939c-9f2fc7c3d309 for instance cc87614e-eb7b-4815-95ba-59617a76643e on n-h2-830883-28 Aug 30 16:11:07.292066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-285d9ada-eeae-4815-9b8b-d71ec3e39f8d req-460c9a19-6b5e-4c90-bf75-ba4efd3c184a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095642 Aug 30 16:11:07.292882 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1049/1878] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:07.307387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:07.309123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:07.322890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.326125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.326775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.327665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.329479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.330028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.388027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.390082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.391285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.391879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 421db09b-8e9d-4e76-8d8b-6fce6efb0374 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:07.473295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:07.480745 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-531ba1c3-9d36-4152-a4ee-3dd062ee717a tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 200 len: 1302 microversion: 2.1 time: 0.182629 Aug 30 16:11:07.494838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1050/1879] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 1302 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:07.687483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:07.688105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:07.698853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.699528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.699980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.700712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.704393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.704852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.891130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:07.899611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67185a18-ef36-4484-968c-1619f4252de0 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1380 microversion: 2.1 time: 0.215980 Aug 30 16:11:07.901075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1051/1880] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1380 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:07.919885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:07.920911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:07.927798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.928554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.929141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.929849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.930697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.931427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.126123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:08.138567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4597289c-d48e-43e1-b821-d8fac41ed2e7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.236924 Aug 30 16:11:08.139404 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1052/1881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:08.283229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.284904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.292823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.293706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.294417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.295587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.314265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.319146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.502286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-812c6f25-864b-4c92-a9f9-325f5dd351d1 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1533 microversion: 2.1 time: 0.362009 Aug 30 16:11:08.514398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1053/1882] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1533 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:08.514398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.514398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 421db09b-8e9d-4e76-8d8b-6fce6efb0374] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.520373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.521374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.522059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.523198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.525593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.526594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.545923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] HTTP exception thrown: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Request method failure captured: Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 HTTP/1.1 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVmzw7QyKfp3TvyQOaE_cxZ1DrJS_lN_RYHVq3JQAUrKmOdxybXmS8cX5PT8l9bRuZOayjLCD4e8UL4Fgmuz0psrKkGh1iRVztN_pdziw2cK3FHnwxTK-3Mxlo9vLLVlCk3sQhsafQAGcBGEo5b88SYNzf3upvkfqSYJ0bjRc7Xxrs Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}] Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f7b57e0f6afe46e9b6d11985e8ff56c6 Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '421db09b-8e9d-4e76-8d8b-6fce6efb0374'} Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:08.549422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. Aug 30 16:11:08.553931 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:08.557625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Returning 404 to user: Instance 421db09b-8e9d-4e76-8d8b-6fce6efb0374 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:08.558842 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0cb776fe-ad36-418b-a4cb-07b150d060e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374" status: 404 len: 111 microversion: 2.1 time: 0.054222 Aug 30 16:11:08.563293 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1054/1883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/421db09b-8e9d-4e76-8d8b-6fce6efb0374 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:08.568700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.569896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.577077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.577970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.578716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.579964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.580651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.581299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.625791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:08.626853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:08.628217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:08.629017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:08.629668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:08.645337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.654399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.655118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.656130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.656860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.657472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.676654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Getting quotas for project f989d61ccb1845ecacf3fa928cd69551. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:08.683031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Getting quotas for user cc4e63f8383b45aab2ee2433ca9c7dbc and project f989d61ccb1845ecacf3fa928cd69551. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:08.698895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:08.701933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:08.757827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a179be4a-daf3-4227-bd3b-252a90127ccf tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.966058 Aug 30 16:11:08.759337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 830/1884] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:11:08.764439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.765381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.772372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.773267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.774104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.775240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.775984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.776666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.786420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-037677a9-c9c5-4fae-8999-89330d68ced0 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1533 microversion: 2.1 time: 0.221596 Aug 30 16:11:08.798426 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1055/1885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1533 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:08.810348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2748a66a-d139-45c6-839f-f01b5656b471 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.810975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2748a66a-d139-45c6-839f-f01b5656b471 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.822656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:08.912888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2748a66a-d139-45c6-839f-f01b5656b471 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:08.921194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2748a66a-d139-45c6-839f-f01b5656b471 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1224 microversion: 2.1 time: 0.131743 Aug 30 16:11:08.923456 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1056/1886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:08.930528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.935717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.936263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.938166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.938166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.938434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.938879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.978375 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b5193c9-63a5-4976-8bb9-fc8dffed8177 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.051555 Aug 30 16:11:08.979767 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1057/1887] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:08.989242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f2c6be4-a4a6-49a8-8bc3-d729853ee496 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 204 len: 0 microversion: 2.1 time: 0.228273 Aug 30 16:11:08.990129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 831/1888] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:08 2022] DELETE /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:08.992102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-830883-28", "block_migration": false, "disk_over_commit": false}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:08.998322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.999331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.999460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:09.007037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.009182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.009886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.010127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.010438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.010889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.011553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.011685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.012045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.012478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.012701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.013478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.067522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lazy-loading 'flavor' on Instance uuid 9ef29e24-0a83-4765-8c63-53fe06015c4b {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:09.081177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Going to try to live migrate instance to n-h1-830883-28 {{(pid=122352) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:11:09.529269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:09.542181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1e39585-2e9b-43d7-b24b-e6bc303f6e3d tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1535 microversion: 2.1 time: 0.546641 Aug 30 16:11:09.544058 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 832/1889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1535 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:09.551500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.552169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:09.577079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.577805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.579896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.580863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.581499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.583541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.738160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:09.747097 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff8c7537-4b2b-4624-8887-2b40b0a170fe tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.201536 Aug 30 16:11:09.747658 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 833/1890] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:09.752049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5e81c1-705f-4e03-8126-9f1697f5fe92", "tag": "5611cd86-6a02-419d-8af4-d4c3609be7d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:09.762544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.763019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.763449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.775256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] Creating event network-changed:5611cd86-6a02-419d-8af4-d4c3609be7d3 for instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 on n-h1-830883-28 Aug 30 16:11:09.780251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7caeabe9-6294-4d98-a202-b3f1069199f7 req-b8554346-1115-4506-9bdf-462fe3785fb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Aug 30 16:11:09.780858 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 834/1891] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:09.786160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-445268176", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "13ae43f5-f65e-41d3-a1c8-61637c2e23b1"}], "security_groups": [{"name": "tempest-securitygroup--85848482"}], "key_name": "tempest-keypair-1361998287", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:09.895098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] validate_networks() for [('13ae43f5-f65e-41d3-a1c8-61637c2e23b1', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:10.354513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:10.354943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:10.355420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:10.355835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:10.356251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:10.365468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.365949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.366429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.367160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.368469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.368911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.387030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:10.392284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for user 81b24fcdb0a749caa02a34817e8fe9f8 and project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:10.404914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:10.407297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:10.475017 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18ad28dd-15ba-43e9-b0e1-a3443baf1766 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 0.692886 Aug 30 16:11:10.476179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 835/1892] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:11:09 2022] POST /compute/v2.1/servers => generated 404 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:11:10.481242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:10.482333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:10.490956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.491745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.493564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.494523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.495153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.496668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.692008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.705434 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d60180d-b753-4070-8dec-ab6e9b356d68 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1220 microversion: 2.1 time: 0.227929 Aug 30 16:11:10.721403 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 836/1893] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:10 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1220 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:10.736187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:10.750349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:10.895793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.912423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.915700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.917421 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a978fad-d700-4ca1-b46c-1632102d43ce tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1285 microversion: 2.25 time: 0.194636 Aug 30 16:11:10.920335 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 837/1894] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:10 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:10.934507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:10.939269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:10.964751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.965305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.972231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.973673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.974188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.978788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.285042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:11.299346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-490dbaa4-77de-42cd-a0e1-7081964afc0e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1535 microversion: 2.1 time: 0.376708 Aug 30 16:11:11.300105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 838/1895] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:10 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1535 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:11.304784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.306169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:11.315745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.316486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.317159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.317846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.318332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.318926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.502078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:11.517105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b5b2e48-a80d-40b5-b5dc-d3cc0b256eec tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.215835 Aug 30 16:11:11.530937 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 839/1896] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:11.530937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe06bce6-994a-4727-b936-ed96ccca1794", "name": "network-vif-deleted", "tag": "d39657ad-c855-4a23-871c-f0dab3e4198d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:11.534528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.535019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.535455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.550191 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] Creating event network-vif-deleted:d39657ad-c855-4a23-871c-f0dab3e4198d for instance fe06bce6-994a-4727-b936-ed96ccca1794 on n-h1-830883-28 Aug 30 16:11:11.556689 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e7f599af-1f7f-4b42-8370-43d4ab811e18 req-45e4d873-c420-44a2-89f4-70b6e7e17ced service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036796 Aug 30 16:11:11.557964 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 840/1897] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:11.633793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d09f432c-0ca9-48ce-84e1-d3f2c80e55cc tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b/action" status: 202 len: 0 microversion: 2.1 time: 2.645187 Aug 30 16:11:11.635324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1058/1898] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:11:08 2022] POST /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b/action => generated 0 bytes in 2648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:11:11.644454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.645428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:11.652465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.652956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.653390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.654090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.654601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.655000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.727994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.728788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:11.741783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.742291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.746687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.749852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.750379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.750829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.836974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:11.840149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:11.844164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:11.846364 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-536ea046-690e-4bd5-a24e-134c295e6a24 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.206046 Aug 30 16:11:11.847318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 841/1899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:11.850475 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b4b9fef-a088-4a04-bc76-44e91deb9ad3 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1284 microversion: 2.1 time: 0.126983 Aug 30 16:11:11.851204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1059/1900] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:11.941192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:11.941831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:11.948975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.949453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.949885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.950599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.951050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.951471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.014985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:12.022974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:12.024588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:12.025684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5c021e6-6d81-4397-b158-595230522089 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1281 microversion: 2.25 time: 0.088484 Aug 30 16:11:12.026241 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 842/1901] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:11 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:12.323137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:12.323827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:12.331901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.332390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.332853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.333674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.334370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.334813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.397806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:12.406186 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6e180ee-010e-45d6-bdf7-90572ef3659b tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1364 microversion: 2.1 time: 0.087792 Aug 30 16:11:12.406800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1060/1902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:12 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1364 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:12.538243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:12.538933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:12.545977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.546568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.547267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.547995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.548440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.548866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.795213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:12.809901 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64b67f47-b507-4f72-911e-b0bdb5bf415c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.275489 Aug 30 16:11:12.822474 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 843/1903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:12 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:12.870346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:12.871006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:12.877835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:12.878505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:12.882552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.883762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.884339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.886659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.887282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.887499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.888232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.888884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.893749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:12.895147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:12.895908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:12.896562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.012191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.023406 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96735129-2bbc-4cf9-a05e-fe3c945fbae4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1282 microversion: 2.1 time: 0.152947 Aug 30 16:11:13.037652 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 844/1904] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:12 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:13.048347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:13.048964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:13.057502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.058008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.058556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.059269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.059735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.060166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.145255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.156685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:13.164378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.168575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.171346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc5b9aab-82e7-4e98-8530-d0692359dda4 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1337 microversion: 2.25 time: 0.126908 Aug 30 16:11:13.175124 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 845/1905] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:13 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:11:13.244195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.260132 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-756d4291-26ee-42c5-bef8-f604efb27b0c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.396518 Aug 30 16:11:13.261472 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1061/1906] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:12 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:13.427143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:13.428106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:13.435660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.436192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.436940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.437653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.438245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.438562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.474291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.474808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.475254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.475704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid fe06bce6-994a-4727-b936-ed96ccca1794 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:13.521019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:13.528834 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab18c227-aba8-4d49-b3aa-c7614b57416e tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 200 len: 1369 microversion: 2.1 time: 0.106206 Aug 30 16:11:13.529411 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 846/1907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:13 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:13.834589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:13.835526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:13.844471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.844978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.845984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:13.846751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:13.847220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:13.847656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.047171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.048550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:14.057670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.058123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.058994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.059913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.060598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.061204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.132539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.143465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cd0ced6-c4a1-41a2-8927-22fd54c648b7 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.314475 Aug 30 16:11:14.144984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1062/1908] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:13 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:14.198322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.199300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:14.206636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.207408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.208087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.209021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.209554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.210071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.286255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.295478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e29c4bbb-af65-4bb9-9940-8af03ac7c475 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.252794 Aug 30 16:11:14.296114 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 847/1909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:14 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:14.300982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.301819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:14.316389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.317218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.317721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.318549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.319091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.319873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.339141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.348234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.350088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.351478 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-127f60ee-9c12-4b09-b29d-c58e3fd4a8a3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1343 microversion: 2.25 time: 0.158504 Aug 30 16:11:14.366211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1063/1910] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:14 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1343 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:11:14.554535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.557011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: fe06bce6-994a-4727-b936-ed96ccca1794] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:14.567920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.572551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.573674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.574761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:14.575313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:14.575749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:14.578801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:14.594917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] HTTP exception thrown: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Request method failure captured: Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 HTTP/1.1 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjVmzw7QyKfp3TvyQOaE_cxZ1DrJS_lN_RYHVq3JQAUrKmOdxybXmS8cX5PT8l9bRuZOayjLCD4e8UL4Fgmuz0psrKkGh1iRVztN_pdziw2cK3FHnwxTK-3Mxlo9vLLVlCk3sQhsafQAGcBGEo5b88SYNzf3upvkfqSYJ0bjRc7Xxrs Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}] Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f7b57e0f6afe46e9b6d11985e8ff56c6 Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fe06bce6-994a-4727-b936-ed96ccca1794'} Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:14.597242 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. Aug 30 16:11:14.603747 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:14.604569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83843962-c5fa-4868-be59-f0fa3de2725c tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.301716 Aug 30 16:11:14.604569 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 848/1911] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:14 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:14.605730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Returning 404 to user: Instance fe06bce6-994a-4727-b936-ed96ccca1794 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:14.606972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04abaade-a663-4a4a-87f2-e2b0c25d44aa tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794" status: 404 len: 111 microversion: 2.1 time: 0.061268 Aug 30 16:11:14.608037 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1064/1912] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:14 2022] GET /compute/v2.1/servers/fe06bce6-994a-4727-b936-ed96ccca1794 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:11:14.617694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d4a16c57-13d0-498f-b98a-157e974d3bd6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '.version_select at 0x7fd35cd80ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:14.644783 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d4a16c57-13d0-498f-b98a-157e974d3bd6 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-525349389" status: 202 len: 0 microversion: 2.1 time: 0.031335 Aug 30 16:11:14.645439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 849/1913] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-525349389 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:11:15.165231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:15.165674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:15.182550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.183059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.183588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.184214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.184679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.185112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.317609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:15.318291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:15.333997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.334533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.334980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.335707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.336225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.336900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.645074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:15.654492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0b42864-b3ea-4efb-b72b-977996dc66b2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.493220 Aug 30 16:11:15.655080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1065/1914] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:15 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:15.666406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:15.667642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:15.679328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.680748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.681508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.683177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.683903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.693220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.885957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:15.895903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:15.897663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:15.900636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe70261f-dbcb-4755-bc19-c2c619e1a243 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.244260 Aug 30 16:11:15.901774 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1066/1915] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:15 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:15.906513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991360b8-c190-4676-8dcc-9aef765b1b17", "tag": "782762f9-787c-4218-919d-04f115eee699"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:15.917424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.918146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.918804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.933145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] Creating event network-changed:782762f9-787c-4218-919d-04f115eee699 for instance 991360b8-c190-4676-8dcc-9aef765b1b17 on n-h1-830883-28 Aug 30 16:11:15.940465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d360691d-a7ac-4446-b5c9-8afe509d0c9f req-88a29282-855e-4d1f-8d19-ac7b7898d180 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037280 Aug 30 16:11:15.943173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:15.943372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1067/1916] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:15.954963 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a75ef333-fe73-48d5-afd9-0fcaf8fc6fa2 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.642260 Aug 30 16:11:15.956722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 850/1917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:15 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:15.956964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:15.957664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:15.966001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.966001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.966439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:15.967070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:15.967531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:15.967967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.185626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:16.200359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8e0c7c4-9e2a-46b6-bfe7-f94519cffe4e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.255552 Aug 30 16:11:16.212120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1068/1918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:15 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:16.679288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:16.681634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:16.689594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:16.692958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.693782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.697697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.699109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.699819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.700477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.786474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:16.787361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:16.793965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.795016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.795713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.796652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.797410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.798091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.826629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:16.942827 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4c281f7-651d-4c26-b21c-79225f3b7576 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 204 len: 0 microversion: 2.1 time: 0.159545 Aug 30 16:11:16.943964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1069/1919] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:16 2022] DELETE /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:11:16.951658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:16.951859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:16.952792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:16.963466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.963972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.966554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:16.967174 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-944cd8c5-fcbf-4a0a-abc5-1d4fe5cbd3c2 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.291585 Aug 30 16:11:16.967566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:16.967796 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 851/1920] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:16 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:16.974632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5e81c1-705f-4e03-8126-9f1697f5fe92", "name": "network-vif-plugged", "status": "completed", "tag": "5611cd86-6a02-419d-8af4-d4c3609be7d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:16.986914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:16.987545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.000817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.004881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.005414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.030987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] Creating event network-vif-plugged:5611cd86-6a02-419d-8af4-d4c3609be7d3 for instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 on n-h1-830883-28 Aug 30 16:11:17.041426 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3ebde688-c83a-484b-893d-fe1b938dede6 req-78a68885-cfc2-44fa-a16a-6e8157afa2d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070511 Aug 30 16:11:17.042096 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 852/1921] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:17.052232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:17.053840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:17.069708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.072234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.072878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.074704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.075351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.076734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.149460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.158882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.160347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.161507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f64a8dc4-d4b0-4770-bb8b-636ae3b3ec73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.215044 Aug 30 16:11:17.162293 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1070/1922] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:16 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:17.181653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:17.182287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:17.189748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.191258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.191784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.192674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.193233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.193770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.227738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.236187 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0353f689-1d9f-4a24-bb8b-6066bbbe6bfd tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1468 microversion: 2.1 time: 0.192896 Aug 30 16:11:17.236784 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 853/1923] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:17 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:17.241241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:17.254655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.255160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.255590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.269116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] Creating event network-changed:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h1-830883-28 Aug 30 16:11:17.274703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-aae816b6-0703-43c5-893c-c276d416112c req-52a7c8ef-84bf-49ce-8415-563ed3de18c0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036603 Aug 30 16:11:17.275535 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 854/1924] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:17.280700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:17.281396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:17.289509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.289996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.290461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.291147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.291743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.293155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.366077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.375711 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-474ce17e-cd86-4078-bb16-4936f726d2db tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.199867 Aug 30 16:11:17.376299 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1071/1925] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:17 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:17.447775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:17.456152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c299b9c8-3a43-43d3-9321-a01c3fe4d5af tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.179279 Aug 30 16:11:17.456782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 855/1926] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:17 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:17.988995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:17.989659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:17.997516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.998010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:17.998491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:17.999192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:17.999646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.000070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.139278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.147897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b17e52e-341e-46c9-a444-94ba554981ab tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.163268 Aug 30 16:11:18.149277 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1072/1927] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:17 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:18.184349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:18.185012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:18.191922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.192394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.192834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.193533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.193984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.194702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.257474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:18.258698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:18.266026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.266620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.267002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.267757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.268171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.268619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.347108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.357671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.361000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.363465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-582e1855-2b0d-4d61-a94c-b6901f972041 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.182666 Aug 30 16:11:18.369605 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 856/1928] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:18.397528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:18.398215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:18.406369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.407057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.407708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.408420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.408892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.409366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.425086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.434774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d86b5b9d-b44e-4a35-b89c-af3f8c813602 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1468 microversion: 2.1 time: 0.181339 Aug 30 16:11:18.435669 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1073/1929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:18.479244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:18.480270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:18.491814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.492929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.493407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.494152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:18.494920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:18.495083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:18.639808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.649317 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ddcdd7b5-8e63-4a78-b1cd-995a4e8b2d41 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.255649 Aug 30 16:11:18.649902 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 857/1930] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:18.672129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:18.680620 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edf844f3-3217-45dd-b3d1-e2a2edee6d55 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.207348 Aug 30 16:11:18.681238 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1074/1931] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:18 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:19.168449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.169442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:19.175556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.176038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.176470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.177192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.177607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.178029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.255581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.263213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.266092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Searching by: {'deleted': False, 'project_id': '09d46d8c36e449bbab8e141dd38b8188'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:11:19.269543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=44 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:19.270851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:19.277626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.278537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.279293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.280233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.280897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.281546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.326653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:11:19.359992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:19.371041 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3556c293-cf28-4396-bf3b-94e0f2872e87 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.119869 Aug 30 16:11:19.372468 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1075/1932] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers => generated 340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:19.417175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.421052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.427242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebc454cc-af30-4ae6-a15f-89cef3274381 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1310 microversion: 2.1 time: 0.262574 Aug 30 16:11:19.438327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 858/1933] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1310 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:19.438327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.438327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:19.441854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.447028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Searching by: {'deleted': False, 'project_id': '09d46d8c36e449bbab8e141dd38b8188'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:11:19.454792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.455380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.455873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.456201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.456466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.457216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.457525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.457664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.458080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.460222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.461113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.461862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.495251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:11:19.538259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.545404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.546206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.546939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.687547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8784a76-45c7-421d-877b-5caa8ee55318 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.282069 Aug 30 16:11:19.694573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1076/1934] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:19.699107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.699969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:19.710075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.711544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.712668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.713560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.714025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.714554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.715274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.723485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.724993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.726133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4800f2e3-3f58-429e-9a1e-9f64ff8e75a6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.295212 Aug 30 16:11:19.735097 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 859/1935] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:19.735097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.735097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:19.739311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.740027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.740727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.741459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.741919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.742718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.853325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:19.865954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09374394-441e-4f5f-b2b2-6660408776f5 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1426 microversion: 2.1 time: 0.175348 Aug 30 16:11:19.868351 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1077/1936] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1426 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:19.877693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:19.878501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:19.895594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.899076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.899870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:19.901000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:19.901496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:19.901966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.095078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.100771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.103997 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a96f678-a5ae-4f82-92a2-6fd85398991f tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.375183 Aug 30 16:11:20.104733 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 860/1937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:20.112628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c8f10ba9-f1be-4dc1-99d7-cbdad3de2cc4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.116178 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b364e96-d148-4958-8973-66eb7ed431e2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.246781 Aug 30 16:11:20.117038 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1078/1938] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:19 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:20.121529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317ffe47-9b46-4e64-ad90-b46585de11e5", "name": "network-vif-deleted", "tag": "f064cf46-a3e2-418c-8ad8-653141ee6a01"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:20.127624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:20.131890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c8f10ba9-f1be-4dc1-99d7-cbdad3de2cc4 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022967 Aug 30 16:11:20.132105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 861/1939] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:20.132211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.133281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.133789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.152078 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] Creating event network-vif-deleted:f064cf46-a3e2-418c-8ad8-653141ee6a01 for instance 317ffe47-9b46-4e64-ad90-b46585de11e5 on n-h1-830883-28 Aug 30 16:11:20.157868 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-be6d8037-0471-46fd-9564-feaf905312bc req-3a757489-c3f6-4164-8ca5-cc3a40f9d494 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039745 Aug 30 16:11:20.158971 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1079/1940] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:20.406879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.407427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:20.409880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:20.416912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.417925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.418796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.419626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.433917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.435967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.459514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.460395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:20.479225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:20.480494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.481021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.481504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.483262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.486323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.489326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.621755 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-603fe81e-b2f3-4ca0-8577-98bea94560ad tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "DELETE /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 204 len: 0 microversion: 2.1 time: 0.218210 Aug 30 16:11:20.622783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 862/1941] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:20 2022] DELETE /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:20.637202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.638688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:20.648721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.650507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.652190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.653232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.653943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.654652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.709533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.737331 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f972f4d9-738a-46f2-8fb1-f01263d0520c tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1496 microversion: 2.1 time: 0.286147 Aug 30 16:11:20.747158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1080/1942] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:20.759928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.761294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:20.768717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.769780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.770418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.771255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.771815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.772340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.878489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.887182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:20.891303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-32b1d9cc-8902-49da-be5d-1ed6a2ddecfb tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1715 microversion: 2.1 time: 0.263018 Aug 30 16:11:20.892432 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 863/1943] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1715 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:20.897549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.901595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=32 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:20.914226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.server_groups [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Querying cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) for 1 instances {{(pid=122351) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 16:11:20.914987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.915460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.915953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.948723 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25e2dc87-9e16-4b13-adcc-d32106f1d648 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e" status: 200 len: 222 microversion: 2.1 time: 0.054975 Aug 30 16:11:20.949319 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 864/1944] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:20.954065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.955092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:20.962798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.963365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.963817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.964528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:20.965010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:20.965628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:20.980373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.988980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.990573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:20.991769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a5c8c89-f404-47bb-b329-8809e0736d21 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.238715 Aug 30 16:11:20.992927 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1081/1945] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:20.997721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:20.998223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:21.000170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.000650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.001087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.001530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 317ffe47-9b46-4e64-ad90-b46585de11e5 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:21.007418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.008022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.008465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.009173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.009639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.010070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.041981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:21.045192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:21.052895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6dc0d7ec-08f9-4d95-bf16-6751b0523b87 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1302 microversion: 2.1 time: 0.102345 Aug 30 16:11:21.053464 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 865/1946] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:20 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:21.121504 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9101f94-36bc-4b24-aa41-1c8c37faf33b tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 204 len: 0 microversion: 2.1 time: 0.126926 Aug 30 16:11:21.122089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1082/1947] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:20 2022] DELETE /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:21.130319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:21.130955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:21.138153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:21.138536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.138691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.138898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:21.139188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.139894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.140380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.140809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.145885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.146395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.146834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.147522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.147969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.149132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.276881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:21.285057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1bf1c85d-fb37-4233-aa02-12ebed9906ae tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1502 microversion: 2.1 time: 0.158689 Aug 30 16:11:21.285638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 866/1948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:21 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:21.296033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:21.296347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:21.296347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:21.296565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af89cc6a-f2a4-4af6-9bfa-69d38524cc74 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.161925 Aug 30 16:11:21.296565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1083/1949] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:21 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:21.297337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.297822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.298266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.299017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.299468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.299888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.435244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:21.443233 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a28c744-e5ac-4bb1-a990-dcc15aeebc96 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.156632 Aug 30 16:11:21.443801 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 867/1950] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:21 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:21.912957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:21.913587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:21.921532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.922031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.922538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:21.923458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:21.923924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:21.924353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.021891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:22.022755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.030061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.030663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.031169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.031938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.032553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.032984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.075805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.084165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dbca792e-669b-4576-8cb1-734aac78db45 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1715 microversion: 2.1 time: 0.175077 Aug 30 16:11:22.084749 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1084/1951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:21 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:22.089767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:22.090402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.096444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.097115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.097833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.098734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.099189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.099618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.132405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.132927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.133364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.133813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 317ffe47-9b46-4e64-ad90-b46585de11e5 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:22.184100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.193033 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2de11e05-95b1-4a19-b7b7-426f4f585bdf tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1302 microversion: 2.1 time: 0.107071 Aug 30 16:11:22.193674 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1085/1952] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:22 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:22.197968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.210062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.211722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.212876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a91d289c-b415-4ea5-8d16-3abc3c68e1c0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.195073 Aug 30 16:11:22.222402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 868/1953] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:22 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:22.309078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:22.309683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.315834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.316218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:22.316360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.316743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.317099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.317436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.317896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.318342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.323600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.324090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.324533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.325230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.325683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.326114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.464002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.473174 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-472765fe-33cb-494f-92c0-40b9aaccc70d tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1502 microversion: 2.1 time: 0.169048 Aug 30 16:11:22.473789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1086/1954] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:22 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:22.479177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:22.480168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.490644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.491447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.492037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.493027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.493822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.494493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.497705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.506023 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1cf5a680-9029-4b08-bc57-8c0fea7c405b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.193634 Aug 30 16:11:22.506881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 869/1955] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:22 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:22.647487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:22.659240 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03a02531-6a40-4119-8a1d-eccac48a17e0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.184403 Aug 30 16:11:22.660143 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1087/1956] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:22 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:22.767781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991360b8-c190-4676-8dcc-9aef765b1b17", "name": "network-vif-plugged", "status": "completed", "tag": "782762f9-787c-4218-919d-04f115eee699"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:22.781610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.782537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.783231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.796383 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] Creating event network-vif-plugged:782762f9-787c-4218-919d-04f115eee699 for instance 991360b8-c190-4676-8dcc-9aef765b1b17 on n-h1-830883-28 Aug 30 16:11:22.801369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-04036564-8788-4882-b5d3-90dd1ff18d8e req-88e4a720-cd63-4124-a22d-7ee55828bdd0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Aug 30 16:11:22.802281 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 870/1957] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:22.892503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7977441-13f8-4a2c-9e20-6d05422cd483"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:22.894960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:22.901698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.902188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.902656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:22.903365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:22.903822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:22.904246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.106115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.106849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.113332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.114011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.114552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.115253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.115740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.116343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.220219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12880fc3-eb6a-4ef7-98c0-a2f97ccb0ebd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "POST /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331492 Aug 30 16:11:23.221820 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1088/1958] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:11:22 2022] POST /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:23.229033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.230281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.237614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.238516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.239133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.240551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.241204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.241817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.248209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:23.281919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.282528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.282770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.283488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 317ffe47-9b46-4e64-ad90-b46585de11e5 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:23.346475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.355287 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c927f860-5026-46a7-ac8b-53f97b022291 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 200 len: 1302 microversion: 2.1 time: 0.131966 Aug 30 16:11:23.356583 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1089/1959] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:23.362672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.363511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.370777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.371814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.372447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.373356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.373990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.374633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.380067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.401434 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-847be147-9a9b-439d-8bd1-e39a7aac9c9f tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1715 microversion: 2.1 time: 0.298928 Aug 30 16:11:23.410366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 871/1960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1715 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:23.496595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.497722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.511137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.511642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.512086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.512803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.513348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.513675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.627598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.637989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.640475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.641866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef9cb275-027f-4e6f-bd61-01b641d7a23c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.283811 Aug 30 16:11:23.642635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1090/1961] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:23.657908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.659664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.668473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.669107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.669644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.670673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.671231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.672123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.791376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.806442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0456881-8475-4b3d-a641-534c7bb0dbd6 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1502 microversion: 2.1 time: 0.313660 Aug 30 16:11:23.808499 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 872/1962] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:23.818634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:23.818843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:23.819929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:23.828492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35fd9173-b691-468f-9487-1c043ff5feb3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.177526 Aug 30 16:11:23.829497 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1091/1963] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:23.831280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.832004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.832640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:23.835019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:23.837370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:23.838111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.160084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d6ab39-466a-4469-b695-46ae394858ef", "name": "network-vif-deleted", "tag": "59d269b2-51d6-4629-af79-e7baa0459c19"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:24.187147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.188996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.189691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.201227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:24.222378 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68ac44a4-ec6b-4d6e-95db-769e868d01c7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1324 microversion: 2.1 time: 0.401913 Aug 30 16:11:24.222378 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 873/1964] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:23 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:24.234910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] Creating event network-vif-deleted:59d269b2-51d6-4629-af79-e7baa0459c19 for instance 53d6ab39-466a-4469-b695-46ae394858ef on n-h2-830883-28 Aug 30 16:11:24.252819 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bb6ca055-a3c5-4682-a507-52ff9872d2b4 req-90362ba9-765e-4477-b239-bfe8b2bfb22a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091725 Aug 30 16:11:24.253667 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1092/1965] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:24.377473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:24.378409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 317ffe47-9b46-4e64-ad90-b46585de11e5] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:24.393573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.397582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.400188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.402342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.403966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.406717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.424905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:24.425612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:24.446088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.460274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.467616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.468572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.469023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.469481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.479645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] HTTP exception thrown: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Request method failure captured: Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 HTTP/1.1 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVmzw7QyKfp3TvyQOaE_cxZ1DrJS_lN_RYHVq3JQAUrKmOdxybXmS8cX5PT8l9bRuZOayjLCD4e8UL4Fgmuz0psrKkGh1iRVztN_pdziw2cK3FHnwxTK-3Mxlo9vLLVlCk3sQhsafQAGcBGEo5b88SYNzf3upvkfqSYJ0bjRc7Xxrs Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}] Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f7b57e0f6afe46e9b6d11985e8ff56c6 Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '317ffe47-9b46-4e64-ad90-b46585de11e5'} Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:24.481338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:24.487211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Returning 404 to user: Instance 317ffe47-9b46-4e64-ad90-b46585de11e5 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:24.512491 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd9c7762-2171-4c6a-afb8-5cb95ed77c89 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5" status: 404 len: 111 microversion: 2.1 time: 0.138839 Aug 30 16:11:24.513101 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 874/1966] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:24 2022] GET /compute/v2.1/servers/317ffe47-9b46-4e64-ad90-b46585de11e5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:24.522112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:24.522880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:24.542482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.543230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.543871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.544748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.546242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.548738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.577252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.577746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.578187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.578664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lazy-loading 'fault' on Instance uuid 53d6ab39-466a-4469-b695-46ae394858ef {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:24.629018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:24.685389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e37cc1074c428ebc01957eb31b1e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d46d8c36e449bbab8e141dd38b8188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:24.693210 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82efe47f-71eb-4e1d-80c9-01aaa9d769cc tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 200 len: 1368 microversion: 2.1 time: 0.272399 Aug 30 16:11:24.693785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1093/1967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:24 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:24.708606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:24.709484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:24.727058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.727941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.728574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.729478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.730118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.730762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.824791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2ab21e3-3dfd-4480-9197-326326c53117 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "DELETE /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 204 len: 0 microversion: 2.1 time: 0.306961 Aug 30 16:11:24.825390 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 875/1968] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:24 2022] DELETE /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:24.834995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:24.835766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:24.867418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.872378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.873155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.874218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:24.874909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:24.875542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:24.972559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:24.988188 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-183cca82-bba5-4b93-ada3-b019bce4efdf tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1460 microversion: 2.1 time: 0.157414 Aug 30 16:11:24.993033 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 876/1969] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:24 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:24.998083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.012590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.018537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.019459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.020076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.020963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3850852-25e9-4bf2-809b-848948d55760 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.316194 Aug 30 16:11:25.023498 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1094/1970] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:24 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:25.030937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.033310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.034160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.036075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.041240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.043451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.044611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.045649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.050895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.051928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.054138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.055723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.056393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.057194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.283083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.294104 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-491fc8eb-7d95-4f11-b022-38101d340dd4 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1467 microversion: 2.1 time: 0.299757 Aug 30 16:11:25.294723 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 877/1971] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:24 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:25.299208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.308108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef598aca-336b-4d5c-ba46-f100fbb21624 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.283342 Aug 30 16:11:25.308682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1095/1972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:25 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:25.324823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.325470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.331713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.332199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.332636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.333327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.333780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.334205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.501531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:25.515604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-193e6130-9f21-4dbd-b1ef-a8ca7805b11c tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1520 microversion: 2.1 time: 0.206514 Aug 30 16:11:25.516889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 878/1973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:25 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:25.600290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c679d42e-4a65-443f-9e30-98e22ecd7b26 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1779007613", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c679d42e-4a65-443f-9e30-98e22ecd7b26 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 243 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1779007613", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1779007613', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '22476a82-fde6-46b2-80f5-9062d8cf2e18'}]}}} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.606192 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.610755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.614115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c679d42e-4a65-443f-9e30-98e22ecd7b26 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.615069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c679d42e-4a65-443f-9e30-98e22ecd7b26 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018633 Aug 30 16:11:25.615708 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1096/1974] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:25 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:11:25.626951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.627674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 9af9c6d0-2d86-4695-a73e-c3816e255a49] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.634652 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] HTTP exception thrown: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9af9c6d0-2d86-4695-a73e-c3816e255a49/metadata HTTP/1.1 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '9af9c6d0-2d86-4695-a73e-c3816e255a49'} Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.641694 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 404 to user: Instance 9af9c6d0-2d86-4695-a73e-c3816e255a49 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.647785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07ff3003-9e26-4ae1-919c-165731aa54d7 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/9af9c6d0-2d86-4695-a73e-c3816e255a49/metadata" status: 404 len: 111 microversion: 2.1 time: 0.021472 Aug 30 16:11:25.650990 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 879/1975] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:11:25 2022] GET /compute/v2.1/servers/9af9c6d0-2d86-4695-a73e-c3816e255a49/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:25.700695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30631cb3-7272-4fb0-a1ed-6f510b2bbcf0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1688291", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30631cb3-7272-4fb0-a1ed-6f510b2bbcf0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 496 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1688291", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1688291', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '22476a82-fde6-46b2-80f5-9062d8cf2e18'}]}}} Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:11:25.705332 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30631cb3-7272-4fb0-a1ed-6f510b2bbcf0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-30631cb3-7272-4fb0-a1ed-6f510b2bbcf0 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010080 Aug 30 16:11:25.709536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1097/1976] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:25 2022] POST /compute/v2.1/servers => generated 687 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:11:25.724742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.725460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] [instance: 53d6ab39-466a-4469-b695-46ae394858ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.733438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.734282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.734826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.735635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.736161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.736806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] HTTP exception thrown: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Request method failure captured: Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef HTTP/1.1 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjYv8m8jGTH3hmKIl5XUOFvjMKlB6orIOY1tkhdXoRD5Lxjq7CaY9N5g3gdpG9rR0UCwiiIT_uzta4JzzxKg1ccKkQcE1YhywNuQuyqoQ6znlpJlqvUaGAIbAmNvtqNJ0lskHajopE0IzIvEb2_YNpwGaT0MPxiIbIr2CoWM_vsqrjw Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 09d46d8c36e449bbab8e141dd38b8188 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestManualDisk-940437010 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09d46d8c36e449bbab8e141dd38b8188"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_09d46d8c36e449bbab8e141dd38b8188"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/09d46d8c36e449bbab8e141dd38b8188"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/09d46d8c36e449bbab8e141dd38b8188"}]}] Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestManualDisk-940437010 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 09d46d8c36e449bbab8e141dd38b8188 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestManualDisk-940437010 Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestManualDisk-940437010-project Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e7e37cc1074c428ebc01957eb31b1e2c Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestManualDisk-940437010-project Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '53d6ab39-466a-4469-b695-46ae394858ef'} Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:25.758635 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Returning 404 to user: Instance 53d6ab39-466a-4469-b695-46ae394858ef could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-56ec1e94-a08f-4d83-a0ad-27b576edd2e8 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef" status: 404 len: 111 microversion: 2.1 time: 0.037313 Aug 30 16:11:25.763002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 880/1977] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:25 2022] GET /compute/v2.1/servers/53d6ab39-466a-4469-b695-46ae394858ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:25.765573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b15e1db-69ee-44c5-8ceb-c1ca7d175d77 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-268466551", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:25.767931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30b631e4-bfcc-4710-897c-282956a8e544 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] Calling method '.version_select at 0x7fd35cd80ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b15e1db-69ee-44c5-8ceb-c1ca7d175d77 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 499 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-268466551", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-268466551', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '22476a82-fde6-46b2-80f5-9062d8cf2e18'}]}}} Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:11:25.770631 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b15e1db-69ee-44c5-8ceb-c1ca7d175d77 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b15e1db-69ee-44c5-8ceb-c1ca7d175d77 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012375 Aug 30 16:11:25.776109 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1098/1978] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:25 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:11:25.797658 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30b631e4-bfcc-4710-897c-282956a8e544 tempest-ServersTestManualDisk-940437010 tempest-ServersTestManualDisk-940437010-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784607634" status: 202 len: 0 microversion: 2.1 time: 0.034743 Aug 30 16:11:25.798674 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 881/1979] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784607634 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:11:25.823005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47249eeb-48e1-420b-a83a-4c8f16142c4e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-643003518", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47249eeb-48e1-420b-a83a-4c8f16142c4e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 753 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-643003518", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-643003518', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '22476a82-fde6-46b2-80f5-9062d8cf2e18'}]}}} Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:11:25.829455 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:11:25.832579 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:11:25.835478 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.835478 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.835478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47249eeb-48e1-420b-a83a-4c8f16142c4e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.835478 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47249eeb-48e1-420b-a83a-4c8f16142c4e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012671 Aug 30 16:11:25.835478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1099/1980] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:25 2022] POST /compute/v2.1/servers => generated 1197 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 16:11:25.886937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1f741a0-5f7d-474d-a92b-8d38d23e3ea4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-639907692", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1f741a0-5f7d-474d-a92b-8d38d23e3ea4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 1265 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-639907692", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "22476a82-fde6-46b2-80f5-9062d8cf2e18"}]}} Aug 30 16:11:25.891669 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-639907692', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '22476a82-fde6-46b2-80f5-9062d8cf2e18'}]}}} Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.894171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:11:25.896122 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:11:25.901423 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:11:25.901423 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.901423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1f741a0-5f7d-474d-a92b-8d38d23e3ea4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.901423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1f741a0-5f7d-474d-a92b-8d38d23e3ea4 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012960 Aug 30 16:11:25.903992 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 882/1981] 10.222.0.47 () {60 vars in 1148 bytes} [Tue Aug 30 16:11:25 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 30 16:11:25.909433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.909942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: b837d61f-b4cc-434c-83d3-216d657bf3cc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.916925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] HTTP exception thrown: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/b837d61f-b4cc-434c-83d3-216d657bf3cc/metadata/test2 HTTP/1.1 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': 'b837d61f-b4cc-434c-83d3-216d657bf3cc', 'id': 'test2'} Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:25.918676 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 404 to user: Instance b837d61f-b4cc-434c-83d3-216d657bf3cc could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae7077c5-735b-4e97-bad1-28e6b36b743b tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/b837d61f-b4cc-434c-83d3-216d657bf3cc/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014687 Aug 30 16:11:25.924948 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1100/1982] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 16:11:25 2022] GET /compute/v2.1/servers/b837d61f-b4cc-434c-83d3-216d657bf3cc/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:25.939859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:25.940638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:25.947712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.948310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.948819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.949590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:25.950122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:25.950693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:25.979293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:25.991443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:26.011349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:26.013087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:26.028272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.029692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.030850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.033552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.034186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.034733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.103126 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbe5f832-f480-4772-948f-ac2d0b512dbd tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "DELETE /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 204 len: 0 microversion: 2.1 time: 0.167909 Aug 30 16:11:26.104021 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 883/1983] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:25 2022] DELETE /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:26.109298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:26.110123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:26.116543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.117922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.118555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.119534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.120047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.120537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.135764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.143723 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7acc2a0f-aeb3-418c-821b-d7c470a42f8a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1460 microversion: 2.1 time: 0.137305 Aug 30 16:11:26.144864 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1101/1984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:26 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1460 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:26.151252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:26.152211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:26.159561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.161149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.162488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.164274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.165232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.165946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.318387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.331949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.333322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.334506 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c88d83f-d23e-4a5a-8b75-ec334e80d89f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.229499 Aug 30 16:11:26.338540 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 884/1985] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:26 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:26.344218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5e81c1-705f-4e03-8126-9f1697f5fe92", "name": "network-vif-deleted", "tag": "5611cd86-6a02-419d-8af4-d4c3609be7d3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:26.358210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.359085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.360290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.375616 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] Creating event network-vif-deleted:5611cd86-6a02-419d-8af4-d4c3609be7d3 for instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 on n-h1-830883-28 Aug 30 16:11:26.381642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c288d5ef-994e-482b-bd67-1b69508df106 req-7a0faf83-934c-4cbc-8bcc-c8cd147e2b25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043838 Aug 30 16:11:26.383512 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 885/1986] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:26.390517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:26.391553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:26.399289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.399829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.400462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.401273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.401930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.402437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.431944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.440137 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e40029eb-1f52-4385-b1a7-03ae0e244ef1 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1526 microversion: 2.1 time: 0.293416 Aug 30 16:11:26.440739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1102/1987] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:26 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1526 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:26.449122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:26.449975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:26.467270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.467779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.475232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.477283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.478567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.479421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.598806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.614794 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64751401-cdb5-4d34-be4d-0d5919a54a5f tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1467 microversion: 2.1 time: 0.229793 Aug 30 16:11:26.615697 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 886/1988] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:26 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:26.702430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:26.718215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37d9b2c1-e209-4a4a-b778-bd3e0012cc7e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.272512 Aug 30 16:11:26.720881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1103/1989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:26 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:26.865617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "name": "network-vif-plugged", "status": "completed", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:26.882875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:26.883766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:26.886058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:26.905903 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] Creating event network-vif-plugged:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h1-830883-28 Aug 30 16:11:26.912555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-323775a4-ba47-4428-99bd-3528c244a47d req-511a2fbf-8632-488f-9300-995428139a6b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053540 Aug 30 16:11:26.917636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 887/1990] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:27.170644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:27.171262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:27.178047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.178566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.179006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.180373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.181268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.181768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.260226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.269183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81f75b7a-5919-4f98-ba68-952f2cfb6f19 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1295 microversion: 2.1 time: 0.102225 Aug 30 16:11:27.283783 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1104/1991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:27 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:27.364526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:27.365547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:27.373104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.373714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.374397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.375374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.375918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.376425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.464615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:27.465193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:27.472331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.472930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.473599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.474603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.475271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.475880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.630995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.642175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4026cb0-e6d2-4d6d-a1c4-8d6d6311afd8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1526 microversion: 2.1 time: 0.181760 Aug 30 16:11:27.642927 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1105/1992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:27 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:27.650809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:27.652124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:27.661111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.661703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.662220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.663334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.664064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.664946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.784933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.794402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.795998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.797208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-79c36ac3-cdc4-4b2c-88c0-850a8773f710 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.438018 Aug 30 16:11:27.797859 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 888/1993] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:27 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:27.813846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:27.814752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:27.823139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.824265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.824926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.826451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:27.827189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:27.827825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:27.841202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:27.853512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f22b86f-81dc-47d6-b78c-af478face288 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1467 microversion: 2.1 time: 0.209275 Aug 30 16:11:27.855842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1106/1994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:27 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1467 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:28.061173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:28.071569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29a2143d-4e64-450c-8a15-89f605c7e38d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.264413 Aug 30 16:11:28.073002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 889/1995] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:27 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:28.292449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:28.293385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:28.300812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.301478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.302016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.302889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.303612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.304133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.351802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.352518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.353137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.353931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lazy-loading 'fault' on Instance uuid fa5e81c1-705f-4e03-8126-9f1697f5fe92 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:28.503080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:28.516252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c12c5733-537b-4573-b768-1ebcc2b7d99f tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1300 microversion: 2.1 time: 0.228686 Aug 30 16:11:28.517811 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1107/1996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:28 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:28.666936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:28.667900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:28.676382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:28.678484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.679478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.680559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.681509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.682228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.682920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.821228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:28.821859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:28.833698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.834196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.837787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:28.838569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:28.839049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:28.839488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.131823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.140211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e66cd018-55d4-45db-a866-2a7cf1a66483 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1526 microversion: 2.1 time: 0.479326 Aug 30 16:11:29.154885 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 890/1997] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:28 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1526 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:29.160340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:29.161516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:29.168525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.169280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.169940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.170997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.171675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.172318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.232886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.252812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.254988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.258673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ffc060e-b412-4dbf-8d7f-0ac3ce03231b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1409 microversion: 2.25 time: 0.442456 Aug 30 16:11:29.260378 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1108/1998] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:28 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:29.269294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:29.270609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:29.285979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.287095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.287933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.292229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.294266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.295283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.322340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.352408 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc1fae97-82c8-4c79-8aa4-8f1efd1db60c tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1425 microversion: 2.1 time: 0.195970 Aug 30 16:11:29.352981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 891/1999] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:29 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1425 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:29.362878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453b4fbb-a577-401c-9a89-58f40bdbac89", "name": "network-vif-deleted", "tag": "a731daa0-1c2f-4166-be66-7a599966baad"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:29.383889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.384841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.385571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.468982 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] Creating event network-vif-deleted:a731daa0-1c2f-4166-be66-7a599966baad for instance 453b4fbb-a577-401c-9a89-58f40bdbac89 on n-h1-830883-28 Aug 30 16:11:29.479588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:29.480157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e4efcc82-54b5-46e8-ab19-b5442747577b req-2a9b0e6a-c687-4c75-a678-1eadbd559872 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123627 Aug 30 16:11:29.481846 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 892/2000] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:29.489121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef29e24-0a83-4765-8c63-53fe06015c4b", "name": "network-vif-unplugged", "status": "completed", "tag": "01b9c527-1507-4770-a8fc-d2153f61039c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:29.529603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.530452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.531153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.534562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:29.569579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] Creating event network-vif-unplugged:01b9c527-1507-4770-a8fc-d2153f61039c for instance 9ef29e24-0a83-4765-8c63-53fe06015c4b on n-h2-830883-28 Aug 30 16:11:29.603873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-05333278-4a6b-4203-9f2f-c8efb932e6a4 req-c457c050-2156-4b9f-86cf-179d4bce999c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119716 Aug 30 16:11:29.604845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 893/2001] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:29.614199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:29.615132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:29.632782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.634530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.635028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.635792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.636275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.636717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.697074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:29.698099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:29.699071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:29.700075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lazy-loading 'fault' on Instance uuid fa5e81c1-705f-4e03-8126-9f1697f5fe92 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:29.782715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4da3bee37e74f56951a4671ce6e3f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c78dbd8a64b944d8b1895fe048eaddae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:29.800166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-060b25ef-6c56-4e19-a30e-125bfb537a94 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 200 len: 1300 microversion: 2.1 time: 0.188957 Aug 30 16:11:29.815587 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 894/2002] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:29 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:30.167295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.168648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:30.192055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.193009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.194643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.206019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.209469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.210209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.293894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.311554 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4c1b359-a4d9-49fd-a3f7-52043ef9f45b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 1.048585 Aug 30 16:11:30.326332 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1109/2003] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:29 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:30.326332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.326332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:30.326856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.330904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.331535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.331997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.333346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.333572 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6fd0ca84-672f-40f4-8e43-2c8d0e0fb108 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1484 microversion: 2.1 time: 0.175086 Aug 30 16:11:30.333828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.334527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.335614 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 895/2004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1484 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:30.372021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:30.378337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.379087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:30.386588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.388431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.390642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.391517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.393814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.394402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.461289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.462922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.464245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.466460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lazy-loading 'fault' on Instance uuid 453b4fbb-a577-401c-9a89-58f40bdbac89 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:30.573074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b57e0f6afe46e9b6d11985e8ff56c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a394898e8f492db0d8174a3ce3eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.600152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f4a0d18-d41e-468f-8330-b4e7b67a93e2 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 200 len: 1302 microversion: 2.1 time: 0.225791 Aug 30 16:11:30.602454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.615866 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 896/2005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 1302 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:30.627248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.631599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:30.640383 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91985d3b-f245-4bf8-9d9d-5dfd868319d9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1605 microversion: 2.25 time: 0.322364 Aug 30 16:11:30.641511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1110/2006] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1605 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:30.665188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.665702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:30.672885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.672885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.680125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.683095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.683914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.684381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.837752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.838470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:30.848415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.848940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.849382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.852876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.853718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.854120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.875987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 HTTP/1.1 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fa5e81c1-705f-4e03-8126-9f1697f5fe92'} Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:30.879280 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee734095-ab3b-4e33-9373-d5d42280302a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 404 len: 111 microversion: 2.1 time: 0.047381 Aug 30 16:11:30.888391 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1111/2007] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:30.899463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.919633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_groups [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Querying cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) for 1 instances {{(pid=122352) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 16:11:30.920451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:30.921035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:30.921634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:30.922622 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0fa5d814-be4c-494f-9351-505926a0687b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.262144 Aug 30 16:11:30.923127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 897/2008] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:30.948408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-091cf3be-8ce2-46b0-add0-c3d62b7ff923 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.055607 Aug 30 16:11:30.949456 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1112/2009] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:30.963072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:30.999582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.server_groups [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Querying cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) for 1 instances {{(pid=122351) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 16:11:31.002006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.003962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.005247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.050151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4897567c-e6ab-4476-974d-7e32f2bd71af tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e" status: 200 len: 184 microversion: 2.1 time: 0.091739 Aug 30 16:11:31.056484 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 898/2010] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:11:30 2022] GET /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e => generated 184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:31.070792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.071330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:31.084151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.084847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.085829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.087084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.088819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.089456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.141877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 HTTP/1.1 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fa5e81c1-705f-4e03-8126-9f1697f5fe92'} Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:31.143485 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a55b97f-28c0-4ef4-904c-5dff613c3b75 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 404 len: 111 microversion: 2.1 time: 0.078587 Aug 30 16:11:31.153765 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1113/2011] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.164887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.164887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] [instance: fa5e81c1-705f-4e03-8126-9f1697f5fe92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:31.167791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.168412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.168721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.169437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.172553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.173021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.209978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 HTTP/1.1 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'fa5e81c1-705f-4e03-8126-9f1697f5fe92'} Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.212207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. Aug 30 16:11:31.218005 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.228865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance fa5e81c1-705f-4e03-8126-9f1697f5fe92 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.229756 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7728b3ec-fb96-4aea-9993-5d87e2623f9a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92" status: 404 len: 111 microversion: 2.1 time: 0.075904 Aug 30 16:11:31.233208 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 899/2012] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:31 2022] GET /compute/v2.1/servers/fa5e81c1-705f-4e03-8126-9f1697f5fe92 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.239640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5167266-6470-4513-a6d7-bb48495c6433 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.248059 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d5167266-6470-4513-a6d7-bb48495c6433 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5167266-6470-4513-a6d7-bb48495c6433 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-server-groups/af26f118-b459-43f9-a624-72594e369ede HTTP/1.1 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'af26f118-b459-43f9-a624-72594e369ede'} Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.253850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. Aug 30 16:11:31.259058 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.261056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5167266-6470-4513-a6d7-bb48495c6433 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance group af26f118-b459-43f9-a624-72594e369ede could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.262347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5167266-6470-4513-a6d7-bb48495c6433 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/af26f118-b459-43f9-a624-72594e369ede" status: 404 len: 117 microversion: 2.1 time: 0.027937 Aug 30 16:11:31.263467 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1114/2013] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/os-server-groups/af26f118-b459-43f9-a624-72594e369ede => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.272250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0de946c0-695c-4715-99c0-05fab9fe8f3a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.281393 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0de946c0-695c-4715-99c0-05fab9fe8f3a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0de946c0-695c-4715-99c0-05fab9fe8f3a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-server-groups/3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 HTTP/1.1 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3dc47eaf-aee6-4afd-8e03-f9c59bdd5908'} Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.285006 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. Aug 30 16:11:31.290128 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.292424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0de946c0-695c-4715-99c0-05fab9fe8f3a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance group 3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.293667 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0de946c0-695c-4715-99c0-05fab9fe8f3a tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/3dc47eaf-aee6-4afd-8e03-f9c59bdd5908" status: 404 len: 117 microversion: 2.1 time: 0.025872 Aug 30 16:11:31.295188 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 900/2014] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/os-server-groups/3dc47eaf-aee6-4afd-8e03-f9c59bdd5908 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.303659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fca287c-5812-411e-bb96-790404119483 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.313919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8fca287c-5812-411e-bb96-790404119483 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fca287c-5812-411e-bb96-790404119483 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-server-groups/7af7b986-c987-406f-a6fb-0d66077de2ab HTTP/1.1 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7af7b986-c987-406f-a6fb-0d66077de2ab'} Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.315660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fca287c-5812-411e-bb96-790404119483 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance group 7af7b986-c987-406f-a6fb-0d66077de2ab could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8fca287c-5812-411e-bb96-790404119483 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/7af7b986-c987-406f-a6fb-0d66077de2ab" status: 404 len: 117 microversion: 2.1 time: 0.017839 Aug 30 16:11:31.320984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1115/2015] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/os-server-groups/7af7b986-c987-406f-a6fb-0d66077de2ab => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.329705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ad05957-731f-48cc-aa38-ffb9f569b1da tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.338173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3ad05957-731f-48cc-aa38-ffb9f569b1da tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] HTTP exception thrown: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. Aug 30 16:11:31.339390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ad05957-731f-48cc-aa38-ffb9f569b1da tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Request method failure captured: Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-server-groups/41b93147-f34b-46e4-98ce-358c202cd0ce HTTP/1.1 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjaQg-y_74kO1RSsIJ3HsUGKcZvOyqy_BPTIChUWAhl_qyejYeNVL1qrFyGEMlKj-fEI_74UYvsweRQ1mvK5A_jG2czXvdGEKqXLtqppvqcwQsA_Diw4USwVURBixhVNUU-J1d5EzXOhmCLs1vNY91XycIKsO_A-rv1Qzk-lkyfMQZo Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c78dbd8a64b944d8b1895fe048eaddae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c78dbd8a64b944d8b1895fe048eaddae"}]}] Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c78dbd8a64b944d8b1895fe048eaddae Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerGroupTestJSON-837884964 Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: a4da3bee37e74f56951a4671ce6e3f5f Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerGroupTestJSON-837884964-project Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '41b93147-f34b-46e4-98ce-358c202cd0ce'} Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.339750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ad05957-731f-48cc-aa38-ffb9f569b1da tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Returning 404 to user: Instance group 41b93147-f34b-46e4-98ce-358c202cd0ce could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ad05957-731f-48cc-aa38-ffb9f569b1da tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/41b93147-f34b-46e4-98ce-358c202cd0ce" status: 404 len: 117 microversion: 2.1 time: 0.015820 Aug 30 16:11:31.344610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 901/2016] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/os-server-groups/41b93147-f34b-46e4-98ce-358c202cd0ce => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.345864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:31.349870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5098dd40-0fc5-4f83-a382-a7a06e5d5736 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.356743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.357368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.357923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.358789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.359357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.359912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.387517 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5098dd40-0fc5-4f83-a382-a7a06e5d5736 tempest-ServerGroupTestJSON-837884964 tempest-ServerGroupTestJSON-837884964-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e" status: 204 len: 0 microversion: 2.1 time: 0.041424 Aug 30 16:11:31.388568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 902/2017] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:11:31 2022] DELETE /compute/v2.1/os-server-groups/8bb2e4f9-32d1-4e47-96a2-335e990bed8e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:31.395882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.396836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:31.411887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.412528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.413223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.415855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.416412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.416957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.461255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.462121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.462827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.463513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lazy-loading 'fault' on Instance uuid 991360b8-c190-4676-8dcc-9aef765b1b17 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:31.550685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4e63f8383b45aab2ee2433ca9c7dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989d61ccb1845ecacf3fa928cd69551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:31.560792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b808dfa-07d0-4501-8fbe-e2a2a55a379e tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 200 len: 1314 microversion: 2.1 time: 0.171090 Aug 30 16:11:31.575413 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 903/2018] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:31 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:31.626683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:31.627515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] [instance: 453b4fbb-a577-401c-9a89-58f40bdbac89] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:31.641067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.642354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.644445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.645161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:31.645699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:31.646183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:31.662477 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] HTTP exception thrown: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Request method failure captured: Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 HTTP/1.1 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjVmzw7QyKfp3TvyQOaE_cxZ1DrJS_lN_RYHVq3JQAUrKmOdxybXmS8cX5PT8l9bRuZOayjLCD4e8UL4Fgmuz0psrKkGh1iRVztN_pdziw2cK3FHnwxTK-3Mxlo9vLLVlCk3sQhsafQAGcBGEo5b88SYNzf3upvkfqSYJ0bjRc7Xxrs Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/84a394898e8f492db0d8174a3ce3eeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/84a394898e8f492db0d8174a3ce3eeb9"}]}] Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 84a394898e8f492db0d8174a3ce3eeb9 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MigrationsAdminTest-442076903 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f7b57e0f6afe46e9b6d11985e8ff56c6 Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MigrationsAdminTest-442076903-project Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '453b4fbb-a577-401c-9a89-58f40bdbac89'} Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:31.664829 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. Aug 30 16:11:31.672083 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:31.673957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] Returning 404 to user: Instance 453b4fbb-a577-401c-9a89-58f40bdbac89 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:31.676150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-54350212-7eee-41ce-966b-b44e14f981e8 tempest-MigrationsAdminTest-442076903 tempest-MigrationsAdminTest-442076903-project] 10.222.0.47 "GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89" status: 404 len: 111 microversion: 2.1 time: 0.055382 Aug 30 16:11:31.677361 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 904/2019] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:31 2022] GET /compute/v2.1/servers/453b4fbb-a577-401c-9a89-58f40bdbac89 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:31.863776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:31.873072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ba671e9-c0f1-438b-912a-03f7fe9795e1 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.538732 Aug 30 16:11:31.874255 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1116/2020] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:31 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:32.219868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991360b8-c190-4676-8dcc-9aef765b1b17", "name": "network-vif-deleted", "tag": "782762f9-787c-4218-919d-04f115eee699"}, {"name": "network-changed", "server_uuid": "9ef29e24-0a83-4765-8c63-53fe06015c4b", "tag": "01b9c527-1507-4770-a8fc-d2153f61039c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:32.240602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:32.241383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:32.242654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:32.264685 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Creating event network-vif-deleted:782762f9-787c-4218-919d-04f115eee699 for instance 991360b8-c190-4676-8dcc-9aef765b1b17 on n-h1-830883-28 Aug 30 16:11:32.265499 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] Creating event network-changed:01b9c527-1507-4770-a8fc-d2153f61039c for instance 9ef29e24-0a83-4765-8c63-53fe06015c4b on n-h2-830883-28 Aug 30 16:11:32.276601 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-068bb48d-40f8-47a6-ac39-4f02f04c88dc req-2a971c81-1f23-4c2d-979f-d6eefeaf3cd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061401 Aug 30 16:11:32.278491 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 905/2021] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:32.591815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:32.593164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] [instance: 991360b8-c190-4676-8dcc-9aef765b1b17] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:32.606493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:32.607406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:32.608724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:32.610322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:32.611346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:32.612597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:32.632652 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] HTTP exception thrown: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Request method failure captured: Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 HTTP/1.1 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjaa1QYYkg7mURf_u7MzKkILJNBuRv_W5eHEQiDP4D51ta438tVWYZ191qG6lXdfJpad6zomGvbs9lrknxEyZOBYaZY5rYyl_oQTozb7QA_0nvtVRvNovoopBBUk7DtpSBCcl5iB7H-w0AD-y74WL-STRG7Khx4Pvj67sZ4f5OMUh24 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f989d61ccb1845ecacf3fa928cd69551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f989d61ccb1845ecacf3fa928cd69551"}]}] Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f989d61ccb1845ecacf3fa928cd69551 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-237178260 Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cc4e63f8383b45aab2ee2433ca9c7dbc Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-237178260-project Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '991360b8-c190-4676-8dcc-9aef765b1b17'} Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:32.635901 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] Returning 404 to user: Instance 991360b8-c190-4676-8dcc-9aef765b1b17 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c55df0d1-7b97-452b-a0e0-310e932459e8 tempest-ServerMetadataNegativeTestJSON-237178260 tempest-ServerMetadataNegativeTestJSON-237178260-project] 10.222.0.47 "GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17" status: 404 len: 111 microversion: 2.1 time: 0.058197 Aug 30 16:11:32.641430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1117/2022] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:32 2022] GET /compute/v2.1/servers/991360b8-c190-4676-8dcc-9aef765b1b17 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:11:32.906681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:32.908161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:32.918167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:32.919190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:32.919854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:32.920815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:32.921490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:32.922173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:32.951878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:33.317872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:33.332229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51fedbe2-cdc7-45e1-8b08-95196e062615 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.439761 Aug 30 16:11:33.352590 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 906/2023] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:32 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:34.359382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:34.360163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:34.369986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:34.376771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:34.377320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:34.378087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:34.378618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:34.379299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:34.558829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:34.589046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:34.589907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:34.590586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:34.608767 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] Creating event network-changed:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h1-830883-28 Aug 30 16:11:34.633761 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1794b514-32bf-4352-ab16-351cf51dba15 req-817d5a00-c139-443e-baa1-ccf764d3989a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080468 Aug 30 16:11:34.636353 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 907/2024] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:36.092052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:36.113529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-055e6ea2-dbc4-4492-b236-4e1a2343c978 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 1.755750 Aug 30 16:11:36.114152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1118/2025] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:34 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:37.364101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9395fd2d-d5b8-4de0-96fd-ffc514830086 tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] Calling method '.version_select at 0x7fd35c4a11f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:37.453323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f1976b-01fd-40d5-aafb-bc3d6baca538"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:37.457489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:37.478441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:37.479298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:37.480665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:37.483538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:37.484899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:37.487999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:37.728839 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] HTTP exception thrown: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Request method failure captured: Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments/c7977441-13f8-4a2c-9e20-6d05422cd483 HTTP/1.1 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 74 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjYxjci2ABnUu89wA8VWq3KhZQbHBcj7QsjuMFlPn3ljdvgDPXAt50dwyRr6w-1qwJQboV9T7Axp0TceTtQh_2A0byAM2UOIOvHSxKke-cByCMtSfZLXeaQbTHbo_upi_-iQCmAS3VBRd6JVqawlmVa82xqN5CeCj0ZhNqMwymid3mg Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 86f4d259b7204fc19502b71d8133352c Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86f4d259b7204fc19502b71d8133352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_86f4d259b7204fc19502b71d8133352c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/86f4d259b7204fc19502b71d8133352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86f4d259b7204fc19502b71d8133352c"}]}] Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 86f4d259b7204fc19502b71d8133352c Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesAdminNegativeTest-897922860-project-admin Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 3eebc0e594b6413e830e046e5d0b2ce6 Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesAdminNegativeTest-897922860-project-admin Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: {"volumeAttachment": {"volumeId": "a1f1976b-01fd-40d5-aafb-bc3d6baca538"}} Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': 'a89b5b78-2cb8-4afc-848b-023f5fb86548', 'id': 'c7977441-13f8-4a2c-9e20-6d05422cd483', 'body': {'volumeAttachment': {'volumeId': 'a1f1976b-01fd-40d5-aafb-bc3d6baca538'}}} Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. (HTTP 404) (Request-ID: req-5d2b6513-91fa-4642-8c8d-4f12439a46f8) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:11:37.746914 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Returning 400 to user: Volume a1f1976b-01fd-40d5-aafb-bc3d6baca538 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7ea33e6-dd31-4748-b06e-b93f240570e0 tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] 10.222.0.47 "PUT /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments/c7977441-13f8-4a2c-9e20-6d05422cd483" status: 400 len: 107 microversion: 2.1 time: 0.865438 Aug 30 16:11:37.754698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 908/2026] 10.222.0.47 () {60 vars in 1433 bytes} [Tue Aug 30 16:11:36 2022] PUT /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments/c7977441-13f8-4a2c-9e20-6d05422cd483 => generated 107 bytes in 868 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:11:37.763911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:37.763911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:37.809318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:37.809318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:37.815204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:37.817310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:37.823425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:37.824080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:38.057109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9395fd2d-d5b8-4de0-96fd-ffc514830086 tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks" status: 200 len: 8108 microversion: 2.1 time: 1.005073 Aug 30 16:11:38.059517 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1119/2027] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:11:37 2022] GET /compute/v2.1/os-networks => generated 8108 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:38.070288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:38.088727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:38.115113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:38.117371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:38.117983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:38.122483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:38.123026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:38.125619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:38.276697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lazy-loading 'services' on Instance uuid a89b5b78-2cb8-4afc-848b-023f5fb86548 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:11:38.392693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-118f6ba2-f8b1-492d-8338-4e5554123862 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments/c7977441-13f8-4a2c-9e20-6d05422cd483" status: 202 len: 0 microversion: 2.1 time: 0.331530 Aug 30 16:11:38.394738 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1120/2028] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:11:38 2022] DELETE /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments/c7977441-13f8-4a2c-9e20-6d05422cd483 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:11:38.404316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-324d9b36-dcd1-4777-bd35-c89c0edf0fe3 tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] Calling method '.version_select at 0x7fd35c4a1040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:38.462083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:38.488367 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d4a11cb-a390-41e7-a510-b6c498bb4ea4 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.731006 Aug 30 16:11:38.489010 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 909/2029] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:37 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:38.503903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:38.505934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:38.523085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:38.526144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:38.526631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:38.527401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:38.528047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:38.528973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:38.624803 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfb4dc2f-1fa3-4982-adbc-f54c3027b47a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134486 Aug 30 16:11:38.625784 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 910/2030] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:38 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:38.736017 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-324d9b36-dcd1-4777-bd35-c89c0edf0fe3 tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks/07bdfb73-ddda-4904-b9ec-58b586277baf" status: 200 len: 652 microversion: 2.1 time: 0.339647 Aug 30 16:11:38.737518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1121/2031] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:11:38 2022] GET /compute/v2.1/os-networks/07bdfb73-ddda-4904-b9ec-58b586277baf => generated 652 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:38.752010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03667387-b884-4acc-a6c2-9672aa1ec3fc tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] Calling method '.version_select at 0x7fd360f0daf0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:39.518566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:39.521945 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03667387-b884-4acc-a6c2-9672aa1ec3fc tempest-NetworksTest-1853560333 tempest-NetworksTest-1853560333-project-admin] 10.222.0.47 "GET /compute/v2.1/os-networks" status: 200 len: 8791 microversion: 2.1 time: 0.775939 Aug 30 16:11:39.521945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 911/2032] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:11:38 2022] GET /compute/v2.1/os-networks => generated 8791 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:39.524608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:39.539121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:39.541098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:39.542743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:39.544190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:39.547343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:39.548682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:39.645643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:39.649165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:39.668159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:39.668668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:39.669746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:39.672091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:39.672602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:39.674949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:39.766136 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07169a04-7287-410d-a749-1fdbde097bdd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131723 Aug 30 16:11:39.767301 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 912/2033] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:39 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:39.961687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:39.974032 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9673b955-2e3b-4525-9d08-2c38fdbb36ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.462442 Aug 30 16:11:39.984975 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1122/2034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:39 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:40.781887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:40.785202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:40.803627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:40.805580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:40.806462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:40.808752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:40.809442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:40.811137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:40.940876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e51728b9-4b37-47fb-b4f6-86fe9bb099f0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159926 Aug 30 16:11:40.942101 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 913/2035] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:40 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:41.000442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:41.001565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:41.017684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:41.025831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:41.026685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:41.028158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:41.029796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:41.030666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:41.533700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:41.549489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b692dca-776c-4388-a9ce-dd69744b7df6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.552957 Aug 30 16:11:41.565630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1123/2036] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:40 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:41.958220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:41.963502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:41.988383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:41.990416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:41.992940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:41.994037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:42.010402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:42.012709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:42.134870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba33a474-15bf-4d63-9189-b25215024c98 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182843 Aug 30 16:11:42.135793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 914/2037] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:41 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:42.578371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:42.579140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:42.588377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:42.589581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:42.591570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:42.592402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:42.597380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:42.598184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:43.149447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:43.152727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:43.177126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:43.187281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:43.187968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:43.189129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:43.189780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:43.190819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:43.249596 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8e117950-1374-4774-aff2-1e399ccfd3e1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106243 Aug 30 16:11:43.250546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 915/2038] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:43 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:43.371445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:43.383328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6017242-c069-4440-8f39-70763c365cff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1390 microversion: 2.1 time: 0.808590 Aug 30 16:11:43.404469 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1124/2039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:42 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1390 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:44.263101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:44.267492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:44.283461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:44.283963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:44.284410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:44.296570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:44.302601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:44.304598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:44.360438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b6a2104-b599-4ef9-b9d8-24f2935ff4ad tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103023 Aug 30 16:11:44.361616 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 916/2040] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:44 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:44.404925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:44.405625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:44.425055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:44.425555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:44.426002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:44.426757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:44.427217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:44.427644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:44.989902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:45.004207 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-465e17f3-904a-41c3-9048-d3f3f31a0f0e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1380 microversion: 2.1 time: 0.602208 Aug 30 16:11:45.007655 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1125/2041] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:44 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1380 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:45.032905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdb861ff-e787-45c6-aaad-c1abfd1134e2 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '.version_select at 0x7fd35d5e3b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.036810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb861ff-e787-45c6-aaad-c1abfd1134e2 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.039062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb861ff-e787-45c6-aaad-c1abfd1134e2 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.040121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb861ff-e787-45c6-aaad-c1abfd1134e2 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.087003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdb861ff-e787-45c6-aaad-c1abfd1134e2 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 2343 microversion: 2.1 time: 0.059135 Aug 30 16:11:45.093753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 917/2042] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:11:45 2022] GET /compute/v2.1/os-migrations => generated 2343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:45.107255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.108155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:45.115106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.123442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.124788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.126841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.132926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.133401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.564742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-674815730", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:45.578107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7d5b0f0-72db-45f4-b61f-673a9cc77018 tempest-LiveMigrationTest-1603277451 tempest-LiveMigrationTest-1603277451-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1533 microversion: 2.1 time: 0.471434 Aug 30 16:11:45.578795 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1126/2043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:45 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1533 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:45.593811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.598354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:45.623379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:45.626942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.628776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.629114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.629848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.630339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.630788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.665269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:45.666105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:45.666909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:45.667520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:45.669207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:45.684584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.685794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.686530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.687684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.688467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.689157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.735228 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21a7f2ea-76fb-48a2-bbda-82c2b9d20848 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155347 Aug 30 16:11:45.737958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1127/2044] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:45 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:45.738255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Getting quotas for project 4e068d321649463790072bfb11a82972. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:45.748270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.748790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:45.751391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Getting quotas for user a2a443776e594b7b90c66a9c5da0999f and project 4e068d321649463790072bfb11a82972. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:45.769292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.770720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.771888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:45.772546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.774444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.774974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.776490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:45.776704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.844598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:11:45.876115 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08a82c72-84ef-4a10-8dd6-6217a5ee8230 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.630455 Aug 30 16:11:45.884709 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 918/2045] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:11:45.893166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.900204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:46.081201 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3d807d4-850a-4399-aa32-099d36fee93d tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 204 len: 0 microversion: 2.1 time: 0.338567 Aug 30 16:11:46.083711 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1128/2046] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:11:45 2022] DELETE /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:11:46.098139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:46.099469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:46.116947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.118946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.120366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.136852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.141274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.141833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.146399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:46.170617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:46.196215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:46.198383 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b8831b9-d54e-4c0e-b896-acf69002fcab tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1277 microversion: 2.54 time: 0.313329 Aug 30 16:11:46.199249 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 919/2047] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:45 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:46.750389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:46.753645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:46.770344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.772746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.780322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.781313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.781937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.782567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.844217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-201a6e4b-20af-4fc2-8d77-3801e0b6c0db tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098565 Aug 30 16:11:46.850808 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 920/2048] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:46 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:47.225614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:47.233962 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4b2c004-e081-4c73-8033-b8a814990863 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1386 microversion: 2.1 time: 1.145616 Aug 30 16:11:47.245008 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1129/2049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:46 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1386 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:47.251598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Action: 'update', calling method: .version_select at 0x7fd360f7b820>, body: {"quota_set": {"ram": "5120"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:47.273367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:47.273850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:47.296228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.297026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.297645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.298827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.299971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.300794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.382952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.384382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.387428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.388631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.389905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.391667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.577160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:47.599338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-004d9c8f-fab3-4f7a-876b-1e8bb3476d80 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710" status: 200 len: 240 microversion: 2.36 time: 0.630123 Aug 30 16:11:47.600920 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 921/2050] 10.222.0.47 () {62 vars in 1303 bytes} [Tue Aug 30 16:11:46 2022] PUT /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710 => generated 240 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:11:47.626629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Calling method '.version_select at 0x7fd360f0d4c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:47.716775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:47.743055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:47.744880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:47.747516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-57e0c16f-c491-41ad-9540-e8a6bbcf41f2 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1329 microversion: 2.54 time: 0.489064 Aug 30 16:11:47.748599 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1130/2051] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:47 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1329 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:47.809054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.827360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.829826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.832737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.837261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.838685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.873452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:47.888511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:47.891904 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b146d9aa-f24f-45c9-8aee-7f84ac393bf8 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710/detail" status: 200 len: 672 microversion: 2.36 time: 0.274870 Aug 30 16:11:47.893882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 922/2052] 10.222.0.47 () {60 vars in 1304 bytes} [Tue Aug 30 16:11:47 2022] GET /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710/detail => generated 672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:11:47.955610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.956496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.957335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.960417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.961707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.962444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.045920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:48.076455 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7b7717de-28b8-4b14-863c-a4a6b762dd7f tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.215984 Aug 30 16:11:48.077685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1131/2053] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:11:47 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:11:48.270964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:48.271979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:48.282338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c4b1430>, body: {"quota_set": {"ram": "2048"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:48.299615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.300982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.301817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.305798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.309191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.314543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.491287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.501780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.502704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.503827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.505287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.507914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.637917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.638467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.639201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.639958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.641070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.641571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.651134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:48.663123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5d965a8e-a37d-49e0-98be-8d54aa2ffda6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1344 microversion: 2.1 time: 0.396828 Aug 30 16:11:48.667210 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 923/2054] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:48 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1344 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:48.688581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef29e24-0a83-4765-8c63-53fe06015c4b", "name": "network-vif-deleted", "tag": "01b9c527-1507-4770-a8fc-d2153f61039c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:48.716434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.720038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.723046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.747193 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] Creating event network-vif-deleted:01b9c527-1507-4770-a8fc-d2153f61039c for instance 9ef29e24-0a83-4765-8c63-53fe06015c4b on n-h1-830883-28 Aug 30 16:11:48.769974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-255c86da-0b17-477c-9540-ad6a59d2926c req-942aa427-35ea-4917-8eff-c9b4d70e01a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099236 Aug 30 16:11:48.770570 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 924/2055] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:48.804220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1000568323", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c5357068-36c9-46c3-a74f-2a1439cb265a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:48.872711 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-058673eb-33b2-4cb8-9337-cef316e48855 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710?user_id=43111c4facb34f468db17165625a4099" status: 200 len: 240 microversion: 2.36 time: 0.594607 Aug 30 16:11:48.888058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1132/2056] 10.222.0.47 () {62 vars in 1384 bytes} [Tue Aug 30 16:11:48 2022] PUT /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710?user_id=43111c4facb34f468db17165625a4099 => generated 240 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:48.902534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:48.910563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:48.926115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.930704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.931508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.934469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.935190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.938708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.954008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] validate_networks() for [('c5357068-36c9-46c3-a74f-2a1439cb265a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:49.099463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:49.112661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:49.114105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:49.121313 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2edc0eba-043e-4b1b-9a79-f28bcbe51405 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1335 microversion: 2.54 time: 0.230350 Aug 30 16:11:49.122261 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1133/2057] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:48 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1335 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:49.138160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-697f8d92-e14b-4e8b-ae18-93975b5c9692 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] Calling method '.version_select at 0x7fd35c4d6040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:49.310501 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-697f8d92-e14b-4e8b-ae18-93975b5c9692 tempest-QuotasAdminTestV236-1973942306 tempest-QuotasAdminTestV236-1973942306-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710?user_id=43111c4facb34f468db17165625a4099" status: 200 len: 282 microversion: 2.36 time: 0.187022 Aug 30 16:11:49.318867 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1134/2058] 10.222.0.47 () {60 vars in 1364 bytes} [Tue Aug 30 16:11:49 2022] GET /compute/v2.1/os-quota-sets/8ec915a1645d4c05a505b04a9a309710?user_id=43111c4facb34f468db17165625a4099 => generated 282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:11:49.689342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:49.690319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:49.703903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:49.707113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:49.708122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:49.710555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:49.713993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:49.714712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.009710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:50.010236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:50.010768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:50.011153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:50.011677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:50.056795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.057460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.057918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.061273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.061858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.062341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.122263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.125039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:50.131977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Getting quotas for user ae6d5176489540329d05947f06c6ccfc and project df53a799481b4b4aa538d42c6cd10ce8. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:50.149628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:50.153297 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e1117cc-8cb7-4635-8cb1-3b4c6f7e23f5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.464555 Aug 30 16:11:50.154185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:50.156259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1135/2059] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:49 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:50.175931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:50.179042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:50.207358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.210709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.211618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.216273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.218408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.218855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.233584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfddfbce-ec0a-4cc5-a12f-0410cf782d81 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460390 Aug 30 16:11:50.235129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 925/2060] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:11:50.262129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-918479bd-0dd9-4a14-a5d3-00e2cb4acdfa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:50.276377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-918479bd-0dd9-4a14-a5d3-00e2cb4acdfa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:50.365766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.380779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.383473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.385456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3325fddb-c625-4015-a67a-e72c035cc5e0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1335 microversion: 2.54 time: 0.227767 Aug 30 16:11:50.402403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1136/2061] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:50 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1335 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:50.460344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-918479bd-0dd9-4a14-a5d3-00e2cb4acdfa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.482065 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-918479bd-0dd9-4a14-a5d3-00e2cb4acdfa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1218 microversion: 2.1 time: 0.239524 Aug 30 16:11:50.494630 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 926/2062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:50 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:51.182201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:51.183962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:51.205194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.205673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.212569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.213606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.214252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.214876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.415411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:51.416731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:51.434446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.435387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.436070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.436976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.439677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.440307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.473677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.493485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c143c864-c1eb-4a1a-be69-1616a73799f2 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.316371 Aug 30 16:11:51.494094 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1137/2063] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:51 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:51.516935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:51.517571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:51.529358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.529859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.534236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.535035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.539586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.540170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.724016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.744204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.745707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.763487 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b24ee995-5c54-414e-a34f-56c17b6c69f0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1335 microversion: 2.54 time: 0.352281 Aug 30 16:11:51.783529 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 927/2064] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:51 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1335 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:11:51.790692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.811752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ac238f9-25f7-4364-9940-7650c268500b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1222 microversion: 2.1 time: 0.298408 Aug 30 16:11:51.825292 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1138/2065] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:51 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1222 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:52.519552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:52.520184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:52.544389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.544895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.545341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.546168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.546558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.546998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.783456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:52.794396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:52.794867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:52.799162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e22a0285-f1b2-4f9a-8c41-4e0ec30f04a8 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.283417 Aug 30 16:11:52.800377 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 928/2066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:52 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.814661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.844954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:52.845849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:52.856153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.856965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.857594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.858519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.867114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.867869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.990443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:53.000742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-defc99b0-5fdc-4869-a290-2c2446c756cc tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1270 microversion: 2.1 time: 0.159486 Aug 30 16:11:53.004996 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 929/2067] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:52 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:53.209982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:53.237315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:53.243166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:53.244745 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-788b1c41-624c-43f8-946b-247fa7b74c24 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1335 microversion: 2.54 time: 0.457353 Aug 30 16:11:53.247019 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1139/2068] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:52 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1335 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:53.821978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:53.822748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:53.847571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:53.848079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:53.848515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:53.849241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:53.849696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:53.865200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.032378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:54.034096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:54.048961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.049743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.050378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.051261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.051896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.056031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.189985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:54.205630 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-923bcae4-e9ff-4b4c-aeff-9b9d043622a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.389063 Aug 30 16:11:54.219005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 930/2069] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:53 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:54.274650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:54.279927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:54.280556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:54.291739 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0211f14f-a8c6-468b-b475-02d6983153f1 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1288 microversion: 2.1 time: 0.263469 Aug 30 16:11:54.296182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.296680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.297119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.297833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.298288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.298737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.301990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1140/2070] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:54 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1288 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:54.311753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:54.676553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:54.691867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:54.693601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:54.694922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-74f3e72c-58aa-4619-a4f6-469acc7cab28 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1356 microversion: 2.54 time: 0.423495 Aug 30 16:11:54.706340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 931/2071] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:54 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1356 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:54.732120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12453dd9-8aca-465a-a031-3f8230b65840 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Action: 'create', calling method: .version_select at 0x7fd35c4d6e50>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1513384017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaKS6YnHcpFNP1IPGmz7ggKUNynGcjVuKrEFF01gfKQG0erZ7b/LJIs4V9iF2om9BsjFVKPrCUrisdfBBSPckkmhSYBue7mrq2eka3Gr9ip3t1bDt4MAK9R7hLIGTr+pQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:54.767062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-12453dd9-8aca-465a-a031-3f8230b65840 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Getting quotas for project 4e068d321649463790072bfb11a82972. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:54.783550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-12453dd9-8aca-465a-a031-3f8230b65840 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Getting quotas for user a2a443776e594b7b90c66a9c5da0999f and project 4e068d321649463790072bfb11a82972. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:54.847443 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12453dd9-8aca-465a-a031-3f8230b65840 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.124631 Aug 30 16:11:54.855192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1141/2072] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:11:54 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:11:54.868048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1513384017", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:54.872822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:54.895199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.898388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.900782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.902426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.904842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.905500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.082426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:55.082860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:55.086658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:55.089152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:55.090108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:55.229754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:55.231194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:55.244207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.250031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.251168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.252909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.253653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.260078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.370698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:55.377332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.378105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.378826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.383998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.384807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.385501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.408933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.422575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1831921f-5b75-4b0d-b13d-26c2b43f4b36 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.198252 Aug 30 16:11:55.438920 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1142/2073] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:55 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:55.461234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:55.465697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:55.481842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.482930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.495134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.496246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.496891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.499444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.503988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef36542e-0db1-4736-8211-672cafa9da1c tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "POST /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25/action" status: 202 len: 1139 microversion: 2.54 time: 0.631596 Aug 30 16:11:55.509616 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 932/2074] 10.222.0.47 () {62 vars in 1320 bytes} [Tue Aug 30 16:11:54 2022] POST /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25/action => generated 1139 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 16:11:55.528849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:55.530886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:55.552157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.552660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.555577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.562197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:55.564522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:55.567519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.739451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.759003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.760856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.769269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77dae877-6b42-4421-aec8-5ed7eb54fbd0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.243653 Aug 30 16:11:55.771220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 933/2075] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:55 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:55.887473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.907109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2d2d991-c72d-482a-a4f1-59537be6c19a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1276 microversion: 2.1 time: 0.466877 Aug 30 16:11:55.922831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1143/2076] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:55 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1276 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:56.243227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-887713453", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:56.415184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] validate_networks() for [('ab677581-85e1-4962-8a2a-a6c572852f36', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:56.453715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:56.454515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:56.468272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.468778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.469213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.471835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.473914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.479468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.710717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:56.718646 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60b42df6-0f80-4521-8336-a675118c5d19 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.269340 Aug 30 16:11:56.722414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1144/2077] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:56 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:11:56.795680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:56.796309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:56.814121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.814679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.815113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.816034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.816661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.820530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.044003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:57.060046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:57.063638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:57.065160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dbc1dde1-f870-4260-b43b-60106c070251 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.273470 Aug 30 16:11:57.075430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1145/2078] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:56 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:11:57.093896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:57.101372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:57.124822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.125583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.126689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.127648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.128347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.129029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.830511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:57.857073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f874eb1-dfa8-46de-9753-c7441550cf41 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.766890 Aug 30 16:11:57.857998 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1146/2079] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:57 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:57.874538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:57.875641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:57.887638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.889502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.897666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.898905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.900585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.904500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.907217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:57.912929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:57.914448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:57.915045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:57.915627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:57.933740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.934872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.936596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.938439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.957818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.958729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.026360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:58.034321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for user b330d5f913ce45d59c3c5aed0972c7e6 and project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:58.090368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:58.102525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:58.180372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.192989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61cb24c1-27cd-4dc4-8bb5-e1b56195f82e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1182 microversion: 2.1 time: 0.332693 Aug 30 16:11:58.216053 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1147/2080] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:57 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1182 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:58.223047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-becc10e1-fc49-40bf-a181-d7d99ddfcc54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.282535 Aug 30 16:11:58.229620 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 934/2081] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:11:58.235144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1133872d-b99c-419e-90f2-732089d77cbd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:58.236637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:58.239841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1133872d-b99c-419e-90f2-732089d77cbd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:58.240826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:58.264644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.272867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.276999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.278472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.293387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.295600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.489901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1133872d-b99c-419e-90f2-732089d77cbd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.503660 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1133872d-b99c-419e-90f2-732089d77cbd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1221 microversion: 2.1 time: 0.272222 Aug 30 16:11:58.518734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.520077 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 935/2082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:58 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:58.561632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.570725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.573578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-231eb755-8f98-4e6a-9ec2-05020360e522 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.355973 Aug 30 16:11:58.577204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1148/2083] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:11:58 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:11:58.786965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b3051b-42bc-4534-ba5d-cd30eae7ac5d", "tag": "a8df926c-9a39-4224-966d-ca59cf41c303"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:58.834739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.844381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.848753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.878895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:58.879444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:58.883348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=5 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:58.908393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.909944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.910670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.913653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] Creating event network-changed:a8df926c-9a39-4224-966d-ca59cf41c303 for instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d on n-h2-830883-28 Aug 30 16:11:58.915309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.915958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.916559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.922439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e97b1587-e6d9-49e5-9781-f3a7005f4aab req-21b73cc0-9c72-4529-8764-70429995a732 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139297 Aug 30 16:11:58.924813 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 936/2084] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:58.952370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1737275716", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:59.144290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] validate_networks() for [('ab677581-85e1-4962-8a2a-a6c572852f36', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:59.763506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:59.772745 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b2f7b0e-7eb2-4fc9-847d-fe533f9e17fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.897635 Aug 30 16:11:59.776933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1149/2085] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:58 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:59.793951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:59.795953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:59.823241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:59.825672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:59.832206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:59.836287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:59.836940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:59.837674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:59.901529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:59.971870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:59.979387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:59.982337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:59.983124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'fault' on Instance uuid 9ef29e24-0a83-4765-8c63-53fe06015c4b {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:00.111163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:00.120460 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-073a6e6c-f287-454d-88f7-ccf934eb58ae tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 200 len: 1187 microversion: 2.1 time: 0.339178 Aug 30 16:12:00.139015 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1150/2086] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:59 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 1187 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:00.197274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:00.204081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:00.265923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:00.272699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:00.274764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:00.275733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:00.278005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:00.278693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:00.603923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:00.618892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:00.621298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:00.628851 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3f99569-5a9c-45bf-991c-ef728ee23259 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.467226 Aug 30 16:12:00.631636 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1151/2087] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:00 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:01.210176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5387afd-4263-477b-b477-d8d2be791da8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Calling method '.version_select at 0x7fd35c4a10d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:01.406613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c5387afd-4263-477b-b477-d8d2be791da8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 371 microversion: 2.1 time: 0.773465 Aug 30 16:12:01.414534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1152/2088] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:12:00 2022] GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 371 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:01.431344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:01.432083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:01.454576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:01.455390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:01.457573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:01.462182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:01.463057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:01.465334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:01.851561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:01.852602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:01.853246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:01.853820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:01.854441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:01.874647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:01.875132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:01.875574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:01.876287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:01.876922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:01.877514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:01.933848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:01.953830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for user b330d5f913ce45d59c3c5aed0972c7e6 and project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:01.995776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:12:01.998201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:02.095173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce3cb019-8b10-4378-bdf2-3cd56cd48b76 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.167093 Aug 30 16:12:02.096072 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 937/2089] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:12:02.113585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:02.114396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 9ef29e24-0a83-4765-8c63-53fe06015c4b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:02.131078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.142894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.147175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5fd3bb63-4231-41ef-bbce-1e045f63dba7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.728657 Aug 30 16:12:02.147869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.152082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.152864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.153526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.161342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1153/2090] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:01 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:02.175137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c4a1280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:02.175586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.223684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] HTTP exception thrown: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Request method failure captured: Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b HTTP/1.1 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjUWhiQ9WAv3WPppz_2ZBE9D3bbwd-toUlPTrw4Sd_HLgTL5NWB1eISc25ho2cWgiWsjAlxhVhJKy1mHZKsByJU38W0vjteOv6Orjt7X2gRISexsK7wR4SuzvadJYjtg3hPFdAhHdMvzpPo745-SAcOvVx-yaGOEfc74eRgJK94BJhw Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}] Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-LiveMigrationTest-63990542 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 43d55a1e4a9f4f2b9cb85e010154f284 Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9ef29e24-0a83-4765-8c63-53fe06015c4b'} Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:02.225701 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:02.230980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Returning 404 to user: Instance 9ef29e24-0a83-4765-8c63-53fe06015c4b could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:02.241281 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbc7f612-5f56-4bbf-a31f-bdcb970b99ab tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b" status: 404 len: 111 microversion: 2.1 time: 0.143121 Aug 30 16:12:02.253992 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 938/2091] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:02 2022] GET /compute/v2.1/servers/9ef29e24-0a83-4765-8c63-53fe06015c4b => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:02.268832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:02.273852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:02.289883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.290415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.290862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.291685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.292034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.307664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.313413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:02.329532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.332090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.337108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.338335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.339047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.339958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.525590 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73dd7072-27a5-430a-bf9f-1a7ce790d34d tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 328 microversion: 2.1 time: 0.354363 Aug 30 16:12:02.538347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1154/2092] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:02 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:02.539299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.540043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.541508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.551361 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6140e0b7-db48-464c-9e68-5fc2ee889912 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.287645 Aug 30 16:12:02.558055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cbcdf65e-c952-4040-9b08-7ec9f5965e11 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:02.558964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cbcdf65e-c952-4040-9b08-7ec9f5965e11 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:02.569627 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 939/2093] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:02 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:02.922741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cbcdf65e-c952-4040-9b08-7ec9f5965e11 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.932466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cbcdf65e-c952-4040-9b08-7ec9f5965e11 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1222 microversion: 2.1 time: 0.390658 Aug 30 16:12:02.936569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1155/2094] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:02 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1222 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:02.942115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1879664780", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:03.052306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:03.171708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:03.172736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:03.187325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.188277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.189425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.192545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.195772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.210772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.416803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:03.417475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:03.418571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:03.419170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:03.419754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:03.440291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.441302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.441748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.442502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.444131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.444732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.475922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:03.478217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:03.490209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for user 1ced283138dc44f2becf9577b3fba74e and project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:03.508721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.utils [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] cores quota exceeded for 55b1da39a0a54372970d28cafeba69bc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122351) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 16:12:03.509274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Request method failure captured: Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 145 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbOxXMjNkIMS66J_QJZ298NqpforcjxOOAOZniKgT7d38fC5X_jtm0nlGyifzkuRitVODts0f3xSlPyPuRLA7aJhX08y6tcBn1FazIAdsYhvH_Pq-KVEJXVEcRsU79XTv3KuwGCLijZ8Hkf7YxAt6LHTQ2mVb_FM9u-I_xRJacKGqo Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}] Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 1ced283138dc44f2becf9577b3fba74e Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1879664780", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1879664780', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452'}}} Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:12:03.525475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:03.530977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:03.533741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1df2d951-be8d-4523-ab15-3a4e80956a74 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.730600 Aug 30 16:12:03.533741 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 940/2095] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:02 2022] POST /compute/v2.1/servers => generated 111 bytes in 732 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:12:03.540318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd360ee7670>, body: {"quota_set": {"cores": 20}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:03.642006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.642798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.643401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.644444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.645085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.645715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.712019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:03.720343 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3cb9a8fa-738e-4c70-8be9-ad1295fdf1ce tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 329 microversion: 2.1 time: 0.183154 Aug 30 16:12:03.721538 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 941/2096] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:03 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 329 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:03.725945 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb45db0d-3199-46a0-9fbf-21a891c860dd tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.559715 Aug 30 16:12:03.728462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:03.728753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:03.729490 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1156/2097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:03 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:03.743432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-696837f2-b6ff-4360-a927-b5e31a3a783a tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Calling method '.version_select at 0x7fd35c4a1dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:03.754719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.755220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.755667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.756503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.757191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.762400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.878774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-696837f2-b6ff-4360-a927-b5e31a3a783a tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 371 microversion: 2.1 time: 0.147614 Aug 30 16:12:03.879958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1157/2098] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:12:03 2022] GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:03.892157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c4b1280>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:03.914672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:03.928888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:03.933951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:03.935244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7235e426-711c-46f3-b6f1-b543e32b2f53 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.212451 Aug 30 16:12:03.935805 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 942/2099] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:03 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:03.973494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:03.975239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:03.992416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.993298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.993963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.994927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.996196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.001440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.038113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.042855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.043579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.044760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.045453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.048496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.171709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:04.206213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c10ed71f-b15b-43ce-868e-d9dc63103dbe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1226 microversion: 2.1 time: 0.236233 Aug 30 16:12:04.207921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 943/2100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:03 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1226 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:04.210165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45cb6aee-b209-4758-a470-f0e2aff61f91 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 328 microversion: 2.1 time: 0.321932 Aug 30 16:12:04.210999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1158/2101] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:03 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 328 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:04.295050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2092985140", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:04.352674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:04.754097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:04.755477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:04.774463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.775851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.789159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.794434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.795095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.798748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.962657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:04.963365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:04.964101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:04.964678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:04.965258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:04.993237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.995316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.996704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.997478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.998884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.999779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.057404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:05.091520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for user 1ced283138dc44f2becf9577b3fba74e and project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:05.137171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.utils [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] instances quota exceeded for 55b1da39a0a54372970d28cafeba69bc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122351) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 16:12:05.140324 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Request method failure captured: Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 145 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbOxXMjNkIMS66J_QJZ298NqpforcjxOOAOZniKgT7d38fC5X_jtm0nlGyifzkuRitVODts0f3xSlPyPuRLA7aJhX08y6tcBn1FazIAdsYhvH_Pq-KVEJXVEcRsU79XTv3KuwGCLijZ8Hkf7YxAt6LHTQ2mVb_FM9u-I_xRJacKGqo Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}] Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 1ced283138dc44f2becf9577b3fba74e Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2092985140", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2092985140', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452'}}} Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:12:05.147268 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 16:12:05.150360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:12:05.154786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:05.155884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d418f33f-4e5e-4241-97c3-33e667191cc9 tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.864823 Aug 30 16:12:05.158786 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 944/2102] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:04 2022] POST /compute/v2.1/servers => generated 119 bytes in 868 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:05.169057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:05.171157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:05.191997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.196068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.203357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.204806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.205488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.206164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.415540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:05.428610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:05.430496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:05.431947 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17742809-00e5-4d05-9a7c-e6188f9d96e6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.270756 Aug 30 16:12:05.432795 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 945/2103] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:05 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:05.447298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:05.448653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd360ee7b80>, body: {"quota_set": {"instances": 10}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:05.461218 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b80ec2c7-6799-4ea6-8970-e4fca4b8b7d0 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.712391 Aug 30 16:12:05.475529 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1159/2104] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:04 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:05.479664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:05.480580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:05.499117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.499622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.500074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.505388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.508561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.510918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.543539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.544230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.544965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.546222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.546882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.547455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.665671 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6033aef-42e8-42d9-acde-326b8517ee09 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 329 microversion: 2.1 time: 0.225737 Aug 30 16:12:05.666981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 946/2105] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:05 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 329 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:05.685300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b99ec58b-3ee0-4ea3-b26a-2d7284367c15 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Calling method '.version_select at 0x7fd360f98d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:05.942190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b99ec58b-3ee0-4ea3-b26a-2d7284367c15 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 371 microversion: 2.1 time: 0.258256 Aug 30 16:12:05.945675 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 947/2106] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:12:05 2022] GET /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:06.002782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd35ccbdee0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:06.190285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:06.204541 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b85e777-792f-471f-9fd4-6f3f233e53cc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1274 microversion: 2.1 time: 0.737814 Aug 30 16:12:06.211052 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1160/2107] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:05 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1274 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:06.227684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.228382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.230338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.231271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.234475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.235111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.412494 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed8e817b-d241-47ca-bcfd-5a4dec04d3a4 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 325 microversion: 2.1 time: 0.458745 Aug 30 16:12:06.419056 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 948/2108] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:05 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 325 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:06.456641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:06.457776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:06.470756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.471571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.472736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.473657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.482902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.483763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.487355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:06.488187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:06.508424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.508924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.509368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.510082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.510565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.515709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.804900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:06.813402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:06.820909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:06.823706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ef195e8-ec12-4a93-93af-d5174fc04cb6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.371764 Aug 30 16:12:06.829018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1161/2109] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:06 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:06.840143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1624810729", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:06.969336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:07.272609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:07.289389 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12c1ba4c-9283-42e0-8002-af897efd9bd7 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.798897 Aug 30 16:12:07.290173 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 949/2110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:06 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:07.297319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88926ad-060b-4fa0-a0db-50ebc5b8f70d", "tag": "bd91cc1d-b602-49d5-8e77-a8dc2197a9aa"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:07.327563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.328435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.332085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.359724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] Creating event network-changed:bd91cc1d-b602-49d5-8e77-a8dc2197a9aa for instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d on n-h1-830883-28 Aug 30 16:12:07.372058 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8ed19f65-97fb-4db8-80da-532e718dca14 req-46b03db1-4baf-4bd7-b186-4ba48aca66be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078194 Aug 30 16:12:07.372999 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 950/2111] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:07.378118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:07.383566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:07.395643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.405199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.405809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.406719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.407280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.414918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.807335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:07.808334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:07.809385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:07.809973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:07.810822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:07.824853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.826032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.827315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.828555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.829602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.830185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.861588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:07.870101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Getting quotas for user 1ced283138dc44f2becf9577b3fba74e and project 55b1da39a0a54372970d28cafeba69bc. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:07.892065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.utils [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] ram quota exceeded for 55b1da39a0a54372970d28cafeba69bc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122352) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 16:12:07.893175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Request method failure captured: Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 145 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbOxXMjNkIMS66J_QJZ298NqpforcjxOOAOZniKgT7d38fC5X_jtm0nlGyifzkuRitVODts0f3xSlPyPuRLA7aJhX08y6tcBn1FazIAdsYhvH_Pq-KVEJXVEcRsU79XTv3KuwGCLijZ8Hkf7YxAt6LHTQ2mVb_FM9u-I_xRJacKGqo Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}] Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 1ced283138dc44f2becf9577b3fba74e Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1624810729", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1624810729', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452'}}} Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:12:07.899220 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 16:12:07.902860 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:07.907362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:07.909490 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59cba340-5e46-47bd-833d-4644da703d7e tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.079259 Aug 30 16:12:07.910241 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1162/2112] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:06 2022] POST /compute/v2.1/servers => generated 110 bytes in 1081 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:07.934618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:07.935485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:07.958336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.960860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.961973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.966373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:07.967018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:07.968700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.063657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:08.094173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f0a777ad-7124-45ae-ab76-3550d1bd56e8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 2343 microversion: 2.25 time: 0.719713 Aug 30 16:12:08.104214 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 951/2113] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:07 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 2343 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:08.109286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:08.110156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:08.122953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.123453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.123898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.124600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.125066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.125494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.284396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:08.292691 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3721339-f1e6-4edf-a687-5152ce890480 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1280 microversion: 2.1 time: 0.380638 Aug 30 16:12:08.293862 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1163/2114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:07 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:08.299805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Action: 'update', calling method: .version_select at 0x7fd360fd61f0>, body: {"quota_set": {"ram": 51200}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:08.326721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:08.348683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:08.354781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:08.356152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84a83d34-8e4a-4270-be5c-b17d8a573926 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.250721 Aug 30 16:12:08.358668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 952/2115] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:08 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:08.364335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:08.370290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.371207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.371796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.372705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.373298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.373865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.401995 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3d81958-f930-43e5-b53a-779a06756fd3 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.041561 Aug 30 16:12:08.410588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 953/2116] 10.222.0.47 () {60 vars in 1217 bytes} [Tue Aug 30 16:12:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:12:08.418154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:08.420841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:08.437778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.449370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.451422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.451915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.452351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.453082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.453838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.454793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:08.455088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.456607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:08.459981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.461082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:08.518327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:08.653511 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a82ee40-f455-401d-a4f6-25e4b3979fd8 tempest-QuotasAdminNegativeTest-106894572 tempest-QuotasAdminNegativeTest-106894572-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 200 len: 329 microversion: 2.1 time: 0.357465 Aug 30 16:12:08.672399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1164/2117] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:08 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 329 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:08.679949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-577ac46a-0bc5-45db-82f8-77b835fa68ff tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Action: 'update', calling method: .version_select at 0x7fd35c419ee0>, body: {"quota_set": {"ram": 0}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:08.686767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-577ac46a-0bc5-45db-82f8-77b835fa68ff tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1ced283138dc44f2becf9577b3fba74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b1da39a0a54372970d28cafeba69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-577ac46a-0bc5-45db-82f8-77b835fa68ff tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Request method failure captured: Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc HTTP/1.1 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 25 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbOxXMjNkIMS66J_QJZ298NqpforcjxOOAOZniKgT7d38fC5X_jtm0nlGyifzkuRitVODts0f3xSlPyPuRLA7aJhX08y6tcBn1FazIAdsYhvH_Pq-KVEJXVEcRsU79XTv3KuwGCLijZ8Hkf7YxAt6LHTQ2mVb_FM9u-I_xRJacKGqo Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/55b1da39a0a54372970d28cafeba69bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/55b1da39a0a54372970d28cafeba69bc"}]}] Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 55b1da39a0a54372970d28cafeba69bc Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2029636561 Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 1ced283138dc44f2becf9577b3fba74e Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-QuotasAdminNegativeTest-2029636561-project Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: {"quota_set": {"ram": 0}} Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '55b1da39a0a54372970d28cafeba69bc', 'body': {'quota_set': {'ram': 0}}} Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:12:08.696812 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 16:12:08.700611 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:08.702612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-577ac46a-0bc5-45db-82f8-77b835fa68ff tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:08.703836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-577ac46a-0bc5-45db-82f8-77b835fa68ff tempest-QuotasAdminNegativeTest-2029636561 tempest-QuotasAdminNegativeTest-2029636561-project] 10.222.0.47 "PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc" status: 403 len: 116 microversion: 2.1 time: 0.029381 Aug 30 16:12:08.705060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1165/2118] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:12:08 2022] PUT /compute/v2.1/os-quota-sets/55b1da39a0a54372970d28cafeba69bc => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:09.189781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:09.196223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:09.197286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:09.210147 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecc254b6-c1a8-4d07-8967-283060d02de3 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 0.798246 Aug 30 16:12:09.229306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.232544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 954/2119] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:08 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:09.233883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.237614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.238388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.238858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.239282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.316925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:09.317539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:09.330697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.332238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:09.336356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.336809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.337541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.345785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.348188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.681368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fe5c926-7136-4340-b286-911a68069108 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 204 len: 0 microversion: 2.1 time: 0.490358 Aug 30 16:12:09.682243 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1166/2120] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:09 2022] DELETE /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:12:09.691767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:09.698545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:09.714730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.715334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.715841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.716786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.719817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.720342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.854477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:09.869024 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-447771b5-a711-4e0b-83e6-56575feafee1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.555821 Aug 30 16:12:09.869546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:09.870876 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 955/2121] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:09 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:09.878599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:09.883140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:09.885046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:09.892388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:09.897813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.898899 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48434a59-057a-4c87-9f7a-2f5fc3ce5057 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.211080 Aug 30 16:12:09.899552 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1167/2122] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:09 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:09.901572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.902818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.905745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.906352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.906890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.908194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b3051b-42bc-4534-ba5d-cd30eae7ac5d", "name": "network-vif-plugged", "status": "completed", "tag": "a8df926c-9a39-4224-966d-ca59cf41c303"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:09.935818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:09.938485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:09.938943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:09.974285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] Creating event network-vif-plugged:a8df926c-9a39-4224-966d-ca59cf41c303 for instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d on n-h2-830883-28 Aug 30 16:12:09.989351 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-22c54e67-e2e9-4529-9aeb-2a73366dec50 req-00b8d128-2192-4f24-8cce-341159c7e532 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085820 Aug 30 16:12:09.999953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1168/2123] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:10.261510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:10.263025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:10.287454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:10.288056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:10.288573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:10.289355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:10.289891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:10.290416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:10.618887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:10.627776 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b03afb1-3177-4e4c-ae5b-2490796f7c5e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1666 microversion: 2.1 time: 0.755527 Aug 30 16:12:10.630290 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 956/2124] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:09 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1666 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:10.891961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:10.892864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:10.906656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:10.909600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:10.910220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:10.912806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:10.915975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:10.917198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.267241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:11.283294 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ff20cac-004c-430e-bf82-255f0d996824 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 1.033579 Aug 30 16:12:11.286861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1169/2125] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:10 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:11.332411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:11.338554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:11.372301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.377312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.377913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.378789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.380255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.381779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.502391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:11.513917 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ef45313-da9a-4f7f-b74d-9e4f2f26fa19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.625955 Aug 30 16:12:11.516694 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 957/2126] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:10 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:11.529691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d46f46bb-9e12-4dd3-bde5-d0f564fa07b3", "tag": "99df5124-6f1c-4991-b5b0-e8a58117099a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:11.548562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.549701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.552014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.576181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] Creating event network-changed:99df5124-6f1c-4991-b5b0-e8a58117099a for instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 on n-h2-830883-28 Aug 30 16:12:11.585327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4dd743ea-2794-4afa-a3a2-e291254d1082 req-ef7e7d62-24be-4729-b44c-c51b009adbb2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064994 Aug 30 16:12:11.587429 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 958/2127] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:11.601385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abe31d76-41cd-4398-9273-ee3d9378529f", "device": "/dev/xvdb"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:11.606328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:11.628779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.630379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.642011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.643516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.645370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.647913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.689596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:11.707891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:11.709640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:11.712772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5fe2f435-1190-4dcc-917b-f75a1e5b9378 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.422444 Aug 30 16:12:11.735363 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1170/2128] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:11 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:11.742046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:11.742701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:11.767015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.775020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.775641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:11.776626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:11.777491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:11.779447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:12.268568 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ee7e771-7421-4f2f-80a9-2dcda051613d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.679257 Aug 30 16:12:12.269940 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 959/2129] 10.222.0.47 () {62 vars in 1364 bytes} [Tue Aug 30 16:12:11 2022] POST /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:12:12.312842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:12.320453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:12.358470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:12.364421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:12.376877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:12.377634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:12.379162 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f81ea7e-cb06-4a77-ab78-260efada65ff tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1666 microversion: 2.1 time: 0.642409 Aug 30 16:12:12.379954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:12.381451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:12.386408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:12.401991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1171/2130] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:11 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1666 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:12.542399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:12.543037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:12.554116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:12.554858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:12.555457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:12.560511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:12.562012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:12.562907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:12.586017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:12.941405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:12.953190 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-092c4f4c-d7cb-4e8f-af61-48479cf161f8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.415886 Aug 30 16:12:12.973972 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1172/2131] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:12 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:12.984441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:12.985540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:13.017373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.019514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.022876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.023827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.026210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.026939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.248165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:13.260718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:13.264408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:13.265889 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6edb7ff-0fb5-4f07-9252-86cf8bca45a6 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.287882 Aug 30 16:12:13.267762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1173/2132] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:12 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:13.276906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88926ad-060b-4fa0-a0db-50ebc5b8f70d", "name": "network-vif-plugged", "status": "completed", "tag": "bd91cc1d-b602-49d5-8e77-a8dc2197a9aa"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:13.300283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.308163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.308622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.335954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] Creating event network-vif-plugged:bd91cc1d-b602-49d5-8e77-a8dc2197a9aa for instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d on n-h1-830883-28 Aug 30 16:12:13.352023 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b0ba35dd-7601-4295-a109-2438cc397566 req-5cad25f1-aac7-49df-9796-33c953c17c4d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078591 Aug 30 16:12:13.366389 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1174/2133] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:13.412154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.418816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:13.441320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.442029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.449139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.450289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.451818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.454104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.545842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:13.557321 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9c71f55-b572-4b83-8fca-11e5e405846c tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1318 microversion: 2.1 time: 1.249373 Aug 30 16:12:13.562025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 960/2134] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:12 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1318 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:13.668970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:13.680406 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a164fa5-d62b-4298-ac71-6be045b7e639 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1598 microversion: 2.1 time: 0.272834 Aug 30 16:12:13.682021 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1175/2135] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1598 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:13.996188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7107d12b-8cc0-427d-b719-6c87935dd178", "name": "network-vif-deleted", "tag": "495e3ead-bcbb-4d78-8561-d6fcd1cccbba"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:13.996282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:13.996282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:13.996282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:13.996282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.996282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.996566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:13.996804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.997337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:13.998454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:13.998888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:13.999326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.005980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.006669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.037524 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] Creating event network-vif-deleted:495e3ead-bcbb-4d78-8561-d6fcd1cccbba for instance 7107d12b-8cc0-427d-b719-6c87935dd178 on n-h1-830883-28 Aug 30 16:12:14.056513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0087a179-9867-43cf-b56b-48d6000af7a2 req-c150eeef-f7db-4536-88db-dcd7edd924b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095273 Aug 30 16:12:14.058604 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 961/2136] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:14.299923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:14.300607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:14.325669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.326200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.326720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.328462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.330136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.330952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.334253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.346514 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d82d980-e5ee-4f68-a87f-88c27d146db1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.371333 Aug 30 16:12:14.347462 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1176/2137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:13 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:14.467855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.487021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.494577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.496986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5aba7e62-e478-4822-bc45-3c4b2d61428f tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.203535 Aug 30 16:12:14.500340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 962/2138] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:14 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:14.598177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:14.599849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:14.611929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.615820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.616437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.617730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.623070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.623924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.708121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:14.710058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:14.726899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.727411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.727854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.728586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.729032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.733464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.789392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.790235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.791263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.791921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'fault' on Instance uuid 7107d12b-8cc0-427d-b719-6c87935dd178 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:14.869478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.879583 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df4787dd-823d-486c-b35a-ec88e1fe5e05 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1322 microversion: 2.1 time: 0.178244 Aug 30 16:12:14.884179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 963/2139] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:14 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:14.953092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.963490 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93dc51f3-79f5-4504-a4a9-cdf418f7ac0e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1508 microversion: 2.1 time: 0.380316 Aug 30 16:12:14.964393 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1177/2140] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:14 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:15.378330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:15.379685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:15.406345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.408722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.409838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:15.416154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.417200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.419599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:15.527752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:15.528700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:15.545240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.545756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.547762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:15.548489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.548961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.549398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:15.738890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:15.756169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:15.759522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:15.763296 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-44cdbea9-94ff-4496-a4dc-23d4f66666da tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.240009 Aug 30 16:12:15.764205 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1178/2141] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:15 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:15.828949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:15.839311 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba1a47dc-4120-4bdd-8460-e9aeb9a7fe74 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.475740 Aug 30 16:12:15.840747 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 964/2142] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:15 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:15.904071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:15.905155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:15.914990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.916423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.918526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:15.921022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:15.921860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:15.924667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.014080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:16.014785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:16.015495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.016365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'fault' on Instance uuid 7107d12b-8cc0-427d-b719-6c87935dd178 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:16.136262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:16.149012 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03ef580b-52ef-4ed6-b638-09034db7c2d6 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 200 len: 1322 microversion: 2.1 time: 0.249593 Aug 30 16:12:16.151994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1179/2143] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:15 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:16.794789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:16.796186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:16.803058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=78 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:16.826821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:16.827449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:16.827915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.829016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:16.829561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:16.830000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.865782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:16.866786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:16.897351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:16.897850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:16.898319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.899049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:16.909438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:16.909962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:16.999088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:17.012781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:17.017217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:17.018614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d46494f1-8821-4195-acd9-cee9be810996 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.230820 Aug 30 16:12:17.022658 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 965/2144] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:16 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:17.164782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:17.175845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3bff5c7d-4d7d-4f52-a163-ea2dd6d9fa79 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.314249 Aug 30 16:12:17.177631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1180/2145] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:16 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:17.183326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:17.184178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 7107d12b-8cc0-427d-b719-6c87935dd178] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:17.190522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.191278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.191926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.193952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.194660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.195300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.225421 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] HTTP exception thrown: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Request method failure captured: Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 HTTP/1.1 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUWhiQ9WAv3WPppz_2ZBE9D3bbwd-toUlPTrw4Sd_HLgTL5NWB1eISc25ho2cWgiWsjAlxhVhJKy1mHZKsByJU38W0vjteOv6Orjt7X2gRISexsK7wR4SuzvadJYjtg3hPFdAhHdMvzpPo745-SAcOvVx-yaGOEfc74eRgJK94BJhw Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}] Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationTest-63990542 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 43d55a1e4a9f4f2b9cb85e010154f284 Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7107d12b-8cc0-427d-b719-6c87935dd178'} Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:17.227445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.230573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Returning 404 to user: Instance 7107d12b-8cc0-427d-b719-6c87935dd178 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:17.231306 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33b023c9-ec09-49b4-a106-552d4eb05e32 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178" status: 404 len: 111 microversion: 2.1 time: 0.051915 Aug 30 16:12:17.233227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1181/2146] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:17 2022] GET /compute/v2.1/servers/7107d12b-8cc0-427d-b719-6c87935dd178 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:17.242700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9020682f-4406-41b0-9602-0141878c25a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '.version_select at 0x7fd35c4740d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:17.275756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9020682f-4406-41b0-9602-0141878c25a3 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-318817253" status: 202 len: 0 microversion: 2.1 time: 0.037962 Aug 30 16:12:17.276861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1182/2147] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-318817253 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:12:17.419774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-324574885", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:17.482943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:17.858735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "13bfa665-8391-4f96-89cb-a215c840b7c2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:17.861192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:17.862067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:17.862699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:17.863277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:17.863687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:17.866356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:17.875848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.877884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.879434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.881653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.883974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.885245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.889577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.890051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.895404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.899036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.899522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.899969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.924913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=25 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:17.946176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:17.952447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:17.966763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:12:17.969098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:17.976412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] HTTP exception thrown: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Request method failure captured: Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d/os-volume_attachments/0c2e2252-60cd-464f-acc4-ac11377f79d7 HTTP/1.1 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 74 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYxjci2ABnUu89wA8VWq3KhZQbHBcj7QsjuMFlPn3ljdvgDPXAt50dwyRr6w-1qwJQboV9T7Axp0TceTtQh_2A0byAM2UOIOvHSxKke-cByCMtSfZLXeaQbTHbo_upi_-iQCmAS3VBRd6JVqawlmVa82xqN5CeCj0ZhNqMwymid3mg Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 86f4d259b7204fc19502b71d8133352c Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86f4d259b7204fc19502b71d8133352c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_86f4d259b7204fc19502b71d8133352c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/86f4d259b7204fc19502b71d8133352c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86f4d259b7204fc19502b71d8133352c"}]}] Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 86f4d259b7204fc19502b71d8133352c Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-897922860 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesAdminNegativeTest-897922860-project-admin Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3eebc0e594b6413e830e046e5d0b2ce6 Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesAdminNegativeTest-897922860-project-admin Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: {"volumeAttachment": {"volumeId": "13bfa665-8391-4f96-89cb-a215c840b7c2"}} Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: exception: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': 'e8b3051b-42bc-4534-ba5d-cd30eae7ac5d', 'id': '0c2e2252-60cd-464f-acc4-ac11377f79d7', 'body': {'volumeAttachment': {'volumeId': '13bfa665-8391-4f96-89cb-a215c840b7c2'}}} Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. (HTTP 404) (Request-ID: req-1dd85b73-4cf3-4ea3-8d21-8a81ad9bfb10) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:12:17.981303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] Returning 404 to user: Volume 0c2e2252-60cd-464f-acc4-ac11377f79d7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-46ab5bca-5c75-4a18-a9d9-ad26190ff29b tempest-VolumesAdminNegativeTest-897922860 tempest-VolumesAdminNegativeTest-897922860-project-admin] 10.222.0.47 "PUT /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d/os-volume_attachments/0c2e2252-60cd-464f-acc4-ac11377f79d7" status: 404 len: 109 microversion: 2.1 time: 0.129045 Aug 30 16:12:17.985131 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1183/2148] 10.222.0.47 () {60 vars in 1433 bytes} [Tue Aug 30 16:12:17 2022] PUT /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d/os-volume_attachments/0c2e2252-60cd-464f-acc4-ac11377f79d7 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:12:18.032429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff33fc43-9a8f-45e4-81ac-cc789d8d1894 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924875 Aug 30 16:12:18.033593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 966/2149] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:12:18.046683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f8a81ed-8f23-4f3a-a823-0a07fc258ba4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:18.047365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f8a81ed-8f23-4f3a-a823-0a07fc258ba4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:18.050957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:18.051788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:18.059369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.060143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.060779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.061717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.062366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.063621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.157247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.175276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.179259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.180904 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1bfb2b39-9106-4ed3-ad29-0f7262c3f197 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.134897 Aug 30 16:12:18.181814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 967/2150] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:18 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:18.203181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:18.207178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:18.219874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.221789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.222577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.224652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.226468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.227142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.423384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.437925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-676e6e7d-0e69-47a0-9c84-341346ae7b7f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.239139 Aug 30 16:12:18.438877 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 968/2151] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:18 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:18.498942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:18.637965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=56 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:18.711240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f8a81ed-8f23-4f3a-a823-0a07fc258ba4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.714500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:18.715745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:18.722426 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f8a81ed-8f23-4f3a-a823-0a07fc258ba4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1216 microversion: 2.1 time: 0.680929 Aug 30 16:12:18.734374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.734374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.734374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.734374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.734374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.736148 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1184/2152] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:18 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1216 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:18.738208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.831742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:18.975482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:19.044650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68e83ebd-0ea3-45dd-8f52-de2fccfe4c66 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 204 len: 0 microversion: 2.1 time: 0.336194 Aug 30 16:12:19.045884 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 969/2153] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:18 2022] DELETE /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:12:19.057207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:19.058638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:19.070528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.071783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.072499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.073563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.074755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.075695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.207995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:19.209978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:19.218069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.218587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.219019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.219718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.220168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.226936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.308459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.319490 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dff7526c-1257-4c4c-9c59-ba83813d980e tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1484 microversion: 2.1 time: 0.269139 Aug 30 16:12:19.322353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1185/2154] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:19 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1484 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:19.393817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.406782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.410286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.412129 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10963a91-57b3-4eb6-acf8-ff202eda1b54 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.210466 Aug 30 16:12:19.413146 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 970/2155] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:19 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:19.461116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:19.462047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:19.468713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.469696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.471118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.472022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.472893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.473491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.746447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:19.747024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:19.764085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.764638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.765090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.765942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:19.766266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:19.766732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:19.904432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.916952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8abed7c4-921b-44d4-adf8-bbca9c99c9c2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1268 microversion: 2.1 time: 0.174353 Aug 30 16:12:19.918080 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 971/2156] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:19 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:19.919510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:19.929964 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6b6121f-8a21-4e2c-9347-7d553b9b54fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.474008 Aug 30 16:12:19.935335 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1186/2157] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:19 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:20.342138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:20.343503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:20.352559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.354702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.356662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.360413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.361520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.363624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.438584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:20.439219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:20.449756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.453927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.454749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.455807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.456809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.460121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.626547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:20.638271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:20.639755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:20.640978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ae74d74-e834-4bfc-91e8-c202a843517b tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.206445 Aug 30 16:12:20.664790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:20.666723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1187/2158] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:20 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:20.675295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9825522c-fec1-4b90-b218-c901e7b960bb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1484 microversion: 2.1 time: 0.337413 Aug 30 16:12:20.677025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:20.678223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:20.684604 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 972/2159] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:20 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1484 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:20.692004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.693602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.694386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.700689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.702671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.703216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.744018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:20.901225 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ece2453-43bf-4f50-89ae-aab1bb93544c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 204 len: 0 microversion: 2.1 time: 0.227477 Aug 30 16:12:20.902398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1188/2160] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:20 2022] DELETE /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:12:20.910225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:20.911070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:20.940717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:20.941580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:20.941830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.946994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.950479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.954385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.956697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.958042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.960257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.960720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.964027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:20.965171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:20.965727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:20.966182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.160713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.180914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24bcce82-c52c-496e-a29a-04eb4512d4f5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1274 microversion: 2.1 time: 0.241706 Aug 30 16:12:21.187030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1189/2161] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:20 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1274 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:21.204599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:21.210288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:21.236828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.245159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.263995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.264873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.265579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.266037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.351274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.369890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-197dc69b-23d7-48df-98e6-c73b3ac62926 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1664 microversion: 2.1 time: 0.463414 Aug 30 16:12:21.371067 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 973/2162] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:20 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1664 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:21.378652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab195c32-74a1-41a8-9112-15c05b92a168", "name": "network-vif-deleted", "tag": "6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:21.410713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.412058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.413088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.438364 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] Creating event network-vif-deleted:6c6f1bb1-fcd4-4ec2-b6f3-77a21ca0537e for instance ab195c32-74a1-41a8-9112-15c05b92a168 on n-h1-830883-28 Aug 30 16:12:21.450616 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-dfc08651-6efc-4881-8640-490bcf4f62c8 req-6bd796f7-9c41-4b02-8241-2cfa830a59d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076742 Aug 30 16:12:21.454058 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 974/2163] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:21.464003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46f46bb-9e12-4dd3-bde5-d0f564fa07b3", "name": "network-vif-plugged", "status": "completed", "tag": "99df5124-6f1c-4991-b5b0-e8a58117099a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:21.476364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.477051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.477691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.503722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] Creating event network-vif-plugged:99df5124-6f1c-4991-b5b0-e8a58117099a for instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 on n-h2-830883-28 Aug 30 16:12:21.542790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a1cbd595-5e11-4207-a62c-5aca5ac34ee1 req-d93ad991-4e9f-4712-80cc-88426d2c0c72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086580 Aug 30 16:12:21.545096 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 975/2164] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:21.654606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.657141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:21.666601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3db57ee-00b4-4bfd-beca-3735e25d980f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.471043 Aug 30 16:12:21.667332 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1190/2165] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:21 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:21.685385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:21.687805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:21.694639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.695200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.695849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.696581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.697206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.697620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.711870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:21.712588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:21.720383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.721468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.722122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.723071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.724566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.725520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.775139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:21.775767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:21.776319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:21.776931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'fault' on Instance uuid ab195c32-74a1-41a8-9112-15c05b92a168 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:21.832700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.837381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.847983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3319b3ff-c244-45b5-8275-fd0107248c62 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 200 len: 1301 microversion: 2.1 time: 0.142792 Aug 30 16:12:21.848135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.850612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1191/2166] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:21 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 1301 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:21.852028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:21.853250 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b9cee40-3ce3-404d-9fa4-db2e3046b644 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.179449 Aug 30 16:12:21.853798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 976/2167] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:21 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:22.206186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:22.207143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:22.216759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.217481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.218050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.221483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.222164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.226192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.393604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:22.394894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:22.403779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.404613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.405215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.406693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.412845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.413620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.579147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:22.592250 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-846ae04a-032e-419f-bdcd-927e7bbe0076 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1664 microversion: 2.1 time: 0.202985 Aug 30 16:12:22.609520 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 977/2168] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:22 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:22.617616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:22.627361 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85241f6c-9496-47f6-a815-0518b333113f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.425591 Aug 30 16:12:22.641368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1192/2169] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:22 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:22.666812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:22.667348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:22.675434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.676215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.677388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.678278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.679269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.679954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.687070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:22.687807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:22.700141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.700648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.702518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.703251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.703718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.704210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.717095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:22.834927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6deb0d18-2471-4548-a284-51fc8d4b5bff tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 204 len: 0 microversion: 2.1 time: 0.171180 Aug 30 16:12:22.836679 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 978/2170] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:22 2022] DELETE /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:12:22.846181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:22.847561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:22.855700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.856294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.863220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.864187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:22.865485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:22.866132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:22.970662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:22.981227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2b6d75b-b993-4364-8c30-52e782c4648b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.297948 Aug 30 16:12:22.995632 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1193/2171] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:22 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:23.002497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.003397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: ab195c32-74a1-41a8-9112-15c05b92a168] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.010488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.011309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.011958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.012879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.013685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.015016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.031608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] HTTP exception thrown: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Request method failure captured: Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 HTTP/1.1 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUWhiQ9WAv3WPppz_2ZBE9D3bbwd-toUlPTrw4Sd_HLgTL5NWB1eISc25ho2cWgiWsjAlxhVhJKy1mHZKsByJU38W0vjteOv6Orjt7X2gRISexsK7wR4SuzvadJYjtg3hPFdAhHdMvzpPo745-SAcOvVx-yaGOEfc74eRgJK94BJhw Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}] Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationTest-63990542 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 43d55a1e4a9f4f2b9cb85e010154f284 Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'ab195c32-74a1-41a8-9112-15c05b92a168'} Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:23.033532 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. Aug 30 16:12:23.038281 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:23.040257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Returning 404 to user: Instance ab195c32-74a1-41a8-9112-15c05b92a168 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:23.041575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-123fb27c-54c7-46b8-8ba3-9ab1eec3a90b tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168" status: 404 len: 111 microversion: 2.1 time: 0.044371 Aug 30 16:12:23.051418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1194/2172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:22 2022] GET /compute/v2.1/servers/ab195c32-74a1-41a8-9112-15c05b92a168 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:23.057819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.058681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.065460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.066136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.066784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.068216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.068998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.069619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.141822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.150543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.150951 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f2b5e0d-913b-43f6-9062-2a0c4362528b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1514 microversion: 2.1 time: 0.309308 Aug 30 16:12:23.158347 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 979/2173] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:22 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:23.171425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.172878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.174128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d64ba78d-7b9f-4267-81a5-50a0f7d80232 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.120692 Aug 30 16:12:23.176136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.176681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.178504 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1195/2174] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:23 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:23.187720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.188220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.188657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.189650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.190133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.190771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.253030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:23.353186 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95dcb303-a8b8-48e7-b168-0ca8a35a8919 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "DELETE /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 204 len: 0 microversion: 2.1 time: 0.199972 Aug 30 16:12:23.354622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 980/2175] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:23 2022] DELETE /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:12:23.363242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.365339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.373864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.374603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.375199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.375913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.376473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.376905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.500409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c146e18-6f96-4c5a-bbc6-ff7ef570db71", "tag": "231cbb7b-609b-4730-81ad-8e92a9423f57"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:23.512433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.512900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.513332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.525809 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] Creating event network-changed:231cbb7b-609b-4730-81ad-8e92a9423f57 for instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 on n-h1-830883-28 Aug 30 16:12:23.530609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5e1152ea-66ba-4c15-8460-92ff93d6bc04 req-58aa9d55-b619-41d4-bc1b-24b4199d8d9e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Aug 30 16:12:23.531361 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 981/2176] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:12:23.547359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.556577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41683c5c-e3fb-42f8-b9d5-4aaffc53e2b5 tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1500 microversion: 2.1 time: 0.197576 Aug 30 16:12:23.557142 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1196/2177] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:23 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:23.616036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.616833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.623093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.623579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.624016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.624710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.625163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.625760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.652441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:23.653151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:23.659630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.660123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.660643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.662023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:23.662727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:23.663353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:23.782720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.791749 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d036eedc-54e7-45aa-a4dc-dfa6ecbcc469 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1664 microversion: 2.1 time: 0.180663 Aug 30 16:12:23.792442 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 982/2178] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:23 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1664 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:23.857082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:23.867937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-55508ab9-e650-4206-8038-fec3291e7380 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.219246 Aug 30 16:12:23.868534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1197/2179] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:23 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:24.006641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.007259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.013542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.014037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.015210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.015968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.016422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.016855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.172239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.172471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.173574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.179570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.180054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.180523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.180926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-edbc6825-98df-4a31-a673-bfca67e0e23d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.178636 Aug 30 16:12:24.181223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.195218 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 983/2180] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:24.195496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.195496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.209430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.210449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.221715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.222215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.226362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.226362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.226566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.226841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.299788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.309622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.311601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.312848 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71f6e58f-e54d-4135-9aa7-10fe8db8d511 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1408 microversion: 2.54 time: 0.112842 Aug 30 16:12:24.313425 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 984/2181] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:24.461173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.469496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b201801-7f82-4bb4-a284-3f5a957829aa tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1514 microversion: 2.1 time: 0.301202 Aug 30 16:12:24.470083 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1198/2182] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1514 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:24.577336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.578584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.586409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.587100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.587719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.588576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.589191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.589619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.594120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:24.689029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:24.700813 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c447c59f-dba1-4900-a59a-1b5d6427ff8f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1458 microversion: 2.1 time: 0.127681 Aug 30 16:12:24.701412 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 985/2183] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1458 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:24.813730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.814490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.823034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.823803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.824603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.825544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.826258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.826785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.890116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:24.890801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:24.902912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.902912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.902912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.903388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:24.903857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:24.905650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:24.995038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.004383 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-107ce593-8914-4fdc-872a-fd88b755075c tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1664 microversion: 2.1 time: 0.194341 Aug 30 16:12:25.019003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1199/2184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:25.169730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.185496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d889407f-e2e3-4113-9706-a11b930b8d92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.299847 Aug 30 16:12:25.190349 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 986/2185] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:24 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:25.204576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:25.205348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:25.214064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.214835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.215387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.216425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.217007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.217552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.338616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:25.339472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:25.345958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.346991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.347584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.348635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.349244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.350033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.385924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.397373 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee0cb6d9-1b88-4379-b0cf-ec3f4c3a0f78 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.197143 Aug 30 16:12:25.403958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1200/2186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:25 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:25.466732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.483363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.488347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.497064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:25.497761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:25.500072 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebb1abd4-c0e3-4f1d-abca-aec91f0e88e7 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1414 microversion: 2.54 time: 0.167110 Aug 30 16:12:25.510354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 987/2187] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:25 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:25.518505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.518505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.518505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.518865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.519094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.524346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.599358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19024a0d-1979-4d16-8972-39a367642e09", "name": "network-vif-deleted", "tag": "5fdf7d78-1af0-48b1-a5f4-feb068b0a535"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:25.610173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.610720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.611156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.650981 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] Creating event network-vif-deleted:5fdf7d78-1af0-48b1-a5f4-feb068b0a535 for instance 19024a0d-1979-4d16-8972-39a367642e09 on n-h1-830883-28 Aug 30 16:12:25.658909 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7ad78e65-fe03-49ac-ae7e-bb6dc95c3b28 req-eb61ec02-9c01-41bf-a98c-8bef17f80f6f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062828 Aug 30 16:12:25.659988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 988/2188] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:25.725663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:25.728773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:25.746951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.747487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.757255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.758192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.758717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.759165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.780507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.789289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa0a428c-0797-4a16-a503-32158169fbdf tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1514 microversion: 2.1 time: 0.297208 Aug 30 16:12:25.790193 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1201/2189] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:25 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:25.839013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:25.839737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:25.840383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:25.841028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lazy-loading 'fault' on Instance uuid 19024a0d-1979-4d16-8972-39a367642e09 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:25.917161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43d55a1e4a9f4f2b9cb85e010154f284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6505a4e8b8e24a71abd1559dfeb05e2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:25.937663 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d51ba6f4-af3c-4273-92d9-1c0e7ccf86eb tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 200 len: 1301 microversion: 2.1 time: 0.219206 Aug 30 16:12:25.942893 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 989/2190] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:25 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 1301 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:26.027354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.029785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.043067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.045514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.046214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.047832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.050912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.053011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.155759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc87614e-eb7b-4815-95ba-59617a76643e", "name": "network-vif-deleted", "tag": "8a3a9b50-d9f6-4246-939c-9f2fc7c3d309"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:26.167843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.169349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.169950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.199011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] Creating event network-vif-deleted:8a3a9b50-d9f6-4246-939c-9f2fc7c3d309 for instance cc87614e-eb7b-4815-95ba-59617a76643e on n-h2-830883-28 Aug 30 16:12:26.206171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9de47a8b-b381-4634-bbfa-2be5f1395901 req-ea5cf95f-9ba4-47cc-a7ee-a3b90deec85a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054495 Aug 30 16:12:26.207089 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 990/2191] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:12:26.222999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.229766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.231147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.238532 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-327aec3f-2c0f-4f69-b5b4-4e82c686763e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1597 microversion: 2.1 time: 0.215346 Aug 30 16:12:26.240309 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1202/2192] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1597 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:26.250160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.250501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.255118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.256779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.259733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.260234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.420865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.422655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.437569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.438483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.439105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.440916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.441796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.443193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.514382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.529401 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9ad6e30-0725-46f9-b624-18c20e529e2b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.318288 Aug 30 16:12:26.538691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 991/2193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:26.549728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.551208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.563608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.566450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.570114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.577680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.578861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.581489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.792987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.806219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.807788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.809031 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76f6a853-0a4f-49fe-b12d-84be196df2bb tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1414 microversion: 2.54 time: 0.269158 Aug 30 16:12:26.819380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:26.822191 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 992/2194] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1414 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:26.828115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.828747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.829269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e312a57-baf0-4d90-906a-e7b7fffdd0f6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.414437 Aug 30 16:12:26.830347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1203/2195] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:26.842818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:26.849926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.850814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.851495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.852600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.853317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.854038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.961757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:26.962689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] [instance: 19024a0d-1979-4d16-8972-39a367642e09] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:26.972060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.972969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.974928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:26.975902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:26.977537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:26.978445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.005931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] HTTP exception thrown: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. Aug 30 16:12:27.009229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Request method failure captured: Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 HTTP/1.1 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjUWhiQ9WAv3WPppz_2ZBE9D3bbwd-toUlPTrw4Sd_HLgTL5NWB1eISc25ho2cWgiWsjAlxhVhJKy1mHZKsByJU38W0vjteOv6Orjt7X2gRISexsK7wR4SuzvadJYjtg3hPFdAhHdMvzpPo745-SAcOvVx-yaGOEfc74eRgJK94BJhw Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6505a4e8b8e24a71abd1559dfeb05e2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6505a4e8b8e24a71abd1559dfeb05e2a"}]}] Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationTest-63990542 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 6505a4e8b8e24a71abd1559dfeb05e2a Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationTest-63990542 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 43d55a1e4a9f4f2b9cb85e010154f284 Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationTest-63990542-project Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '19024a0d-1979-4d16-8972-39a367642e09'} Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:27.016366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. Aug 30 16:12:27.019790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:27.020183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5735d7cc-e04c-4b2a-ab94-a022ebaad86b tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1472 microversion: 2.1 time: 0.194955 Aug 30 16:12:27.022635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] Returning 404 to user: Instance 19024a0d-1979-4d16-8972-39a367642e09 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:27.024040 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba663930-39c9-4c64-91a8-f6919f4c087f tempest-LiveMigrationTest-63990542 tempest-LiveMigrationTest-63990542-project] 10.222.0.47 "GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09" status: 404 len: 111 microversion: 2.1 time: 0.068098 Aug 30 16:12:27.024763 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1204/2196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/19024a0d-1979-4d16-8972-39a367642e09 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:27.035864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 993/2197] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:26 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:27.152352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:27.154658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:27.163946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.165365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.165829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.167063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.167539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.167973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.261300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:27.262406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:27.269504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.270201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.270864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.271737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.272338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.272911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.352322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:27.361872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6f9de55-23ae-42d4-9558-32390b7cce7b tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1310 microversion: 2.1 time: 0.104589 Aug 30 16:12:27.363399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 994/2198] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:27 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1310 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:27.376416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:27.392468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5c4b608-d85b-4c64-9590-0c36513667b2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 2421 microversion: 2.25 time: 0.245454 Aug 30 16:12:27.393467 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1205/2199] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:27 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 2421 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:27.417668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-830883-28", "block_migration": "auto"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:27.420444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:27.426757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.427568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.428113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.429200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.429717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.430702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.470449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'flavor' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:27.486931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Going to try to live migrate instance to n-h2-830883-28 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:12:27.552536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:27.553333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:27.564167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.565652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.567025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.568541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.569867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.571502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.826575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:27.842623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e85c8552-c1c7-4f9b-b32e-40eefe7b8700 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.296082 Aug 30 16:12:27.844408 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1206/2200] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:27 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:27.853884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:27.856946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:27.878900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.882458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.883436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.885038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:27.891079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:27.895225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:27.943564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:27.961391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:28.361987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:28.371641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:28.373144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:28.374784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77fe93d6-0be3-4408-b7c3-d07f241284e1 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1414 microversion: 2.54 time: 0.529262 Aug 30 16:12:28.375518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1207/2201] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:27 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1414 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:28.380750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:28.381689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:28.391958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.392471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.392924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.393667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.394106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.394707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.397921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:28.632693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:28.652586 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7b2329a2-7264-4797-878b-90e5a6d672fe tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1322 microversion: 2.1 time: 0.274709 Aug 30 16:12:28.653863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1208/2202] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:28 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:28.659358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:28.660132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:28.671606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.673804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.677463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.683499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.685577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.687473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.718166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:28.750805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.751976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.752805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.753341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lazy-loading 'fault' on Instance uuid e8b3051b-42bc-4534-ba5d-cd30eae7ac5d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:28.815271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:28.824952 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ea2a88c-a171-4224-9cb9-d95184800e74 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1308 microversion: 2.1 time: 0.169749 Aug 30 16:12:28.844077 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1209/2203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:28 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:28.861663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b3051b-42bc-4534-ba5d-cd30eae7ac5d", "name": "network-vif-deleted", "tag": "a8df926c-9a39-4224-966d-ca59cf41c303"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:28.877914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.878442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.878886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.939576 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] Creating event network-vif-deleted:a8df926c-9a39-4224-966d-ca59cf41c303 for instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d on n-h2-830883-28 Aug 30 16:12:28.953129 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e00e1552-1075-44d3-8833-4fb6f6a477a9 req-54e5b4fc-aa28-466f-a0dd-d9442a19e7b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106257 Aug 30 16:12:28.957560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1210/2204] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:28.968982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:28.980676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:28.988259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.990072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.991405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:28.992150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:28.992618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:28.995973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.078174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.079891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.080593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.081510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lazy-loading 'fault' on Instance uuid cc87614e-eb7b-4815-95ba-59617a76643e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:29.153665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:29.167137 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c411a022-26d3-41a2-bdd8-86bbbe13bbb4 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1315 microversion: 2.1 time: 0.207841 Aug 30 16:12:29.167776 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1211/2205] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:28 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:29.172618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:29.173414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:29.181919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.182769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.183465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.184477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.185089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.185668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.563716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:29.576281 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1dbe7f6f-b9c1-4c96-84fe-709d3ade82c5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.407406 Aug 30 16:12:29.576886 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1212/2206] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:29 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:29.587880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c146e18-6f96-4c5a-bbc6-ff7ef570db71", "name": "network-vif-plugged", "status": "completed", "tag": "231cbb7b-609b-4730-81ad-8e92a9423f57"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:29.595965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.596457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.596896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.609008 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] Creating event network-vif-plugged:231cbb7b-609b-4730-81ad-8e92a9423f57 for instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 on n-h1-830883-28 Aug 30 16:12:29.619951 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c966a5fa-c727-462b-ab3d-3ad3ed5bbcdb req-9e0a226b-361f-4217-a1ad-b3563b010cc7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041874 Aug 30 16:12:29.621503 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1213/2207] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:29.631656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:29.633015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:29.639641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.640143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.640590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.641299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.641762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.642193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.745395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:29.754058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:29.755997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:29.757391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-654fc47d-d9b6-49d0-8fee-571a5dd688a0 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1414 microversion: 2.54 time: 0.130671 Aug 30 16:12:29.758067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1214/2208] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:29 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:29.762612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:29.763405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:29.769259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.769889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.770611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:29.771307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:29.771761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:29.772189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.072843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:30.081005 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4efbcbe-0244-42e2-a7d8-8e1b1ec20ac6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1516 microversion: 2.1 time: 0.321755 Aug 30 16:12:30.081507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1215/2209] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:29 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:30.097518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:30.098151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:30.104539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.105026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.105465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.106160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.106647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.107074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.137072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:30.141616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.143567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.143932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.144398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lazy-loading 'fault' on Instance uuid e8b3051b-42bc-4534-ba5d-cd30eae7ac5d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:30.243485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:30.253469 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce246210-5265-4d43-bb40-3b50bfd6b167 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1308 microversion: 2.1 time: 0.170947 Aug 30 16:12:30.256584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1216/2210] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:30 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:30.264633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:30.267429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:30.276599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.277330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.277958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.279220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.279844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.280932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.307467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'flavor' on Instance uuid d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:30.548093 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-991b4593-c3eb-43b9-80b2-ab7cd240bc8b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action" status: 200 len: 32 microversion: 2.1 time: 0.290066 Aug 30 16:12:30.549372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1217/2211] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:12:30 2022] POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action => generated 32 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:12:30.566998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:30.569801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:30.580711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.581558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.582201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.583668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.584552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.585230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.643421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.644158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.644750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.645934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lazy-loading 'fault' on Instance uuid cc87614e-eb7b-4815-95ba-59617a76643e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:30.765822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48fab0861464f0e8642d023b410bf5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f39724a7b0b54a2eb35417dcfef2f4f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:30.776015 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71a5675a-f4f5-4da8-b627-c750011b431e tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 200 len: 1315 microversion: 2.1 time: 0.224828 Aug 30 16:12:30.790537 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1218/2212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:30 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:30.795886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:30.796583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:30.804121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.804937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.805602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.806595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.807499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.808176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.924861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94e1208f-4649-4fe2-b94c-db22e12db798 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/action" status: 202 len: 0 microversion: 2.25 time: 3.511954 Aug 30 16:12:30.929370 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 995/2213] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:12:27 2022] POST /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/action => generated 0 bytes in 3517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:12:30.935210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:30.936065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:30.954457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.954957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.955390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:30.956120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:30.956539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:30.959272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.148045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.158667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.165157 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd174906-b11f-4a6c-b4c0-32d1ad2bdf9e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.373160 Aug 30 16:12:31.181952 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1219/2214] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:30 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:31.186500 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d88ea57-ebb4-4f91-b0c0-510790f0087d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1316 microversion: 2.1 time: 0.255607 Aug 30 16:12:31.188384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.192280 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 996/2215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:30 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:31.203797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:31.208921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.211036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:31.221263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.221971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.226333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.227283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.227907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.229078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.241728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.242515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.243118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.243986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.261714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.262654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.456094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.470386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.475837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.479077 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e4989bc-0aca-46a6-8542-54ab311042df tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1399 microversion: 2.54 time: 0.306195 Aug 30 16:12:31.508711 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1220/2216] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:31 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1399 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:31.518899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.519549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:31.528881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.529442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.529888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.530624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.531275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.531702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.574624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.575936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.576556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.577160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lazy-loading 'fault' on Instance uuid e8b3051b-42bc-4534-ba5d-cd30eae7ac5d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:31.622674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.632331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.643091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.644565 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f22e6ccf-687d-40c9-968e-160a34c8afcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.450230 Aug 30 16:12:31.645346 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 997/2217] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:31 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:31.668386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-337e1759-c526-4377-86ab-cc22894754cc tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '.version_select at 0x7fd360ee7550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.713497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-337e1759-c526-4377-86ab-cc22894754cc tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1513384017" status: 204 len: 0 microversion: 2.54 time: 0.057540 Aug 30 16:12:31.720681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 998/2218] 10.222.0.47 () {60 vars in 1319 bytes} [Tue Aug 30 16:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1513384017 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:12:31.722169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:31.730708 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a788608f-f3a1-42f4-9903-c4d0b2cafa58 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 200 len: 1308 microversion: 2.1 time: 0.220981 Aug 30 16:12:31.734383 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1221/2219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:31 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:31.748192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.748764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:31.757315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.757817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.758259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.759012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.759469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.759897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.792303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:31.799104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:31.799734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] [instance: cc87614e-eb7b-4815-95ba-59617a76643e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:31.812083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.815440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.815916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.817087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:31.817196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:31.817875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:31.987292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f0df4cd-d48d-48a7-833f-10c51e757015 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 204 len: 0 microversion: 2.54 time: 0.254883 Aug 30 16:12:31.989902 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 999/2220] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:12:31 2022] DELETE /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:12:32.008947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.013480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:32.040419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.041193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.041891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.042808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.043412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.044005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.092287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:32.187565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] HTTP exception thrown: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Request method failure captured: Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e HTTP/1.1 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjZzDY2fFXVkdzXJH_WjQJbbmGHJ4I-rupYADIe4rYjaWehgyLLaGZGVfFa3q-jxmAw1UJTjkvnzsDXqha_TTZBxBaEbOQf0_xqVkYKjnCUOkZTVIWm0Mp5-CDXgqdjAiSuFeSKsd3oI6e-KCuMf6qM2YKUGj73n6srpGImBXQ95nuc Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f39724a7b0b54a2eb35417dcfef2f4f2 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestFqdnHostnames-1175963265 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f39724a7b0b54a2eb35417dcfef2f4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f39724a7b0b54a2eb35417dcfef2f4f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f39724a7b0b54a2eb35417dcfef2f4f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f39724a7b0b54a2eb35417dcfef2f4f2"}]}] Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestFqdnHostnames-1175963265 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f39724a7b0b54a2eb35417dcfef2f4f2 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1175963265 Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestFqdnHostnames-1175963265-project Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e48fab0861464f0e8642d023b410bf5e Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestFqdnHostnames-1175963265-project Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'cc87614e-eb7b-4815-95ba-59617a76643e'} Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:32.190259 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. Aug 30 16:12:32.195408 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:32.197022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Returning 404 to user: Instance cc87614e-eb7b-4815-95ba-59617a76643e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:32.198275 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b53aefa2-a000-4ccd-ac2b-a309342d42c1 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e" status: 404 len: 111 microversion: 2.1 time: 0.403161 Aug 30 16:12:32.202548 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1222/2221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:31 2022] GET /compute/v2.1/servers/cc87614e-eb7b-4815-95ba-59617a76643e => generated 111 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:12:32.209487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.210481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:32.225271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.225903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.226492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.227383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.227965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.228484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.234633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:32.535273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:32.547325 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9a874cc-f60a-417b-b0df-a0a6233184fa tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.343364 Aug 30 16:12:32.548210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1223/2222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:32 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:32.555031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3689f476-9e34-4bce-a0ff-bd82a2570b72 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] Calling method '.version_select at 0x7fd35c306ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.582264 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3689f476-9e34-4bce-a0ff-bd82a2570b72 tempest-ServersTestFqdnHostnames-1175963265 tempest-ServersTestFqdnHostnames-1175963265-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-339675483" status: 202 len: 0 microversion: 2.1 time: 0.032730 Aug 30 16:12:32.583459 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1224/2223] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-339675483 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:12:32.589624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.590545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:32.597620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.598175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.599378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.601027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.601680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.602184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.712992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:32.726227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:32.727840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:32.729455 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b63ae9b-d5c8-4ae8-a7a7-d718697599fd tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1405 microversion: 2.54 time: 0.733948 Aug 30 16:12:32.730573 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1000/2224] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:31 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1405 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:32.735819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.736699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:32.747654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.748427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.749427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.750586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:32.751867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:32.752664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:32.974618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:32.984744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c75cd678-8f63-4940-80e8-0bc50d069049 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1466 microversion: 2.1 time: 0.400061 Aug 30 16:12:32.985312 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1225/2225] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:32 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1466 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:32.996354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:32.996985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: e8b3051b-42bc-4534-ba5d-cd30eae7ac5d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:33.005920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.006478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.006932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.007707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.008174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.008926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.079594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] HTTP exception thrown: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Request method failure captured: Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d HTTP/1.1 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYhihR3ZERwNglayHzBB_aHwwKPBCpuXuwzOmf5xSXemp5I5rTZkK8raZUMl1Xe-fBpXP4-EsC5SquULnm3j6dgx1ngTGVmaZWYJTya95G387yoUVvW7RUE_z_NTtTjhF134IQqUtr4vAIJ1J5iMC62Ho5ocTvxqh1-gcjMOZgpUi0 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: df53a799481b4b4aa538d42c6cd10ce8 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df53a799481b4b4aa538d42c6cd10ce8"}]}] Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: df53a799481b4b4aa538d42c6cd10ce8 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesAdminNegativeTest-503090970-project Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ae6d5176489540329d05947f06c6ccfc Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesAdminNegativeTest-503090970-project Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'e8b3051b-42bc-4534-ba5d-cd30eae7ac5d'} Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:33.081368 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. Aug 30 16:12:33.085666 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:33.088884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Returning 404 to user: Instance e8b3051b-42bc-4534-ba5d-cd30eae7ac5d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:33.089779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c8c86eb-e9a0-4f75-a0d4-064fefd84e34 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d" status: 404 len: 111 microversion: 2.1 time: 0.103562 Aug 30 16:12:33.091016 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1226/2226] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:32 2022] GET /compute/v2.1/servers/e8b3051b-42bc-4534-ba5d-cd30eae7ac5d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:33.295605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:33.296735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:33.305607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.312086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.312548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.315288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.316750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.321317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.326569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:33.349726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:33.362941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:33.367217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ff0a59c-813f-49ec-85c8-3f6c7622808c tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.635153 Aug 30 16:12:33.369761 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1001/2227] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:32 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:33.570052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:33.570815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:33.587950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.588626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.589168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.589990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.590559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.591089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.829218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:33.837617 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a7e85e70-d1fd-4654-9f6b-4e277113c5ec tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.272326 Aug 30 16:12:33.838187 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1002/2228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:33 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:33.853055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:33.855886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:33.872017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.872509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.872945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.873672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:33.874192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:33.874558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:33.985302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:33.995877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:34.003988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:34.005331 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d2caf44-af95-4ffc-8a12-32879bf46992 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1405 microversion: 2.54 time: 0.163656 Aug 30 16:12:34.020969 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1003/2229] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:33 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:34.406066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:34.407074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:34.416152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:34.417241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:34.418169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:34.419215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:34.420248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:34.422015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:34.671490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:34.699586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:34.701513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:34.703269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fceb7e1a-93ff-4593-994c-bc338c373c67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.301028 Aug 30 16:12:34.705770 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1004/2230] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:34 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:34.862639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:34.863723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:34.883171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:34.887130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:34.892094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:34.893118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:34.893905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:34.894552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.220113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:35.249545 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80cdc2c9-029d-4cdd-a7a4-5555da740b75 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1619 microversion: 2.1 time: 2.157669 Aug 30 16:12:35.250121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1227/2231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:33 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1619 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:35.250198 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-269a5ce0-8be7-4459-be62-f19f05e36e99 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.391964 Aug 30 16:12:35.251035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1005/2232] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:34 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:35.275520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: .version_select at 0x7fd360ea64c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1218529734", "policies": ["affinity"]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:35.291520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:35.292420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:35.299513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:35.308376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.309863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.311911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.312851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.313984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.314274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:35.317698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.429395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.430285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.430908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.431115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:35.434153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lazy-loading 'fault' on Instance uuid 0d88a65b-8396-43d6-bdb8-f35f633bac25 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:35.447997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:35.501057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37cd9546-90ea-4983-aa89-bcc8bdb4f97c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.230466 Aug 30 16:12:35.502250 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1006/2233] 10.222.0.47 () {60 vars in 1174 bytes} [Tue Aug 30 16:12:35 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:35.577094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:35.589658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:35.599428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a2a443776e594b7b90c66a9c5da0999f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e068d321649463790072bfb11a82972', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:35.601158 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ed4da21-526f-48ca-b00d-87f51e4cd2ae tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 200 len: 1410 microversion: 2.54 time: 0.328411 Aug 30 16:12:35.615400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1228/2234] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:35 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 1410 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:35.633824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-10282528", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "77a6ff0e-eaab-49f4-b166-bd7f68d69e5e"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:35.731450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:35.732297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:35.740384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:35.743382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.743894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.744347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.745061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.745534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.745961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.213225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:36.233592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:36.237922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:36.244011 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0ebdb34-96a5-449b-8a0a-0379c4c04228 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.516291 Aug 30 16:12:36.247211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1229/2235] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:35 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:36.272107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:36.273547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:36.292078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:36.299293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:36.299981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.300976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:36.301786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:36.302579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.794834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:36.795412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:36.796334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:36.796832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:36.797348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:36.843912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:36.846942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:36.847604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.848827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:36.852154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:36.852791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.907743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:36.955662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:37.032220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 2 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:12:37.034375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:37.069939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.080823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83fe0ecf-79f9-4100-90c0-e23e2085602d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.813500 Aug 30 16:12:37.091221 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1230/2236] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:36 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:37.111978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:37.117528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] [instance: 0d88a65b-8396-43d6-bdb8-f35f633bac25] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:37.137660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.139002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.139742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.140725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.141661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.142352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.188587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] HTTP exception thrown: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. Aug 30 16:12:37.195745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122351) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Request method failure captured: Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 HTTP/1.1 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbAMxHunc41NnQqPqCGMAOT0afmoB0hItm9FwfEKiuvdJOspFg97IyP16IGdmtd30kKpzu-z6FiqKp4IhcKG7AgjMHR_fosmO-lmTkgvX6HvgcMK5JTmdBwALDuYP98EMBY_0h4JA3WMwD57CUGEkS3Ox3ubWAREVYGm4xGRUCSutY Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.54 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4e068d321649463790072bfb11a82972 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerShowV254Test-84530706 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4e068d321649463790072bfb11a82972"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4e068d321649463790072bfb11a82972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4e068d321649463790072bfb11a82972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4e068d321649463790072bfb11a82972"}]}] Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerShowV254Test-84530706 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4e068d321649463790072bfb11a82972 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerShowV254Test-84530706 Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerShowV254Test-84530706-project Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a2a443776e594b7b90c66a9c5da0999f Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerShowV254Test-84530706-project Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '0d88a65b-8396-43d6-bdb8-f35f633bac25'} Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:37.203422 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] Returning 404 to user: Instance 0d88a65b-8396-43d6-bdb8-f35f633bac25 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19322507-6e06-4566-a573-93ea3e371668 tempest-ServerShowV254Test-84530706 tempest-ServerShowV254Test-84530706-project] 10.222.0.47 "GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25" status: 404 len: 111 microversion: 2.54 time: 0.092475 Aug 30 16:12:37.208403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1231/2237] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:37 2022] GET /compute/v2.1/servers/0d88a65b-8396-43d6-bdb8-f35f633bac25 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:12:37.231269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:37.238931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:37.274909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:37.276659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:37.291135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.293472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.295486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.296441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.301415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.302118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.314164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:37.352225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:37.374493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:37.505352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=1e04c935-0f3a-4def-abd4-b6fae92fa742,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:37.668751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:37.679151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.683392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:37.698555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.704326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.719733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71c40aaa-f467-4534-b950-66acc996fdcb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.446231 Aug 30 16:12:37.720157 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1232/2238] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:37 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:37.804830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:37.822496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:37.929051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e9688a3-15a5-45ec-b7d8-a5fcadef6e31 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.299271 Aug 30 16:12:37.933147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1007/2239] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:12:37.938135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:37.949378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.949871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Searching by: {'deleted': False, 'project_id': 'f17545909b3c4b559a571813e373cd09'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:12:38.068281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.075228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.077563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.080392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.083541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.084765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.113594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:38.114269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:38.132817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.133013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.133408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.139522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.140738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.141190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.157283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:12:38.239651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-623b415a-e671-4d67-86b8-8e5e0d511f00 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.305402 Aug 30 16:12:38.240585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1233/2240] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:12:37 2022] GET /compute/v2.1/servers => generated 999 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:12:38.252085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7eb3d86a-50d5-4a8b-a005-e9ed581c7474 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:38.253401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eb3d86a-50d5-4a8b-a005-e9ed581c7474 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:38.522002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:38.556503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc635edc-0d4b-4cf6-98f5-230cd0178cf3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.448442 Aug 30 16:12:38.559677 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1008/2241] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:38 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:38.629191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eb3d86a-50d5-4a8b-a005-e9ed581c7474 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:38.637617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7eb3d86a-50d5-4a8b-a005-e9ed581c7474 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1217 microversion: 2.1 time: 0.389392 Aug 30 16:12:38.643897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1234/2242] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:38 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1217 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:38.744500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:38.745469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:38.762362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.763087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.763752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.778746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.779653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.780368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.039046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:39.040025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:39.078740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.085035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.091073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.091983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.092571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.093133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.185936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:12:39.459587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70480158-d75b-40ba-b72f-ce91e37b02f9 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 204 len: 0 microversion: 2.1 time: 0.425697 Aug 30 16:12:39.461684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1235/2243] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:12:39 2022] DELETE /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:12:39.468843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:39.484108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:39.486268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:39.487446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:39.492136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:39.493597 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c571c079-fa2e-4fa8-b904-c74681ff7ecf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.753845 Aug 30 16:12:39.495567 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1009/2244] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:38 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:39.517962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.519301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.522072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.524822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.527032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.528767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.579351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:39.580248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:39.590150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.593987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.594743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.595657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.599390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.599959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.027439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:40.052241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f2ef2d8b-faad-4347-bb71-864c9f082aea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.462306 Aug 30 16:12:40.052907 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1010/2245] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:39 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:40.069232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:40.076721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:40.096780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.097295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.097740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.112351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.112885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.113337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.195351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:40.226740 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c94b4f0-c677-4003-a6fa-0335d9bc95fe tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1682 microversion: 2.1 time: 0.760576 Aug 30 16:12:40.227889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1236/2246] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:39 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1682 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:40.288287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:40.296504 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64161943-623f-4f91-b9b5-fb7f0ad2577f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1221 microversion: 2.1 time: 0.242517 Aug 30 16:12:40.300883 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1011/2247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:40 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:40.523974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:40.524838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:40.538093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.551647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.552856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.554376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.555032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.555693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.075315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:41.076524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:41.095012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.096965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.098646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.099946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.100562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.101223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.419548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:41.438469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f6142ab-5cc2-4cbf-8ece-79a2fa6b91bf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.367775 Aug 30 16:12:41.439508 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1012/2248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:41 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:41.459775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:41.463052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:41.476841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.479800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.484563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.486955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.487902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.492408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.836450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:41.869061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:41.872466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:41.873867 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a454cf6-31ed-4d2b-99d7-504720424dab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 1.354980 Aug 30 16:12:41.895884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:41.910924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1237/2249] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:40 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:41.918144 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46970206-39cd-4a08-8182-8c6134c8b69a tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1682 microversion: 2.1 time: 0.477391 Aug 30 16:12:41.934634 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1013/2250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:41 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1682 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:41.936309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:41.937109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:41.945609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.946352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.947018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.948013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.948647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.949248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:42.045950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:42.058912 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60eeaa33-2918-4018-991f-43a18be01175 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1269 microversion: 2.1 time: 0.142906 Aug 30 16:12:42.059562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1238/2251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:41 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:42.462005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:42.462814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:42.486001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:42.487044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:42.487451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:42.488367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:42.489029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:42.489609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:42.901069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:42.902331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:42.910402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:42.911087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:42.911680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:42.912602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:42.913204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:42.913777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.421126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.439626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.441305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.443191 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5df6fdd-c2bb-4860-bb87-a2b813cf910d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.547236 Aug 30 16:12:43.462168 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1239/2252] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:42 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:43.483202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:43.484007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:43.512712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.513455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.514145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.515237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.515844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.516715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.646041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.660026 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64a64d69-0d2c-4e43-9d62-bc7864916c5e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 1.202775 Aug 30 16:12:43.678648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1014/2253] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:42 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:43.686008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:43.687112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:43.697521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.698740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.699685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.700650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.701439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.702407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.912366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.932256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2eda0fc-91d9-4cd9-9440-37eaa7a94bd9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1275 microversion: 2.1 time: 0.251905 Aug 30 16:12:43.951808 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1015/2254] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:43 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:43.995500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:44.006684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:44.027932 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e2497ba-b843-463f-bd1f-a263ee7a9d21 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1682 microversion: 2.1 time: 0.560954 Aug 30 16:12:44.029223 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1240/2255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:43 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1682 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:44.467595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:44.468212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:44.501020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.501551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.501960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:44.535956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.536955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.540221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:44.681427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:44.682185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:44.688784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.689276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.689721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:44.690450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.690912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.691347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.125664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.139205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.140630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.141822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdd5510f-0b6a-4664-8a01-218b88d1353f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.678912 Aug 30 16:12:45.147054 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1016/2256] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:44 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:45.154609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:45.155227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:45.169833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.177413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.178709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.179606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.180209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.180780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.302236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.313978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25cc9df9-f6dc-44f1-bb53-32a432fdf786 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1275 microversion: 2.1 time: 0.163436 Aug 30 16:12:45.330847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1017/2257] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:45 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:45.336215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:45.339909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:45.356784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.359615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.361079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.362026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.364776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.367949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.412528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:45.452100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.452582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.453387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.454175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lazy-loading 'fault' on Instance uuid a89b5b78-2cb8-4afc-848b-023f5fb86548 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:12:45.613211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6d5176489540329d05947f06c6ccfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df53a799481b4b4aa538d42c6cd10ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.622196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-189eaa6a-bb48-415d-b2ad-3e63863bc615 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 200 len: 1331 microversion: 2.1 time: 0.289943 Aug 30 16:12:45.630559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1018/2258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:45 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 1331 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:45.644577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89b5b78-2cb8-4afc-848b-023f5fb86548", "name": "network-vif-deleted", "tag": "0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:45.680997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.681476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.684616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.709962 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] Creating event network-vif-deleted:0c6bfc98-18ea-49ea-86ac-d7424ab5a1cc for instance a89b5b78-2cb8-4afc-848b-023f5fb86548 on n-h2-830883-28 Aug 30 16:12:45.725821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c3a89d00-81f6-4000-8e4b-a6ea16043c0f req-34cdc0be-a26e-4c54-aa6b-5265da1594e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089960 Aug 30 16:12:45.727158 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1019/2259] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:45.747818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.763160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41278684-a7fb-49d7-ad02-e0fa867a3fc2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 1.085505 Aug 30 16:12:45.781701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1241/2260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:44 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:46.166395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.167103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:46.173895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.174407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.174847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.175554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.176575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.177060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.342446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.343214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:46.355909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.356420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.356905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.360435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.360962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.361602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.572328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:46.645471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca95fbdf-cdc8-4800-b391-fcfa36b5cb13 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1275 microversion: 2.1 time: 0.307310 Aug 30 16:12:46.662776 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1242/2261] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:46 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:46.665888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:46.676841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.678065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] [instance: a89b5b78-2cb8-4afc-848b-023f5fb86548] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:46.682983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:46.684783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:46.687250 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0fadce54-4873-4174-9d8b-bc3fe8ea4ab3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.525129 Aug 30 16:12:46.693689 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1020/2262] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:46 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:46.705022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.706228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.708351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.709659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.712480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.712993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.744399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] HTTP exception thrown: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Request method failure captured: Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 HTTP/1.1 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYhihR3ZERwNglayHzBB_aHwwKPBCpuXuwzOmf5xSXemp5I5rTZkK8raZUMl1Xe-fBpXP4-EsC5SquULnm3j6dgx1ngTGVmaZWYJTya95G387yoUVvW7RUE_z_NTtTjhF134IQqUtr4vAIJ1J5iMC62Ho5ocTvxqh1-gcjMOZgpUi0 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: df53a799481b4b4aa538d42c6cd10ce8 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/df53a799481b4b4aa538d42c6cd10ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/df53a799481b4b4aa538d42c6cd10ce8"}]}] Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: df53a799481b4b4aa538d42c6cd10ce8 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-503090970 Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesAdminNegativeTest-503090970-project Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ae6d5176489540329d05947f06c6ccfc Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesAdminNegativeTest-503090970-project Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a89b5b78-2cb8-4afc-848b-023f5fb86548'} Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:46.746603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. Aug 30 16:12:46.751266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:46.752624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Returning 404 to user: Instance a89b5b78-2cb8-4afc-848b-023f5fb86548 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:46.753663 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bbcd2ef-b7f8-4215-bba1-860569182575 tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548" status: 404 len: 111 microversion: 2.1 time: 0.087730 Aug 30 16:12:46.758933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1243/2263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:46 2022] GET /compute/v2.1/servers/a89b5b78-2cb8-4afc-848b-023f5fb86548 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:46.766100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18a29592-2826-4234-9e5b-807b2fdbb70e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] Calling method '.version_select at 0x7fd360e18820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.787241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.788325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:46.797958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.798667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.799272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.800359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.801583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.802404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.817667 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18a29592-2826-4234-9e5b-807b2fdbb70e tempest-VolumesAdminNegativeTest-503090970 tempest-VolumesAdminNegativeTest-503090970-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450340041" status: 202 len: 0 microversion: 2.1 time: 0.057202 Aug 30 16:12:46.818151 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1021/2264] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450340041 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:12:47.664320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:47.672038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:47.674097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:47.678635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:47.685341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0ca19b2-91ea-48f0-b13c-20d1b68a0092 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.904245 Aug 30 16:12:47.704520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1244/2265] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:46 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:47.711619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.712115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.712716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:47.714594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:47.715034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.715516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:47.715646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.716069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:47.728430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.729700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.730801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:47.732687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.734266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.735632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:47.850198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:48.101796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:48.314403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.329649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a497f40-c7dc-4924-ae14-50e8bd657457 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.662683 Aug 30 16:12:48.334075 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1022/2266] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:47 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:48.341794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e04c935-0f3a-4def-abd4-b6fae92fa742", "tag": "d96d0f95-6048-4426-8848-0e85c6aad430"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:48.386755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:48.387372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:48.387826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:48.422825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] Creating event network-changed:d96d0f95-6048-4426-8848-0e85c6aad430 for instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 on n-h2-830883-28 Aug 30 16:12:48.440134 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-439183fa-d2df-45d7-9dc8-0857e027818e req-e71ff955-f807-410e-b645-5dd43f3babf1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104413 Aug 30 16:12:48.440753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1023/2267] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:48.480453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.507647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.509268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.513424 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1132a32f-aa7f-4c2a-b75a-6454e8c0167e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.803149 Aug 30 16:12:48.518018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1245/2268] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:47 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:12:48.714148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:48.714818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:48.726220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:48.726760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:48.727202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:48.730850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:48.731488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:48.731931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.353217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:49.353760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:49.359262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:49.361618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.362373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.363030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.364098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.364753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.365376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.523574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:49.533053 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b55d970b-f35a-4398-bfac-eea953fee1d9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.824523 Aug 30 16:12:49.547806 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1024/2269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:48 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:49.553443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:49.554112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:49.561602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.562316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.562891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.563739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.564331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.564960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.652927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:49.671737 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d91be555-095f-4e3e-ac0e-6dd57be97177 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.322359 Aug 30 16:12:49.672542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1246/2270] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:49 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:50.193810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:50.228015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:50.235038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:50.239836 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3122e19-d2e7-45a2-96b9-5952d7280972 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.688775 Aug 30 16:12:50.242728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1025/2271] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:49 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:50.507967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d06940-7b7c-4a45-be79-0e368aaa02a1", "tag": "38bb2556-4dc2-4917-b360-f582454b1c09"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:50.530835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.531341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.536794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.565483 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] Creating event network-changed:38bb2556-4dc2-4917-b360-f582454b1c09 for instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 on n-h2-830883-28 Aug 30 16:12:50.566203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:50.568179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:50.580749 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2e19f05b-5d6b-432e-a43a-9c42de13f189 req-7acf7c92-26ff-4d04-983a-4b81049cdb14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077252 Aug 30 16:12:50.581989 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1247/2272] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:50.591228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.593535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.594611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.601280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.602606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.603316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.696690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:50.697486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:50.721079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.721728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.722219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.729822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.730430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.730878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:51.074058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.085850 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e8679c92-f33b-4251-8455-1c633fe40ea2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.535316 Aug 30 16:12:51.087971 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1026/2273] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:50 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:51.247552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.269169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:51.269648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa205941-e8f5-49c3-b505-075b2575eb50 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.570539 Aug 30 16:12:51.270036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:51.289545 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1248/2274] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:50 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:51.294360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:51.297240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:51.298740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:51.301185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:51.302463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:51.303251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:51.823757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.844100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.851103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.856217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-42e7f455-4157-481a-b670-f3a20ca18dd0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.591409 Aug 30 16:12:51.857950 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1027/2275] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:51 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:52.110269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:52.111029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:52.122859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.124119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.125590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.126693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.127512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.128205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.297883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:52.298631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:52.316526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.318323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.320280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.321292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.330072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.331661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.872910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:52.909936 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e069e304-ed92-4942-975f-d7144c4a48bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.617111 Aug 30 16:12:52.940837 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1028/2276] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:52 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:52.957707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:52.963890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:52.986873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.988647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.990462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.991418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.992873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.994046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:53.065789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:53.080766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-96b43fe0-b900-4fcf-a345-28929337023c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.975682 Aug 30 16:12:53.082100 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1249/2277] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:52 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:53.953068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:53.953964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:53.973429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:53.975155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:53.975828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:53.978375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:53.978870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:53.980484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:54.122481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:54.134983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:54.136433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:54.142967 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-596e5283-c011-40d9-9d36-56f812467fa1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 1.200938 Aug 30 16:12:54.143589 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1029/2278] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:52 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:54.155667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:54.156285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:54.166174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:54.166747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:54.167249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:54.167963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:54.168463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:54.168899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:54.502500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:54.512855 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2f11909-a24f-47cf-aac3-2c0551a9aa2f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1522 microversion: 2.1 time: 0.367837 Aug 30 16:12:54.514030 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1030/2279] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:54 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:54.825317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1605309046", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:54.927839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:54.985775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:55.003891 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b469797d-4ef9-44fa-8665-f32fe1c409b4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 1.055791 Aug 30 16:12:55.030428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1250/2280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:53 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:55.171508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:55.172300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:55.193658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.195396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.198531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:55.199585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.201599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.202275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:55.711182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:55.728004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:55.729858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:55.731354 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-defffadb-f3d0-47bf-baba-0c267cfef9e6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.566546 Aug 30 16:12:55.732688 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1251/2281] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:55 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:55.750861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:55.751685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:55.781370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.782231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.783148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:55.784241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.786017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.790173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.525807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:56.526247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:56.527612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:56.529694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:56.530151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:56.545264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.547105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.547791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.549681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.550643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.552314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.628059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Getting quotas for project 410abd3e175941ec913e83cf298de76a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:56.668064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Getting quotas for user 51ad541793be46b0890a8d849586363e and project 410abd3e175941ec913e83cf298de76a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:56.699756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:56.704586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:12:56.708066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:56.731724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68710f7d-434f-49fe-b809-df9a8426667e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1502 microversion: 2.1 time: 0.996276 Aug 30 16:12:56.749570 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1252/2282] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:55 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1502 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:56.781913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:56.785969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:56.788161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:56.815809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.819651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.820146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.820900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.821360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.821791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.844225 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ad895e7-0c24-4fbe-b3c0-cbe840c1e238 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328709 Aug 30 16:12:56.851841 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1031/2283] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:12:56.860884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "name": "network-vif-unplugged", "status": "completed", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:56.875289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.876111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.876841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.898404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] Creating event network-vif-unplugged:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h1-830883-28 Aug 30 16:12:56.904143 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5dd526a1-6d92-4e03-ba7a-d408cabbcdfb req-ff73f78a-d91a-4611-882c-664cf1408f2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051121 Aug 30 16:12:56.905792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1032/2284] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:56.912804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:56.916436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:56.936366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.938611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.939688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.942890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.943603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.944297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.461390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:57.495601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:57.502021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:57.508156 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83d7d84a-90cb-41ef-b3b4-d1a5e1572774 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.596251 Aug 30 16:12:57.509240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1033/2285] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:56 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:57.524518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:57.526710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:57.546624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.549223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.549878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.553548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.555226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.556158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.785143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:57.799183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b0cf9e25-b983-4d22-95c3-570dcc72f6b3 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 1.047299 Aug 30 16:12:57.802739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1253/2286] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:56 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:57.819439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:57.820510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:57.833831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.836340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.837531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.839073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.840991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.841661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.155966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:58.169503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1223 microversion: 2.1 time: 0.365163 Aug 30 16:12:58.205515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1254/2287] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:57 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1223 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:58.206716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:58.222052 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd545995-a1c6-492a-a288-3c3dfd7b48c9 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001512 Aug 30 16:12:58.237675 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1255/2288] 10.222.0.47 () {56 vars in 886 bytes} [Tue Aug 30 16:12:58 2022] GET /compute/ => generated 377 bytes in 32 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 16:12:58.474667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:58.485276 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc962c32-61e4-48c4-85a9-d16fc9512af4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1515 microversion: 2.1 time: 0.973683 Aug 30 16:12:58.485860 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1034/2289] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:57 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1515 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:58.513987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:58.519489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: b49a0e29-c289-44fc-a33a-f620f186ca3f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:58.533338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. Aug 30 16:12:58.536528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:58.537573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b49a0e29-c289-44fc-a33a-f620f186ca3f/action HTTP/1.1 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 14 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: {"rescue": {}} Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b49a0e29-c289-44fc-a33a-f620f186ca3f', 'body': {'rescue': {}}} Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:58.541515 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. Aug 30 16:12:58.546429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:12:58.548488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 404 to user: Instance b49a0e29-c289-44fc-a33a-f620f186ca3f could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:12:58.550784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3197962-29cf-43f9-91e0-f4d0c4e4e6ba tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/b49a0e29-c289-44fc-a33a-f620f186ca3f/action" status: 404 len: 111 microversion: 2.1 time: 0.042538 Aug 30 16:12:58.552596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1256/2290] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:12:58 2022] POST /compute/v2.1/servers/b49a0e29-c289-44fc-a33a-f620f186ca3f/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:12:58.561156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.561711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.562170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.562913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:58.563041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.563607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:58.570713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.571140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.575332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.576081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.577359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.580107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.581252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.581948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.734200 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1618bc9-5800-4723-af2d-806ff950e43c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action" status: 202 len: 0 microversion: 2.1 time: 0.176459 Aug 30 16:12:58.735621 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1257/2291] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:12:58 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:12:58.751386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:58.752186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:58.759568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.760361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.761037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.761967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.762654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.763281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.218643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:59.234946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:59.241398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc2e9947-ee5a-4c02-8ac2-687b345baa8e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1520 microversion: 2.1 time: 0.494637 Aug 30 16:12:59.248361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1258/2292] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:58 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:59.253532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:59.263472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:59.264047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:59.267919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:59.269478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a43644e8-57b3-4a5c-8b17-eba42bafa8d7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.737775 Aug 30 16:12:59.275489 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1035/2293] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:12:58 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:12:59.277470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:59.280731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:59.287672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.288428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.290204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.295246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.296065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.296696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.297860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.298729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.299350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.315270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] Creating event network-changed:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h1-830883-28 Aug 30 16:12:59.321425 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bd61567c-9a74-4043-bda6-fa91f3cb173b req-e34f44ba-65ef-4a90-b99f-97bfb55ab758 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044358 Aug 30 16:12:59.322383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1036/2294] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:59.328264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e04c935-0f3a-4def-abd4-b6fae92fa742", "name": "network-vif-plugged", "status": "completed", "tag": "d96d0f95-6048-4426-8848-0e85c6aad430"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:59.344122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.345690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.346394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.362175 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] Creating event network-vif-plugged:d96d0f95-6048-4426-8848-0e85c6aad430 for instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 on n-h2-830883-28 Aug 30 16:12:59.369539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d85ea674-3204-4dab-9038-772b5206fc69 req-656a9303-4e42-42eb-ae5a-c0907f6d6462 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045209 Aug 30 16:12:59.370904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1037/2295] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:59.377161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:59.378167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:59.385130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.385953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.386637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.387559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.388273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.388952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.616719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:59.626645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e58e2f10-df0b-46c4-85d2-10c4ee5b4887 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1271 microversion: 2.1 time: 0.254188 Aug 30 16:12:59.627303 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1038/2296] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:59 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:00.116034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:00.124899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:00.135613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d27f4fd6-2a8e-426a-a41c-7bd0087f70c4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.885824 Aug 30 16:13:00.136847 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1259/2297] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:59 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:00.267364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:00.268946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:00.276675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.277326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.277872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.279082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.279652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.282997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.301055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:00.302509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:00.319057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.319590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.320049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.323626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.324121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.327305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.688601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:00.694024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:00.703733 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44783da8-7df2-4f28-8aa6-661d243b9dd2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1500 microversion: 2.1 time: 0.440228 Aug 30 16:13:00.704889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1039/2298] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:00 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1500 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:00.720577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9160299-40f8-4d7c-9944-350a0e3043b4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Action: 'create', calling method: .version_select at 0x7fd360e18040>, body: {"keypair": {"name": "tempest-keypair-1574705844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkQVBGxznMWKA5sX5Nx/GuK6TVF02WPly4fPy3i3gykNVyCfPfYPEQAzLzdvme6oQxxflWjFGfZRtlAa8luvSqD7m2HpmZz/UCcAlCdhu+kA0xOzJYXBuRrYwPqKIiOoA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:00.766674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d9160299-40f8-4d7c-9944-350a0e3043b4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Getting quotas for project f8fe3a2308cf43d88d7c8f3e954257f7. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:00.773308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d9160299-40f8-4d7c-9944-350a0e3043b4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Getting quotas for user 389b6f29e0274334aa4661e16414797d and project f8fe3a2308cf43d88d7c8f3e954257f7. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:00.840559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9160299-40f8-4d7c-9944-350a0e3043b4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.127620 Aug 30 16:13:00.843453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1040/2299] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:13:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:13:00.860736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:00.861737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:00.883087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.883975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.884639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.885480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.886065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.886616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.046678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:01.084023 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fda75b8e-9789-44d7-ac8c-714729a377d4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1277 microversion: 2.1 time: 0.235271 Aug 30 16:13:01.085051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1041/2300] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:00 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:01.100270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:01.113641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:01.129331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.131185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.132306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.133880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.136286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.136921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.204028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'flavor' on Instance uuid e88926ad-060b-4fa0-a0db-50ebc5b8f70d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:01.243292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Cannot 'rescue' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state paused Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action HTTP/1.1 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 14 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: {"rescue": {}} Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'rescue' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state paused Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e88926ad-060b-4fa0-a0db-50ebc5b8f70d', 'body': {'rescue': {}}} Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d in vm_state paused. Cannot rescue while the instance is in this state. Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state paused Aug 30 16:13:01.259617 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state paused Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:01.263779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 409 to user: Cannot 'rescue' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state paused {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:13:01.264896 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71ab0c34-6c72-4d94-885e-2b3828a9f440 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action" status: 409 len: 144 microversion: 2.1 time: 0.178471 Aug 30 16:13:01.282814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1042/2301] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:13:01 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action => generated 144 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:13:01.290222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:01.291121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:01.300357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.301134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.302549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.303577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.304207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.304781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.917383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:01.934881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:01.938147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:01.943244 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a4039c9-69ee-4195-8d64-5d5dd30c3083 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 1.642025 Aug 30 16:13:01.963515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1260/2302] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:00 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:01.984653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:01.986582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.015996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.018831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.019672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.021169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.023396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.025786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.204391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e2c75a3-6004-4c31-a369-ce243558b2e5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action" status: 202 len: 0 microversion: 2.1 time: 0.239204 Aug 30 16:13:02.210467 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1261/2303] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:13:01 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:13:02.222917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:02.226470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.242943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:02.244503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.255380 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-377b8032-1ba7-49c7-8bfe-5817eac4c2a7 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.970684 Aug 30 16:13:02.257063 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1043/2304] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:01 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:02.260278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.260948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.261972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.262688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.263364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.290868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:02.291675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.312674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.320388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.321447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.322409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.323261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.323849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.616713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:02.678018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6015c11b-485e-41b6-aa5d-a16f0866e562 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1277 microversion: 2.1 time: 0.460730 Aug 30 16:13:02.682015 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1262/2305] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:02 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1277 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:02.771564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:02.783547 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f86aa83-a39c-4224-b555-f074251153d0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1507 microversion: 2.1 time: 0.511412 Aug 30 16:13:02.784375 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1044/2306] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:02 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1507 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:02.972179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:02.972815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.980086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.980586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.981029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.981735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.982192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.982649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.277294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:03.278612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:03.288188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.290865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.295591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.299232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.299909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.300514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.783535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:03.790955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:03.797568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:03.799468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:03.801376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02a3fae9-9c61-4ad9-8805-ef8e39188ee1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.833366 Aug 30 16:13:03.803734 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b735abba-b38f-4840-8388-bdc4f348b806 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.530489 Aug 30 16:13:03.805226 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1263/2307] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:02 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:03.806858 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1045/2308] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:03 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:03.823010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:03.824517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:03.825324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:03.826088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:03.840165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.840672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.841119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.842886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.844228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.844673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.845387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.845989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.846257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:03.850075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:03.850540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:03.851102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:04.076087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:04.086411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93db4e03-19b5-4d7d-a166-c1a341966138 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1277 microversion: 2.1 time: 0.279796 Aug 30 16:13:04.087419 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1264/2309] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:03 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:04.237181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:04.246190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b7a05e7-aa8d-4c0d-979c-2a256f837c71 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1515 microversion: 2.1 time: 0.438057 Aug 30 16:13:04.246791 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1046/2310] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:03 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:04.831537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:04.833602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:04.839318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:04.840696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:04.858065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:04.858673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:04.860043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:04.860182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:04.860762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:04.861079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:04.861412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:04.861529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:04.861954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:04.864355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:04.871180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:04.871899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:05.389702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:05.404560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4485d962-00c3-4949-ac75-c983d96be375 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.568782 Aug 30 16:13:05.407399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1047/2311] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:04 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:05.437534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d06940-7b7c-4a45-be79-0e368aaa02a1", "name": "network-vif-plugged", "status": "completed", "tag": "38bb2556-4dc2-4917-b360-f582454b1c09"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:05.476605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:05.477108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:05.477546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:05.480007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:05.491560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:05.493366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:05.494924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f61ea0cf-b4b6-4a11-9a82-f3a23527f990 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.667450 Aug 30 16:13:05.496046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] Creating event network-vif-plugged:38bb2556-4dc2-4917-b360-f582454b1c09 for instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 on n-h2-830883-28 Aug 30 16:13:05.496283 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1265/2312] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:04 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:05.503434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:05.505114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:05.520738 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6007de1f-c752-4c20-8236-6cc2374abfa1 req-434adaf5-c45c-49de-956a-e568f76d1241 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111337 Aug 30 16:13:05.521700 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1048/2313] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:05.531772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:05.532661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:05.533320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:05.534636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:05.535428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:05.536665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.018059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:06.035001 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7548142f-3fbd-403d-a2e3-cc5e91f00bc0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1277 microversion: 2.1 time: 0.537445 Aug 30 16:13:06.035634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1266/2314] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:05 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1277 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:06.428714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:06.429427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:06.436191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.436901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.437481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.438593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.439311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.439895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.524575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:06.525230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:06.565404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.566117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.566487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.577274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.578322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.578970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.604534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:06.900405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:06.913363 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d4547795-5611-40e1-bc26-cdf22b4765fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1317 microversion: 2.1 time: 0.490353 Aug 30 16:13:06.916502 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1049/2315] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:06 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:06.927694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:06.929901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:06.946394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.946793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.947439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:06.954061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:06.954825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:06.956123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:07.007858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'flavor' on Instance uuid e88926ad-060b-4fa0-a0db-50ebc5b8f70d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:07.165946 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d4dcfd9-25b2-4bcc-a974-f211a647b37e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action" status: 200 len: 32 microversion: 2.1 time: 0.246032 Aug 30 16:13:07.171221 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1050/2316] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:13:06 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:13:07.200836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:07.201577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:07.214585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:07.215084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:07.215523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:07.216441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:07.216902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:07.217325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:07.499281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:07.522853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eb9397e9-92ce-499a-b96b-57873bba6856 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.347775 Aug 30 16:13:07.524247 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1051/2317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:07 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:07.533832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:07.544823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:07.571316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:07.572159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:07.572702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:07.576025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:07.578810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:07.583986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.096099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.105080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31692cb1-70b6-4f2c-8f99-450fb8a837e3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.577495 Aug 30 16:13:08.110439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1052/2318] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:07 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:08.124541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.125130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:08.125253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:08.135468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.136282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.136783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.137222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.137928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.138419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.138829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.143870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.150978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-640b29d9-b42f-4daf-9f0c-abfaac35f35e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 1.630482 Aug 30 16:13:08.162398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1267/2319] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:06 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:08.443874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.452310 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-781858da-ea98-4d03-b707-a229f46199a4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1467 microversion: 2.1 time: 0.340722 Aug 30 16:13:08.469529 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1053/2320] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:08 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1467 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:08.475572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:08.476449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:08.491266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.492066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.492866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.493909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.494782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.497904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.543743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:08.544911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:08.557078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.557787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.558225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.559103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:08.559551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:08.559976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:08.861718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:08.871610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30c90227-5738-4240-b8b2-40f56bd2a852 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.331586 Aug 30 16:13:08.902741 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1054/2321] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:08 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:09.133451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:09.134406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:09.143102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:09.143513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:09.143948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:09.144650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:09.145317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:09.155824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:09.466730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:09.475411 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a8c313c2-9da9-4d55-a7ef-b388ab36d28c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.348082 Aug 30 16:13:09.486721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1055/2322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:09 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:09.494127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:09.496810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:09.503750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:09.504889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:09.504889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:09.505554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:09.506008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:09.506487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:09.511793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:09.686601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:09.698289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:09.700390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:09.701987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07f01776-9f0f-4b48-ba16-23c38df885f8 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.214055 Aug 30 16:13:09.703398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1056/2323] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:09 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:09.708837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1935062675", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7c93638-aa59-44da-8395-72a7a788b7d2"}, {"port": "73080464-a53a-4f5f-a6b6-6e893e0ca8be", "tag": "port-1"}, {"port": "15b97f03-f08d-4051-bbbf-dbdc86d23c04", "tag": "port-2"}, {"uuid": "cb9d0ad5-b665-4421-82e9-d11483f88457", "tag": "net-1"}, {"uuid": "cb9d0ad5-b665-4421-82e9-d11483f88457"}, {"uuid": "25622a53-e323-490d-9182-98a64ad9d046", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "25622a53-e323-490d-9182-98a64ad9d046", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "05c11dba-cf43-4a48-9887-b482eb82020d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "45f0cec7-836e-4efd-9e92-f0e57d045bc1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2e352250-b26a-463c-8d73-66ad9e8b15fc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--891593208"}], "key_name": "tempest-keypair-1574705844", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:09.888795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] validate_networks() for [('b7c93638-aa59-44da-8395-72a7a788b7d2', None, None, None, None, None), (None, None, '73080464-a53a-4f5f-a6b6-6e893e0ca8be', None, None, None), (None, None, '15b97f03-f08d-4051-bbbf-dbdc86d23c04', None, None, None), ('cb9d0ad5-b665-4421-82e9-d11483f88457', None, None, None, None, None), ('cb9d0ad5-b665-4421-82e9-d11483f88457', None, None, None, None, None), ('25622a53-e323-490d-9182-98a64ad9d046', '10.2.2.100', None, None, None, None), ('25622a53-e323-490d-9182-98a64ad9d046', '10.2.2.200', None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:10.010093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:10.026454 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f3bbc8f-77a2-4db8-98a2-531903874170 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1467 microversion: 2.1 time: 1.554136 Aug 30 16:13:10.038250 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1268/2324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:08 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1467 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:10.045663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:10.047020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:10.056795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:10.057468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:10.058205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:10.059215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:10.059823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:10.060453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:10.691818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:10.702993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b77a0a7-952a-4573-aba6-ab7129040677 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.671728 Aug 30 16:13:10.704592 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1269/2325] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:10 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:10.712548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:10.718753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:10.720977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Searching by: {'reservation_id': 'r-fz05fa4i', 'deleted': False, 'project_id': 'f17545909b3c4b559a571813e373cd09'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:13:10.731779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:10.732288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:10.733070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:10.734107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:10.734601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:10.736314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:10.786635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:10.943205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:13:11.066643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:11.107679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:11.111099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:11.111807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:11.587318 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de9d9442-0a09-4967-b79d-4de9409544d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?reservation_id=r-fz05fa4i" status: 200 len: 2927 microversion: 2.1 time: 0.880263 Aug 30 16:13:11.588471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1270/2326] 10.222.0.47 () {58 vars in 1197 bytes} [Tue Aug 30 16:13:10 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fz05fa4i => generated 2927 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:11.595531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:11.597139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:11.606587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:11.609975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:11.611586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:11.613280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:11.614040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:11.614668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:12.443626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:12.465707 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bb568bd-4aaa-412c-b84c-b16a40ec1684 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.875124 Aug 30 16:13:12.467243 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1271/2327] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:11 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:12.473612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:12.474513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:12.481980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:12.482821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:12.483716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:12.484641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:12.486088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:12.486859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:12.976439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:12.991062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:12.992509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:12.993718 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6df3eace-2149-4bf8-8960-aa65b7c788e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1811 microversion: 2.25 time: 0.525094 Aug 30 16:13:13.000063 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1272/2328] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:12 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1811 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:13.018387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:13.044314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_groups [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Querying cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) for 2 instances {{(pid=122352) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 16:13:13.045041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.045526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.045965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.093492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9010bbd9-c192-4ec2-bfa1-e41c43ebc582 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/77a6ff0e-eaab-49f4-b166-bd7f68d69e5e" status: 200 len: 266 microversion: 2.1 time: 0.091666 Aug 30 16:13:13.100166 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1273/2329] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:13:13 2022] GET /compute/v2.1/os-server-groups/77a6ff0e-eaab-49f4-b166-bd7f68d69e5e => generated 266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:13.105300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5054d9b1-d25a-4d70-89eb-d06b35ecae6d", "tag": "b342da81-0723-4233-a0cb-311af9256f18"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:13.129955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.130756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.131357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.143029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] Creating event network-changed:b342da81-0723-4233-a0cb-311af9256f18 for instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d on n-h1-830883-28 Aug 30 16:13:13.148558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c4650b74-0208-4ced-8fc5-896ead377f23 req-5cd259a9-fc33-4a0a-b0f4-041d4bcca719 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047144 Aug 30 16:13:13.149687 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1274/2330] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:13.154992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:13.155877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:13.163503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.164247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.164827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.165682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.166286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.166883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.483964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:13.491020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:13.503973 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75544ab5-a566-423f-9afb-a2783398d083 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.352858 Aug 30 16:13:13.506566 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1275/2331] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:13 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:13.525186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:13.526063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:13.534242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.535126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.535911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.536802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.537422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.538007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.861356 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4660756d-44cf-4db3-8bb7-e0681ca4c05d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 200 len: 1620 microversion: 2.1 time: 0.353476 Aug 30 16:13:13.864673 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1276/2332] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:13 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 1620 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:13.876357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:13.876983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:13.892228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.892735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.893193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:13.907896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:13.909632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:13.913199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:14.259911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:14.275377 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a845964-95a7-4509-88db-6fda0323603c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.409584 Aug 30 16:13:14.276561 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1277/2333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:13 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:14.281293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:14.284170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:14.298872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:14.299563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:14.307308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:14.308343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:14.308973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:14.309743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:14.678560 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87dc0670-4c09-491f-918b-94f7cf13917f tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1620 microversion: 2.1 time: 0.400612 Aug 30 16:13:14.688971 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1278/2334] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:14 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1620 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:14.695198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:14.700472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:14.717982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:14.718785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:14.719394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:14.720335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:14.732669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:14.742259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.252495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:15.282428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:15.284906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:15.289329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e83b6ac-48a6-429e-8ee3-651999b25b28 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1801 microversion: 2.25 time: 0.598921 Aug 30 16:13:15.293681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1279/2335] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:14 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1801 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:15.305528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:15.307465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:15.330040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.331416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.333719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.340694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.341416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.342943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.485891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:15.487323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:15.490664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:15.491133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:15.492429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:15.530173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.531424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.532419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.533831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.534818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.536965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.574059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Getting quotas for project f8fe3a2308cf43d88d7c8f3e954257f7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:15.583871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Getting quotas for user 389b6f29e0274334aa4661e16414797d and project f8fe3a2308cf43d88d7c8f3e954257f7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:15.653752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:15.675220 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f881fb7f-2b95-43c5-a6b7-47fb7cdbc71b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.380131 Aug 30 16:13:15.680062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1280/2336] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:15 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:15.686346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: .version_select at 0x7fd35c4f9310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1280125413", "policies": ["anti-affinity"]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:15.738227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:15.745404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:15.836567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:15.843656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:15.896104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70fee7be-dcfb-48e9-9ae5-4ab4d5de7933 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.213272 Aug 30 16:13:15.897612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1281/2337] 10.222.0.47 () {60 vars in 1174 bytes} [Tue Aug 30 16:13:15 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:15.906829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:15.907781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:15.938909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:15.942801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='05c11dba-cf43-4a48-9887-b482eb82020d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='45f0cec7-836e-4efd-9e92-f0e57d045bc1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e352250-b26a-463c-8d73-66ad9e8b15fc',volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:15.959838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.971316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.972012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:15.974085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:15.974868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:15.975560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:16.294099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:16.308657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a3db56e-a8f1-4aa1-b3c6-6175e8eb3b05 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.405482 Aug 30 16:13:16.326973 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1282/2338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:15 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:16.334827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d11ab30-b81b-47ab-9cab-cc7e223d4ed2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '.version_select at 0x7fd35c5231f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:16.340132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d11ab30-b81b-47ab-9cab-cc7e223d4ed2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:16.341050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d11ab30-b81b-47ab-9cab-cc7e223d4ed2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:16.342730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d11ab30-b81b-47ab-9cab-cc7e223d4ed2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:16.355428 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d11ab30-b81b-47ab-9cab-cc7e223d4ed2 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1289 microversion: 2.25 time: 0.026481 Aug 30 16:13:16.366389 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1283/2339] 10.222.0.47 () {60 vars in 1184 bytes} [Tue Aug 30 16:13:16 2022] GET /compute/v2.1/os-migrations => generated 1289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:16.372715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1384232238", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "67be9e3b-0a2d-4295-ab5b-28f98aba2fe1"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:16.460311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:16.729548 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90a9acb7-8bbe-4651-b06d-f97c985831cb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.024766 Aug 30 16:13:16.730213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1057/2340] 10.222.0.47 () {62 vars in 1189 bytes} [Tue Aug 30 16:13:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 7026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:13:16.753507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:16.754135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:16.777148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:16.777784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:16.779415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:16.780690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:16.781570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:16.782159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:17.162972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:17.196834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:17.197783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:17.198455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:17.198999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:17.199557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:17.238029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-537e8885-00cd-4904-9c94-18f67b1e13c4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 2421 microversion: 2.25 time: 0.491205 Aug 30 16:13:17.242814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1058/2341] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:16 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 2421 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:17.250869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:17.253996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:17.260264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:17.260764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:17.265299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:17.266232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:17.274234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:17.278416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:17.279289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:17.285907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:17.286826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:17.289811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:17.297309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:17.298048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:17.334673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:17.354795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:17.388907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 2 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:17.392162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:17.502583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:17.505502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:17.513752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:17.603113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:17.616094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:17.661491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=8ef789cb-7ef1-4cdc-8653-f17f5b9849b4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:17.777351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:17.796020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:17.810722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:17.837671 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b708023e-4fc5-4240-9bec-bc1088630393 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.593318 Aug 30 16:13:17.842910 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1059/2342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:17 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:17.861853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:17.862694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:17.970571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:17.997640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'server_group_members'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:18.032146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.044750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.047207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.052239 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d412bbcc-bd07-4e0f-9343-093885f0f12c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1286 microversion: 2.32 time: 0.204331 Aug 30 16:13:18.053505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1060/2343] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:17 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:18.064103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.068332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:18.081698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.082991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.084228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.086432 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87f9cbbc-0396-4c4b-96a5-916467510d47 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.716411 Aug 30 16:13:18.087262 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1284/2344] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1720 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:13:18.088445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.089560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.092094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.097369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.101083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:18.118262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.119791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.120152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.120881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.121433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.121865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.540559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:18.559303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53eb6495-c47b-46be-97a0-a1403a626ab7 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 2421 microversion: 2.25 time: 0.503506 Aug 30 16:13:18.560449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1061/2345] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:18 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 2421 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:18.565882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.572938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.574202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Searching by: {'deleted': False, 'project_id': 'f17545909b3c4b559a571813e373cd09'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:13:18.600607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.604656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.605103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.607490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.608782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.609710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.654602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:13:18.722577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.729614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-011efa89-8414-4c0c-821d-4fcfc695ae32 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.167580 Aug 30 16:13:18.743577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8b1509a-f6d7-4aea-aa0e-1eaf351c9eb1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.640787 Aug 30 16:13:18.743577 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1285/2347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:18 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:18.746831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46dd7dd6-3b5a-4da3-9a06-3b2975f966b2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.748028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1062/2347] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:13:18 2022] GET /compute/v2.1/servers => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:18.748676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-46dd7dd6-3b5a-4da3-9a06-3b2975f966b2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:18.773125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.777631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:18.818767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.819524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.837374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.838238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.840442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.844038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.845127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-46dd7dd6-3b5a-4da3-9a06-3b2975f966b2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:18.853044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-46dd7dd6-3b5a-4da3-9a06-3b2975f966b2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1219 microversion: 2.1 time: 0.109921 Aug 30 16:13:18.857484 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1286/2348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:18 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:18.883112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:18.885199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:18.906553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.908869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.912392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:18.915540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:18.916540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:18.918532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.258447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lazy-loading 'services' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:19.529375 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e978138-0633-4b13-84c5-942884752f5b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments/abe31d76-41cd-4398-9273-ee3d9378529f" status: 202 len: 0 microversion: 2.25 time: 0.766602 Aug 30 16:13:19.531108 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1063/2349] 10.222.0.47 () {60 vars in 1457 bytes} [Tue Aug 30 16:13:18 2022] DELETE /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments/abe31d76-41cd-4398-9273-ee3d9378529f => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:13:19.537242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:19.538252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:19.546145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.547928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.548563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.549847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.550561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.551113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.671825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:19.692689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:19.694442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:19.695641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b439267f-9678-4b38-9769-2ebb07e7ca32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1576 microversion: 2.32 time: 0.163311 Aug 30 16:13:19.722434 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1064/2350] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:19 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:19.742513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:19.745444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:19.772406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.773072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.773633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.775603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.777400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.777858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.841483 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd83c4a3-8c89-4439-a70a-e9afb7acf165 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110535 Aug 30 16:13:19.842159 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1065/2351] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:19 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:19.847192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:19.849108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:19.857564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.858751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.858884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:19.859524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:19.860124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:19.860705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.222288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:20.235018 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3907fb4-a2bf-4bfc-82cd-83610f38e998 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.387645 Aug 30 16:13:20.236299 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1066/2352] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:19 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:20.255792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:20.258194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:20.274008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:20.281462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.282480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.306937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.317028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.320245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.323365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.465392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:20.467354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:20.478744 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6657c8fb-72ed-4577-8fa2-c1a809b6e792 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1223 microversion: 2.1 time: 0.240430 Aug 30 16:13:20.481851 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1067/2353] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:20 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1223 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:20.494105 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62773bb5-9547-4bb2-a18c-0384e178d9d7 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 1.626296 Aug 30 16:13:20.519827 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1287/2354] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:18 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:20.732208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:20.733262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:20.745706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.747732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.749563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.751908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.753991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.755470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.858984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:20.862442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:20.906161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.908162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.908641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.909403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:20.909867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:20.910710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:20.999523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:21.015876 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48e18311-87a3-411c-b5ce-61062fadd800 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.165288 Aug 30 16:13:21.022799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1288/2355] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:20 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:21.037674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:21.046197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:21.052913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37b40e8f-0c06-4477-8613-81a2a2b6c3c0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1594 microversion: 2.32 time: 0.324963 Aug 30 16:13:21.070675 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1068/2356] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:20 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1594 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:21.258829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:21.259460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:21.279126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.280051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.280674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.293014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.293752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.295293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.450685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1131151694", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c2b9d578-9e47-4701-9ad3-f11cc5232430"}, {"uuid": "faf9e82d-ca7d-4629-9cea-f490f79835ff"}, {"uuid": "c2b9d578-9e47-4701-9ad3-f11cc5232430"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:21.590205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] validate_networks() for [('c2b9d578-9e47-4701-9ad3-f11cc5232430', None, None, None, None, None), ('faf9e82d-ca7d-4629-9cea-f490f79835ff', None, None, None, None, None), ('c2b9d578-9e47-4701-9ad3-f11cc5232430', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:21.648186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:21.656911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b5ee3a6-59f2-4a4e-a3c0-54849066cf86 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.403218 Aug 30 16:13:21.664154 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1289/2357] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:21 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:21.669126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:21.677104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:21.688921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.689656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.690258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.691174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.691787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.694374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.882264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:21.897161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b10e9f1f-8440-42f2-9190-185ce9a45e2e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1271 microversion: 2.1 time: 0.231641 Aug 30 16:13:21.915825 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1290/2358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:21 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:21.922191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:21.923046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:21.945186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.947753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.954061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.959436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.960204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.960807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:22.994585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:23.005188 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79959d8d-e7dd-46d1-845b-1963d5a6ce37 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 1.087421 Aug 30 16:13:23.011114 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1291/2359] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:21 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:23.019209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:23.032332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:23.041733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.047826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.048586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.049552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.050537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.051209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.155958 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43097ac9-a8eb-4fd7-bb31-704c07436ceb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143553 Aug 30 16:13:23.156956 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1292/2360] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:23 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:23.166102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:23.170116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:23.187672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.190493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.193738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.197324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.198037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.206773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.432686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:23.445091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:23.461789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:23.476320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7eacd282-2729-4712-8eec-911658298802 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1594 microversion: 2.32 time: 0.318083 Aug 30 16:13:23.477116 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1293/2361] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:23 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1594 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:23.481850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:23.482679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:23.495737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.500266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.500920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.501847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.502523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.503162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.826810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:23.837328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b527f956-16a7-4cb2-bb8f-44a4b58dae98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.358649 Aug 30 16:13:23.843471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1294/2362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:23 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:23.858435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:23.866218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:23.880417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.882451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.885047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:23.885897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:23.887742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:23.890224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.059735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:24.065445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:24.077398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da5279f8-4857-4e1e-a26a-d485be7e4051 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1277 microversion: 2.1 time: 0.232672 Aug 30 16:13:24.081324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1295/2363] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:23 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:24.094007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5054d9b1-d25a-4d70-89eb-d06b35ecae6d", "name": "network-vif-plugged", "status": "completed", "tag": "b342da81-0723-4233-a0cb-311af9256f18"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:24.114893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.119690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.120424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.146346 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] Creating event network-vif-plugged:b342da81-0723-4233-a0cb-311af9256f18 for instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d on n-h1-830883-28 Aug 30 16:13:24.152871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-cf54a0a2-f160-4203-899d-5621bd9cb736 req-a2d89645-1267-45b0-9bf4-ebb86c21992f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069890 Aug 30 16:13:24.154938 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1296/2364] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:24.171367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:24.174063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:24.194115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.196434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.197038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.207985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.209869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.210864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.830724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:24.888557 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f34b4ce-9658-4203-8f19-b20bceb9813e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1319 microversion: 2.1 time: 0.727466 Aug 30 16:13:24.892897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1297/2365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:24 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1319 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:24.918968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:24.925163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:24.953462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.957847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.958606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.961861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.963713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.964375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.027529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:25.028820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:25.029524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:25.030096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:25.030804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:25.050433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.053308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.053775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.054948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.055429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.055866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.076099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-31bcc1da-249a-4198-ae0e-e1fda9ec1d6e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.181922 Aug 30 16:13:25.077314 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1298/2366] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:24 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:25.103119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:25.103975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:25.110394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Getting quotas for project bd97ef9096e541b48a9f24ddfe666b1a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:25.112048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.112812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.113464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.115120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.115766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.116508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.133100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Getting quotas for user 08b0dab09f5e47ccbe1e9385edbe6cc9 and project bd97ef9096e541b48a9f24ddfe666b1a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:25.171755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:25.194148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:25.322868 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92272541-b3eb-47b5-b27a-4ae8173eb2c5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.876383 Aug 30 16:13:25.323545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1069/2367] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:13:25.334677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:25.336203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:25.364768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.365278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.366289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.367045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.367515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.367958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.011564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.047028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.048678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.051368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7b61d31-5439-4781-9fe2-96c08491a898 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1661 microversion: 2.32 time: 0.972818 Aug 30 16:13:26.070912 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1299/2368] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:25 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1661 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:26.082706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:26.084736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:26.091492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.092487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.093665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.095117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.095798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.096513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.424319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.433754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bce2d291-db14-4208-994b-991ff1869b54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.361599 Aug 30 16:13:26.434398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1300/2369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:26 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:26.447041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d70499d-ccf2-4dd3-9259-65564fca417b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:26.447743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d70499d-ccf2-4dd3-9259-65564fca417b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:26.654698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6d70499d-ccf2-4dd3-9259-65564fca417b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.664816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d70499d-ccf2-4dd3-9259-65564fca417b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1213 microversion: 2.1 time: 0.229318 Aug 30 16:13:26.665424 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1301/2370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:26 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:26.680574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:26.695515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:26.717337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.719347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.726230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.727256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.732433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.733072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.005594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:27.014945 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b628271-3893-4ae3-97f4-3d7f5b8f89bd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1501 microversion: 2.1 time: 1.685102 Aug 30 16:13:27.028867 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1070/2371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:25 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1501 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:27.034238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:27.048673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:27.064741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.068656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.069312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.070251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.074490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.075172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.171768 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bcdb7427-6c24-4985-ba51-16c7349e9516 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141485 Aug 30 16:13:27.173041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1071/2372] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:27 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:27.181374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0ade69a-8d97-460e-a212-83d166493e25"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:27.230254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:27.250904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.251423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.251875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.252625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.253074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.253510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.315401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:27.339477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:27.350860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9e5b126-9813-4b9a-ae03-0d2d20d192f6 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1469 microversion: 2.1 time: 0.674840 Aug 30 16:13:27.356113 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1302/2373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:26 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1469 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:27.359715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Cannot 'attach_volume' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state rescued Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/os-volume_attachments HTTP/1.1 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 74 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: {"volumeAttachment": {"volumeId": "f0ade69a-8d97-460e-a212-83d166493e25"}} Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'attach_volume' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state rescued Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': 'e88926ad-060b-4fa0-a0db-50ebc5b8f70d', 'body': {'volumeAttachment': {'volumeId': 'f0ade69a-8d97-460e-a212-83d166493e25'}}} Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 16:13:27.372157 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state rescued Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state rescued Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:27.375705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 409 to user: Cannot 'attach_volume' instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d while it is in vm_state rescued {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:13:27.383308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:27.383958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:27.387329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd528196-53a1-4543-9f32-dfd0588b9f8c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.199178 Aug 30 16:13:27.387991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1072/2374] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:13:27 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/os-volume_attachments => generated 152 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:13:27.404359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.413014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.422535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.424650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.427504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.429338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.010295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2010183651", "block_migration": true, "disk_over_commit": false}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:28.013218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.059747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.060232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.060700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.061451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.061915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.082666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.138912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lazy-loading 'flavor' on Instance uuid 5054d9b1-d25a-4d70-89eb-d06b35ecae6d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:28.144203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:28.157710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Going to try to live migrate instance to tempest-host-2010183651 {{(pid=122351) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:13:28.170379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] HTTP exception thrown: Compute host tempest-host-2010183651 could not be found. Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Request method failure captured: Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d/action HTTP/1.1 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 107 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjcFJJE7demfRT8QfZsz8anQyGcVMJ3_tMjldKG0qoFySlZChQcbDO2C2XbeR1IXpbCs-WMT1q48UZGuQ-yu1T9hYj_GL7yvfXuyfBbPp743oIfjwMr0WIFL_-GVfMUSbEf3PisMv5fhcanUBXyHzXPv7tPhPioMv6_tkhrpEWJEYbw Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 959db011b6124516b0227002341ffa14 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/959db011b6124516b0227002341ffa14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_959db011b6124516b0227002341ffa14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/959db011b6124516b0227002341ffa14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/959db011b6124516b0227002341ffa14"}]}] Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 959db011b6124516b0227002341ffa14 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-LiveMigrationNegativeTest-889317682-project-admin Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 746882f8266a4e8c868cd083554ffaf6 Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-LiveMigrationNegativeTest-889317682-project-admin Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: {"os-migrateLive": {"host": "tempest-host-2010183651", "block_migration": true, "disk_over_commit": false}} Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: exception: Compute host tempest-host-2010183651 could not be found. Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5054d9b1-d25a-4d70-89eb-d06b35ecae6d', 'body': {'os-migrateLive': {'host': 'tempest-host-2010183651', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5498, in live_migrate Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 30 16:13:28.220509 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2010183651 could not be found. Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2010183651 could not be found. Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2010183651 could not be found. Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Returning 400 to user: Compute host tempest-host-2010183651 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f79cf86b-4638-47ad-871a-49b05b0bd7c6 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d/action" status: 400 len: 100 microversion: 2.1 time: 0.826452 Aug 30 16:13:28.225352 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1073/2375] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Aug 30 16:13:27 2022] POST /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d/action => generated 100 bytes in 834 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:13:28.240495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:28.245627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.247800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:28.258057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:28.264489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.265452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.267504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.270439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.273617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.274826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.276209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:28.277497 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2d248a7-271b-4671-ac7c-96fed1dd111b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1661 microversion: 2.32 time: 0.915044 Aug 30 16:13:28.278293 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1303/2376] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:27 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1661 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:28.294325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:28.294968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.318870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.321489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.322838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.327262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.328039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.328680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.452849 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f0654be-cde7-4e8b-807f-2e8607648e61 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action" status: 202 len: 0 microversion: 2.1 time: 0.228231 Aug 30 16:13:28.453500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1074/2377] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:13:28 2022] POST /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:13:28.462124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:28.462874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.486409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.486852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.487399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.488122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.488583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.489652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.760044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:28.775518 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5351105f-1abb-4fbe-ba2a-a536f1c7cda8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1271 microversion: 2.1 time: 0.317671 Aug 30 16:13:28.789895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1075/2378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:28 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1271 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:28.795432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:28.804921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.821906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.822409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.822856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.823629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.824020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.824448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.893515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4266f7f-4139-4d30-b283-74aa66e460d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102275 Aug 30 16:13:28.896787 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1076/2379] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:28 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:13:28.905323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:28.906224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:28.915313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.915985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.917313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.919246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:28.927213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:28.927932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.766000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:29.781622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8dbf24ea-2c0b-425b-9e67-d98442dcd0f8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 1.496714 Aug 30 16:13:29.785436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1304/2380] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:28 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:29.807634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:29.811859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:29.815576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:29.822430 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c422ef0f-0268-44af-adde-fab1ec769920 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1469 microversion: 2.1 time: 0.924366 Aug 30 16:13:29.827336 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1077/2381] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:28 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1469 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:29.832120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.835989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:29.837996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:29.838744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.842595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.844944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.847852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.855453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.858281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.859746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.860406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.861336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.862014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.863183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.659661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:30.673393 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3cc36901-800e-46d7-9b25-d14ccd737537 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1509 microversion: 2.1 time: 0.876669 Aug 30 16:13:30.674224 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1305/2382] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:29 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1509 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:30.680764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:30.681913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:30.699415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.700150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.700812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.701774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.703316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.703996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.874468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:30.880427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:30.882958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:30.886660 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ec0d14c-26c0-4e95-bbf2-e88b68999fc0 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1707 microversion: 2.32 time: 1.057813 Aug 30 16:13:30.889552 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1078/2383] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:29 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1707 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:30.912698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:30.928179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:30.942865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.944811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.945509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.951543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.955600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.957058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:31.038664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b62f189d-30cd-4dc2-904d-232c4628a7a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.145760 Aug 30 16:13:31.049316 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1079/2384] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:13:30 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:31.064450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-385755993", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:31.171405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:31.352642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:31.365365 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25c6078a-d84d-4de7-9562-ee533e659a2c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1313 microversion: 2.1 time: 0.687026 Aug 30 16:13:31.367981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1306/2385] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:30 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1313 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:31.381472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:31.390524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:31.407154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:31.407667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:31.408109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:31.408821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:31.409278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:31.409704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.207372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:32.222923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a68239e-fa17-4eda-9668-006bead6f816 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.853139 Aug 30 16:13:32.227574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1307/2386] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:31 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:32.245968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef789cb-7ef1-4cdc-8653-f17f5b9849b4", "tag": "8669c6d0-5b1f-40c4-8577-feac3689e799"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:32.285074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:32.285568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:32.286687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.328833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] Creating event network-changed:8669c6d0-5b1f-40c4-8577-feac3689e799 for instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 on n-h1-830883-28 Aug 30 16:13:32.345680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d0f2708b-159d-4c96-beff-ab279134b1bf req-40f29eea-78cb-4de0-aa5a-83ec3832f984 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116528 Aug 30 16:13:32.346328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1308/2387] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:32.378161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:32.378958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:32.401119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:32.401690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:32.402086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.402832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:32.403307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:32.403731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.828938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:32.830179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:32.832197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:32.832916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:32.833659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:32.854517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:32.855325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:32.858635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.859720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:32.860426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:32.861062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:32.919876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Getting quotas for project 410abd3e175941ec913e83cf298de76a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:32.930831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Getting quotas for user 51ad541793be46b0890a8d849586363e and project 410abd3e175941ec913e83cf298de76a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:32.968283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:32.970827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:33.090502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:33.108308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7f5803b-cf4d-4110-b2e8-3c57493a01fc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.054849 Aug 30 16:13:33.111725 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1080/2388] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:13:33.137429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:33.138080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:33.138284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ff418db-1365-4eb1-857e-c25f69482f90 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1509 microversion: 2.1 time: 0.782459 Aug 30 16:13:33.144746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1309/2389] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:32 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1509 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:33.167513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:33.168348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:33.170449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:33.177071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:33.177626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:33.178088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:33.178866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:33.179334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:33.179772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:33.198650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:33.199172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:33.199630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:33.201019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:33.201492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:33.201929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:33.820461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:33.837619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:33.840419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:33.841842 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-06f3c973-a2c7-402c-acba-d1af593508ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1753 microversion: 2.32 time: 0.726513 Aug 30 16:13:33.845555 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1081/2390] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:33 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1753 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:33.865527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4baa9929-bdae-4c76-ba24-f3f5f913bbc4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:33.866174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4baa9929-bdae-4c76-ba24-f3f5f913bbc4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:33.973753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:33.990149 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ed0540d-6378-469d-ba11-8be602ea741d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1313 microversion: 2.1 time: 0.840018 Aug 30 16:13:34.006709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1310/2391] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:33 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:34.019919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:34.021649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:34.036444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4baa9929-bdae-4c76-ba24-f3f5f913bbc4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:34.050122 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4baa9929-bdae-4c76-ba24-f3f5f913bbc4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1218 microversion: 2.1 time: 0.198375 Aug 30 16:13:34.050502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:34.052236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:34.053951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:34.054132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1082/2392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:33 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:34.055200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:34.055823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:34.056428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:34.168602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:34.169364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:34.204177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:34.206160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:34.208010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:34.211941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:34.211941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:34.212162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:34.867509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:34.878030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02ec86b7-4618-4fc1-a078-eebef5041d53 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.869675 Aug 30 16:13:34.882732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1311/2393] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:34 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:34.892469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb", "tag": "62164293-779d-4a42-9a09-5062f22e0e6d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:34.917688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:34.946963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:34.947769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:34.984467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] Creating event network-changed:62164293-779d-4a42-9a09-5062f22e0e6d for instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb on n-h2-830883-28 Aug 30 16:13:34.990496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8eeaff4e-bfe8-4305-a442-78bd19c74018 req-fcb7fca3-6d32-43cf-b062-c38fc893796f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100997 Aug 30 16:13:34.991563 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1312/2394] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:34.996874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:35.003776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:35.016513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.017251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.017881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.023062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.023798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.024391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.297783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.309849 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a43199f-a8a3-42e5-9b28-fcc08e1978ef tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1515 microversion: 2.1 time: 1.145505 Aug 30 16:13:35.311027 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1083/2395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:34 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1515 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:35.336680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:35.338210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:35.356238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.359478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.361980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.363235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.365140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.365832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.649296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.670667 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31b4088e-f426-46d6-baef-a1849f9d1b90 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1334 microversion: 2.1 time: 0.355959 Aug 30 16:13:35.674486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1084/2396] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:35 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1334 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:35.687906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:35.688975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:35.710344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.711903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.712625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.715488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.716423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.717207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.777559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.787547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.794056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.803874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-291e8c6b-326f-4496-a937-3748f16aacbe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1753 microversion: 2.32 time: 0.811025 Aug 30 16:13:35.804666 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1313/2397] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:34 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1753 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:35.892447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:35.906678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:35.907235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:35.916712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.917241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.917688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:35.919320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:35.919673 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e7ab88d-dd3a-40de-ae52-2a4ac3b9b040 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1270 microversion: 2.1 time: 0.238787 Aug 30 16:13:35.920124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:35.921636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1085/2398] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:35 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:35.922143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:36.659519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:36.698432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:36.699061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:36.729343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:36.732088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:36.733205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:36.737897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:36.744804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:36.747200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:37.066493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:37.086717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6c876f3-18eb-4255-8aeb-19494655f520 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 1.183960 Aug 30 16:13:37.088016 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1314/2399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:35 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:37.105534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:37.106523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:37.113946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:37.117332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:37.118388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:37.122012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:37.122868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:37.123514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:37.162704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:38.033665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.053538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d36424d7-d811-427c-82a0-667a6f999815 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1334 microversion: 2.1 time: 1.357630 Aug 30 16:13:38.058125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1086/2400] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:36 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1334 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:38.074771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:38.076446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:38.096053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:38.097868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:38.099952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:38.100880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:38.105374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:38.108209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:38.401268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.404521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.419943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4aa6c7d-40fb-4a24-badc-a5c522d00bf0 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1276 microversion: 2.1 time: 0.358221 Aug 30 16:13:38.433454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.433800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1087/2401] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:38 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1276 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:38.437747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.440054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb19382f-d8c6-42f3-bf6b-9e7f16c3c90e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1799 microversion: 2.32 time: 1.350889 Aug 30 16:13:38.461292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:38.462670 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1315/2402] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:37 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1799 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:38.470973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:38.475892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a81d799-f69e-4837-bcf5-e7034814820b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: .version_select at 0x7fd35cda8040>, body: {"keypair": {"name": "tempest-keypair-2054806290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVQI/byAgKl7+AlG9DlYYG4jXiqrEXmrMECkSZrhuI2Po/BXORxyi4VmqSvAq+KzJv+/JLRN/c9YI1NnEiEuRr2cRkwEDGkCgHYuerYus+EVE00GE8jJBqFQnyHFLqXWQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:38.493529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:38.512455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:38.515096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:38.517721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:38.519949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:38.521707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:38.555153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7a81d799-f69e-4837-bcf5-e7034814820b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for project f9c014aef8c14c49a199e79223de58d5. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:38.579784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7a81d799-f69e-4837-bcf5-e7034814820b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for user b330d5f913ce45d59c3c5aed0972c7e6 and project f9c014aef8c14c49a199e79223de58d5. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:38.642670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a81d799-f69e-4837-bcf5-e7034814820b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178614 Aug 30 16:13:38.643985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1316/2403] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:13:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:38.908909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:38.930895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-797a2c9e-e0b4-40a8-a3ce-af1d6e31d891 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.493662 Aug 30 16:13:38.934692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1088/2404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:38 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:39.079334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:39.080260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:39.108137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.108653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.109957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.111737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.112208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.112645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.455289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:39.457485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:39.485352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.487752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.492098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.495722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.498436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.499598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.761862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:39.772870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9cb56a7-706c-446c-8adf-2ee35cbaf27f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1276 microversion: 2.1 time: 0.327097 Aug 30 16:13:39.785612 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1089/2405] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:39 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1276 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:39.785612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:39.790813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:39.805066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.805568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.806012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.810129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:39.810695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:39.811140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:39.976616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:39.986145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9dbfffeb-a252-42bf-89b5-cd1c9e4bcf62 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1334 microversion: 2.1 time: 0.910541 Aug 30 16:13:39.989867 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1317/2406] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:39 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1334 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:40.002540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:40.003495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:40.024959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:40.033991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:40.034976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:40.037804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:40.039384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:40.041333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:40.570628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:40.574149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:40.583429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:40.585074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:40.586277 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0596a3f0-1955-4401-b82a-023f0b82c0eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1799 microversion: 2.32 time: 0.811866 Aug 30 16:13:40.608121 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1090/2407] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:39 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1799 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:40.793355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:40.794228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:40.812544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:40.813212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:40.813755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:40.814622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:40.815573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:40.815998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:41.333158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:41.366071 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3763b262-89d4-4e5e-96b2-b2d76ae7caa0 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 1.372724 Aug 30 16:13:41.379312 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1318/2408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:39 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:41.382386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:41.395092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:41.405734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:41.410757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:41.417021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:41.418704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:41.423467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:41.423996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:41.725767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:41.744779 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-62596ec3-96c3-410d-a29f-2f7904a4139f tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.953774 Aug 30 16:13:41.746628 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1091/2409] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:40 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:41.757358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:41.761540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:41.782018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:41.784254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:41.785026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:41.788250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:41.790113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:41.791034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:42.607273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:42.630563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7fcf239e-1e5e-4216-8d4d-606129636dd9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 1.258047 Aug 30 16:13:42.633709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1319/2410] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:41 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:42.664960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:42.666045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:42.676933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:42.678290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:42.678960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:42.680136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:42.680807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:42.681383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:42.819997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:42.837424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:42.842211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:42.847020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca26615e-1ab1-4fd4-bf7c-3f6b4eecdab1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1845 microversion: 2.32 time: 1.098717 Aug 30 16:13:42.849604 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1092/2411] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:41 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1845 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:42.861777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:42.862725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:42.886752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:42.888457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:42.889123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:42.890806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:42.891490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:42.892158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:42.921543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:43.315199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:43.335431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69d9ab32-2f55-4032-8443-b6821a64a3b3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.484445 Aug 30 16:13:43.336262 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1093/2412] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:42 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:43.459764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:43.473935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b8414af-d8d8-49b5-9873-b945d8ccdd26 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.837480 Aug 30 16:13:43.477532 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1320/2413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:42 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:43.515838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef789cb-7ef1-4cdc-8653-f17f5b9849b4", "name": "network-vif-plugged", "status": "completed", "tag": "8669c6d0-5b1f-40c4-8577-feac3689e799"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:43.537486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:43.543023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:43.546437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:43.583960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] Creating event network-vif-plugged:8669c6d0-5b1f-40c4-8577-feac3689e799 for instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 on n-h1-830883-28 Aug 30 16:13:43.596120 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7952ff46-bfdd-4823-873d-dd309eda9abc req-aa43d15d-5acc-4f6b-a9f3-94e45dfc6a8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084328 Aug 30 16:13:43.608117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1094/2414] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:43.658724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:43.665064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:43.701195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:43.703021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:43.704824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:43.706733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:43.710674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:43.711420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:43.880997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:43.882287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:43.900554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:43.904844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:43.905626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:43.907929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:43.908581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:43.912698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:44.041972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=22 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:44.426147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:44.445753 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09e893e2-b095-4633-9d0d-81815dd2cdb0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.791316 Aug 30 16:13:44.446438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1321/2415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:43 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:44.451388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a07301a-0c1f-4383-bf3e-26f178c3ff4a", "tag": "aad8b143-9a40-4ba9-aa49-00d80e2bec02"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:44.466804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:44.467365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:44.467714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:44.498003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] Creating event network-changed:aad8b143-9a40-4ba9-aa49-00d80e2bec02 for instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a on n-h1-830883-28 Aug 30 16:13:44.504112 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d3e01148-3ae3-4cbb-82f3-b83f153481bf req-b61a67ff-6caa-4fa0-9dc3-b497359f7189 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056051 Aug 30 16:13:44.506187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1322/2416] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:44.513335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:44.514438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:44.523082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:44.524027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:44.524672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:44.525593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:44.526254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:44.526991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.250153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:45.264741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:45.271311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:45.279875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5e73474-27a6-47cb-8e62-dc321055582f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1845 microversion: 2.32 time: 1.403884 Aug 30 16:13:45.281097 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1095/2417] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:43 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1845 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:13:45.292870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:45.295187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:45.296025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:45.314369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:45.315432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:45.315568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c51f9c15-64e9-4466-9142-226caa3ffd55 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.807854 Aug 30 16:13:45.316456 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1323/2418] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:44 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:45.317133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.319409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:45.323110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:45.323840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.467917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:45.468543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:45.483163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:45.483635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:45.484099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.484870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:45.487286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:45.487781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.824576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:45.837338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef8c7d27-9aa4-41cb-bb6d-1dc66df84e27 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.554960 Aug 30 16:13:45.850329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1096/2419] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:45 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:45.850329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb", "name": "network-vif-plugged", "status": "completed", "tag": "62164293-779d-4a42-9a09-5062f22e0e6d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:45.879149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:45.881437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:45.882265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:45.920541 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] Creating event network-vif-plugged:62164293-779d-4a42-9a09-5062f22e0e6d for instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb on n-h2-830883-28 Aug 30 16:13:45.932160 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c9df01c4-3354-4c7f-97d3-8cd6bf915a2a req-102e0fe7-7aa3-44ff-a793-5a31f5da7461 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089300 Aug 30 16:13:45.934161 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1097/2420] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:46.309742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:46.313518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:46.331983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:46.336439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:46.338177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:46.339744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:46.341876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:46.343025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:46.404214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:46.419520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-97d29f4d-7513-448a-85f2-f4cfdb3ca32b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.952606 Aug 30 16:13:46.420609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1324/2421] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:45 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:46.430948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:46.433110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:46.441128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:46.441776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:46.443174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:46.444357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:46.445096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:46.445663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.089945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:47.109007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:47.112216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:47.118074 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64d3156e-b6ce-4c01-9a1d-54ad59e06f4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1845 microversion: 2.32 time: 0.813179 Aug 30 16:13:47.135242 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1098/2422] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:46 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1845 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:47.156144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:47.157044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:47.181612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.183796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.184436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.187130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.189991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.190652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.229203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:47.246682 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60a62c1b-4ed6-4d8f-aa5b-264c7d8f84ca tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.823078 Aug 30 16:13:47.247448 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1325/2423] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:46 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:47.254144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "tag": "ddc192e2-47fe-48f1-8631-dab5b8ad658d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:47.282157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.288408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.289046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.310937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] Creating event network-changed:ddc192e2-47fe-48f1-8631-dab5b8ad658d for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:13:47.322148 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-08e7f323-1118-40eb-bb0c-3a9123b5f64c req-94d3d0fc-3d2a-4409-b6c1-c615942cf69a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073462 Aug 30 16:13:47.324051 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1326/2424] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:47.336665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "9b75d5dd-b5a1-44aa-b140-428ef42dc6e7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:47.357691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.359805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.360472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.401087 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] Creating event network-changed:9b75d5dd-b5a1-44aa-b140-428ef42dc6e7 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:13:47.407697 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-97196bbd-07d5-47d7-8588-33507a78cd8c req-c1398b78-35c0-4c40-be9d-479a7931814c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079422 Aug 30 16:13:47.409409 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1327/2425] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:47.633167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:47.654011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c248426-7cc0-4b55-be4b-18ac6b9f32d4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1319 microversion: 2.1 time: 0.517328 Aug 30 16:13:47.654645 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1099/2426] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:47 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:47.667905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:47.679185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:47.694701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.695280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.695752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:47.696563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:47.697195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:47.697960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:48.009238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-635716988", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "3bd50dcb-a5fd-4d4d-9ae9-423e909e42a3"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:48.057933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:48.100019 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ba70062-e3ec-4df5-80f8-1a73f560105b tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.444258 Aug 30 16:13:48.100877 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1100/2427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:47 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:48.113660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] validate_networks() for [('3bd50dcb-a5fd-4d4d-9ae9-423e909e42a3', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:48.169369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:48.174718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:48.212607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:48.219667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:48.220565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:48.221931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:48.224367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:48.225926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:48.609621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:48.961264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:48.978731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:48.982790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:48.982790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8181a2e8-f4ee-4219-b9d5-eb12fa35ad84 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1845 microversion: 2.32 time: 0.833680 Aug 30 16:13:49.004693 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1101/2428] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:48 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1845 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:49.021647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:49.025408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:49.038551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:49.042047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:49.044543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:49.045663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:49.050109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:49.050109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:49.050109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:49.917467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:49.932612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-371ce3d7-f3d6-44d3-97c7-3a52d75f345c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.925463 Aug 30 16:13:49.935417 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1102/2429] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:49 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:49.951377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-475251620", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab677581-85e1-4962-8a2a-a6c572852f36"}], "security_groups": [{"name": "tempest-securitygroup--962107794"}], "key_name": "tempest-keypair-2054806290", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:50.336679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] validate_networks() for [('ab677581-85e1-4962-8a2a-a6c572852f36', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:50.791243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:50.791873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:50.792145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:50.792566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:50.792988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:50.803875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:50.804775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:50.805392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:50.806327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:50.807299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:50.807905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:50.834783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Getting quotas for project f464e91bd08345b4b5dc759b294016c4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:50.846645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Getting quotas for user f43b46ba684e4b9b870e0ad76072d72e and project f464e91bd08345b4b5dc759b294016c4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:50.870268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:50.873157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:50.945838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ac0db43-ee44-4528-9039-55ed44d0e7eb tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.535010 Aug 30 16:13:50.947359 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1328/2430] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:13:50.954189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:50.955227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:50.963662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:50.964430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:50.968343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:50.969325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:50.969956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:50.970577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:51.311401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:51.328065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-28300108-a239-4572-8520-3b62234cd30a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1468 microversion: 2.1 time: 0.378652 Aug 30 16:13:51.347113 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1329/2431] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:50 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:51.355186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:51.356399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:51.366928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:51.367717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:51.368404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:51.369949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:51.370669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:51.371325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:51.727770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:51.737935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de4858f8-be9d-4bc0-bbee-85c248665558 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.387835 Aug 30 16:13:51.742736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1330/2432] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:51 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:51.759781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "tag": "65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:51.793909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:51.797174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:51.800720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:51.842204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] Creating event network-changed:65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:13:51.856956 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-98cbfac1-178e-4380-b0da-3a2faaa1c5e0 req-911aa800-e6b2-4164-9396-868b792c9709 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108767 Aug 30 16:13:51.862165 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1331/2433] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:51.892190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:51.900810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:51.930844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:51.931361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:51.932975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:51.936515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:51.937488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:51.938090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:52.515585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:52.534896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:52.542340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:52.550199 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d9232ab-7b5d-4b38-b819-ebc04d0d7dc4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1866 microversion: 2.32 time: 0.686331 Aug 30 16:13:52.554189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1332/2434] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:51 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1866 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:52.561144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:52.565954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:52.585965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:52.587186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:52.588308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:52.589407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:52.590080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:52.590993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:52.991504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:53.006823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5b07094-2cf5-486e-bd20-e9da444153e4 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.446614 Aug 30 16:13:53.008069 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1333/2435] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:52 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:53.020260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:53.022272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:53.037045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.037880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.041567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.042644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.043483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.044130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.204300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:53.214401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d07dbc2e-66b0-45e6-b4a5-d838e99c9fce tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1283 microversion: 2.1 time: 0.205230 Aug 30 16:13:53.231842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1334/2436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:53 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1283 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:53.242750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:53.243400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:53.258985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.259830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.260816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.262547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.263225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.264086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.305977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:53.307453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:53.308087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:53.308644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:53.309206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:53.324502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.325344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.325977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.326932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.327611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.328255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.350169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:53.358226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Getting quotas for user b330d5f913ce45d59c3c5aed0972c7e6 and project f9c014aef8c14c49a199e79223de58d5. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:53.377014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:53.379615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:53.452606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab204194-12b3-4820-bf63-79fcbd6161f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.516059 Aug 30 16:13:53.454035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1103/2437] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 3518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:13:53.467167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:53.468151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:53.483795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.484503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.485096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.488893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.489545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.490826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.597161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:53.607903 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11a35127-14c4-408e-b146-9262275ef45f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1468 microversion: 2.1 time: 0.374165 Aug 30 16:13:53.608571 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1335/2438] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:53 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:53.622063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e88e09e-ba50-4190-a6f3-20ab34cf639b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:53.624698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e88e09e-ba50-4190-a6f3-20ab34cf639b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:53.735599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e88e09e-ba50-4190-a6f3-20ab34cf639b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:53.751206 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e88e09e-ba50-4190-a6f3-20ab34cf639b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1245 microversion: 2.1 time: 0.135365 Aug 30 16:13:53.752268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1336/2439] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:53 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:53.757161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:53.759989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:53.787850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.802842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.808409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.812105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:53.813329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:53.817480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:53.878473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:54.320220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.342831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.346206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.347779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb3aa778-81f4-473b-ab3f-e085886e4ccf tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1866 microversion: 2.32 time: 0.594419 Aug 30 16:13:54.358486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1337/2440] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:53 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1866 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:54.368775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:54.396207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.398468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Searching by: {'reservation_id': 'r-ukk05jh2', 'deleted': False, 'project_id': 'f17545909b3c4b559a571813e373cd09'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:13:54.420460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:54.422795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:54.424198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:54.427047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.429024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:54.429530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:54.429974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:54.441377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-351d82d5-86cd-47af-9eeb-b076f65f68fc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.986079 Aug 30 16:13:54.445809 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1104/2441] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:53 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:54.459181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:54.460280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:54.476228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:54.477046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:54.477732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:54.478695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:54.479527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:54.480830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:54.606374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:13:54.752761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:54.771876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:54.772377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:54.772827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.078341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aeddbdc2-e715-45b9-a530-24b60b38af8e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?reservation_id=r-ukk05jh2" status: 200 len: 2929 microversion: 2.1 time: 0.718260 Aug 30 16:13:55.079445 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1338/2442] 10.222.0.47 () {58 vars in 1197 bytes} [Tue Aug 30 16:13:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ukk05jh2 => generated 2929 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:55.087538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "tag": "c21c2326-9290-4f8d-9ad4-ef82c8c519f3"}, {"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "73080464-a53a-4f5f-a6b6-6e893e0ca8be"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:55.133862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.138232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.138782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.169726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Creating event network-changed:c21c2326-9290-4f8d-9ad4-ef82c8c519f3 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:13:55.170627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] Creating event network-changed:73080464-a53a-4f5f-a6b6-6e893e0ca8be for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:13:55.184769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-dd25e8e8-1dac-4d3d-ad53-50b2f96157f4 req-a72a09ac-d842-46c8-bee8-268b080b9c08 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.100306 Aug 30 16:13:55.184769 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1339/2443] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:55.188347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:55.198257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:55.199796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.200474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.201348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.202231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.203186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.203873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.405968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:55.415235 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba4f48e2-7038-43b8-9fc0-20f67e658c45 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1289 microversion: 2.1 time: 0.231786 Aug 30 16:13:55.415768 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1340/2444] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:55 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1289 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:55.428832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:55.441134 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2d6e00d-5d38-4111-86e9-c67ec67edd4c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.993799 Aug 30 16:13:55.442853 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1105/2445] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:54 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:55.452441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a07301a-0c1f-4383-bf3e-26f178c3ff4a", "name": "network-vif-plugged", "status": "completed", "tag": "aad8b143-9a40-4ba9-aa49-00d80e2bec02"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:55.453178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:55.454017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:55.476766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.477417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.477874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.478625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.478768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.479100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.479212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.479526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.479672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.541352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] Creating event network-vif-plugged:aad8b143-9a40-4ba9-aa49-00d80e2bec02 for instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a on n-h1-830883-28 Aug 30 16:13:55.554289 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-34c5b1cf-7afe-48b3-b2c2-d2c3b9e40f20 req-045f520a-dd5c-47df-867e-929294025fb8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110116 Aug 30 16:13:55.556728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1106/2446] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:55.570029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:55.609341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.server_groups [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Querying cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) for 2 instances {{(pid=122351) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 16:13:55.610210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.610833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.611362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.644076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:55.658386 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17ab751c-4068-452a-9a3f-35ba46d36021 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/67be9e3b-0a2d-4295-ab5b-28f98aba2fe1" status: 200 len: 271 microversion: 2.1 time: 0.096217 Aug 30 16:13:55.660496 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1107/2447] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:13:55 2022] GET /compute/v2.1/os-server-groups/67be9e3b-0a2d-4295-ab5b-28f98aba2fe1 => generated 271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:55.664389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8a549ca-8b7c-4c40-9a16-c3deb485f1ea tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1297 microversion: 2.1 time: 0.217649 Aug 30 16:13:55.665059 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1341/2448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:55 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1297 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:55.682938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:55.683758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:55.695061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:55.696088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:55.702261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.702926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.703465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.704276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.704847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.705503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.709113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.709812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.710260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:55.711026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:55.711695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:55.712425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.346262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:56.364429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e1699e3-bde6-4959-b6c0-f98b11b8b421 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.697797 Aug 30 16:13:56.368368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1342/2449] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:55 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:56.379041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:56.391573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:56.401330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.402664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.403351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.404755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.405431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.406208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.758059 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ec489511-2575-4f2e-b2e4-7b6b740110b0 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 200 len: 1621 microversion: 2.1 time: 0.385563 Aug 30 16:13:56.761898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1343/2450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:56 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 1621 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:56.781305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:56.785777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:56.805301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.805797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.806247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.806998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.820750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.821389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.947808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:56.957683 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b0231b3d-6372-4dc2-b2f8-51f03b3d4f97 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1289 microversion: 2.1 time: 0.193596 Aug 30 16:13:56.972259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1344/2451] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:56 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1289 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:56.972259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:56.972259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:56.979086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.979604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.980678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:56.981424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:56.981895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:56.982455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.103319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:57.130942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:57.132681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:57.133928 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44e8e30b-0cbf-4d42-aa6a-2fe135420108 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1887 microversion: 2.32 time: 1.472208 Aug 30 16:13:57.145739 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1108/2452] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:55 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1887 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:13:57.169854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:57.170695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:57.187606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.188115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.188564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.189276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.189910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.190563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.270884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:57.286881 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9db81352-197b-41ac-a04e-cc8046335969 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1318 microversion: 2.1 time: 0.325114 Aug 30 16:13:57.288260 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1345/2453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:56 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:57.310329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:57.311239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:57.330255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:57.332984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.336334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.339169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.341735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.344657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.349866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.495231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:57.509646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e839974f-0dbf-499e-9122-2710728129ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1303 microversion: 2.1 time: 0.345202 Aug 30 16:13:57.515479 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1109/2454] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:57 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1303 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:57.536300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "15b97f03-f08d-4051-bbbf-dbdc86d23c04"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:57.564455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.565283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.570569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.602941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] Creating event network-changed:15b97f03-f08d-4051-bbbf-dbdc86d23c04 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:13:57.621188 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0b0d26d8-89e0-43c5-832a-d41d4265cd9a req-cc3de8ef-8892-488e-b687-dd603ac12c22 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102489 Aug 30 16:13:57.621817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1110/2455] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:57.652038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:57.652898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:57.666463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.672296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.672903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.673962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:57.678423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:57.679160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:57.689638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:57.838688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4ddf0c6-bc47-432a-be4f-0ec0d147f3a4 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1621 microversion: 2.1 time: 0.546846 Aug 30 16:13:57.842698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1346/2456] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:57 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1621 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:57.979746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:57.980368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:58.010032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:58.010032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:58.028167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:58.029218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:58.029724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:58.030340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:58.375799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:58.387237 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f931bceb-dc81-48cb-a2b9-2a03347ffead tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.411205 Aug 30 16:13:58.387851 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1347/2457] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:57 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:13:58.392619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-949476935", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2c146e18-6f96-4c5a-bbc6-ff7ef570db71"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:58.489662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:13:59.140809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:13:59.141383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:13:59.141714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:13:59.142133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:13:59.142651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:13:59.186749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.187763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.188370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:59.189455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.190076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.190902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:59.234837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:13:59.241693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:13:59.257439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:13:59.260081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:13:59.288482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:59.297076 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4aa4c1d0-780e-4d49-b3f8-e54639107dfd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 1.663266 Aug 30 16:13:59.300521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1111/2458] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:57 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:59.307177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:59.323269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:59.330110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.330914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.332700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:59.334273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.334850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.335729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:59.342579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa2903ed-36a6-44ba-9285-c5c456105b09 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952716 Aug 30 16:13:59.344039 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1348/2459] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:13:59.354103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:59.355196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:59.362393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.363395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.364951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:59.367061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:59.367834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:59.368428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:00.831917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:00.849978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:00.851450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:00.852637 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-daba2da7-1473-42ac-b262-2b396020fc5d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1887 microversion: 2.32 time: 1.549447 Aug 30 16:14:00.862613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1112/2460] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:13:59 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1887 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:00.881945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:00.882688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:00.892260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:00.892764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:00.893198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:00.897211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:00.897703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:00.901068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.105533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:01.121868 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73a0d89b-c7e5-4404-a114-f7e8c8c2c543 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1467 microversion: 2.1 time: 1.773939 Aug 30 16:14:01.123473 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1349/2461] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:59 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1467 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:01.142669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:01.146252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:01.146803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:01.154543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-432cd1e3-b750-42e6-ab2e-8073577b3784 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1303 microversion: 2.1 time: 0.290675 Aug 30 16:14:01.174066 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1113/2462] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:00 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1303 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:01.174797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.177520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.178484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.179477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.180916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.183026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.187603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:01.187901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:01.206647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.215483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.216191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.217093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.217703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.218281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.397879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:01.407647 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2c04dadc-7241-4dec-9b40-b42c0c383b96 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1268 microversion: 2.1 time: 0.283095 Aug 30 16:14:01.415654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1350/2463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:01 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1268 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:01.431946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "bf706539-23c6-4579-a131-4f6071e58ec8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:01.459588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:01.462199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.466815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.468992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.497075 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bbb7d829-62af-4631-96a6-36857cc83665 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.321780 Aug 30 16:14:01.498208 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1114/2464] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:01 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:01.505713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:01.506524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:01.513029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.513789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.515328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.517484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.518170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.519138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.530382 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] Creating event network-changed:bf706539-23c6-4579-a131-4f6071e58ec8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:01.543907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1c5bba84-57ba-4694-8ae9-b2ff40e6d8cb req-53b0d183-9113-4aaf-93c8-424332375f2e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125958 Aug 30 16:14:01.548743 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1351/2465] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:01.554106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61362efa-c071-4a8a-949a-bc7a915745d3", "tag": "296ff2c7-a694-42d2-b713-7cd99df8b5b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:01.594011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.600157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.600640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.622274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] Creating event network-changed:296ff2c7-a694-42d2-b713-7cd99df8b5b0 for instance 61362efa-c071-4a8a-949a-bc7a915745d3 on n-h2-830883-28 Aug 30 16:14:01.631878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3d85239c-c397-4e6a-82e0-427bdb60e5dd req-cd0eccf4-8b67-404f-a7f3-80824ee8ed69 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081492 Aug 30 16:14:01.639320 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1352/2466] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:01.644995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:01.647477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:01.662906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.663703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.669826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.671439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.672067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.672650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.718260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lazy-loading 'flavor' on Instance uuid 5a07301a-0c1f-4383-bf3e-26f178c3ff4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:01.898054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ed60e11-2557-4824-a0a4-897e4448667e tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a/action" status: 202 len: 0 microversion: 2.1 time: 0.256852 Aug 30 16:14:01.902121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1353/2467] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:01 2022] POST /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:14:01.917353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:01.920266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:01.938699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.939207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.939646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.943746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:01.944546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:01.945162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:01.983558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:02.166672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.177581 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07a1c45b-c4b1-4a75-bb6e-3e144570d69e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.677918 Aug 30 16:14:02.195023 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1115/2468] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:01 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:02.219187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:02.220240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:02.234875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.236748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.239308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.240275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.240861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.241410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.465983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.483369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.484863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.491187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce98ac91-6d2b-4e23-85e3-2ba7a110e79e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1887 microversion: 2.32 time: 0.585873 Aug 30 16:14:02.491784 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1354/2469] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:01 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1887 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:02.499279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:02.501045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:02.516820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.517538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.518776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.521259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.523735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.524369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.727192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.757762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-feea8ba1-55a8-48f9-913e-84aecdbc71a3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1475 microversion: 2.1 time: 0.559131 Aug 30 16:14:02.760060 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1116/2470] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:02 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1475 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:02.766542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:02.767182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:02.777439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.778262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.778997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.780267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.781005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.781668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.835324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.845269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-30f72db3-2429-4283-ae36-77fa29164907 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.351232 Aug 30 16:14:02.860484 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1355/2471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:02 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:02.866481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:02.867493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:02.875955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.876748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.877400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.878365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:02.879031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:02.879801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:02.978052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:02.994936 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-275f394e-621b-4ad1-9b97-d3ce44c46dbb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1268 microversion: 2.1 time: 0.233029 Aug 30 16:14:02.996315 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1117/2472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:02 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:03.127379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:03.136127 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a83e4b3f-36ef-4e76-8ba3-e0a9158789da tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.274118 Aug 30 16:14:03.150773 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1356/2473] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:02 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:03.204441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:03.205088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:03.211723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.212433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.213072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.214157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.215142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.215801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.340430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:03.369626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:03.519552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:03.521845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:03.533613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.534126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.534601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.535340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.535815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.536411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.573610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:03.582374 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-802b6c52-d7b9-42ee-a018-5ea3c374c8d9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.381951 Aug 30 16:14:03.589882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1118/2474] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:03 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:03.633958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:03.656120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.656601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.656865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.669895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] Creating event network-changed:1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:03.677121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6913cccc-47b4-41e9-80ab-8fdb686fb19b req-0da10f8f-4c2c-4a7d-9769-3989272a64af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047930 Aug 30 16:14:03.678610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1119/2475] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:14:03.782148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:03.783223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:03.794028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.795029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.795996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.797324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:03.798992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:03.800057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:03.976784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:03.992372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:03.994132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:03.995491 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4eaefcd5-6647-48db-9678-c9fb97a14708 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.484535 Aug 30 16:14:03.998373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1357/2476] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:03 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:04.022629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:04.024608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:04.034685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.037806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.038843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.040250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.041065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.041684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.367432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:04.382742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f25e208f-0e7f-469a-8bed-4700acb7f883 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1458 microversion: 2.1 time: 0.605495 Aug 30 16:14:04.396744 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1120/2477] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:03 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1458 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:04.409595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:04.410677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:04.420667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.421558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.422516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.423626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.424269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.424951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.441124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:04.455860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49740be8-bcf7-4416-81a9-f26caeb487fc tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.456051 Aug 30 16:14:04.466485 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1358/2478] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:03 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:04.486950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:04.516506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.518697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.519531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.546395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] Creating event network-changed:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:14:04.552994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-76326722-51a6-4816-8fa6-380ad6c207bf req-742bef43-9866-4483-be90-26ab564cc240 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083555 Aug 30 16:14:04.554362 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1359/2479] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:04.560939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:04.562138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:04.573831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.574966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.575810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.576852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.577543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.578146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.744110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:04.778169 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-335a3aa6-28c3-495a-857a-0e68388cfab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1268 microversion: 2.1 time: 0.374596 Aug 30 16:14:04.781689 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1121/2480] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:04 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1268 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:04.794060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:04.794943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:04.804450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.805836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.806639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:04.807729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:04.808392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:04.809004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:05.049583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:05.071540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bc3ba64-1c2a-4da8-9746-bfff0675fd43 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.515785 Aug 30 16:14:05.072307 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1360/2481] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:04 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:05.090125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:05.091117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:05.097543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:05.098332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:05.099718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:05.100626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:05.101289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:05.101923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:05.601590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:05.616475 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f13dccc-9fc6-4519-8b78-32004befc8bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.528687 Aug 30 16:14:05.617392 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1361/2482] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:05 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:05.641525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:05.642371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:05.658763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:05.663408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:05.663783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:05.664513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:05.664977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:05.665751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.071989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.091351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.094822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.096541 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cb63ce91-27b2-4d65-9100-a96e34e00d98 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.474331 Aug 30 16:14:06.097428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1362/2483] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:05 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:06.103773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:06.105452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:06.116066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.117495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.118199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.119770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.120516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.121442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.483604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.496914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9ca078c-1a1f-4c73-90b1-47a0379dd4dd tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.397417 Aug 30 16:14:06.499682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1363/2484] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:06 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:06.525835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "f9a22e9e-f2ce-4969-bccc-323838f099f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:06.559510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.560466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.573158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.596358 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] Creating event network-changed:f9a22e9e-f2ce-4969-bccc-323838f099f8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:06.603491 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0630e718-e73d-44c7-9d26-afb1d16b9765 req-da53132f-dede-4daf-8acc-c291830409ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099701 Aug 30 16:14:06.604849 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1364/2485] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:06.611939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:06.612903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:06.619926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.620428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.621101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.622012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.622595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.623260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.705181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.717920 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-690bdbcd-029a-4c65-8013-65ed360a4ec2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1274 microversion: 2.1 time: 0.110864 Aug 30 16:14:06.719641 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1365/2486] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:06 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:06.726792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:06.727638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:06.735930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.736827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.738520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.740492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.741184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.742214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.767126 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b88b9496-0afa-4116-b196-51c3d18572cb tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1611 microversion: 2.1 time: 1.983191 Aug 30 16:14:06.775218 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1122/2487] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:04 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1611 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:06.782074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:06.782767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:06.792093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.792668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.793180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.794010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:06.794793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:06.795300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:06.924365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:06.933873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8bcb199f-581b-40d1-a93e-56a8c1048847 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.211643 Aug 30 16:14:06.934785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1366/2488] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:06 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:06.939565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-624811729", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "13ae43f5-f65e-41d3-a1c8-61637c2e23b1"}], "block_device_mapping_v2": [{"uuid": "2a83665d-6729-46c8-aea4-1da74304f2f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:07.015040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] validate_networks() for [('13ae43f5-f65e-41d3-a1c8-61637c2e23b1', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:14:07.383150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:07.400147 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3dce106e-26a4-4646-95aa-8dcb2594f551 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.623634 Aug 30 16:14:07.400753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1123/2489] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:06 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:07.405103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:07.415618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.418497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.420771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.423240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.424477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.424477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.492968 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e62ef45-1113-4b6e-92d7-6a304048b935 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.091102 Aug 30 16:14:07.501878 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1124/2490] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:14:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:07.514630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:07.515693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:07.530934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:07.531672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:07.532332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:07.532924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:07.533663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:07.535581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.537418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.538073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.542019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.542799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.543522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.555789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.556363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.562342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.563417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:07.564212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:07.564645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:07.608471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:14:07.615157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Getting quotas for user 81b24fcdb0a749caa02a34817e8fe9f8 and project 7f8325d53f9148ab83a9416259312f4d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:14:07.771847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:14:07.774008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a83665d-6729-46c8-aea4-1da74304f2f7',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:14:08.041914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59509703-6413-4acd-808f-07757dd53e38 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.105751 Aug 30 16:14:08.042979 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1367/2491] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:14:08.048088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-830883-28", "block_migration": true, "disk_over_commit": false}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:08.053497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:08.064831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.066547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.067993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.069376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.070874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.071532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.106348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Lazy-loading 'flavor' on Instance uuid 5a07301a-0c1f-4383-bf3e-26f178c3ff4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:08.139525 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a while it is in vm_state suspended Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Request method failure captured: Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a/action HTTP/1.1 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 98 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcFJJE7demfRT8QfZsz8anQyGcVMJ3_tMjldKG0qoFySlZChQcbDO2C2XbeR1IXpbCs-WMT1q48UZGuQ-yu1T9hYj_GL7yvfXuyfBbPp743oIfjwMr0WIFL_-GVfMUSbEf3PisMv5fhcanUBXyHzXPv7tPhPioMv6_tkhrpEWJEYbw Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 959db011b6124516b0227002341ffa14 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/959db011b6124516b0227002341ffa14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_959db011b6124516b0227002341ffa14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/959db011b6124516b0227002341ffa14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/959db011b6124516b0227002341ffa14"}]}] Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 959db011b6124516b0227002341ffa14 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-889317682 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationNegativeTest-889317682-project-admin Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 746882f8266a4e8c868cd083554ffaf6 Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationNegativeTest-889317682-project-admin Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: {"os-migrateLive": {"host": "n-h2-830883-28", "block_migration": true, "disk_over_commit": false}} Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'os-migrateLive' instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a while it is in vm_state suspended Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5a07301a-0c1f-4383-bf3e-26f178c3ff4a', 'body': {'os-migrateLive': {'host': 'n-h2-830883-28', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:08.141539 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a while it is in vm_state suspended Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a while it is in vm_state suspended Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a while it is in vm_state suspended {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35f6f85e-9957-42b8-9d46-046482e06012 tempest-LiveMigrationNegativeTest-889317682 tempest-LiveMigrationNegativeTest-889317682-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a/action" status: 409 len: 155 microversion: 2.1 time: 0.098826 Aug 30 16:14:08.146465 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1368/2492] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:08 2022] POST /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a/action => generated 155 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:14:08.150734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:08.150734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:08.159164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.159660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.160113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.160830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.161327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.165415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.708791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:08.718785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18247c28-aefa-443e-8449-cc6d74e886c5 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.572477 Aug 30 16:14:08.721237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1369/2493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:08 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:08.728359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:08.729253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:08.736558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.737275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.737928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.738961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:08.740858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:08.741519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:08.968416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:08.984355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:08.987740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.006710 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-657cf38a-5668-499b-84b2-b16775e54bc7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 1.488304 Aug 30 16:14:09.009865 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1125/2494] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:07 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:09.027386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.029439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.043826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.045048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.045714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.046826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.047558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.048206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.070140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.092520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48d9a13d-1783-4a2c-9ae3-41ddf7c5b205 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.369529 Aug 30 16:14:09.095322 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1370/2495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:08 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:09.107130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.108578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.120246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.121185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.121846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.122862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.123591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.124721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.347659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.370385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.376244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.382982 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c1b2b58-bf65-4b94-8b7c-6212796c7b15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1232 microversion: 2.25 time: 0.280944 Aug 30 16:14:09.386151 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1371/2496] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:09 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1232 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:09.396902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.399093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.408549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.409358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.410351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.411885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.412826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.413584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.448791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:09.471321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:09.596327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c625050-4326-4167-9b02-32a4d2fc6b90 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 204 len: 0 microversion: 2.1 time: 0.207385 Aug 30 16:14:09.597662 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1372/2497] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:09 2022] DELETE /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:09.605235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.605996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.612469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.612975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.613399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.614096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.615191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.615781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.681093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.691551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e046d76-ab40-4045-9c00-2525a96ee2cc tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.680213 Aug 30 16:14:09.692250 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1126/2498] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:09 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:09.699053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "b19c0404-0b11-4f1f-8b59-13ad213dcf6a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:09.710844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.711560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.712086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.725178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] Creating event network-changed:b19c0404-0b11-4f1f-8b59-13ad213dcf6a for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:09.730269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-459ae709-dcdb-4528-8550-dda0312a5feb req-487c465d-4c75-497b-8e2e-8769a49c3c4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034793 Aug 30 16:14:09.730982 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1127/2499] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:09.736344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.746996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.753573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.754069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.754539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.756462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.756928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.764695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.814253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.825809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9461a4eb-bdac-457c-a781-41bcf7966333 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.225683 Aug 30 16:14:09.828766 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1373/2500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:09 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:09.838236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:09.840304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:09.846807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.847899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.848748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.849880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:09.850559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:09.851003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:09.969747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:09.980948 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b93cbe0-07bf-4d39-95ef-bd8ca660caff tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1464 microversion: 2.1 time: 0.248479 Aug 30 16:14:09.981967 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1128/2501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:09 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:10.037902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:10.040139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:10.055738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.056536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.059304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.060657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.064501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.065231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.103206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.113398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19979b77-f279-4034-b2f9-1c137dae8c54 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.281550 Aug 30 16:14:10.114721 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1374/2502] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:09 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:10.121156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:10.122046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:10.135337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.136334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.137017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.138437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.139970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.140625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.304649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.308385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:10.312365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.320003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.321477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.325576 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c53bdfc8-6e3e-4eb7-8cf9-53ceb0a6c4b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.290271 Aug 30 16:14:10.326143 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1129/2503] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:10.330130 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4dad0e4-6947-4eaa-9971-036e5ae12472 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.214159 Aug 30 16:14:10.330875 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1375/2504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:10.409514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:10.410129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:10.416161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.416648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.417087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.417770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.418245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.418690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.481642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.490209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.491668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.492773 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf570564-abc0-4fa3-bb04-7322c63f1042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1240 microversion: 2.25 time: 0.087745 Aug 30 16:14:10.493326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1130/2505] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:10.712973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:10.713558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:10.719980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.720473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.720922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.721616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.722084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.722572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.851327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:10.852505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:10.859535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.860097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.860607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.861381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:10.861911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:10.862021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:10.862481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:10.871038 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f16545b-e4d4-46eb-8084-6e3238b8306f tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.161805 Aug 30 16:14:10.871627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1376/2506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:11.003011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.003772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.010669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.011170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.011620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.012325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.012959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.013548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.023129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.032423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-abd4ef1b-2d2e-404d-a3d1-03a68118f977 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.186481 Aug 30 16:14:11.033478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1131/2507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:11.136800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.137526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.147734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.148554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.149208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.150577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.151147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.151783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.165046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.173918 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19afa0c2-451a-4b3f-8001-edbd2c0dc064 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1464 microversion: 2.1 time: 0.175482 Aug 30 16:14:11.174510 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1377/2508] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:10 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:11.291828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.299815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea08a34c-4d2c-4082-85e8-02c8c759ca63 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.168540 Aug 30 16:14:11.300407 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1132/2509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:11 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:11.357870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.359223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.359661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.360429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.372190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.374204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.374897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.376416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.376676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.377391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.379144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.379666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.380383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.381100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.381653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.383594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.599881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.612574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.614078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.615623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60e92d97-13ec-4745-b9f8-ce41c8faefe4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.269772 Aug 30 16:14:11.616175 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1378/2510] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:11 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:11.621209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.622723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.645199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:11.647551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.648054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.648503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.649240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.649705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.653995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.719157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.727997 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f871e32-1ada-4827-9c87-cf0abd372591 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.380218 Aug 30 16:14:11.728862 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1133/2511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:11 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:11.749684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.761134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.762789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:11.764636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b78dfd1e-4a99-4561-87e5-0b5bcff3013b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1250 microversion: 2.25 time: 0.146905 Aug 30 16:14:11.765519 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1379/2512] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:11 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1250 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:11.896659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:11.896659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:11.906958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.907458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.907968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:11.908928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:11.910445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:11.911145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.065869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:12.069613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:12.087373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.090622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.092893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.095414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.096338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.098495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.429144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:12.440026 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-521b51d3-7e3e-45fd-91ee-562f279f37d4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.389924 Aug 30 16:14:12.441705 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1380/2513] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:12 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:12.461291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:12.465725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:12.479515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.480023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.480463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.481161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.481619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.482047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.866069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:12.877379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2516c974-ff64-45d0-b8bd-5bce93bd6a3a tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.988565 Aug 30 16:14:12.894994 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1134/2514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:11 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:12.905709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "name": "network-vif-plugged", "status": "completed", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:12.911097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:12.929139 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c82204e8-fa36-497c-a6f8-e66db3e6969e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1464 microversion: 2.1 time: 0.486333 Aug 30 16:14:12.939536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1381/2515] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:12 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1464 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:12.945074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:12.946073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:12.956770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.957281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.957728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.972319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.972829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.973279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.974597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:12.975072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:12.975513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:12.989154 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] Creating event network-vif-plugged:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:14:12.995356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c8b15af3-42a0-4b2c-bad4-c4182edff86a req-37d9e90c-8673-48f2-941b-0227c381b3bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101835 Aug 30 16:14:12.996590 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1135/2516] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:13.004228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:13.005639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:13.013309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.014052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.014720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.015590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.016549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.021925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.447065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:13.459904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-46d1f3b6-9bc9-4055-9b1f-c45b55e961a4 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.519000 Aug 30 16:14:13.460523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1382/2517] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:12 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:13.475676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:13.476292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:13.496129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.496683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.497351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.498266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.498949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.499574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.702961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:13.715022 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3cffdbdb-86e1-4683-a83e-5aa61c927678 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.253440 Aug 30 16:14:13.720875 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1383/2518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:13 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:13.731280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:13.732178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:13.751757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.752733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.753635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.754616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.755910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.757161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.770071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:13.791334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:13.796765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:13.798039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17b24c2a-3227-4bee-982f-0e3e89f00788 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.800184 Aug 30 16:14:13.801611 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1136/2519] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:12 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:13.810957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:13.817121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:13.831808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.832327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.833286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:13.834330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:13.835134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:13.837098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.035149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.044791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.046350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.047847 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c8e6361-6b3a-4b1c-9841-4c41b5303f17 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1292 microversion: 2.25 time: 0.323812 Aug 30 16:14:14.063394 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1384/2520] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:13 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1292 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:14.071252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:14.071880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:14.078509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.078996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.079431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.080125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.080631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.084031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.403537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.420874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-337c5218-adaa-4c5d-abf6-eab2ce157756 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.355938 Aug 30 16:14:14.423803 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1385/2521] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:14 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:14.432632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:14.438272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:14.455670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.456882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.457465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.459551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.460175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.461592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.538215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.539058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.539644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.540467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lazy-loading 'fault' on Instance uuid 5a07301a-0c1f-4383-bf3e-26f178c3ff4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:14.593859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.604345 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b223f28b-6d8a-4209-999f-06c61f96fa1b tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 200 len: 1308 microversion: 2.1 time: 0.178662 Aug 30 16:14:14.609831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1386/2522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:14 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:14.633599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a07301a-0c1f-4383-bf3e-26f178c3ff4a", "name": "network-vif-deleted", "tag": "aad8b143-9a40-4ba9-aa49-00d80e2bec02"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:14.647931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.648692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.649278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.667342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] Creating event network-vif-deleted:aad8b143-9a40-4ba9-aa49-00d80e2bec02 for instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a on n-h1-830883-28 Aug 30 16:14:14.673284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2b18b2e1-cce6-49fe-9ebb-170ca66b5781 req-4b29c0b6-98cb-4cd8-a6f3-c14461f29dcb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046185 Aug 30 16:14:14.674363 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1387/2523] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:14.680635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:14.681980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:14.689116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.689806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.690438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.691453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.692600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.693220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.710864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:14.717790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:14.730338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68c02086-c622-4ea8-b903-a212e1cdd3c2 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.925508 Aug 30 16:14:14.732910 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1137/2524] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:13 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:14.775507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:14.776507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:14.794634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.796737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.798033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:14.799319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:14.803146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:14.804228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.181157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:15.190845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb6db033-46ae-4c6a-bbc9-fa18af307c5d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1370 microversion: 2.1 time: 0.515065 Aug 30 16:14:15.218804 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1388/2525] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:14 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1370 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:15.237292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:15.238282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:15.248079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.248583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.249026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.249743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.250203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.252144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.677855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:15.689426 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-386078cc-ce64-4d53-9d10-f0cbe2604d0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.931100 Aug 30 16:14:15.698178 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1138/2526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:14 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:15.709344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-plugged", "status": "completed", "tag": "65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1"}, {"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-plugged", "status": "completed", "tag": "ddc192e2-47fe-48f1-8631-dab5b8ad658d"}, {"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-plugged", "status": "completed", "tag": "c21c2326-9290-4f8d-9ad4-ef82c8c519f3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:15.749597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:15.761541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.763431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.764132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.770385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:15.780837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:15.782094 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6db6d07a-058a-4b38-8db1-ba8f9b286f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.561986 Aug 30 16:14:15.782902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1389/2527] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:15 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:15.794056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Creating event network-vif-plugged:65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:15.794056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Creating event network-vif-plugged:ddc192e2-47fe-48f1-8631-dab5b8ad658d for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:15.794056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] Creating event network-vif-plugged:c21c2326-9290-4f8d-9ad4-ef82c8c519f3 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:15.812112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:15.813263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:15.816639 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cc389aa4-fb86-411b-8d8c-d4e43152f5ed req-737e1ded-2eb7-4330-ba0b-f008036cf9ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.116897 Aug 30 16:14:15.822628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.825525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.825525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.826777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.826942 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1139/2528] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:15.827743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.828497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.836428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:15.837401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:15.845954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.846618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.847344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:15.848866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:15.849858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:15.850991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.003879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.016796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.018789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.020204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98116e57-9e07-4a61-937c-b13cad317c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1292 microversion: 2.25 time: 0.218088 Aug 30 16:14:16.021369 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1390/2529] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:15 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1292 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:16.026393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.027456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5a07301a-0c1f-4383-bf3e-26f178c3ff4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.034476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.035176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.035819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.038711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.039355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.039946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.060189 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] HTTP exception thrown: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Request method failure captured: Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a HTTP/1.1 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcE0fv5_u_v3dlfi2_oOVP2NGERX9hE3t8mXNKZrrw4G49vtpLBZTfRTJcCpF4Z0XAs39etK_UARvB2tktE7eYNEosX2mv_ZFj7VFxw-05ziITvZc7tkX2aZAqtd-nlQF_gGQvgdN0RiGBNZDuHHgh36IaIYvGc9kSZy14hpTSAgjY Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 410abd3e175941ec913e83cf298de76a Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/410abd3e175941ec913e83cf298de76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_410abd3e175941ec913e83cf298de76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/410abd3e175941ec913e83cf298de76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/410abd3e175941ec913e83cf298de76a"}]}] Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 410abd3e175941ec913e83cf298de76a Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationNegativeTest-1742442456-project Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51ad541793be46b0890a8d849586363e Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationNegativeTest-1742442456-project Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5a07301a-0c1f-4383-bf3e-26f178c3ff4a'} Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:16.062514 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. Aug 30 16:14:16.067176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:16.068941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Returning 404 to user: Instance 5a07301a-0c1f-4383-bf3e-26f178c3ff4a could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:16.070277 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ce3ba63-6c55-4203-af99-4c9e1167582e tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a" status: 404 len: 111 microversion: 2.1 time: 0.047760 Aug 30 16:14:16.074361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1391/2530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/5a07301a-0c1f-4383-bf3e-26f178c3ff4a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:16.083250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.084108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.095469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.096689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.097290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.098215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.100857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.101470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.306370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.317822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ad30aee-e599-4951-a805-346233fcb3cc tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.241689 Aug 30 16:14:16.319811 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1392/2531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:16.325446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.326454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.334986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.335831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.336767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.337867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.339237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.340411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.371539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:16.456933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.467205 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73ae97fe-5c8f-4387-8e16-080b141e5eca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.637584 Aug 30 16:14:16.468038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1140/2532] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:15 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:16.486746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.487637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.495081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.495647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.496303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.497322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.498147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.498671 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93106b34-4de0-4bea-88f2-7f6480456d11 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 204 len: 0 microversion: 2.1 time: 0.176956 Aug 30 16:14:16.498973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.499747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1393/2533] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:16 2022] DELETE /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:16.522456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.523178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.534255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.534987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.535388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.536152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.536759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.537408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.741069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.750430 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52020b00-9f0b-4c45-8a85-ce0d5ccc85b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1563 microversion: 2.1 time: 0.267908 Aug 30 16:14:16.751326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1141/2534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:16.757138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.757888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.760972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:16.764790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.765381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.766130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.766977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.767672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.768202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.782159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.791245 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f24f1d9b-85c6-4373-9ed2-872214e720dc tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1475 microversion: 2.1 time: 0.283820 Aug 30 16:14:16.792668 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1394/2535] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1475 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:16.799405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287753fe-aa86-4093-8f86-94881bbaa903", "tag": "a0442408-0d7a-47f1-9b43-bc14025bf85d"}, {"name": "network-changed", "server_uuid": "031e4e54-ce97-4a23-b247-2fa283242c02", "tag": "88bc17db-c681-49fc-a483-5b25f219c7e9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:16.828114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.829163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.829767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.846103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Creating event network-changed:a0442408-0d7a-47f1-9b43-bc14025bf85d for instance 287753fe-aa86-4093-8f86-94881bbaa903 on n-h2-830883-28 Aug 30 16:14:16.846793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] Creating event network-changed:88bc17db-c681-49fc-a483-5b25f219c7e9 for instance 031e4e54-ce97-4a23-b247-2fa283242c02 on n-h1-830883-28 Aug 30 16:14:16.857438 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2c2c759f-87b4-470c-ba9e-414ae8ddf534 req-9bbc7391-4958-4938-ba11-789dce08aac2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063342 Aug 30 16:14:16.858205 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1395/2536] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:16.865249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:16.866903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:16.876319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.877276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.877872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.878773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:16.880513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:16.881160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:16.990283 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b77a028-f461-4313-ae87-aefd0e24c81e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129764 Aug 30 16:14:16.992926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:16.998915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1396/2537] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:17.006347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:17.007438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-969ce3d5-7523-4896-a129-2af040e93aa1 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.254696 Aug 30 16:14:17.007931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:17.008051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1142/2538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:17.028312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.028808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.029242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.030049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.030560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.031186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.046377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:17.046840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:17.053597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.054586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.055265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.056400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.057015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.057602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.285704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.295974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.300753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.307948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4804c431-79c3-49ba-bb4d-c35c4896865b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.301678 Aug 30 16:14:17.314865 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1397/2539] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:16 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:17.343253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:17.343875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:17.352358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.352748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.353513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.354395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.355351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.355351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.366567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.379436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.381353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.385797 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d536e5e0-4c52-4c65-bf73-222d1f8ebf54 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1292 microversion: 2.25 time: 0.344606 Aug 30 16:14:17.388264 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1143/2540] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:17 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1292 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:17.492106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:17.493040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:17.501375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:17.504401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.505614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.506367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.507464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.508249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.509580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.552121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.565299 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edef2992-1cdc-41ef-9ba1-4c8e46a34f0f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1355 microversion: 2.1 time: 0.226282 Aug 30 16:14:17.565897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1398/2541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:17 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1355 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:17.824742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:17.825984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:17.837018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:17.847507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:17.848292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=22 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:17.851266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.851764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.852224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.852992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:17.853463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:17.853989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:17.859693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73f0d899-968a-4f63-9d37-cfd421534f24 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.375096 Aug 30 16:14:17.865139 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1144/2542] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:17 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:18.033405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:18.035022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:18.049114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.049924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.051133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:18.053813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.054598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.055244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:18.194329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:18.216947 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ffe24cee-6123-4376-a411-c41b879f1afd tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1475 microversion: 2.1 time: 0.387254 Aug 30 16:14:18.220024 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1399/2543] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:17 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1475 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:18.330673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:18.332623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:18.366355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.367785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.372070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:18.373432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.376411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.377678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:18.789734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:18.797958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3401072e-011f-42e3-88f6-773042c6c54e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.772325 Aug 30 16:14:18.810777 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1145/2544] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:18 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:18.819078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:18.820274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:18.826716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.827542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.828241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:18.829232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:18.829910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:18.835241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.060499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.076223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.077912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.081585 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-741990b0-fd66-4111-82f4-2e71cea8ed6a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.754939 Aug 30 16:14:19.085877 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1400/2545] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:18 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:19.093453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61362efa-c071-4a8a-949a-bc7a915745d3", "name": "network-vif-plugged", "status": "completed", "tag": "296ff2c7-a694-42d2-b713-7cd99df8b5b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:19.112070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.112563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.112994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.138007 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] Creating event network-vif-plugged:296ff2c7-a694-42d2-b713-7cd99df8b5b0 for instance 61362efa-c071-4a8a-949a-bc7a915745d3 on n-h2-830883-28 Aug 30 16:14:19.143371 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1cd5b6b8-8a12-4b8c-a06a-d37db26c1f89 req-1d687e82-3fdd-49d5-9ad4-fb2f0ae747ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055947 Aug 30 16:14:19.144356 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1401/2546] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:19.151222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:19.152112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:19.159770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.160281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.160725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.162409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.163700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.164323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.373127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.382977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c16535bf-a003-4c17-9bad-812858eeed93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1804 microversion: 2.1 time: 0.236693 Aug 30 16:14:19.395062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1402/2547] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:19 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1804 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:19.401689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:19.402655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:19.410524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.411142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.412322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.413106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.413641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.414254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.707175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.709927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.718625 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eac813a2-2a69-4e30-b76e-d26901a2699d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.334023 Aug 30 16:14:19.722065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1403/2548] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:19 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:19.725926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.728502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:19.730233 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee88587d-b92a-49c6-afa1-ae1a2be68e72 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1292 microversion: 2.25 time: 0.917964 Aug 30 16:14:19.731256 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1146/2549] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:18 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1292 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:19.733132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:19.734944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:19.743232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:19.744133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:19.760954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.764280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.764977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.765275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.765774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.765895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.766908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.767672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.768183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.768419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.769525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.771692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.808046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8eb27332-5269-406f-bd40-a13b6f88a53e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee/ips" status: 200 len: 217 microversion: 2.1 time: 0.075546 Aug 30 16:14:19.815841 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1147/2550] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:14:19 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee/ips => generated 217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:19.822607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:19.823184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:19.830011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.830607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.831143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.832322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:19.832850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:19.833503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:19.838813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:19.871457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:19.977402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c86b79c6-8c11-40e2-a9a9-357302312f93 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "DELETE /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 204 len: 0 microversion: 2.1 time: 0.158406 Aug 30 16:14:20.000435 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1148/2551] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:19 2022] DELETE /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:20.015973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:20.029726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:20.039836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.040667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.041339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.043429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.045219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.046193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.130611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.143689 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3579cb35-a7a3-47e9-8a2f-3393cd8f4193 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1475 microversion: 2.1 time: 0.417264 Aug 30 16:14:20.144524 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1404/2552] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:19 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1475 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:20.149071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:20.149874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:20.156211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.156935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.157810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.158813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.159446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.160627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.396013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.412629 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18425201-12f2-41c2-b6c9-59da8e556f01 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.409100 Aug 30 16:14:20.418500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1149/2553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:20 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:20.436662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:20.437335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:20.443525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.444024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.444778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.445516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.445968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.448001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.506372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.508800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:20.520552 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5a7f7fa-cf18-4e5e-9888-d9e4cd2005ba tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1810 microversion: 2.1 time: 0.375040 Aug 30 16:14:20.521359 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1405/2554] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:20 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1810 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:20.546728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:20.564332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.565126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.566959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.581119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] Creating event network-changed:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:14:20.588953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c39f1a03-a9eb-47b1-8cd2-27a3d08e9601 req-d3be5a60-6eca-464c-8e44-45dc8cbd6fdc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065279 Aug 30 16:14:20.589946 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1406/2555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:20.747137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:20.748336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:20.758145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.759086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.759782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.760713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.761392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.762041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.892420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.907922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.910041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.911595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3f46bd89-daf9-4aff-a962-f9af985b2662 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.479314 Aug 30 16:14:20.912462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1150/2556] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:20 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:20.918258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:20.918962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:20.925442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.926122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.927302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.928177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:20.928791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:20.929399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:20.976912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:20.985261 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f065f9a-6f88-4d32-8784-db9ce4fce145 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.242357 Aug 30 16:14:20.985843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1407/2557] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:20 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:21.103363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.111879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.113340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.115063 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f34ecb0e-3655-4dbc-9382-3987694b0889 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.200851 Aug 30 16:14:21.115622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1151/2558] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:20 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:21.165795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:21.167002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:21.173807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.174323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.174769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.175509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.175965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.176393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.218469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.218469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.218469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.218469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lazy-loading 'fault' on Instance uuid 5054d9b1-d25a-4d70-89eb-d06b35ecae6d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:21.276080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.283939 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d81dc99-f419-49b2-9858-7ee9f606bb6c tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1309 microversion: 2.1 time: 0.123325 Aug 30 16:14:21.287080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1408/2559] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:21 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:21.439430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:21.440051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:21.447241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.447747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.448222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.448939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.449403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.449836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.543209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:21.543815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:21.554647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.555155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.555752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.556487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.556945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.557551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.652108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.660080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e1cf1f0-5412-4f39-9756-25bffd44fea2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.224608 Aug 30 16:14:21.660744 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1152/2560] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:21 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:21.846643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:21.855182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94034335-081a-4352-8cda-35198044d2de tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1810 microversion: 2.1 time: 0.315768 Aug 30 16:14:21.855933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1409/2561] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:21 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:21.936674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:21.937329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:21.944949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.945525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.945967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:21.946703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:21.947154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:21.947744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.008851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:22.009820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:22.018851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.019611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.020119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.021503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.021973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.022437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.157591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.171455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.172994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.174193 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-120574a9-f406-4e9a-9bf1-10e50159c067 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.241545 Aug 30 16:14:22.174798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1153/2562] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:21 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:22.184321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:22.185259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:22.186592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.193283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.194110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.195531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.196429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.203497 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f973117-11dd-4279-90d4-70b6c69e3bec tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.199620 Aug 30 16:14:22.203900 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1410/2563] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:22 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:22.204515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.205166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.307286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:22.308356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:22.337917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.338713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.339726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.341156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.342064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.343184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.412553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.413170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.413753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.414273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lazy-loading 'fault' on Instance uuid 5054d9b1-d25a-4d70-89eb-d06b35ecae6d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:22.417102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.429360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.431091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.432326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1fefcc87-9adf-401f-bab5-8213be982a8a tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.253707 Aug 30 16:14:22.450456 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1154/2564] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:22 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:22.474708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51ad541793be46b0890a8d849586363e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410abd3e175941ec913e83cf298de76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.483866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2403a6e8-c543-43e8-89f0-dbe7ef42dea3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 200 len: 1309 microversion: 2.1 time: 0.182095 Aug 30 16:14:22.497354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1411/2565] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:22 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:22.636321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5054d9b1-d25a-4d70-89eb-d06b35ecae6d", "name": "network-vif-deleted", "tag": "b342da81-0723-4233-a0cb-311af9256f18"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:22.647106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.647689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.648190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.659767 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] Creating event network-vif-deleted:b342da81-0723-4233-a0cb-311af9256f18 for instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d on n-h1-830883-28 Aug 30 16:14:22.665465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-348970ee-0b41-4b2a-8b60-f77ebb615b38 req-821fad71-421d-408b-a5f7-c3ccdf4eb656 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Aug 30 16:14:22.666007 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1155/2566] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:22.682025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:22.682745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:22.688763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.689248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.689865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.690585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.691050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.691481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.831963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:22.839759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ec55baf-8d8e-45f6-b8a4-b1304b45e2b5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.162803 Aug 30 16:14:22.840341 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1412/2567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:22 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:22.877842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:22.878682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:22.885395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.885887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.886403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:22.887181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:22.887635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:22.888057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.038338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.046651 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b63d94c-d9c2-4d83-936a-3a19a421ed82 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1810 microversion: 2.1 time: 0.172963 Aug 30 16:14:23.047360 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1156/2568] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:22 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:23.206879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:23.209533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:23.232144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:23.233057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:23.236151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.236930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.237549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.238815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.239674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.240187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.240685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.240805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.241292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.242056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.242600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.243091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.446402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.447033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.457253 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08de082f-84a2-4036-a45e-8e2d51cd7939 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.231009 Aug 30 16:14:23.457952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.460243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.460393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1157/2569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:23 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:23.465668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:23.466331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:23.472939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.473433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.475155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.475583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1296b16-44e8-4960-88d2-4ba805c9ee7c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.275464 Aug 30 16:14:23.475890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.476190 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1413/2570] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:23 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:23.476351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.476820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.505520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:23.506272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] [instance: 5054d9b1-d25a-4d70-89eb-d06b35ecae6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:23.517326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.517997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.518610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.519608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.520619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.522815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.539441 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] HTTP exception thrown: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Request method failure captured: Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d HTTP/1.1 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcE0fv5_u_v3dlfi2_oOVP2NGERX9hE3t8mXNKZrrw4G49vtpLBZTfRTJcCpF4Z0XAs39etK_UARvB2tktE7eYNEosX2mv_ZFj7VFxw-05ziITvZc7tkX2aZAqtd-nlQF_gGQvgdN0RiGBNZDuHHgh36IaIYvGc9kSZy14hpTSAgjY Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 410abd3e175941ec913e83cf298de76a Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/410abd3e175941ec913e83cf298de76a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_410abd3e175941ec913e83cf298de76a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/410abd3e175941ec913e83cf298de76a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/410abd3e175941ec913e83cf298de76a"}]}] Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 410abd3e175941ec913e83cf298de76a Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1742442456 Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveMigrationNegativeTest-1742442456-project Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 51ad541793be46b0890a8d849586363e Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveMigrationNegativeTest-1742442456-project Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5054d9b1-d25a-4d70-89eb-d06b35ecae6d'} Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:23.541149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] Returning 404 to user: Instance 5054d9b1-d25a-4d70-89eb-d06b35ecae6d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8c9450b8-f48d-45fb-9942-213d77a85bb3 tempest-LiveMigrationNegativeTest-1742442456 tempest-LiveMigrationNegativeTest-1742442456-project] 10.222.0.47 "GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d" status: 404 len: 111 microversion: 2.1 time: 0.042351 Aug 30 16:14:23.546199 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1414/2571] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:23 2022] GET /compute/v2.1/servers/5054d9b1-d25a-4d70-89eb-d06b35ecae6d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:14:23.631685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.639586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.641354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:23.642347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a819192b-e8f8-4260-a5dd-3db2b0d599c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.181220 Aug 30 16:14:23.642911 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1158/2572] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:23 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:23.863508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:23.865099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:23.872487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.873171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.873613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:23.874499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:23.875123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:23.875715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.065963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:24.071003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:24.071849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:24.079374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.080046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.080485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.081189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.081639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.081936 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb532bbd-981e-4468-9695-d71a325c2524 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.224358 Aug 30 16:14:24.082570 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1415/2573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:23 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:24.082708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.311221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:24.320835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b060979-3600-4ab3-9a4e-2e255e73f2d0 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1810 microversion: 2.1 time: 0.255691 Aug 30 16:14:24.321766 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1159/2574] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:24 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:24.480663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:24.481305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:24.487888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.488367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.488805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.490347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.490957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.491583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.499766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:24.500383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:24.508862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.509565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.510180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.511231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.512666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.513321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.672484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:24.683494 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-afc06c77-9dfe-4742-9aea-51accdc3ec4c tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1331 microversion: 2.1 time: 0.206501 Aug 30 16:14:24.699747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1416/2575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:24 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1331 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:24.711808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:24.712943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:24.721435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.722540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.723152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:24.724991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:24.725465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:24.725904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.004202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.016769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.018962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.020390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ce8aa0a-2cee-4484-99d0-7ffca124e3a0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.318811 Aug 30 16:14:25.023012 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1417/2576] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:24 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:25.029605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287753fe-aa86-4093-8f86-94881bbaa903", "name": "network-vif-plugged", "status": "completed", "tag": "a0442408-0d7a-47f1-9b43-bc14025bf85d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:25.044596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.045254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.045873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.063397 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] Creating event network-vif-plugged:a0442408-0d7a-47f1-9b43-bc14025bf85d for instance 287753fe-aa86-4093-8f86-94881bbaa903 on n-h2-830883-28 Aug 30 16:14:25.070761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fcf0cf30-eccd-4d0f-bc96-65234f7bd0d7 req-445e001c-43a2-44eb-9c35-3ee57bada48f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045273 Aug 30 16:14:25.071522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1418/2577] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:25.091741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.102472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.104430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:25.105258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:25.116435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.117751 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f124e5b7-8726-4aca-956b-f2efab4bf693 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.622026 Aug 30 16:14:25.122656 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1160/2578] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:24 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:25.127661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.131331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.131967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.134079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.135309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.136733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.343423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:25.344637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:25.367691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.369069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.373041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.378126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.378687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.384034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.385365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.389752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06787b17-dd97-4e2b-a423-5ab8ae013213 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.289773 Aug 30 16:14:25.390573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1419/2579] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:25 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:25.705234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:25.705859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:25.713254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.713973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.714613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.715516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:25.716136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:25.716727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:25.811221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.827048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ede3697e-3318-4f93-a5f6-12bb3f9fc931 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1810 microversion: 2.1 time: 0.488221 Aug 30 16:14:25.827921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1161/2580] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:25 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1810 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:25.933178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:25.960777 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9859e30c-c351-4a56-abb5-98db8dfa20e7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1536 microversion: 2.1 time: 0.255429 Aug 30 16:14:25.961835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1420/2581] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:25 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1536 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:25.983160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-041518d4-8502-4208-bb48-cb68455cba15 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'create', calling method: .version_select at 0x7fd360fee430>, body: {"pool": "07bdfb73-ddda-4904-b9ec-58b586277baf"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:26.045091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:26.046114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:26.059648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.060443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.061061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.062003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.062664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.063880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.305263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.321141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.323985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.326164 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b7e68b0-e3e9-47e7-9b2d-f9adbbb3cb58 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.286254 Aug 30 16:14:26.326935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1421/2582] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:26 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:26.335286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-deleted", "tag": "ddc192e2-47fe-48f1-8631-dab5b8ad658d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:26.346646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.347378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.347993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.360935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] Creating event network-vif-deleted:ddc192e2-47fe-48f1-8631-dab5b8ad658d for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:26.367330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-48ea1bd3-219a-4a28-8820-f788cbcbb432 req-179fc7af-8eb6-493b-ba2e-04f88238204a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038687 Aug 30 16:14:26.368543 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1422/2583] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:26.373890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:26.375039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:26.381523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:26.383543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.384505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.385309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.386432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.387097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.387726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.653542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.664021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.665455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.666658 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a07d1a5d-19eb-4509-970e-f9cfe95b6f9d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.296825 Aug 30 16:14:26.667219 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1423/2584] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:26 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:26.681431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:26.685034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:26.691799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.692538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.692979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.693776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.694235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.694958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.712193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:26.874029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:26.884425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5382bbe6-dd58-41ac-9abd-74fd252c6368 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1316 microversion: 2.1 time: 0.213705 Aug 30 16:14:26.901366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1424/2585] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:26 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:26.908139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:26.909206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:26.918446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.919854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.920819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:26.922176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:26.923038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:26.923856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:27.163076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:27.176596 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27cfd6f7-acf0-4cf7-b1ec-3167b3210664 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1675 microversion: 2.1 time: 0.273453 Aug 30 16:14:27.178754 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1425/2586] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:26 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1675 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:27.676389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-725243207", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:27.736501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:27.737567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:27.738229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:27.738672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:27.739089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:27.748804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:27.749292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:27.749901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:27.750676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:27.751134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:27.751561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:27.769911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Getting quotas for project ce1c5a70408c4c3f8b122fc442f2a278. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:14:27.775380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Getting quotas for user 5a9c9c525e1348e2b06930950040d24f and project ce1c5a70408c4c3f8b122fc442f2a278. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:14:27.788331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:14:27.790884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:14:27.842241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5069e1d5-78a3-4944-85c0-f30faab10637 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.558039 Aug 30 16:14:27.843282 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1426/2587] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 16:14:27.861474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:27.863113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:27.877138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:27.877832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:27.878694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:27.879577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:27.880901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:27.881505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.065236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.080184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.084814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.089884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7e9d762-3c6c-421e-8388-0bedd429421f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.244655 Aug 30 16:14:28.091109 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1427/2588] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:27 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:28.096918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:28.098477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.108284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.108963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.109420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.110143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.110698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.111270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.352841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.365142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.367695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.369360 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71b7d71a-a491-4a62-80b0-ce23fe5d78b5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.277056 Aug 30 16:14:28.370653 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1428/2589] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:28 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:28.399691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:28.404747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.548641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.560502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.561964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.574047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65fc5fe4-8ebb-4b88-9818-ff706c65f657 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "PUT /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1358 microversion: 2.75 time: 0.202146 Aug 30 16:14:28.575869 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1429/2590] 10.222.0.47 () {62 vars in 1297 bytes} [Tue Aug 30 16:14:28 2022] PUT /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:28.589053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:28.589721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.599379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.600650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.601390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.605283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.606009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.606673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.735340 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-041518d4-8502-4208-bb48-cb68455cba15 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.755893 Aug 30 16:14:28.745019 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1162/2591] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:14:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:28.756391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:28.761346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.776874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.777427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.777883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.778693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.779164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.779748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.797580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.811965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e981610-faee-477b-af6c-ec53a8fecacd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1465 microversion: 2.1 time: 0.234959 Aug 30 16:14:28.812559 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1430/2592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:28 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:28.823161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:28.823348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.823850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.824296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.824757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lazy-loading 'fault' on Instance uuid 804827d9-9c13-4b4f-9139-667ebb49adee {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:28.827239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.841012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.842631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.843090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.843814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.844291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.844728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.880345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:28.900181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-abe8d6bb-9c90-4f5e-8112-d63929ce7b45 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 200 len: 1303 microversion: 2.1 time: 0.153969 Aug 30 16:14:28.904969 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1163/2593] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:28 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:28.909682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-deleted", "tag": "65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1"}, {"server_uuid": "804827d9-9c13-4b4f-9139-667ebb49adee", "name": "network-vif-deleted", "tag": "c21c2326-9290-4f8d-9ad4-ef82c8c519f3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:28.928953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.929453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.929890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.943735 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Creating event network-vif-deleted:65d98d1d-f211-4e63-9dc5-d7ff3c9bd9a1 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:28.944164 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] Creating event network-vif-deleted:c21c2326-9290-4f8d-9ad4-ef82c8c519f3 for instance 804827d9-9c13-4b4f-9139-667ebb49adee on n-h2-830883-28 Aug 30 16:14:28.949823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-89f8ee21-ec72-4228-9e81-2da7a1a522fa req-07095ceb-dbb2-4b87-9382-827280e44204 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043816 Aug 30 16:14:28.950826 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1164/2594] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:28.957770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.250"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:28.960918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:28.969390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.970337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.971006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.971934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:28.972590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:28.973217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:28.998976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:29.005699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:14:29.006121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquired lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:14:29.024390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.040877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.042763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.050562 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4906177c-703e-4d44-bb93-48a9144980cb tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1354 microversion: 2.75 time: 0.234324 Aug 30 16:14:29.051782 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1431/2595] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:28 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:29.065459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:29.066378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:29.078233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.079101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.079710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.080686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.081374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.082033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.287589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f55469b-2832-43ec-ad57-bcae08734b6d tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1618 microversion: 2.1 time: 0.233493 Aug 30 16:14:29.288417 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1432/2596] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:29 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1618 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:29.293510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:29.294677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:29.306706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.307651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.310611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.313672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.314392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.318906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.496654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.507975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.510035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.512400 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a327db0b-9d57-4ffc-be8a-e36e76089dde tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.222253 Aug 30 16:14:29.513214 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1433/2597] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:29 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:29.518665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:29.519664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:29.527098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.527098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.527524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.528233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:29.528690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:29.529124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:29.746909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.769812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.771784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:29.774043 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4412fc9e-9b2b-4fd1-8db3-03f4e8e69f8f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.258564 Aug 30 16:14:29.775139 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1434/2598] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:29 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:29.779930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-533075548", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2c146e18-6f96-4c5a-bbc6-ff7ef570db71"]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:29.852986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:14:30.149027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:30.149836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:30.150620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:30.151668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:30.152434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:30.164231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.165754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.166563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.167825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.168575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.169451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.200309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:14:30.210910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:14:30.230158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:14:30.232518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:14:30.281037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71a0c9f2-ba74-4118-9480-07d9c5b24f57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504607 Aug 30 16:14:30.281702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1435/2599] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:14:30.287595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:30.288639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:30.295392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.296084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.296533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.297230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.297851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.299088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.315994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee HTTP/1.1 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '804827d9-9c13-4b4f-9139-667ebb49adee'} Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:30.318743 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:14:30.323596 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:30.325203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:30.326553 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5adef4d-2d62-4396-bc56-118bff7303a4 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 404 len: 111 microversion: 2.1 time: 0.043192 Aug 30 16:14:30.327584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1436/2600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:30 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:30.333188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:30.334231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:30.341150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.341890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.342524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.343446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.344108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.344941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.445227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:30.459587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:30.461191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:30.469280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:14:30.480207 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fdfb541c-fad7-44ec-9ebf-1d872e7e7d4d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1416 microversion: 2.75 time: 0.151359 Aug 30 16:14:30.480800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1437/2601] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:30 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:30.500058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-847aeed5-2d4f-47ac-af3b-c6013549843b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:30.500921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-847aeed5-2d4f-47ac-af3b-c6013549843b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:30.618735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-847aeed5-2d4f-47ac-af3b-c6013549843b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:30.636701 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-847aeed5-2d4f-47ac-af3b-c6013549843b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1216 microversion: 2.1 time: 0.154828 Aug 30 16:14:30.643178 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1438/2602] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:30 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:30.672261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:30.672785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:30.697222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.697728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.698173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:30.698966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:30.699425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:30.699854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:31.280647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Updating instance_info_cache with network_info: [{"id": "296ff2c7-a694-42d2-b713-7cd99df8b5b0", "address": "fa:16:3e:75:08:65", "network": {"id": "3bd50dcb-a5fd-4d4d-9ae9-423e909e42a3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1313273397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f464e91bd08345b4b5dc759b294016c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap296ff2c7-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:14:31.298609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Releasing lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:14:31.300895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4250ad2e-92f8-4b7d-964f-9378e23773ca tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 202 len: 0 microversion: 2.1 time: 2.347999 Aug 30 16:14:31.302845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1165/2603] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:28 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 0 bytes in 2351 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:14:31.310866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:31.311891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:31.319525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:31.323062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:31.326284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:31.327569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:31.328658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:31.329292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:31.330064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:31.337200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:31.338735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:31.340540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-281a3f09-f114-4030-b2b1-ffd3cbd59dff tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.696660 Aug 30 16:14:31.341303 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1439/2604] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:30 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:31.349977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61362efa-c071-4a8a-949a-bc7a915745d3", "tag": "296ff2c7-a694-42d2-b713-7cd99df8b5b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:31.373617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:31.380941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:31.381646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:31.398702 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] Creating event network-changed:296ff2c7-a694-42d2-b713-7cd99df8b5b0 for instance 61362efa-c071-4a8a-949a-bc7a915745d3 on n-h2-830883-28 Aug 30 16:14:31.418019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-cfd53e04-6e5b-416e-b08d-79845349c92d req-abc77b34-a411-4e3d-bc50-07eb66c9b499 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071946 Aug 30 16:14:31.419333 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1440/2605] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:31.424598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d596037-128f-4e7c-a686-7ffd24b33d21 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'create', calling method: .version_select at 0x7fd35c0e1d30>, body: {"pool": "07bdfb73-ddda-4904-b9ec-58b586277baf"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:32.110756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.134869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.142833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.144112 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6efe3997-318c-4779-bf75-e1ca2832c685 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.839874 Aug 30 16:14:32.144696 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1166/2606] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:31 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:32.176306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:32.181528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:32.192359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:32.204031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:32.204805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:32.206036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:32.206732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:32.210922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:32.384464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.396293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.402567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:32.418275 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3582cd43-dd69-41a9-b6b9-a08eb0b14355 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1416 microversion: 2.75 time: 0.250704 Aug 30 16:14:32.420923 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1167/2607] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:32 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1416 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:32.430553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:32.431160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:32.440316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:32.440316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:32.440316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:32.440759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:32.441458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:32.449545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.273990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:33.285847 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10e4f79e-0ba8-49b3-a847-0fa1b94f3d0c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1276 microversion: 2.1 time: 0.862788 Aug 30 16:14:33.287204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1168/2608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:32 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1276 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:33.303694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:33.304325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:33.321701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.322211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.322686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.323402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.323863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.324297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.639215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d596037-128f-4e7c-a686-7ffd24b33d21 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.218600 Aug 30 16:14:33.648421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1441/2609] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:14:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:33.803999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:33.816947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:33.822916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:33.824404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-60b69467-baaf-41b4-bdbd-6e3139073b36 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.535632 Aug 30 16:14:33.835380 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1169/2610] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:33 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:33.840469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031e4e54-ce97-4a23-b247-2fa283242c02", "name": "network-vif-plugged", "status": "completed", "tag": "88bc17db-c681-49fc-a483-5b25f219c7e9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:33.849816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:33.852028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:33.860621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.861375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.861964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.863080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.863816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.865300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.866120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.866679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.867126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.887627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] Creating event network-vif-plugged:88bc17db-c681-49fc-a483-5b25f219c7e9 for instance 031e4e54-ce97-4a23-b247-2fa283242c02 on n-h1-830883-28 Aug 30 16:14:33.893519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-cb32a55a-1324-45ea-bf81-dd6cf32a6a45 req-9f2753f0-49ad-4bbf-a7eb-4c95c2a23bea service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249383 Aug 30 16:14:33.904144 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1442/2611] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:33.914180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:33.914413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:33.923273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.923857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.924427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:33.938219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:33.939801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:33.940491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.079386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.089144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.090620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.117155 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9960aa37-fad2-4645-ae1b-33d673fbdd5e tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1437 microversion: 2.75 time: 0.211981 Aug 30 16:14:34.118488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1443/2612] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:33 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1437 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:34.127958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.23"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:34.132458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:34.140855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.141636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.142228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.143062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.143591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.144096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.171651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:14:34.172086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquired lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:14:34.283993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.295133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.296962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.298690 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb17870b-5028-4261-9099-0ae0733bbbd2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.454744 Aug 30 16:14:34.312465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1170/2613] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:33 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:34.326934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:34.330835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:34.339428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.340093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.340508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.346608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.347182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.347688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.488446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:34.489287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:34.489957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:34.490898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:34.491715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:34.603189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:34.616962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.619091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.619713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.621436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.622064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.622675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.790994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.800149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.801601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:34.809168 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-059c65bb-894e-4b73-9971-50f18dd08681 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "POST /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db/action" status: 202 len: 1494 microversion: 2.75 time: 0.494771 Aug 30 16:14:34.810294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1171/2614] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:14:34 2022] POST /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db/action => generated 1494 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 16:14:34.815814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:34.821691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:34.830144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.831097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.833863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.833863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.833863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.834876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.900790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf.", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:14:34.901413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Releasing lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:14:34.903637 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.903637 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Request method failure captured: Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action HTTP/1.1 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 45 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjc6u4dAMzDIXzrjHqBwCU-Tan80lpmxNP16vKlVs4gVz8HeVmXh6PoRo2rKnjF7I1uo9xxw8aQR9gmyHz6minX1_JVJKO6kTdEHDg56gunJPf4W_sgnbHoZQRx8HS6bhJGfx9USWzMsaXVSvvG4fDSAZjXe_VglFs_V7p3z4t9W97w Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}] Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f43b46ba684e4b9b870e0ad76072d72e Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: {"addFloatingIp": {"address": "172.25.3.23"}} Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '61362efa-c071-4a8a-949a-bc7a915745d3', 'body': {'addFloatingIp': {'address': '172.25.3.23'}}} Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:14:34.907677 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] Aug 30 16:14:34.911741 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:34.920821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Returning 400 to user: Cannot associate floating IP 172.25.3.23 (91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9) with port 296ff2c7-a694-42d2-b713-7cd99df8b5b0 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 07bdfb73-ddda-4904-b9ec-58b586277baf. Aug 30 16:14:34.920821 n-d-830883-28 devstack@n-api.service[122352]: Neutron server returns request_ids: ['req-62d004e4-ee3a-452f-bcda-977b386b130c'] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:34.922080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6929aab9-445d-482c-9571-586bdf167259 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 400 len: 381 microversion: 2.1 time: 0.798528 Aug 30 16:14:34.922895 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1444/2615] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:34 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 381 bytes in 800 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:14:34.934089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:34.934990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:34.947755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.948527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.949349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:34.950380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:34.951021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:34.951671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:35.097116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.110825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.112766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.119571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d218055-060f-45f5-93ff-5a37b4a41882 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.191397 Aug 30 16:14:35.134330 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1445/2616] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:34 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:35.134330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:35.134330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:35.147348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:35.147860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:35.148303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:35.149015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:35.149473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:35.150127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:35.437646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.448274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.449258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2daaa377-64b2-4da3-8f4e-36f62a5d4855 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.634511 Aug 30 16:14:35.450065 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1172/2617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:34 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:35.460587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.463046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.464081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4f141fe-4fcf-4747-bb8b-a907e53927a3 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '.version_select at 0x7fd35d6f4430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:35.464693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bcb2cabb-b871-4f12-a2c0-ebf0aac5d599 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1280 microversion: 2.25 time: 0.342854 Aug 30 16:14:35.465490 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1446/2618] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:35 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1280 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:35.470574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:35.471525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:35.479161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:35.480106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:35.480788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:35.481722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:35.482575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:35.483367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:35.781009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.783972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:35.794784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.796409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:35.797755 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ee2ff9f-1ece-417a-9d77-216902edc2ce tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.331126 Aug 30 16:14:35.798968 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1447/2619] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:35 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:36.146962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:36.149119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:36.164474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.165230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.167125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.168758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.169724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.170429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.261978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:36.271102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:36.276162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:36.282872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e44b2a27-3d0f-4c6f-aee1-10233700c2da tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.141341 Aug 30 16:14:36.284304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1448/2620] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:36 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:36.472210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:36.472859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:36.479542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.480032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.480481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.481153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.481603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.482023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.711832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:36.734948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f41004df-57f5-404c-a405-9be00554c1d2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.266380 Aug 30 16:14:36.735860 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1449/2621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:36 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:36.785176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:36.789789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:36.792490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:36.797806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.798280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.798904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.800117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.800251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.800857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.156074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.169905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.173438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.175426 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54a867d9-1608-4439-83ec-b62e92ab1d04 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1476 microversion: 2.25 time: 0.415341 Aug 30 16:14:37.187631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1450/2622] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:36 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:37.201900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:37.202755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:37.213072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.213994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.215371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.216428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.218720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.219677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.656775 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4f141fe-4fcf-4747-bb8b-a907e53927a3 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9" status: 202 len: 0 microversion: 2.1 time: 2.204270 Aug 30 16:14:37.658289 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1173/2623] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:14:35 2022] DELETE /compute/v2.1/os-floating-ips/91d10eb1-68aa-493f-a6ab-3e1f71dc8bb9 => generated 0 bytes in 2207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:14:37.769851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.782768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.785518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.789990 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe2ff7dc-2ef2-4882-afdb-1468c5a80a4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.600241 Aug 30 16:14:37.792669 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1451/2624] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:37 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:37.838401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1f135f-887c-42de-959d-0185ff186938", "tag": "53886c53-8c18-4946-bf63-5dda24ea7583"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:37.866528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.871940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.872386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.902200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] Creating event network-changed:53886c53-8c18-4946-bf63-5dda24ea7583 for instance 1f1f135f-887c-42de-959d-0185ff186938 on n-h2-830883-28 Aug 30 16:14:37.921928 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-299128f0-04f4-4b32-9c9e-91eae049772c req-0da1705b-3016-4fbe-8ed3-6215425bd26a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261037 Aug 30 16:14:37.923343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1174/2625] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:37.929985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:37.932338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:37.948388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.948886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.949339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.950034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.950520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.956069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.999427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:38.000075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:38.014834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.015337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.015782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.016530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.016996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.017425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.047704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:38.063670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:38.065362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:38.078137 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ae1ee87-66a1-4b5c-a2fc-325eafd0d14c tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.153371 Aug 30 16:14:38.078901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1175/2626] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:37 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:38.086551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.250"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:38.237990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 031e4e54-ce97-4a23-b247-2fa283242c02 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:38.265675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b1a888a0-0b3d-467c-a59c-f5d83f5e17b8 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1970 microversion: 2.25 time: 0.471092 Aug 30 16:14:38.265849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:38.266278 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1452/2627] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:37 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1970 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:38.275183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.275183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.275183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.276344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.276904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.277359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.290061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:38.291139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:38.301416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.303370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.304754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.305489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.305962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.307571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.547280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:14:38.547836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquired lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:14:38.744491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:38.757254 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98a70b3f-b08c-49ea-8a5b-192cb88ba450 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.471373 Aug 30 16:14:38.760875 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1453/2628] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:38 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:38.765790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:38.767149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:38.782628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.783523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.784328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.785238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.799904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.800547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.074685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 031e4e54-ce97-4a23-b247-2fa283242c02 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:39.106901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5d53c92-0cbb-4362-ad56-0f846a2ebf0c tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1970 microversion: 2.25 time: 0.344671 Aug 30 16:14:39.107507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1454/2629] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:38 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1970 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:39.115514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:39.116141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:39.131806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.132300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.138543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.139519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.140139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.140900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.452551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.462380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.464030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.465388 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e3a74b6-1617-41bd-a2f8-a0d8fb104f8a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.356230 Aug 30 16:14:39.470609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1455/2630] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:39 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:39.481601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:39.482488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:39.491340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.492089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.492878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.493746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.499525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.500283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.621738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.641108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.642904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.649112 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e889ca1-e0be-432f-854c-8969f484c0b6 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.177221 Aug 30 16:14:39.649995 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1456/2631] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:39 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:39.654771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:39.658619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.659292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.659992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.660888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.662785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.669259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.708571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25801eb5-3912-4081-b367-b19fb07c5314 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.056751 Aug 30 16:14:39.709491 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1457/2632] 10.222.0.47 () {60 vars in 1217 bytes} [Tue Aug 30 16:14:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:14:39.724648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-830883-28", "block_migration": "auto"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:39.727095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:39.744208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.745390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.752354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.753126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.754202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.754202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.805421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'flavor' on Instance uuid 031e4e54-ce97-4a23-b247-2fa283242c02 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:14:39.814181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:14:39.822352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Going to try to live migrate instance to n-h2-830883-28 {{(pid=122352) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:14:40.570424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Updating instance_info_cache with network_info: [{"id": "296ff2c7-a694-42d2-b713-7cd99df8b5b0", "address": "fa:16:3e:75:08:65", "network": {"id": "3bd50dcb-a5fd-4d4d-9ae9-423e909e42a3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1313273397-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f464e91bd08345b4b5dc759b294016c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap296ff2c7-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:14:40.586678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Releasing lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:14:40.587937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e07de172-ba30-4f93-99f8-cbcfd09a2aee tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 202 len: 0 microversion: 2.1 time: 2.507208 Aug 30 16:14:40.589412 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1176/2633] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:38 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 0 bytes in 2510 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:14:40.596350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-13280622", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "ebf9eaff-2dc4-4578-ab70-6e2734d020c5"}, {"uuid": "93e6713f-19c0-4465-9392-f80715ad769a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:40.622743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=16 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:40.667828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] validate_networks() for [('ebf9eaff-2dc4-4578-ab70-6e2734d020c5', None, None, None, None, None), ('93e6713f-19c0-4465-9392-f80715ad769a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:14:41.578751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:41.579267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:41.580662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:41.581155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:41.581924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:41.596412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:41.599608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:41.600139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:41.602780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:41.603442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:41.604253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:41.630814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Getting quotas for project bd97ef9096e541b48a9f24ddfe666b1a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:14:41.641693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Getting quotas for user 08b0dab09f5e47ccbe1e9385edbe6cc9 and project bd97ef9096e541b48a9f24ddfe666b1a. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:14:41.676353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:14:41.681943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:14:41.773071 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5100e01-4df6-482c-8dd2-e15abef539bb tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182216 Aug 30 16:14:41.780746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1177/2634] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:14:41.786160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:41.786869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:41.792848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:41.794634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:41.795348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:41.796004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:41.797419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:41.798083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:41.798737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:42.079291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:42.092988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-890a916a-de64-4e45-9d7e-ae01ca3c93bd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.310625 Aug 30 16:14:42.111919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1178/2635] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:41 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:42.122865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61362efa-c071-4a8a-949a-bc7a915745d3", "tag": "296ff2c7-a694-42d2-b713-7cd99df8b5b0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:42.148270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:42.149332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:42.149927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:42.167084 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] Creating event network-changed:296ff2c7-a694-42d2-b713-7cd99df8b5b0 for instance 61362efa-c071-4a8a-949a-bc7a915745d3 on n-h2-830883-28 Aug 30 16:14:42.174885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8c6521af-18c2-42b1-97ff-e5efedd9c5eb req-2b6216f2-e7b6-4399-a11b-c561fe63d644 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060214 Aug 30 16:14:42.178466 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1179/2636] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:42.215276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:42.216208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:42.247372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:42.247887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:42.251825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:42.253604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:42.268474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:42.269945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:42.651722 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc782be1-207b-42b7-8383-5bfecf2e06e0 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02/action" status: 202 len: 0 microversion: 2.25 time: 2.933144 Aug 30 16:14:42.652654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1458/2637] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:14:39 2022] POST /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02/action => generated 0 bytes in 2935 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:42.657665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f58c69c2-c7ae-481e-bf6b-91ef7e09c57d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '.version_select at 0x7fd35c0ca280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:42.773682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:42.778319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:42.802031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:42.805815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:42.811006 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35c4dc46-54a8-44b2-8b97-9a467424c0d6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.621663 Aug 30 16:14:42.814418 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1180/2638] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:42 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:42.829243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:42.829870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:42.851224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:42.851753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:42.852142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:42.853230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:42.854383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:42.855872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.081016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:43.102424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:43.108466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:43.122252 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c92f834f-0f3e-40e4-9550-8162ecd12698 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.305828 Aug 30 16:14:43.135996 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1181/2639] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:42 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:43.152993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:43.153862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:43.197875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.198585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.200445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.206200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.212383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.212852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.476136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:43.485590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f3270b8-3c36-4de5-9f56-512a83f56037 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1263 microversion: 2.1 time: 0.346762 Aug 30 16:14:43.488628 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1182/2640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:43 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1263 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:43.500724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:43.501371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:43.513834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.520383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.523270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.524576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.526706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.527000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.063054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f58c69c2-c7ae-481e-bf6b-91ef7e09c57d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/c6138227-166d-49a9-9907-12b4b58cb20c" status: 202 len: 0 microversion: 2.1 time: 1.408520 Aug 30 16:14:44.064205 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1459/2641] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:14:42 2022] DELETE /compute/v2.1/os-floating-ips/c6138227-166d-49a9-9907-12b4b58cb20c => generated 0 bytes in 1411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:14:44.070640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.072689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.080134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.081394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.082644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.084614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.085220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.085872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.099081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.117310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.123570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.129599 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd172145-2678-4b35-ac1a-c819a391513e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.638511 Aug 30 16:14:44.134203 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1183/2642] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:43 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:44.149665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.150582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.172215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.173095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.173732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.174722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.175420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.176007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.321049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.343738 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49b378d5-8aa6-4dd2-905e-773eed114bae tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.278032 Aug 30 16:14:44.344355 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1460/2643] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:44 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:44.353200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f33eb9c6-64b8-44d1-b944-c345719f813d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f33eb9c6-64b8-44d1-b944-c345719f813d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Request method failure captured: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action HTTP/1.1 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 34 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjc6u4dAMzDIXzrjHqBwCU-Tan80lpmxNP16vKlVs4gVz8HeVmXh6PoRo2rKnjF7I1uo9xxw8aQR9gmyHz6minX1_JVJKO6kTdEHDg56gunJPf4W_sgnbHoZQRx8HS6bhJGfx9USWzMsaXVSvvG4fDSAZjXe_VglFs_V7p3z4t9W97w Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}] Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f43b46ba684e4b9b870e0ad76072d72e Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: {"addFloatingIp": {"address": ""}} Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '61362efa-c071-4a8a-949a-bc7a915745d3', 'body': {'addFloatingIp': {'address': ''}}} Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '' Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:14:44.362815 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 16:14:44.369981 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.373852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f33eb9c6-64b8-44d1-b944-c345719f813d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:44.375152 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f33eb9c6-64b8-44d1-b944-c345719f813d tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 400 len: 142 microversion: 2.1 time: 0.029772 Aug 30 16:14:44.376238 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1461/2644] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:44 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 142 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:14:44.381383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.383048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.390605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.391384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.392156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.393753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.394398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.394983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.510410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.524799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.537540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.543551 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ac60a75-4ea6-427e-8a9e-fdefbb0247c8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.166106 Aug 30 16:14:44.562946 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1462/2645] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:44 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:44.592386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:44.596545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.607038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.607541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.607986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.608699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.609283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.609603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.657041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:14:44.657441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquired lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:14:44.796780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Releasing lock "refresh_cache-61362efa-c071-4a8a-949a-bc7a915745d3" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:14:44.797352 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] HTTP exception thrown: floating IP not found Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Request method failure captured: Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action HTTP/1.1 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 41 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjc6u4dAMzDIXzrjHqBwCU-Tan80lpmxNP16vKlVs4gVz8HeVmXh6PoRo2rKnjF7I1uo9xxw8aQR9gmyHz6minX1_JVJKO6kTdEHDg56gunJPf4W_sgnbHoZQRx8HS6bhJGfx9USWzMsaXVSvvG4fDSAZjXe_VglFs_V7p3z4t9W97w Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}] Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f43b46ba684e4b9b870e0ad76072d72e Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: exception: floating IP not found Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '61362efa-c071-4a8a-949a-bc7a915745d3', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 30 16:14:44.799195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Returning 404 to user: floating IP not found {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5c95325-8018-49da-8f57-49defbe2136e tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 404 len: 67 microversion: 2.1 time: 0.236591 Aug 30 16:14:44.804035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1463/2646] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:44 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 67 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:14:44.809775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.810628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.819486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.820242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.820680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.821379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.822014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.822466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.891835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.899252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:44.902409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3251ecb8-4521-4640-aa3e-c4f99c50e863 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1269 microversion: 2.1 time: 0.100255 Aug 30 16:14:44.903682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1464/2647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:44 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:44.909938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bbcc911-7aa6-4928-a441-c6c419667bdd tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Action: 'action', calling method: .version_select at 0x7fd35eaeb4c0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:44.966167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7bbcc911-7aa6-4928-a441-c6c419667bdd tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bbcc911-7aa6-4928-a441-c6c419667bdd tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Request method failure captured: Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action HTTP/1.1 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 44 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjc6u4dAMzDIXzrjHqBwCU-Tan80lpmxNP16vKlVs4gVz8HeVmXh6PoRo2rKnjF7I1uo9xxw8aQR9gmyHz6minX1_JVJKO6kTdEHDg56gunJPf4W_sgnbHoZQRx8HS6bhJGfx9USWzMsaXVSvvG4fDSAZjXe_VglFs_V7p3z4t9W97w Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}] Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f43b46ba684e4b9b870e0ad76072d72e Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: exception: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '61362efa-c071-4a8a-949a-bc7a915745d3', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 30 16:14:44.968284 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:44.972337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bbcc911-7aa6-4928-a441-c6c419667bdd tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:44.975892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bbcc911-7aa6-4928-a441-c6c419667bdd tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action" status: 404 len: 88 microversion: 2.1 time: 0.071149 Aug 30 16:14:44.976628 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1465/2648] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:14:44 2022] POST /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3/action => generated 88 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:14:44.986552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.987487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.003300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.004536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.005825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.006959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.007531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.008318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.038446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:45.134503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3f7b509-4077-4f4b-9475-2997048cc751 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "DELETE /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 204 len: 0 microversion: 2.1 time: 0.152385 Aug 30 16:14:45.135584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1466/2649] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:44 2022] DELETE /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:45.146244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.147655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.154690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.155206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.155652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.156400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.156871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.157331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.251303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.264806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.266185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.267546 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-142a3d3b-da14-470a-8d98-664953ac76c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 1.132331 Aug 30 16:14:45.268114 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1184/2650] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:44 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:45.290752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.292449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.305370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.306160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.306835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.307597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.308204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.308785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.316775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.327409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e098310-71a7-4935-9981-2acb7d775028 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1542 microversion: 2.1 time: 0.186445 Aug 30 16:14:45.343629 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1467/2651] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:45.367299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.368239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.375556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.376135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.376576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.377496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.378167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.378776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.518673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.527249 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1fc043d-87a7-4ceb-af95-bb0ba7242587 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.165077 Aug 30 16:14:45.528047 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1468/2652] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:45.584893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.585519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.591410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.591916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.592359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.593064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.593528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.593961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.641958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.651694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.653628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.655122 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3516200e-e485-4330-b702-d75bb8ef9c22 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.375670 Aug 30 16:14:45.655800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1185/2653] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:45.662918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.671353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.672955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.678295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69c1a8fb-6d73-485b-969e-8dd6996da274 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.097974 Aug 30 16:14:45.678933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1469/2654] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:45.930094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.931629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.940829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.941718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.943431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.944412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.946288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.946898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.037541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.045857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bde7f0db-bbef-4568-8436-f242c8155979 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1269 microversion: 2.1 time: 0.123776 Aug 30 16:14:46.046478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1186/2655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:46.072703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1f135f-887c-42de-959d-0185ff186938", "name": "network-vif-plugged", "status": "completed", "tag": "53886c53-8c18-4946-bf63-5dda24ea7583"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:46.084731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.085213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.085646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.096913 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] Creating event network-vif-plugged:53886c53-8c18-4946-bf63-5dda24ea7583 for instance 1f1f135f-887c-42de-959d-0185ff186938 on n-h2-830883-28 Aug 30 16:14:46.101911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-167056ab-f705-4a20-adaa-3d3705edd257 req-f9d0537c-ca41-4111-b78a-b0d98ec36cc4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Aug 30 16:14:46.102702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1470/2656] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:46.294772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:46.295645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:46.305995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.306676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.307356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.308549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.309294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.309980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.349968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:46.350791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:46.363650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.365049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.366778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.367784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.370986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.371717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.619119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.637172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.638652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.639842 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed4af60a-b65c-456d-b4f1-0cc506087b4a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.350896 Aug 30 16:14:46.640408 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1187/2657] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:46 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:46.655093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:46.655093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:46.664245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.673253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.673253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.673523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.674337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.674970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.675522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.679280 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd6f854a-fc2b-4abe-95ea-69728f1a2dc2 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1542 microversion: 2.1 time: 0.333755 Aug 30 16:14:46.694746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1471/2658] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:46 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:46.701535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:46.702554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:46.711781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.712638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.713633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.715423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.716147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.716837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.090678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.121379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85c4875e-0020-4915-95e4-be86710d68a6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.479882 Aug 30 16:14:47.124484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.125328 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1188/2659] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:46 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:47.135125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.136060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:47.136967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.139548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.144450 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-356b635e-23cc-48fd-85d2-7ed2e02fdc67 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.445839 Aug 30 16:14:47.147549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1472/2660] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:46 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:47.152764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.153625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.154268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.155361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.156021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.157053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.159665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.160298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:47.184982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.187393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.188472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.191409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.193334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.193879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.284442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.294465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.296294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.303223 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a83f9e50-7cc1-4207-b6ea-ed17d6b9850a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.175631 Aug 30 16:14:47.303934 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1189/2661] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:47 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:47.462511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.472263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91a4e807-7698-40d3-9f3c-6c0ec9dc2c0c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1311 microversion: 2.1 time: 0.323295 Aug 30 16:14:47.486252 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1473/2662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:47 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:47.666070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.666734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:47.682388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.683175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.688306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.689231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.689868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.690505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.702346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.705737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:47.720938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.728140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.728778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.729681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.730333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.730931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.959750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.981083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.984303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:47.987020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b673d1b0-d5dc-4ca7-a44f-23353c9dbbba tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.325597 Aug 30 16:14:47.987682 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1190/2663] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:47 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:48.070190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.081435 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-202f3ffd-1bb9-4d2f-8f90-b684b90adbb7 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1542 microversion: 2.1 time: 0.384278 Aug 30 16:14:48.082641 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1474/2664] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:47 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1542 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:48.151487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:48.152355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.159618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.160207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.160707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.165538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.166687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.167321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.175405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:48.177835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.189818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.190768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.191774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.195229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.196019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.196686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.648170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.678331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.682223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.687929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ff74b92-54cf-436c-a965-6074c834f8dd tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.522980 Aug 30 16:14:48.700027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1475/2665] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:48 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:48.727548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:48.728101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.736514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.743506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.743922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.744710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.745235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.745627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.828681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.840936 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bfda9fc1-d465-422c-9795-222cadd3386f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1316 microversion: 2.1 time: 0.692890 Aug 30 16:14:48.861036 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1191/2666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:48 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:48.870812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:48.873905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.894928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.896374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.896971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.898542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.899160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.899742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.947874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.960060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.961907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:48.967467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca421884-edb6-46ad-9302-a9dca58d5254 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.253797 Aug 30 16:14:48.968351 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1476/2667] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:48 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:49.014833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:49.015549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:49.030475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.031207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.032025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.033025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.033565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.034390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.305615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:49.325597 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a1c07ab-c326-462b-abc3-bdfaf20fd37f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.458614 Aug 30 16:14:49.326779 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1192/2668] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:48 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:49.344339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:49.345404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:49.362284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.362937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.363577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.365042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.365627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.367161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.499141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43b46ba684e4b9b870e0ad76072d72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f464e91bd08345b4b5dc759b294016c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:49.511200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1c89703-955c-4f29-9249-613beca28a02 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 200 len: 1500 microversion: 2.1 time: 0.181374 Aug 30 16:14:49.526691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1193/2669] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:49 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:49.595832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:49.612577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:49.614052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:49.631351 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f13261a1-e1f4-4959-8623-dc1f20ece892 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.608013 Aug 30 16:14:49.632020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1477/2670] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:49 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:49.719737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:49.720856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:49.733426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.734086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.734733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.735894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.736652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.737874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.743833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61362efa-c071-4a8a-949a-bc7a915745d3", "name": "network-vif-deleted", "tag": "296ff2c7-a694-42d2-b713-7cd99df8b5b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:49.761477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:49.766736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.767346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.773969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.803201 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] Creating event network-vif-deleted:296ff2c7-a694-42d2-b713-7cd99df8b5b0 for instance 61362efa-c071-4a8a-949a-bc7a915745d3 on n-h2-830883-28 Aug 30 16:14:49.814361 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-20a23e0d-a027-4d9d-93a6-1f42101c2a03 req-bd23f683-2e67-41d4-9eca-61eeac58bea4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075254 Aug 30 16:14:49.819318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1478/2671] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:14:49.869848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:49.871758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:49.885177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.888768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.890658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:49.891836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:49.894901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:49.895491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.308824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.320867 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b0653db-f59d-44c7-b082-204d321f2749 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1465 microversion: 2.1 time: 0.456554 Aug 30 16:14:50.339563 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1479/2672] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:49 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1465 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:50.347187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:50.351259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:50.366713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.369077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.369906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.373010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.373689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.374292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.511886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.545158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.550889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.572515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f10791e-d841-4932-b5c1-967a4a368d5b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.231622 Aug 30 16:14:50.574567 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1480/2673] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:50 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:50.580368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:50.581379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:50.590020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.591385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.592172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.593520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.594821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.609943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.717297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.738183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.748817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:50.750349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b6df15d-55f2-46af-8280-6cdda21b14d5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 1.038115 Aug 30 16:14:50.751182 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1194/2674] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:49 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:50.777094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:50.778096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:50.797212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.807556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.809786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:50.814691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:50.815260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:50.815830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.008808 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41ee5d3c-1da0-444e-9921-81f5df6f7f04 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1618 microversion: 2.1 time: 0.432836 Aug 30 16:14:51.011441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1481/2675] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:50 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1618 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:51.053922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:51.055738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] [instance: 61362efa-c071-4a8a-949a-bc7a915745d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:51.076278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.076696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.077185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.077913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.079191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.080016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.089637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:51.112767 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] HTTP exception thrown: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Request method failure captured: Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 HTTP/1.1 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjc6u4dAMzDIXzrjHqBwCU-Tan80lpmxNP16vKlVs4gVz8HeVmXh6PoRo2rKnjF7I1uo9xxw8aQR9gmyHz6minX1_JVJKO6kTdEHDg56gunJPf4W_sgnbHoZQRx8HS6bhJGfx9USWzMsaXVSvvG4fDSAZjXe_VglFs_V7p3z4t9W97w Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f464e91bd08345b4b5dc759b294016c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f464e91bd08345b4b5dc759b294016c4"}]}] Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f464e91bd08345b4b5dc759b294016c4 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734 Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f43b46ba684e4b9b870e0ad76072d72e Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '61362efa-c071-4a8a-949a-bc7a915745d3'} Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. Aug 30 16:14:51.121313 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. Aug 30 16:14:51.125933 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:14:51.129286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] Returning 404 to user: Instance 61362efa-c071-4a8a-949a-bc7a915745d3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:51.132597 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75c39d76-06fb-417c-9d58-336b1b914d81 tempest-FloatingIPsAssociationNegativeTestJSON-370033734 tempest-FloatingIPsAssociationNegativeTestJSON-370033734-project] 10.222.0.47 "GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3" status: 404 len: 111 microversion: 2.1 time: 0.117281 Aug 30 16:14:51.138071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1482/2676] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:51 2022] GET /compute/v2.1/servers/61362efa-c071-4a8a-949a-bc7a915745d3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:51.148777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:51.153590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:51.164215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.164945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.165640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.166585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.167243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.167896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.295357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.310074 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-912e9f60-8e47-48c7-8826-7b0e9f43070d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.554469 Aug 30 16:14:51.326533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1195/2677] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:50 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:51.331951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "9b75d5dd-b5a1-44aa-b140-428ef42dc6e7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:51.343744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.344478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.345078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.365452 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] Creating event network-vif-plugged:9b75d5dd-b5a1-44aa-b140-428ef42dc6e7 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:51.384011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-36a2aa30-1bcc-4eb0-85ef-801267ac0799 req-19cc0f6d-f934-4e3f-9366-f401369ff2e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055739 Aug 30 16:14:51.385167 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1196/2678] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:51.390717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2035471825", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2c146e18-6f96-4c5a-bbc6-ff7ef570db71"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:51.491628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:14:51.580064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.591393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.601157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.602589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f971c3b-6a39-4a45-af5f-fa8805fa722a tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.463176 Aug 30 16:14:51.618229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1483/2679] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:51 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:51.618229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:51.618999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:51.619757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:51.628005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.628693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.629276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.632453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.633064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.633623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.664600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:51.799980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.810120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.816030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:51.834009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fad065d2-ab3a-4fff-9453-4249e966d9a5 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.228719 Aug 30 16:14:51.835036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1484/2680] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:51 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:51.839719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:51.843625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:51.856362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.857363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.858888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:51.861667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:51.862268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:51.864162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.219960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:14:52.220512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:14:52.220861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:14:52.221393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:14:52.221814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:14:52.242416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:52.243214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:52.243825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.244777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:52.245411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:52.246259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.282445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:14:52.289875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Getting quotas for user f07ded691ce047bd857e8ff51aa88668 and project f17545909b3c4b559a571813e373cd09. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:14:52.326282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:14:52.330882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:14:52.463203 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-248ca148-a302-4375-95c5-71a4ead31a22 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074440 Aug 30 16:14:52.466087 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1197/2681] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:14:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:14:52.480881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:52.481950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:52.517051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:52.518098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:52.519402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.545653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:52.549691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:52.550873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.785250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:52.795225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:52.810535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:52.812577 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f115df3c-0aca-4b18-aa3a-e30be98fc4b3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.976392 Aug 30 16:14:52.813615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1485/2682] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:51 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:52.828957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1cc8692-5f93-446b-baae-6ac5f3a78943 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:52.833005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1cc8692-5f93-446b-baae-6ac5f3a78943 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:52.858033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:52.871048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:52.875879 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2ead70d5-3948-448e-a236-b54d40206a95 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.408222 Aug 30 16:14:52.877132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1198/2683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:52 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:52.885254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "tag": "bbdd798f-4e9b-409e-ba67-713aafd5808f"}, {"name": "network-changed", "server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "tag": "fa05a76a-4fb5-4611-b617-d06843eb3d52"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:52.901473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:52.902202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:52.902981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:52.935715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Creating event network-changed:bbdd798f-4e9b-409e-ba67-713aafd5808f for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:14:52.936403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] Creating event network-changed:fa05a76a-4fb5-4611-b617-d06843eb3d52 for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:14:52.949690 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a4643f91-942e-4d2f-87ec-edd52c838f3d req-837f60e2-8320-475d-9103-f25dccd5282e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070102 Aug 30 16:14:52.951989 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1199/2684] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:52.967733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:52.968125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1cc8692-5f93-446b-baae-6ac5f3a78943 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:52.971405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:52.977007 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1cc8692-5f93-446b-baae-6ac5f3a78943 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1217 microversion: 2.1 time: 0.162229 Aug 30 16:14:52.984056 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1486/2685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:52 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:52.988865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:52.990760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:53.005971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.009628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.010368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.011794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.014216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.015528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.017402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.018948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.022406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.023341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.023998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.024614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.278954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.287952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.289423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.302968 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b216e111-22dc-4027-8ece-79b07b6cd2d3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.317567 Aug 30 16:14:53.303578 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1487/2686] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:52 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:53.416067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "bf706539-23c6-4579-a131-4f6071e58ec8"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "f9a22e9e-f2ce-4969-bccc-323838f099f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:53.428159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.439557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.445702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.452980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.453791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.463275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:53.468278 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c23c8534-045f-452c-8321-73ae79ea8a1c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.513777 Aug 30 16:14:53.470355 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1200/2687] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:52 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:53.473534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Creating event network-vif-plugged:bf706539-23c6-4579-a131-4f6071e58ec8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:53.476747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Creating event network-vif-plugged:1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:53.479512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] Creating event network-vif-plugged:f9a22e9e-f2ce-4969-bccc-323838f099f8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:53.491735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8e58d59a-c6af-480d-9db1-3771142b5794 req-17b7ae10-bdf5-4408-9ea0-5b173f644d65 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.079765 Aug 30 16:14:53.506166 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1488/2688] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:14:53.853682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:53.854645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:53.875056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.876281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.877212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.878288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.878987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.879657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.901642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:53.903530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:53.914454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.915918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.918198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:53.918816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:53.919626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:53.922013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.092100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.104967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.106715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.108247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69955274-0e52-47ef-b40f-20e9d3ab392b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.275768 Aug 30 16:14:54.120483 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1201/2689] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:53 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:54.129380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:54.131579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:54.142573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.143337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.143979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.144882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.145530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.146554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.218125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.228458 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61967eb9-6059-45d5-8ca0-b48a6dc743f4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1269 microversion: 2.1 time: 0.105330 Aug 30 16:14:54.229050 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1202/2690] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:54 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:54.288789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.308109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f978d674-6207-4059-bede-5bab0509fca3 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.414137 Aug 30 16:14:54.308702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1489/2691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:53 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:54.335762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:54.336394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:54.342651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.343397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.344017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.344730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.345195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.345632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.428412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.437974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.440109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:54.446970 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df06c2b4-8894-42d3-8da8-c9f8b0222ab3 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.119800 Aug 30 16:14:54.463132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1203/2692] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:54 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:54.496441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:54.498156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:54.500329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:54.512668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.514569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.515095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:54.517989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:54.518574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:54.519069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.132709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:55.133631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:55.141105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.141601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.142034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.142770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.143224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.143650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.327732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.337574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.339061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.340251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78cb1988-f4c5-4231-a8c2-382182933eb7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.212348 Aug 30 16:14:55.340813 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1204/2693] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:55 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:14:55.341258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.346513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:55.347289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:55.355329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.355775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.356406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.357065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.357189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.358122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.358813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.359466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.362042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05f8e248-3c05-43d4-ae45-a473c1e415c9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.865947 Aug 30 16:14:55.365859 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1490/2694] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:54 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:55.378034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:55.378890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:55.402900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.403692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.407553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.408922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.415087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.415820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.488928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.499549 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd9dfde2-b1b2-439d-a06a-e13d71753c18 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1275 microversion: 2.1 time: 0.156689 Aug 30 16:14:55.500345 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1205/2695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:55 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1275 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:55.515308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:55.516107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:55.527864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.528366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.528810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.529527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.529985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.530445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.688982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.712836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.714290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:55.719747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a48763c5-e1f0-4a5e-9d85-cf521a711ebd tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.218593 Aug 30 16:14:55.734856 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1206/2696] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:55 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:55.745139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "15b97f03-f08d-4051-bbbf-dbdc86d23c04"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:55.756119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:55.756622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:55.757060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:55.790931 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] Creating event network-vif-plugged:15b97f03-f08d-4051-bbbf-dbdc86d23c04 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:55.807518 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8e54359c-b352-4218-8aa7-a89fb0015ce0 req-d411ef8f-e0f1-4707-8a50-6860738dab9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071250 Aug 30 16:14:55.810327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1207/2697] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:56.084401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.094458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-303575ff-dc39-47d9-b3e7-a9b8b207e40a tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.725876 Aug 30 16:14:56.096020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1491/2698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:55 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:56.370761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:56.372012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:56.378915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.379405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.379844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.381247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.381709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.382495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.405020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:56.407102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:56.422928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.423362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.424150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.424909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.425554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.426149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.538897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.547583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.549528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.550740 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0605f528-7626-4360-9b09-bfa38094dbf1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.188061 Aug 30 16:14:56.564493 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1208/2699] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:56 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:56.564493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:56.564493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:56.565038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.565714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.566334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.567225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.568541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.569604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.652577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.664905 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27b6ed2a-b311-4b04-892a-12cbfa475113 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1275 microversion: 2.1 time: 0.112080 Aug 30 16:14:56.674504 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1209/2700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:56 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:56.751512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:56.752419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:56.758817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.759443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.759982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.760789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:56.761349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:56.761876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:56.841418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.851924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.853679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:56.859769 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-575f226c-65e5-42dd-a9cc-9bfc7d40118f tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.112137 Aug 30 16:14:56.860757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1210/2701] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:56 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:57.016535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:57.032281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:57.035025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:57.038575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2a743aff-c66d-46d2-b18c-3d1509a0c10f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.647318 Aug 30 16:14:57.039686 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1492/2702] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:56 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:57.124036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:57.124986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:57.136374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.136953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.137556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.139404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.140030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.140475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.493575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:57.502472 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c2fd6d4-1226-4b15-bca1-2aed1550fca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.388522 Aug 30 16:14:57.515744 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1211/2703] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:57 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:57.580799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:57.582051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:57.597383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.598157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.599023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.601000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.601690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.602294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.687965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:57.688989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:57.696176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.696570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.697010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.697717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:57.698168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:57.698636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:57.971452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:57.979955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-131037f6-d134-453c-b40e-b05dc236f78c tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.295716 Aug 30 16:14:57.980478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1212/2704] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:57 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:58.004569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "73080464-a53a-4f5f-a6b6-6e893e0ca8be"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-plugged", "status": "completed", "tag": "b19c0404-0b11-4f1f-8b59-13ad213dcf6a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:58.034739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.035363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.035912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.076964 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Creating event network-vif-plugged:73080464-a53a-4f5f-a6b6-6e893e0ca8be for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:58.078126 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] Creating event network-vif-plugged:b19c0404-0b11-4f1f-8b59-13ad213dcf6a for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:14:58.088662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-828d8ba8-bd7b-4697-aee7-5813bfef0a9c req-a740a848-7f0f-4cb7-979a-3c0ee7e31fca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106080 Aug 30 16:14:58.089598 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1213/2705] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:58.101899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:58.102563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:58.111807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.112679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.112827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.113870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.113993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.115279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.162621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.180319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.182761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.184744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4024082-efb2-49f8-91cb-7b83f2c2bc90 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.608750 Aug 30 16:14:58.186400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1493/2706] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:57 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:58.192698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:58.194901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:58.227699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.228590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.229242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.230178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.232042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.232754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.251969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.276296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.282253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.301438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c133d6da-d25a-485f-bc3d-2c52e753259b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.209654 Aug 30 16:14:58.303193 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1214/2707] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:58 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:58.529887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:58.530739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:58.539460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:58.543097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.544358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.545644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.546634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:58.547461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:58.548290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:58.799760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.815824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.820841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.823651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa348a53-e762-465d-8f4e-9f6912775dee tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.635597 Aug 30 16:14:58.824939 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1494/2708] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:58 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:58.919112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:58.931693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f0e6ed5-f6f3-4e6a-bbf1-0e05054004f9 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.408146 Aug 30 16:14:58.933116 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1215/2709] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:58 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:59.005823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:59.008019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:59.014466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.015306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.015810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.016681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.017307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.017902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.216310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:59.217732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:59.230778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.231906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.232597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.233624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.235091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.235949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.497068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.511309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-006c275e-1961-4e9f-abb2-e1a9038e99ab tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.510906 Aug 30 16:14:59.518502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.534464 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1495/2710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:58 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:59.553931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.555064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:59.556848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.558208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9aed81da-c852-41bb-9ac4-8cfed74c1c03 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.348713 Aug 30 16:14:59.559230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:59.577549 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1216/2711] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:59 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:59.581388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.582272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.582487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.583040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.584125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.584561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.741163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.751703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.754106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:59.760114 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4498bee-696e-4391-9f52-bf2b193361ae tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.224094 Aug 30 16:14:59.761404 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1496/2712] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:59 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:14:59.852130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:59.852798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:59.860163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.860912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.861583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.862499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.863311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.865618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.902621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:59.955775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:59.956425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:59.963875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.964433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.964882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:59.965648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:59.966271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:59.966912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.298500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:00.314491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:00.320731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:00.324561 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c8fd9416-3cf5-4402-84f8-66721ad774d7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1875 microversion: 2.32 time: 0.475856 Aug 30 16:15:00.334963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1217/2713] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:14:59 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1875 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:00.340311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:00.372002 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-55342ab5-d851-44dd-b852-502b823a2160 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.420092 Aug 30 16:15:00.373615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1497/2714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:59 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:00.401288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f92a1a7-be54-4dc6-8846-3ba43434b812", "tag": "0eaf6274-4859-45a6-b7d3-41fc59aca632"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:00.416433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.417259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.422754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.436450 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] Creating event network-changed:0eaf6274-4859-45a6-b7d3-41fc59aca632 for instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 on n-h1-830883-28 Aug 30 16:15:00.451450 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5509f0f2-fe56-4048-87de-a7477f3f34da req-bdc63140-dde9-448c-8de8-331ae94e0b5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059070 Aug 30 16:15:00.453025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1218/2715] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:00.552706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:00.553652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:00.565884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.566434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.566896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.568177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.568651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.569092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.591703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:00.592468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:00.602922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.603427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.603870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.604581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.605046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.611021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.773753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:00.785289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5946469-b7ac-4e33-b7db-6720ac404bfc tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.240731 Aug 30 16:15:00.799426 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1498/2716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:00 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:00.806025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:00.806977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:00.813675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.814581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.815282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:00.816182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:00.816878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:00.817958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.005567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.021664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.024258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.043590 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cb92c6c-9b29-4168-9cab-575dbcf7922a tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.242617 Aug 30 16:15:01.044515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1499/2717] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:00 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:01.352996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:01.353991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:01.361009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.361829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.362539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.363495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.364165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.365506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.440472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.457010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.467733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.472042 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-340d2997-4251-413f-8c6d-31d815614388 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.883793 Aug 30 16:15:01.475721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1219/2718] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:00 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:01.480664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:01.484243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:01.499550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.500278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.500940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.501655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.502108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.502762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.627301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.637804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.639262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.640509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be2de47a-1038-4aee-b9ea-5137bc12e1e7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2831 microversion: 2.32 time: 0.292798 Aug 30 16:15:01.641079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1500/2719] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:01 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2831 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:01.666815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:01.667325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:01.673289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.673786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.675117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.676184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.676660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.677718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.701166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:01.810714 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34e85994-4207-486c-86dc-95337038bd03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.148099 Aug 30 16:15:01.823862 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1501/2720] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:15:01 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e/os-interface => generated 1833 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:01.829268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:01.831217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:01.838002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.838550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.839007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.839720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:01.840183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:01.840752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:01.887894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:01.900476 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-189b2ad8-7d3c-4bb8-91b8-bf93c14cbf7f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.423424 Aug 30 16:15:01.902829 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1220/2721] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:01 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:02.077843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:02.078839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:02.088958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.089906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.091313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.093224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.094417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.096603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.212750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.231669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.233579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.248326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf104ec6-146a-4273-af66-8abe3b459565 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.173534 Aug 30 16:15:02.249439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1221/2722] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:02 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:02.449812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.460782 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9041eef-b246-4d5b-9681-181c2ea3f265 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.635528 Aug 30 16:15:02.461747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1502/2723] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:01 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:02.498525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:02.499157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:02.501453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:02.502534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:02.510434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.510940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.511386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.512111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.512653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.513088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.801336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.810590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.812029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:02.813196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a3c872a-e2a3-44d3-a685-4d74269b4146 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.320987 Aug 30 16:15:02.814188 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1222/2724] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:02 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:02.930957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:02.932096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:02.956814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.957388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.957920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.958878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:02.959715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:02.960101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:02.985836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:03.275229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:03.275845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:03.283598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.284093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.284530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:03.285231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.285684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.286106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:03.376287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:03.389692 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f05e1af-f997-4266-a5ed-b3867dc00fab tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.466211 Aug 30 16:15:03.390272 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1503/2725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:02 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:03.413147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:03.428099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:03.430514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:03.439113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3020e29-8b4d-4196-a834-cea632512fed tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.167665 Aug 30 16:15:03.439848 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1223/2726] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:03 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:03.482873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:03.483646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:03.491390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.492391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.493454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:03.494621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.495491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.496108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:03.812576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:03.823926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5864178-d388-4285-bbe2-3f122bbe816f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.344342 Aug 30 16:15:03.825257 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1504/2727] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:03 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:03.846317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:03.846981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:03.859647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.861183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.861866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:03.867742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:03.868507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:03.869184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.057988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "tag": "9b75d5dd-b5a1-44aa-b140-428ef42dc6e7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:04.076617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.078411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.080637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.097320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] Creating event network-changed:9b75d5dd-b5a1-44aa-b140-428ef42dc6e7 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:15:04.104316 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-132fe314-cc23-4197-bb6d-981a4e3477ff req-4653c605-1588-4c14-9404-9c72a9c8bfc0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050155 Aug 30 16:15:04.109093 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1505/2728] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:04.295853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cc86da6-daf7-4dcd-9159-54e6254cf8e5"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:04.298434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:04.309646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.310177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.316512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.317355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.318867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.323643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.583447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:04.601278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:04.602872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:04.604349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b9fc6f2-0e1e-4cad-ae36-f342ee67a175 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.762918 Aug 30 16:15:04.605646 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1224/2729] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:03 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:04.610859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:04.611818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:04.619917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.620798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.621455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.622522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.626272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.637124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.796714 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2f9de42-422d-427c-9bce-b803c9fd0c19 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504094 Aug 30 16:15:04.812865 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1506/2730] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:15:04 2022] POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:04.822679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:04.823585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:04.836802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.837408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.837928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.839277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:04.839948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:04.840556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:04.955574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:04.989356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:04.991381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:05.007617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f31f9cb-e5a5-4e79-8823-722b808062f7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.192077 Aug 30 16:15:05.010549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1507/2731] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:04 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:05.023397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81168562-d222-4e57-93fe-0ed114cb6b29 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd357fe9820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:05.131882 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81168562-d222-4e57-93fe-0ed114cb6b29 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15" status: 200 len: 636 microversion: 2.1 time: 0.119579 Aug 30 16:15:05.135097 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1508/2732] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:15:05 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15 => generated 636 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:05.141223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:05.142232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:05.153455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:05.155453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:05.156154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:05.157087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:05.157746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:05.158701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:05.442247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:05.454609 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3acbacc9-89ac-4ab4-83e5-64129fbc7df2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.317945 Aug 30 16:15:05.455602 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1509/2733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:05 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:05.460850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0dc3c31f-ac8b-4375-a87a-e96d1c5b9dca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd357fe9430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:05.541579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0dc3c31f-ac8b-4375-a87a-e96d1c5b9dca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:05.554111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0dc3c31f-ac8b-4375-a87a-e96d1c5b9dca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:05.714232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:05.730100 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e18e191-8cce-4b69-8fbb-a3a36666039c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 1.123064 Aug 30 16:15:05.730726 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1225/2734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:04 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:05.741002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "name": "network-vif-plugged", "status": "completed", "tag": "bbdd798f-4e9b-409e-ba67-713aafd5808f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:05.775307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:05.776141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:05.776931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:05.790646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] Creating event network-vif-plugged:bbdd798f-4e9b-409e-ba67-713aafd5808f for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:15:05.796542 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f1a45ba5-eb8c-4984-98d3-fc32feca3675 req-85761974-7c35-43d7-9078-29d5cc76112b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060726 Aug 30 16:15:05.797934 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1226/2735] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:05.805561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:05.806673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:05.816198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:05.816959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:05.817825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:05.819054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:05.819973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:05.821035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.102411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0dc3c31f-ac8b-4375-a87a-e96d1c5b9dca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.645591 Aug 30 16:15:06.103343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1510/2736] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:05 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:06.108715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:06.109851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:06.119511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.121263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.122561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.124392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.125637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.126469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.242559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.255900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.257355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.272686 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05a11686-c55b-455d-a750-71c2e3e277e8 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.166205 Aug 30 16:15:06.274985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1511/2737] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:06 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:06.291524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de29cb72-22e7-4cca-a2ea-2eab63271631 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35c069e50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:06.479688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.494073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.496808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.498372 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ecddc8d-0b81-4a6d-a280-133ab9b7aea5 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.698933 Aug 30 16:15:06.506824 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1227/2738] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:05 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:06.528765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:06.530389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:06.541050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.542605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.544332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.545680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.546526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.547420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.773645 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de29cb72-22e7-4cca-a2ea-2eab63271631 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "DELETE /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.496733 Aug 30 16:15:06.774838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1512/2739] 10.222.0.47 () {58 vars in 1296 bytes} [Tue Aug 30 16:15:06 2022] DELETE /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_version => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:06.782518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031e4e54-ce97-4a23-b247-2fa283242c02", "name": "network-vif-unplugged", "status": "completed", "tag": "88bc17db-c681-49fc-a483-5b25f219c7e9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:06.794405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.795949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.796549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.813075 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] Creating event network-vif-unplugged:88bc17db-c681-49fc-a483-5b25f219c7e9 for instance 031e4e54-ce97-4a23-b247-2fa283242c02 on n-h1-830883-28 Aug 30 16:15:06.819969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-df0ccf99-cc9f-46c0-976e-98a076e78039 req-05b9390e-6505-4563-a184-dbbd71e7b49c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043099 Aug 30 16:15:06.821165 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1513/2740] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:06.836212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:06.836940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:06.844757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.845760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.846392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.847241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:06.847804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:06.848401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:06.955116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:06.969961 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-406467a9-946f-41ef-aeb2-b2e45a144121 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.460896 Aug 30 16:15:06.971594 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1228/2741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:06 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:06.976594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29e89b53-a433-4013-9ac8-7a51e8c65c3b tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35d7e4af0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.026548 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29e89b53-a433-4013-9ac8-7a51e8c65c3b tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 37 microversion: 2.1 time: 0.053177 Aug 30 16:15:07.028844 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1229/2742] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:06 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:07.034255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.041717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5339d86f-ccac-4657-b71d-c22f5dd7e1ac tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd35c4b4040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:07.045153 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9930dba3-6692-4183-a0de-7f2e2d925ca8 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.221665 Aug 30 16:15:07.070079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1514/2743] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:06 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:07.124500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5339d86f-ccac-4657-b71d-c22f5dd7e1ac tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:07.133081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5339d86f-ccac-4657-b71d-c22f5dd7e1ac tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:07.307199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.308543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:07.324990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.325760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.326893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.330340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.331141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.331752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.431542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.441532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.445846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.452145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d76d80a-16bf-4214-a592-f18100649a52 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1446 microversion: 2.75 time: 0.151930 Aug 30 16:15:07.453819 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1515/2744] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:07.481983 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5339d86f-ccac-4657-b71d-c22f5dd7e1ac tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.445699 Aug 30 16:15:07.488747 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1230/2745] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:07 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:15:07.493061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dec00fed-93e5-458b-b3e4-2197651a6d1a tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35c03d430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.533148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.534139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:07.543664 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dec00fed-93e5-458b-b3e4-2197651a6d1a tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.055183 Aug 30 16:15:07.544316 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1516/2746] 10.222.0.47 () {58 vars in 1290 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_distro => generated 33 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:15:07.550604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.551222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.551588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.555423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.556024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.556481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.559791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93e172da-a36c-436e-8957-367b3dce3a1e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd357fcee50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:07.646148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-93e172da-a36c-436e-8957-367b3dce3a1e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:07.653793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-93e172da-a36c-436e-8957-367b3dce3a1e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:07.789234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.799815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.802787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:07.804316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5bcd23d7-057f-43d2-9729-3880c34aa4e0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.275628 Aug 30 16:15:07.819602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1231/2747] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:07.856480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "name": "network-vif-plugged", "status": "completed", "tag": "fa05a76a-4fb5-4611-b617-d06843eb3d52"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:07.867505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:07.868374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:07.869046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:07.898903 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] Creating event network-vif-plugged:fa05a76a-4fb5-4611-b617-d06843eb3d52 for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:15:07.914179 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f350dda4-9ff3-4923-85a8-281cd43fad72 req-76edbb57-2f06-4567-878c-cd1d38c52e60 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063555 Aug 30 16:15:07.915306 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1232/2748] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:07.944331 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93e172da-a36c-436e-8957-367b3dce3a1e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.390666 Aug 30 16:15:07.945575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1517/2749] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:07 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:07.956106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-284e8ef2-e56f-4618-b26d-2f45a017afbe tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35ce7de50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.994939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:07.995504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:08.004312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.005663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.006035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.008974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.009573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.010025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.027661 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-284e8ef2-e56f-4618-b26d-2f45a017afbe tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076412 Aug 30 16:15:08.030416 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1233/2750] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:08.043171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfc95486-5d8b-4a11-bdd0-ecf6273b5462 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd35d22c280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:08.105836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bfc95486-5d8b-4a11-bdd0-ecf6273b5462 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:08.111473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bfc95486-5d8b-4a11-bdd0-ecf6273b5462 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:08.353824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bfc95486-5d8b-4a11-bdd0-ecf6273b5462 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.315967 Aug 30 16:15:08.354608 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1234/2751] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:08 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:08.359453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:08.360324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:08.367474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.368218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.368830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.369688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.370296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.370899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.373090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:08.384817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9b2a83d-9a0c-48c6-8d35-a983fa0fecb4 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.395126 Aug 30 16:15:08.385874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1518/2752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:07 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:08.407740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd173cbb-fd39-4931-af73-c299405fc911 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd35c03fe50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:08.479166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-dd173cbb-fd39-4931-af73-c299405fc911 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:08.485411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-dd173cbb-fd39-4931-af73-c299405fc911 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:08.662456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:08.673354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ca81b3c-7c3b-41d6-955d-2d81513c8cf5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.317489 Aug 30 16:15:08.688066 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1235/2753] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:08.694215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:08.703175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:08.717400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.718318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.718794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.720161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.720748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.721197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.829589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:08.845317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:08.847418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:08.856882 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-87c1aa90-5cde-475c-a624-56bbd6b9126b tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1452 microversion: 2.75 time: 0.167578 Aug 30 16:15:08.866415 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1236/2754] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:08.866415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:08.866415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:08.871658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.871658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.871658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.871658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.872092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.872324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.905459 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd173cbb-fd39-4931-af73-c299405fc911 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 64 microversion: 2.1 time: 0.503466 Aug 30 16:15:08.906361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1519/2755] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:08 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 64 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:08.912004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031e4e54-ce97-4a23-b247-2fa283242c02", "tag": "88bc17db-c681-49fc-a483-5b25f219c7e9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:08.923778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:08.924463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:08.925055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:08.942454 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] Creating event network-changed:88bc17db-c681-49fc-a483-5b25f219c7e9 for instance 031e4e54-ce97-4a23-b247-2fa283242c02 on n-h1-830883-28 Aug 30 16:15:08.948871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8861fefc-950e-4e7f-953f-b5e0b1917f22 req-f142174d-3e3e-42ce-bccd-5047d6186ca8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041145 Aug 30 16:15:08.949790 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1520/2756] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:08.957159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f18acded-c293-4763-a738-05c6e7a32aca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35d21fdc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:09.009277 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f18acded-c293-4763-a738-05c6e7a32aca tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 64 microversion: 2.1 time: 0.058000 Aug 30 16:15:09.010351 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1521/2757] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 64 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:09.022273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f80bbe8b-89ff-4281-8cbe-0ae451cb933c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd357fe95e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:09.087948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f80bbe8b-89ff-4281-8cbe-0ae451cb933c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:09.088495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:09.097533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:09.098100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f80bbe8b-89ff-4281-8cbe-0ae451cb933c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:09.099074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:09.100292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b492fc0-8738-44b2-b530-877b47593665 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.241723 Aug 30 16:15:09.102922 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1237/2758] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:08 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:09.406815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:09.407367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:09.421165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.421630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.422257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:09.423112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.423573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.424171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:09.446964 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f80bbe8b-89ff-4281-8cbe-0ae451cb933c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.430017 Aug 30 16:15:09.448247 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1522/2759] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:09 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:09.459334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2e98238-3b52-4e8e-aedc-ea33fbbdba97 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update', calling method: .version_select at 0x7fd35c0ca670>, body: {"meta": {"os_version": "alt"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:09.519012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a2e98238-3b52-4e8e-aedc-ea33fbbdba97 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:09.525415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a2e98238-3b52-4e8e-aedc-ea33fbbdba97 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:09.696547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:09.712774 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-898780f8-7c6c-4ea0-9349-59e5ffb86f54 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.307639 Aug 30 16:15:09.729316 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1238/2760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:09 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:09.736087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:09.737443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:09.746697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.747571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.748510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:09.749926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.751676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.752401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:09.821689 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2e98238-3b52-4e8e-aedc-ea33fbbdba97 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.367099 Aug 30 16:15:09.822647 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1523/2761] 10.222.0.47 () {60 vars in 1313 bytes} [Tue Aug 30 16:15:09 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata/os_version => generated 31 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:09.835688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5cfad73b-2c49-40e2-a0cf-575c66eb3c86 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd357fe9f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:09.896345 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5cfad73b-2c49-40e2-a0cf-575c66eb3c86 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 58 microversion: 2.1 time: 0.066192 Aug 30 16:15:09.903062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1524/2762] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:09 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 58 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:09.913856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:09.914872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:09.917480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:09.923572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.924076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.924525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:09.925240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:09.925757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:09.926193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.000988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.012353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.013966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.019832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ed6d10e8-4b4c-4544-ab14-064f6e387c40 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1452 microversion: 2.75 time: 0.112524 Aug 30 16:15:10.021186 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1525/2763] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:09 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:10.025107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.032935 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7883fe6b-b955-4cd2-8347-c59b6cbbb3bf tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1332 microversion: 2.1 time: 0.302171 Aug 30 16:15:10.042535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-92832882-002a-4f18-9b19-9d8f21da253c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'update_all', calling method: .version_select at 0x7fd35c069a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:10.048593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1239/2764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:09 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:10.055266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f92a1a7-be54-4dc6-8846-3ba43434b812", "name": "network-vif-plugged", "status": "completed", "tag": "0eaf6274-4859-45a6-b7d3-41fc59aca632"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:10.065449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:10.066201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:10.066871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.071719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:10.083515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] Creating event network-vif-plugged:0eaf6274-4859-45a6-b7d3-41fc59aca632 for instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 on n-h1-830883-28 Aug 30 16:15:10.089222 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e65b5a8b-373d-42dd-a620-c616e5c8a8a1 req-e5a5bfc7-442f-4dfe-9edc-953fe5cc2b87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039110 Aug 30 16:15:10.090697 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1240/2765] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:10.110200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-92832882-002a-4f18-9b19-9d8f21da253c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:10.116367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-92832882-002a-4f18-9b19-9d8f21da253c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:10.125747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:10.127215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:10.136147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:10.137233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:10.139436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.140401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:10.141077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:10.141739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.456728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.475107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-92832882-002a-4f18-9b19-9d8f21da253c tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.451554 Aug 30 16:15:10.477718 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1526/2766] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:10 2022] PUT /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 61 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:10.478164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.480578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:10.488708 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05626d21-d7fd-467c-a898-154992434127 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.366609 Aug 30 16:15:10.490422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b077a0f0-365d-474b-b5e8-a8d488e6154e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Action: 'create', calling method: .version_select at 0x7fd357fe9f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:10.512446 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1241/2767] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:10 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:10.557096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b077a0f0-365d-474b-b5e8-a8d488e6154e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:10.564421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b077a0f0-365d-474b-b5e8-a8d488e6154e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Getting quotas for user 4cf0ab90d08546b4bfa8f573b95ad18b and project 844ead5f7fe547e29efebc2a6688de61. Resources: dict_keys(['metadata_items']) {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:10.735994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:10.737079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:10.744776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:10.745527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:10.746381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.747461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:10.748141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:10.748770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:10.908977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b077a0f0-365d-474b-b5e8-a8d488e6154e tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "POST /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 85 microversion: 2.1 time: 0.426107 Aug 30 16:15:10.909829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1527/2768] 10.222.0.47 () {60 vars in 1281 bytes} [Tue Aug 30 16:15:10 2022] POST /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 85 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:10.920397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4339dff7-f328-4607-a304-f27a78e31ec4 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] Calling method '.version_select at 0x7fd35c03dee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:10.984297 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4339dff7-f328-4607-a304-f27a78e31ec4 tempest-ImagesMetadataTestJSON-85938858 tempest-ImagesMetadataTestJSON-85938858-project] 10.222.0.47 "GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067500 Aug 30 16:15:10.985412 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1528/2769] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:10 2022] GET /compute/v2.1/images/0e4e094a-89f7-42cf-8566-dab3ffa91a15/metadata => generated 85 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:15:11.048303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:11.049789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:11.060077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.060077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.060077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.060841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.061301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.061729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.263200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.277115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.283294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.296992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b168097-574d-460c-8036-f7fe764f0306 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1452 microversion: 2.75 time: 0.252879 Aug 30 16:15:11.299805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1529/2770] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:11 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1452 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:11.316905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:11.322117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:11.328614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.337595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14228a5a-9a6e-4692-88b6-7e10fd8f744a tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.605028 Aug 30 16:15:11.349141 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1242/2771] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:10 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:11.352367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.358190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.363377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.366168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.366696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.367533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.512919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:11.514148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:11.536881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.537828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.538281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.539327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.540073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.541336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.727356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.736624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.738456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.740167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09a11507-bcdb-477e-ac97-1f1161df87bf tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.231637 Aug 30 16:15:11.743705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:11.774185 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3e0f3b9-2f8a-415e-930a-ef7eef4e24bd tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1667 microversion: 2.1 time: 0.467205 Aug 30 16:15:11.774623 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1243/2772] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:11 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:11.779075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1530/2773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:11 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1667 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:11.803167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:11.803936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:11.810398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.811213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.811926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.812780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.813393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.813974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.843221 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27f4f580-6665-48ac-a99b-027cfec0f614 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020/ips" status: 200 len: 179 microversion: 2.1 time: 0.044322 Aug 30 16:15:11.851625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1244/2774] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:15:11 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020/ips => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:11.857584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:11.858109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:11.867331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.868072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.868606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.869386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:11.869913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:11.870474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:11.902839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:11.907570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:12.047119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1373f48-68d6-4e9d-a8f5-b0a045e5498c tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 204 len: 0 microversion: 2.1 time: 0.193923 Aug 30 16:15:12.059321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:12.059874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:12.062414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1531/2775] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:11 2022] DELETE /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:15:12.067527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.068308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.068999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.070629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.071121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.071561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.328859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:12.329977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:12.338105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.338517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.339173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.340403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.340972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.341591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.344629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:12.356067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a89d4051-b35f-4ccc-a88e-adb348a16d1d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1673 microversion: 2.1 time: 0.301635 Aug 30 16:15:12.358031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1245/2776] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:12 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:12.375859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:12.376785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:12.386900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.387480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.388245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.389148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.389840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.391238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.493083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:12.510864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:12.513434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:12.522701 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da7eae95-3436-426c-b005-f22f98963183 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1437 microversion: 2.75 time: 0.198454 Aug 30 16:15:12.524634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1532/2777] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:12 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1437 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:12.618696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:12.642684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a7fce8bc-9234-41c3-8905-156c083559da tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1317 microversion: 2.1 time: 0.283334 Aug 30 16:15:12.643231 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1246/2778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:12 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:12.793263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:12.793888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:12.805967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.806506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.806957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:12.807658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:12.808116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:12.808544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.125054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:13.126710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:13.130010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:13.136123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:13.137816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:13.139198 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a2602a7-a1f3-4b52-bf78-5f5176dd666b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.349814 Aug 30 16:15:13.139913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1247/2779] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:12 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:13.142989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.145143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.145737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.147156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.147740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.148420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.265584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:15:13.266098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:15:13.266801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:15:13.267322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:15:13.268149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:15:13.346020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:13.354116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.354636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.355243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.356115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.356628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.357253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.379099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:13.380995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:13.390443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.395522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.399478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.400451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.401100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.401721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.603754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:13.615360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52a68bca-da28-4f0d-9329-d10d0e41f5db tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1673 microversion: 2.1 time: 0.239487 Aug 30 16:15:13.617246 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1248/2780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:13 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:13.689515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:13.745714 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-106f7f63-b3c4-4183-9ea5-d87c9756033e tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db/action" status: 202 len: 1942 microversion: 2.75 time: 1.199160 Aug 30 16:15:13.747004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1533/2781] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:15:12 2022] POST /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db/action => generated 1942 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 30 16:15:13.762165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:13.763090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:13.769934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.770461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.771221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.771918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.772380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.772813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.844390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-573b5408-32a4-4668-8988-abeb2db9f802 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Calling method '.version_select at 0x7fd35cc769d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:13.878144 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-573b5408-32a4-4668-8988-abeb2db9f802 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-573b5408-32a4-4668-8988-abeb2db9f802 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/ec70aa37-8528-42d2-8a0b-3373afeace8f/metadata/os_distro HTTP/1.1 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'image_id': 'ec70aa37-8528-42d2-8a0b-3373afeace8f', 'id': 'os_distro'} Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ec70aa37-8528-42d2-8a0b-3373afeace8f Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:13.887272 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ec70aa37-8528-42d2-8a0b-3373afeace8f could not be found. Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:13.892051 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:13.896737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-573b5408-32a4-4668-8988-abeb2db9f802 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:13.897827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-573b5408-32a4-4668-8988-abeb2db9f802 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "DELETE /compute/v2.1/images/ec70aa37-8528-42d2-8a0b-3373afeace8f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.279613 Aug 30 16:15:13.898610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1249/2782] 10.222.0.47 () {58 vars in 1293 bytes} [Tue Aug 30 16:15:13 2022] DELETE /compute/v2.1/images/ec70aa37-8528-42d2-8a0b-3373afeace8f/metadata/os_distro => generated 62 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:13.911273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:13.912328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:13.921531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.922051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.922523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:13.923263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:13.923717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:13.924152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.029759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:14.044784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f2da6f2-74c7-4af6-9e78-cc040bbb6480 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1466 microversion: 2.1 time: 0.293581 Aug 30 16:15:14.045375 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1534/2783] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:13 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1466 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:14.050193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bee8886a-1f4f-402b-bc1f-4a81201e7323 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Calling method '.version_select at 0x7fd35c086f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.073317 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-bee8886a-1f4f-402b-bc1f-4a81201e7323 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bee8886a-1f4f-402b-bc1f-4a81201e7323 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/images/e6cc4c14-299f-4d21-8937-2c5d73799791/metadata/os_version HTTP/1.1 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'image_id': 'e6cc4c14-299f-4d21-8937-2c5d73799791', 'id': 'os_version'} Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e6cc4c14-299f-4d21-8937-2c5d73799791 Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:14.075991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6cc4c14-299f-4d21-8937-2c5d73799791 could not be found. Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:14.079789 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.084607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bee8886a-1f4f-402b-bc1f-4a81201e7323 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:14.085732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bee8886a-1f4f-402b-bc1f-4a81201e7323 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "GET /compute/v2.1/images/e6cc4c14-299f-4d21-8937-2c5d73799791/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039142 Aug 30 16:15:14.086896 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1535/2784] 10.222.0.47 () {58 vars in 1293 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/images/e6cc4c14-299f-4d21-8937-2c5d73799791/metadata/os_version => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:14.095883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.096877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:14.108031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.109048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.109955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.111295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.111996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.113259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.136306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:14.166849 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2de23085-0440-4cbe-9c6d-50b47a78f86d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.266381 Aug 30 16:15:14.168811 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1250/2785] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:13 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:14.174233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0cf55403-d626-4f17-922a-3cc4ae683f80 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Calling method '.version_select at 0x7fd35d4f8550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.229257 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0cf55403-d626-4f17-922a-3cc4ae683f80 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0cf55403-d626-4f17-922a-3cc4ae683f80 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/images/844660b0-cfd0-40b3-8fff-da00c36fcfb6/metadata HTTP/1.1 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'image_id': '844660b0-cfd0-40b3-8fff-da00c36fcfb6'} Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 844660b0-cfd0-40b3-8fff-da00c36fcfb6 Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:14.232171 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 844660b0-cfd0-40b3-8fff-da00c36fcfb6 could not be found. Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:14.236440 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.247386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0cf55403-d626-4f17-922a-3cc4ae683f80 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:14.248465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0cf55403-d626-4f17-922a-3cc4ae683f80 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "GET /compute/v2.1/images/844660b0-cfd0-40b3-8fff-da00c36fcfb6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.078468 Aug 30 16:15:14.249660 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1251/2786] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/images/844660b0-cfd0-40b3-8fff-da00c36fcfb6/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:14.257488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.258655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:14.267383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.268157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.268826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.270831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.272249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.274686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.401003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a885420-1217-4720-8c56-87341137ea42 tempest-ServersOnMultiNodesTest-218762612 tempest-ServersOnMultiNodesTest-218762612-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1619 microversion: 2.1 time: 0.312744 Aug 30 16:15:14.401556 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1536/2787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1619 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:14.406510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a651476f-0e99-4d0b-89fc-0c8dae464ff7 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Action: 'update_all', calling method: .version_select at 0x7fd35c04ad30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:14.439919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a651476f-0e99-4d0b-89fc-0c8dae464ff7 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a651476f-0e99-4d0b-89fc-0c8dae464ff7 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/images/d12690af-7a2e-41c8-bd14-4dc5ae2ad8e4/metadata HTTP/1.1 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 57 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'image_id': 'd12690af-7a2e-41c8-bd14-4dc5ae2ad8e4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d12690af-7a2e-41c8-bd14-4dc5ae2ad8e4 Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:14.442731 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d12690af-7a2e-41c8-bd14-4dc5ae2ad8e4 could not be found. Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a651476f-0e99-4d0b-89fc-0c8dae464ff7 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a651476f-0e99-4d0b-89fc-0c8dae464ff7 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "PUT /compute/v2.1/images/d12690af-7a2e-41c8-bd14-4dc5ae2ad8e4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.042383 Aug 30 16:15:14.447724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1537/2788] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:14 2022] PUT /compute/v2.1/images/d12690af-7a2e-41c8-bd14-4dc5ae2ad8e4/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:14.452798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.456340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:14.466937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.467746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.468435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.469284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.469792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.470787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.507084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:14.633011 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7303b89-db3d-411d-9484-40045efedb99 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 204 len: 0 microversion: 2.1 time: 0.184648 Aug 30 16:15:14.634473 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1538/2789] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:14 2022] DELETE /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:14.644704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba59a55f-d975-4d6e-b9bb-f98642a39b8b tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Action: 'update', calling method: .version_select at 0x7fd360f15790>, body: {"meta": {"os_distro": "alt"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:14.680130 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ba59a55f-d975-4d6e-b9bb-f98642a39b8b tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba59a55f-d975-4d6e-b9bb-f98642a39b8b tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/images/305c52a6-cd4c-4f62-ad31-4a95f78d8e61/metadata/os_distro HTTP/1.1 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 30 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: {"meta": {"os_distro": "alt"}} Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'image_id': '305c52a6-cd4c-4f62-ad31-4a95f78d8e61', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 305c52a6-cd4c-4f62-ad31-4a95f78d8e61 Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:14.682727 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 305c52a6-cd4c-4f62-ad31-4a95f78d8e61 could not be found. Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:14.689261 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:14.695379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba59a55f-d975-4d6e-b9bb-f98642a39b8b tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:14.696751 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba59a55f-d975-4d6e-b9bb-f98642a39b8b tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "PUT /compute/v2.1/images/305c52a6-cd4c-4f62-ad31-4a95f78d8e61/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.060093 Aug 30 16:15:14.697629 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1539/2790] 10.222.0.47 () {60 vars in 1310 bytes} [Tue Aug 30 16:15:14 2022] PUT /compute/v2.1/images/305c52a6-cd4c-4f62-ad31-4a95f78d8e61/metadata/os_distro => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:14.705909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.706897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:14.716421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.717217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.718048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.719107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.719744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.720145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.744832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:14.763471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:14.772987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:14.776186 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-061ede3f-0ce5-4cdc-b65a-cf8087c51400 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.525206 Aug 30 16:15:14.779803 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1252/2791] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:14.791587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:14.793283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:14.808013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.809850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.810994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.812113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:14.812802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:14.814297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:14.985616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:15.000285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bff7491-ebc2-449a-a29a-da741cd47481 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1673 microversion: 2.1 time: 0.300935 Aug 30 16:15:15.001529 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1540/2792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1673 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:15.008724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48cb8d3a-83ad-4ee1-b678-514d807437b1 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Action: 'create', calling method: .version_select at 0x7fd35c03d040>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:15.035966 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-48cb8d3a-83ad-4ee1-b678-514d807437b1 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] HTTP exception thrown: Image not found. Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48cb8d3a-83ad-4ee1-b678-514d807437b1 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Request method failure captured: Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/images/efb22719-e9bf-409b-a336-aa3dccc4cbf2/metadata HTTP/1.1 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 57 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeROxR7UAZ3-futMbMBBzpHQ7oOIaCa89DTRJGsm6UeNYQedMfQyxLKSXjrryTUmVO_8mFblOq68pFSlnuQpe0nCH7YznVQtf4qCc0Z6M825n0aWxsivq4Ob89kz71_mzjWiJ__By0YCGdbZIAsOBu3p8tnQCC9-cEc30IQp_EInrY Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4de088758f7c4333948b9e9d200a5508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4de088758f7c4333948b9e9d200a5508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4de088758f7c4333948b9e9d200a5508"}]}] Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 4de088758f7c4333948b9e9d200a5508 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-292914749 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d49d92193cbd49d5ba20e6b158d6e440 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-292914749-project Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'image_id': 'efb22719-e9bf-409b-a336-aa3dccc4cbf2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID efb22719-e9bf-409b-a336-aa3dccc4cbf2 Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:15:15.039400 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image efb22719-e9bf-409b-a336-aa3dccc4cbf2 could not be found. Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:15.045932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48cb8d3a-83ad-4ee1-b678-514d807437b1 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:15.051070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48cb8d3a-83ad-4ee1-b678-514d807437b1 tempest-ImagesMetadataNegativeTestJSON-292914749 tempest-ImagesMetadataNegativeTestJSON-292914749-project] 10.222.0.47 "POST /compute/v2.1/images/efb22719-e9bf-409b-a336-aa3dccc4cbf2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044738 Aug 30 16:15:15.051070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1541/2793] 10.222.0.47 () {60 vars in 1281 bytes} [Tue Aug 30 16:15:15 2022] POST /compute/v2.1/images/efb22719-e9bf-409b-a336-aa3dccc4cbf2/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:15.199484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:15.200287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:15.208393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:15.208974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:15.209371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:15.210167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:15.210736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:15.211192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:15.212578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:15.220643 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3bc14d07-89c3-482a-a70b-e9df4b306535 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1472 microversion: 2.1 time: 0.439583 Aug 30 16:15:15.229521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1253/2794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:14 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:15.301425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:15.329112 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfaea7f5-0302-4942-8b32-b1eb68f42d09 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.134681 Aug 30 16:15:15.329695 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1542/2795] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:15 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:15.535218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "name": "network-vif-deleted", "tag": "bbdd798f-4e9b-409e-ba67-713aafd5808f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:15.549525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:15.550118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:15.550720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:15.565840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] Creating event network-vif-deleted:bbdd798f-4e9b-409e-ba67-713aafd5808f for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:15:15.571738 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bb9ad4f2-2bda-441e-aedd-fddf5b914f30 req-93cf7b02-6feb-46c5-9206-7ceec5b8abec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040543 Aug 30 16:15:15.572671 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1254/2796] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:15.809333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:15.815447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:15.835553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:15.836218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:15.836770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:15.837587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:15.838163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:15.838704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.027801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:16.028645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:16.062443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.063011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.063506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.064242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.064680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.069970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.086622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:16.102206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:16.118350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:16.120218 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5f53cca-dd88-408d-9bdc-f749ecc1d822 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.319674 Aug 30 16:15:16.122158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1543/2797] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:15 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:16.253841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:16.255529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:16.265486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.267017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.267760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.268878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.269630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.270395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.533954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:16.543511 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10f41c31-9694-405a-9004-c3b497e6d03b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1472 microversion: 2.1 time: 0.293885 Aug 30 16:15:16.544921 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1544/2798] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:16 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:16.552412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:16.553532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:16.562036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.562973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.563750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.564669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:16.565473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:16.566278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:16.650866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:16.664674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85bae750-6a54-45d9-9530-25e964e3ef9e tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1494 microversion: 2.1 time: 0.640412 Aug 30 16:15:16.665465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1255/2799] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:16 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1494 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:16.687592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:16.697392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:16.725609 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd10818d-ede9-457e-b2c4-2dfd8fe4d15f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.178396 Aug 30 16:15:16.726453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1545/2800] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:16 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:17.150188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:17.150875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:17.157497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.158120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.158704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.159403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.159857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.160282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.245728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Calling method '.version_select at 0x7fd360f24700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:17.263746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.264935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.264935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.271815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.272604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.273263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.309670 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36ae38ee-24f5-4384-953e-a62358b8d993 tempest-AbsoluteLimitsTestJSON-2105255833 tempest-AbsoluteLimitsTestJSON-2105255833-project] 10.222.0.47 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.215285 Aug 30 16:15:17.323631 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1256/2801] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 16:15:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:17.331314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:17.341608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:17.343243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:17.344419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e101cb6d-8fa0-442d-9662-bc00935447fe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.203071 Aug 30 16:15:17.344990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1546/2802] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:17 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:17.573925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:17.574599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:17.584830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:17.587311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.587845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.588296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.590068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.590647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.591247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.691115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:17.692018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:17.716739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.718752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.719591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.720576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.721317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.721769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.798996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b0dab09f5e47ccbe1e9385edbe6cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd97ef9096e541b48a9f24ddfe666b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:17.825232 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d913353f-b957-40a6-8172-d27fe16799f5 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 200 len: 1296 microversion: 2.1 time: 0.141303 Aug 30 16:15:17.825830 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1547/2803] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:17 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:17.830821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:17.831425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:17.854939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.855484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.855949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.856705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:17.857161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:17.857596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:17.993556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:18.016077 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bda595c-0543-42c0-bb94-402db42139b2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.189129 Aug 30 16:15:18.017009 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1548/2804] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:17 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:18.022731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc08c2-2efa-401e-bf24-6c76fd9a7020", "name": "network-vif-deleted", "tag": "fa05a76a-4fb5-4611-b617-d06843eb3d52"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:18.037014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:18.037621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:18.038067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:18.053097 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] Creating event network-vif-deleted:fa05a76a-4fb5-4611-b617-d06843eb3d52 for instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 on n-h2-830883-28 Aug 30 16:15:18.065741 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f36ad1a7-99ad-4f25-8e44-704e8e5f0ea3 req-edb024ce-a104-405b-9ef1-008e46997e0a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044211 Aug 30 16:15:18.066737 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1549/2805] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:18.376261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:18.378154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:18.387657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:18.388405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:18.388844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:18.389971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:18.390441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:18.391197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:18.558916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:18.573755 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ff53e27-b62b-47b8-b3ea-e36832eb91fd tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 200 len: 1472 microversion: 2.1 time: 1.011748 Aug 30 16:15:18.587122 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1257/2806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:17 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 1472 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:18.587327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:18.601223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:18.603382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:18.605684 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2bcd15e-9f90-4f4e-87ae-8902123604e3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1486 microversion: 2.25 time: 0.236445 Aug 30 16:15:18.623979 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1550/2807] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:18 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1486 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:18.847070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:18.848008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:18.858960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:18.860420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:18.861093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:18.862447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:18.863108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:18.863732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:18.882201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 HTTP/1.1 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '24dc08c2-2efa-401e-bf24-6c76fd9a7020'} Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:18.884710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:18.889693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c57b8782-8b5b-498d-8d71-c9b80f7c6a28 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 404 len: 111 microversion: 2.1 time: 0.043751 Aug 30 16:15:18.890492 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1258/2808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:18 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:19.046646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:19.047659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:19.054743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.055094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.056403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.056684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.057936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.058076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.203172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:19.261119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-92db1bb2-8ce4-4476-ae7b-fd6ed8c85992 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.215794 Aug 30 16:15:19.263035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1551/2809] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:19 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:19.300857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:19.304182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:19.321785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.322543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.323155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.324031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.324647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.325259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.375855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'flavor' on Instance uuid 0ba50491-c695-4c19-a36e-09d614d1b9a2 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:19.608379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:19.610395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 4f92a1a7-be54-4dc6-8846-3ba43434b812] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:19.634004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.636922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.638785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.640905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.642153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.643713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.697200 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 HTTP/1.1 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4f92a1a7-be54-4dc6-8846-3ba43434b812'} Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:19.700849 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. Aug 30 16:15:19.705495 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:19.707723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:19.710341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:19.715643 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-767b1124-912f-45fe-a819-a2e5408bf986 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812" status: 404 len: 111 microversion: 2.1 time: 0.119745 Aug 30 16:15:19.717162 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1552/2810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:19 2022] GET /compute/v2.1/servers/4f92a1a7-be54-4dc6-8846-3ba43434b812 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:19.729244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:19.732106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:19.750257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.752638 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd1c9841-4ddc-45af-bb24-f6d491ff3706 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/action" status: 200 len: 32 microversion: 2.1 time: 0.455769 Aug 30 16:15:19.753779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.754432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.756397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.763152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.763685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1259/2811] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:15:19 2022] POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:15:19.764308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.770240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:19.780513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:19.796792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.802323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.803036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.805408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:19.806051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:19.806754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:19.882499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:20.014478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0661c6b-8c03-4c6c-ba09-1d10dd5753d6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 204 len: 0 microversion: 2.1 time: 0.246042 Aug 30 16:15:20.015516 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1260/2812] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:19 2022] DELETE /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:20.026717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.027392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:20.036714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.037737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.038490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.040003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.040994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.042036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.075430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:20.120497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:20.122064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:20.127493 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-245b333e-0142-40f5-9e04-896103bc6e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1476 microversion: 2.25 time: 0.407119 Aug 30 16:15:20.151058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1553/2813] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:19 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:20.160612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.163146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:20.178817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.179648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.185138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.186091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.186750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.187332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.496526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:20.505992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca231180-d25a-4b9a-a2ef-ef99682f6d45 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1471 microversion: 2.1 time: 0.352850 Aug 30 16:15:20.519032 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1554/2814] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1471 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:20.526653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f92a1a7-be54-4dc6-8846-3ba43434b812", "name": "network-vif-deleted", "tag": "0eaf6274-4859-45a6-b7d3-41fc59aca632"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:20.538788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.539344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.539849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.553100 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] Creating event network-vif-deleted:0eaf6274-4859-45a6-b7d3-41fc59aca632 for instance 4f92a1a7-be54-4dc6-8846-3ba43434b812 on n-h1-830883-28 Aug 30 16:15:20.559474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a58198f9-17e9-4616-a025-1ee659ee2a4e req-7beabcdd-ddd9-46c0-b992-83fe4e53f5bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038846 Aug 30 16:15:20.560403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1555/2815] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:20.561379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:20.566181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d269fe7f-e6eb-43b5-bd61-008481710aa4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '.version_select at 0x7fd357fcbb80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.570448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7de4c35-df48-494e-9259-64f0bc7ffbdf tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.550516 Aug 30 16:15:20.571204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d269fe7f-e6eb-43b5-bd61-008481710aa4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.571340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1261/2816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:20.572161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d269fe7f-e6eb-43b5-bd61-008481710aa4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.572782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d269fe7f-e6eb-43b5-bd61-008481710aa4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.575151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=28 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:20.586811 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d269fe7f-e6eb-43b5-bd61-008481710aa4 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.024629 Aug 30 16:15:20.587945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.588746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:20.596698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1556/2817] 10.222.0.47 () {60 vars in 1184 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:20.599585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.600815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.601422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.602436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.603040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.603727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.604840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.605821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:20.612341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.613625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.614320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.615320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.615984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.616623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.711178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:20.737342 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d181283f-c02e-42c4-9aae-0ac60cf5c326 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.165026 Aug 30 16:15:20.738443 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1262/2818] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:20.841437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] Lazy-loading 'services' on Instance uuid 031e4e54-ce97-4a23-b247-2fa283242c02 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:20.855668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe3d0091-15ee-4130-9122-257a82cb0f61 tempest-LiveAutoBlockMigrationV225Test-659090200 tempest-LiveAutoBlockMigrationV225Test-659090200-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1970 microversion: 2.25 time: 0.256871 Aug 30 16:15:20.870328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1557/2819] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:20 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1970 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:20.896419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:20.897255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:20.904815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.905578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.906117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.906854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:20.907757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:20.908091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:20.935901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:21.024835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e4ed366-747c-4324-bf39-12e1dc5bab0b tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 204 len: 0 microversion: 2.25 time: 0.132765 Aug 30 16:15:21.025757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1263/2820] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:20 2022] DELETE /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:15:21.034900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.035637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:21.044010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.044803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.045369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.046149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.046723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.047427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.193645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:21.203553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:21.205343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:21.207457 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-feb51606-8214-4511-90e5-9deea9ddaf4f tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1482 microversion: 2.25 time: 0.176755 Aug 30 16:15:21.208025 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1558/2821] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1482 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:21.533825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.535024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:21.542953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.543608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.544355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.545176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.545713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.546441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.595408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.596376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:21.598474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:21.607793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.609049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.609537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.610679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.610679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.611239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.869279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:21.887618 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e2216bc-e3e2-4762-83ce-f3436ea37b04 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.298232 Aug 30 16:15:21.888788 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1559/2822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:21.893666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:21.894481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:21.907782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.908508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.909184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:21.909853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:21.910348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:21.910792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:22.079405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:22.132927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73c8ea96-75bc-4b71-9bfc-eaa895c92625 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.242865 Aug 30 16:15:22.135888 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1560/2823] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:22.177590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:22.195512 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41430b93-7cf8-44fc-b363-252917947e57 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1471 microversion: 2.1 time: 0.665655 Aug 30 16:15:22.197281 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1264/2824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:21 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1471 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:22.230292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:22.230968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:22.239751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:22.241685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:22.242920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:22.244380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:22.245425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:22.246191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:22.762972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:22.771618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:22.773357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:22.774783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2323290-fdfa-459e-90fb-47d066aefedc tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1482 microversion: 2.25 time: 0.548404 Aug 30 16:15:22.775512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1561/2825] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:22 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1482 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:22.918178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:22.919727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:22.934594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:22.935595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:22.936266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:22.938518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:22.939350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:22.940168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.160615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:23.162875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:23.170843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.171562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.172313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.173201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.173846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.174473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.419123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:23.440153 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2efe97f0-9937-46e8-bcd9-a255a2f3183e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.533726 Aug 30 16:15:23.441363 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1265/2826] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:22 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:23.449738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:23.452624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:23.464518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.466383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.466993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.467874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.469511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.470571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.663011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:23.674687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-86e1f42f-1deb-4fe7-9c6a-1267acc6e092 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1301 microversion: 2.1 time: 0.229666 Aug 30 16:15:23.676796 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1266/2827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:23 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1301 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:23.692359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1f135f-887c-42de-959d-0185ff186938", "name": "network-vif-deleted", "tag": "53886c53-8c18-4946-bf63-5dda24ea7583"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:23.709414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.710284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.711239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.722733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:23.726657 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] Creating event network-vif-deleted:53886c53-8c18-4946-bf63-5dda24ea7583 for instance 1f1f135f-887c-42de-959d-0185ff186938 on n-h2-830883-28 Aug 30 16:15:23.734838 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-968734ad-6a47-472e-a2d2-a4e919efc2f7 req-37e3d23c-0116-455b-a390-8e3241026ed6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055130 Aug 30 16:15:23.736165 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1267/2828] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:23.757049 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6aff069e-312f-4c98-afb3-f695e7d526d0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.600657 Aug 30 16:15:23.764585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1562/2829] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:23 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:23.805023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:23.807346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:23.818629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.819140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.819591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:23.820310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:23.821032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:23.821470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.029870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:24.060015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:24.062128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:24.063721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-703c4bf8-8d08-4d5c-956e-f625b60cf7ab tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1440 microversion: 2.25 time: 0.269166 Aug 30 16:15:24.065367 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1268/2830] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:23 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1440 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:24.464140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:24.466106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:24.486424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:24.487279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:24.488223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.489380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:24.491295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:24.492353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.588466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:24.699807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:24.700455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:24.717395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:24.717902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:24.718389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.722943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:24.723680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:24.725455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.834059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:24.835426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:24.836130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:24.839992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 1f1f135f-887c-42de-959d-0185ff186938 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:24.964489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:24.974352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69342505-f91f-4978-b03a-022a3080226f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 200 len: 1306 microversion: 2.1 time: 0.280158 Aug 30 16:15:24.975514 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1269/2831] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:24 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 1306 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:24.985156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:24.991194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.007594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.008108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.008528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.013256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.014961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.015425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.241079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:25.283027 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1865b173-d52a-43fa-84c5-21150ceee01d tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.306188 Aug 30 16:15:25.285485 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1270/2832] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:24 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:25.303657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:25.310278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.329669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.332946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.334102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.336085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.337155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.337603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.502689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:25.519536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:25.522112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:25.525187 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d50ac07b-5aec-4394-b276-8265826c89e7 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.237724 Aug 30 16:15:25.526315 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1271/2833] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:25 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:25.543222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:25.544654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.557070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.557725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.558507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.559379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.560447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.561023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.597538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:25.613907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c15fcbb-f3ce-4805-9978-df57f5e8649c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 1.156655 Aug 30 16:15:25.614346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.615062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1563/2834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:24 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 HTTP/1.1 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '24dc08c2-2efa-401e-bf24-6c76fd9a7020'} Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:25.632676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:25.637271 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ab0356f-5a8e-4758-a830-2403b5df1452 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 404 len: 111 microversion: 2.1 time: 0.106796 Aug 30 16:15:25.640070 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1272/2835] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:25 2022] DELETE /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:25.649122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:25.649832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 24dc08c2-2efa-401e-bf24-6c76fd9a7020] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.657147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.660225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.661942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.663089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.663787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.664420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.680216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 HTTP/1.1 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '24dc08c2-2efa-401e-bf24-6c76fd9a7020'} Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.682248 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. Aug 30 16:15:25.688337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.690622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 24dc08c2-2efa-401e-bf24-6c76fd9a7020 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:25.693304 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa66889c-9fbd-4222-bb19-50919e44feb1 tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020" status: 404 len: 111 microversion: 2.1 time: 0.050434 Aug 30 16:15:25.694425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1564/2836] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:25 2022] GET /compute/v2.1/servers/24dc08c2-2efa-401e-bf24-6c76fd9a7020 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:25.703085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:25.703701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.711570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.712066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.712508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.713216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.713675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.714105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.730355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:25.757918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee HTTP/1.1 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '804827d9-9c13-4b4f-9139-667ebb49adee'} Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:25.759715 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.764200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:25.769379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b6ba68a-5f84-4cf9-9918-2c657c25f06f tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "DELETE /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 404 len: 111 microversion: 2.1 time: 0.070227 Aug 30 16:15:25.769970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1273/2837] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:25 2022] DELETE /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:25.783031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:25.784167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] [instance: 804827d9-9c13-4b4f-9139-667ebb49adee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:25.797667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.798624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.799376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.800359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.801326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.803077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.832562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031e4e54-ce97-4a23-b247-2fa283242c02", "name": "network-vif-deleted", "tag": "88bc17db-c681-49fc-a483-5b25f219c7e9"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:25.851006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] HTTP exception thrown: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Request method failure captured: Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee HTTP/1.1 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjcZi-SgK7wpMToGWi2zvzTT98wJcd1Tvt6PSIPwSADUmNMn8zAmUYFSiLQfKumfU2SuWXaFgBY8LqUqC_jEgYgg3jmntzGgWsQ5-2FO5bJWQtAo6XAjqH2QCqFGzDcDbhFnseh1Kkb2HaJg6ywMNAWw12wyLQ5u13Ds0mth8Lq8QC4 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bd97ef9096e541b48a9f24ddfe666b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bd97ef9096e541b48a9f24ddfe666b1a"}]}] Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: bd97ef9096e541b48a9f24ddfe666b1a Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestMultiNic-1769397910 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 08b0dab09f5e47ccbe1e9385edbe6cc9 Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestMultiNic-1769397910-project Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '804827d9-9c13-4b4f-9139-667ebb49adee'} Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:25.857352 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. Aug 30 16:15:25.862068 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:25.864059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:25.865593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] Returning 404 to user: Instance 804827d9-9c13-4b4f-9139-667ebb49adee could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:25.866291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:25.867958 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f20cd1a1-b553-407f-9ead-f5de7fc0a88d tempest-ServersTestMultiNic-1769397910 tempest-ServersTestMultiNic-1769397910-project] 10.222.0.47 "GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee" status: 404 len: 111 microversion: 2.1 time: 0.091744 Aug 30 16:15:25.868481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:25.873298 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1565/2838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:25 2022] GET /compute/v2.1/servers/804827d9-9c13-4b4f-9139-667ebb49adee => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:25.887743 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] Creating event network-vif-deleted:88bc17db-c681-49fc-a483-5b25f219c7e9 for instance 031e4e54-ce97-4a23-b247-2fa283242c02 on n-h2-830883-28 Aug 30 16:15:25.898841 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1a11ffc1-40a4-4dc7-b5fd-4659c5324e3a req-45cc1157-e6fd-4396-bf3b-f9390bfe3b46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072496 Aug 30 16:15:25.900014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1274/2839] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:15:26.005970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.006874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1f1f135f-887c-42de-959d-0185ff186938] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.013777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.014711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.015417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.017836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.018900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.019810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.071833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 HTTP/1.1 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1f1f135f-887c-42de-959d-0185ff186938'} Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:26.076619 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 1f1f135f-887c-42de-959d-0185ff186938 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-141a7c57-4d2f-4d70-a24d-6f3172f699ca tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938" status: 404 len: 111 microversion: 2.1 time: 0.078975 Aug 30 16:15:26.081421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1566/2840] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:25 2022] GET /compute/v2.1/servers/1f1f135f-887c-42de-959d-0185ff186938 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:26.091519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.092157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.104915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.110016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.110852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.111731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.112205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.112635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.179222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:26.322137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.323900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.360887 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4cca5524-5a7f-4e54-b608-56d20fc9384f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 204 len: 0 microversion: 2.1 time: 0.274579 Aug 30 16:15:26.362776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.363417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.363867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.366368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1275/2841] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:26 2022] DELETE /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:26.373652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.374959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.376210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.376859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.378716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.381406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.381911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.382445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.383080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.383539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.383969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.525581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:26.585508 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-55d4ed65-3952-41aa-ae27-2818f7ff5b5f tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.269793 Aug 30 16:15:26.603913 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1567/2842] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:26 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:26.612149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.612783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.630797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.631588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.632207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.633089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.634917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.637831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.760620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:26.769360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd0db348-677b-4d7c-b22e-c5aac39b5d1d tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1471 microversion: 2.1 time: 0.400759 Aug 30 16:15:26.772093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:26.772817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1276/2843] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:26 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:26.784244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:26.787057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:26.787891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:26.788431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:26.790159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82c42651-41e1-463a-8146-cce14ff9b834 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.185132 Aug 30 16:15:26.804486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1568/2844] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:26 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:26.804713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:27.071049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:27.081387 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a458c12b-5917-4eaa-bef8-6a3cafd48c31 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.307426 Aug 30 16:15:27.093072 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1277/2845] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:26 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:27.617800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:27.619175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:27.626453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:27.633315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:27.637965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:27.639235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:27.640005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:27.640729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:27.798638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:27.799265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:27.815262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:27.817361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:27.821445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:27.824589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:27.832123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:27.835346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:27.836011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:27.836605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:27.938601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:28.014818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35fb0dea-5959-4617-8217-7e7f7c804eb2 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.401542 Aug 30 16:15:28.015418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1569/2846] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:27 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:28.038594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:28.039518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:28.061580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:28.062071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:28.072249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:28.073276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:28.080118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:28.080856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:28.239329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:28.248532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:28.249903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:28.251094 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-251bac8c-98c7-4f6a-abdd-849d1f385650 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.232527 Aug 30 16:15:28.258717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1570/2847] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:28 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:28.266159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:28.273196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:28.287881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:28.288876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:28.289540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:28.290560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:28.291219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:28.293672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:28.636562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:28.654456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9762fc1-9e3b-4569-a075-af0f2c9154c0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.393750 Aug 30 16:15:28.669891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1571/2848] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:28 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:28.917242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:28.930155 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eee4f880-00f8-43fe-b4bb-619ab60d7a76 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1471 microversion: 2.1 time: 1.135818 Aug 30 16:15:28.931258 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1278/2849] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:27 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1471 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:29.043262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:29.044694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:29.060838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.064925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.067505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.069024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.075165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.075924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.278643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:29.279747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:29.286956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:29.290514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.296729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.311112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.313854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.315939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.318285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.374416 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-125c5418-055d-4bb1-b6f4-08033667f101 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.328406 Aug 30 16:15:29.375082 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1572/2850] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:29 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:29.554331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:29.570183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:29.576863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:29.579675 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b26d214-a3a1-4656-9727-9d424d128870 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.305864 Aug 30 16:15:29.580519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1279/2851] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:29 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:29.678172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:29.678847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:29.696724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.697247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.697692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.700488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.700880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.706146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.954421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:29.955380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:29.967008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.974623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.975599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:29.976595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:29.977272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:29.977958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:30.139021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:30.148438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d2bc6a6-a6a8-406e-916a-e1f35a42d72b tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1429 microversion: 2.1 time: 0.198104 Aug 30 16:15:30.149585 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1280/2852] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:29 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1429 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:30.161620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287753fe-aa86-4093-8f86-94881bbaa903", "name": "network-vif-deleted", "tag": "a0442408-0d7a-47f1-9b43-bc14025bf85d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:30.223408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:30.228886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:30.230452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:30.279650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] Creating event network-vif-deleted:a0442408-0d7a-47f1-9b43-bc14025bf85d for instance 287753fe-aa86-4093-8f86-94881bbaa903 on n-h2-830883-28 Aug 30 16:15:30.297502 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0725560f-c353-492f-b161-56355fca4af1 req-6442a205-5f9a-4e5b-925c-6e68ef239db6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146330 Aug 30 16:15:30.301267 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1281/2853] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:30.406551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:30.407666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:30.426552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:30.430123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:30.433861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:30.436441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:30.440649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:30.443879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:30.764191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:30.815714 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-570b24e9-2334-4181-9a82-4a91d47855c6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.414885 Aug 30 16:15:30.818331 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1282/2854] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:30 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:30.828675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:30.829443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:30.845878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:30.849950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:30.850778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:30.851741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:30.853594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:30.856772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:31.023902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:31.054132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:31.065113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:31.072682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-565094b5-99dd-417e-961e-2d427c650a9e tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.247570 Aug 30 16:15:31.076032 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1283/2855] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:30 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:31.173484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:31.174401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:31.186519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:31.187174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:31.189181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:31.190129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:31.191408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:31.192271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:31.274039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:31.274972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:31.275738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:31.276269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 287753fe-aa86-4093-8f86-94881bbaa903 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:31.341006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:31.352300 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca42e14b-19f3-408a-805b-18ccb234fa92 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 200 len: 1306 microversion: 2.1 time: 0.182957 Aug 30 16:15:31.363110 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1284/2856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:31 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:31.523088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:31.534064 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac153b5f-63f5-431c-ba87-37beb359de56 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 1.860212 Aug 30 16:15:31.540011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1573/2857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:29 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:31.864611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:31.865260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:31.889341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:31.891513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:31.892145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:31.894545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:31.896987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:31.897590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.108294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:32.108836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:32.120676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.126628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:32.129369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.129802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.137853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.142910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.143547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.178750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c941a4c5-9f09-4c05-bcfc-d0cff8939b94 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.336546 Aug 30 16:15:32.191395 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1285/2858] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:31 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:32.332380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:32.350883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:32.352787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:32.357239 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-531b8357-fc16-4a5a-a415-ee870734f213 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 200 len: 1265 microversion: 2.25 time: 0.249769 Aug 30 16:15:32.358029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1574/2859] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:32 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:32.375985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:32.377137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 287753fe-aa86-4093-8f86-94881bbaa903] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:32.391870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.392602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.393216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.394064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.394773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.395388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.440640 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 HTTP/1.1 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '287753fe-aa86-4093-8f86-94881bbaa903'} Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:32.445588 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 287753fe-aa86-4093-8f86-94881bbaa903 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-55091f48-0a02-4192-93d6-8d30cb963ae6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903" status: 404 len: 111 microversion: 2.1 time: 0.075782 Aug 30 16:15:32.450755 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1286/2860] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:32 2022] GET /compute/v2.1/servers/287753fe-aa86-4093-8f86-94881bbaa903 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:32.459446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:32.460083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:32.469592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.469700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.470387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.471236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.471898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.472451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.565535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:32.566350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:32.610712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.614660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.616222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:32.624143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:32.628908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:32.644068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.024769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:33.166018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-56c89f9f-113d-42e1-8569-afde514db07e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 204 len: 0 microversion: 2.1 time: 0.712404 Aug 30 16:15:33.166730 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1575/2861] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:32 2022] DELETE /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:33.184206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:33.203416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-63824dba-2972-4909-9f55-768fb2512cf7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.646168 Aug 30 16:15:33.207645 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1287/2862] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:32 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:33.216417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:33.216923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:33.249852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.250151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.250805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.252059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.252649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.255966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.335459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:33.406373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:33.543601 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b84ccee7-981b-48ea-943a-524e09ff6334 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 204 len: 0 microversion: 2.1 time: 0.330891 Aug 30 16:15:33.544810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1288/2863] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:33 2022] DELETE /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:33.562858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:33.568626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:33.577914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:33.592971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.602114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.604815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.615527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.616747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.619172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.812693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1963859097", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2b23a35e-3b05-4dda-b6dc-7668bb1d37c1"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:33.843912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:33.881602 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-452a910e-9376-4322-962f-c4cf7b86c208 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.334539 Aug 30 16:15:33.894500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1289/2864] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:33 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:33.910654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:33.912174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 031e4e54-ce97-4a23-b247-2fa283242c02] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:33.933213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] validate_networks() for [('2b23a35e-3b05-4dda-b6dc-7668bb1d37c1', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:15:33.949288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.950965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.951419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.952412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:33.953146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:33.953809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:33.979313 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] HTTP exception thrown: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Request method failure captured: Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 HTTP/1.1 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjYGDmge_lEVDMTaUMIY6p6FUu5ZszHJ7sb5gmAPNICJ9zyxhTLblLRJHJKGfwqjpw56upavNhfi9ZkreBh_yCKw3olCdlunKd7jeRH7lbF8Q5aZxJZdFDeC4LOvF4Yye-SlDRcPTxm6g12TaG4ChMj5TIa93JmXGc3tlqqEJRgMli0 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}] Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 81b24fcdb0a749caa02a34817e8fe9f8 Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '031e4e54-ce97-4a23-b247-2fa283242c02'} Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. Aug 30 16:15:33.981819 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. Aug 30 16:15:33.986638 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:33.988683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Returning 404 to user: Instance 031e4e54-ce97-4a23-b247-2fa283242c02 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:33.989770 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00231dd6-23ad-49ed-abc7-e0f7a1ca2c15 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02" status: 404 len: 111 microversion: 2.25 time: 0.086568 Aug 30 16:15:33.999753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1290/2865] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:33 2022] GET /compute/v2.1/servers/031e4e54-ce97-4a23-b247-2fa283242c02 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:15:34.005855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:34.006679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:34.037687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.038325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.038794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:34.039529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.039987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.040411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:34.368287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:34.384347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aaa8f185-a474-49d7-bcb8-4f2f5af90774 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1474 microversion: 2.1 time: 0.383587 Aug 30 16:15:34.405596 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1291/2866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:33 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:34.424188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:34.425371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:34.440543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.442999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.444817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:34.446263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.449829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.450347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:34.712359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:34.723375 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2005d018-5ff4-4b20-a6b7-a9f34ba80dda tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.314098 Aug 30 16:15:34.725051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1292/2867] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:34 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:34.919970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:34.920604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:34.947348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.947854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.948310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:34.955000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:34.957331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:34.957903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.147004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:15:35.148117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:15:35.149549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:15:35.150458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:15:35.151236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:15:35.164662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.166351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.167351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.168469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.169251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.170616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.211332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Getting quotas for project 0b9f8254fcb64493a3660a7f15ee09b6. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:35.236395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Getting quotas for user edf39f4cee5740f7b12e1e31ef1820fb and project 0b9f8254fcb64493a3660a7f15ee09b6. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:35.319303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:15:35.327240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:15:35.415427 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08184674-8a04-4d7f-85d6-f6c7e29c4f08 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.244746 Aug 30 16:15:35.416955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1576/2868] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:15:35.422116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:35.423153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:35.431075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.431935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.432592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.433516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.434213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.435059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.547238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:35.602713 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a332fc8e-0fc7-4e49-972d-fdcdf07b73e6 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.696251 Aug 30 16:15:35.606186 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1293/2869] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:34 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:35.619792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78b0cf06-98dd-4313-98a3-d42604ceea48 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:35.627218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78b0cf06-98dd-4313-98a3-d42604ceea48 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:35.703232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:35.723506 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66a88a09-52dc-4a39-9299-e7e9a995d883 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1474 microversion: 2.1 time: 0.303694 Aug 30 16:15:35.725272 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1577/2870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:35 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:35.746485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:35.747356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:35.757121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.760347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.761361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.763302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:35.765963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:35.766675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:35.894295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78b0cf06-98dd-4313-98a3-d42604ceea48 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:35.914110 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78b0cf06-98dd-4313-98a3-d42604ceea48 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1216 microversion: 2.1 time: 0.306483 Aug 30 16:15:35.914684 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1294/2871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:35 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1216 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:36.078577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:36.092575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7ab912f-bb91-4878-8a10-ff3899d865d2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.347546 Aug 30 16:15:36.109249 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1578/2872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:35 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:36.634149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:36.634845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:36.655185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:36.655769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:36.656228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:36.657526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:36.658004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:36.658699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:36.746937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:36.748154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:36.762228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:36.768188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:36.769963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:36.774103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:36.777002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:36.777658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:37.127931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:37.140460 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9a756d4-be86-4419-9b84-965e09f8f028 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1474 microversion: 2.1 time: 0.398132 Aug 30 16:15:37.142157 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1579/2873] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:36 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1474 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:37.147197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:37.153302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:37.168759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:37.171769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:37.173790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:37.175648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:37.181114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:37.181589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:37.186250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:37.328736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:37.343879 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc84d2e9-c50c-46a6-8fe1-74491bd4dd1e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1268 microversion: 2.1 time: 0.198143 Aug 30 16:15:37.357310 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1580/2874] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:37 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:37.358910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:37.359557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:37.376669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:37.378327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:37.379827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:37.383600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:37.384317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:37.386455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:37.404711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:37.515823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f0d3ed8-cac5-408e-94eb-a82f5c1bd1da tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.885810 Aug 30 16:15:37.521328 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1295/2875] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:36 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:37.714976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:37.724623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29486f5e-9bff-40a2-840b-6b9805d5b649 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.376059 Aug 30 16:15:37.725235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1581/2876] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:37 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:38.163419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:38.164093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:38.183953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.187578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.191024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.195719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.196650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.223138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.369721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:38.371287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:38.400154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.402577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.404393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.409366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.410343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.412675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.447719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:38.476079 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f61064d-66a9-487d-bb67-8ca9ef5ca5cb tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1432 microversion: 2.1 time: 0.316892 Aug 30 16:15:38.483084 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1296/2877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:38 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1432 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:38.511042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef789cb-7ef1-4cdc-8653-f17f5b9849b4", "name": "network-vif-deleted", "tag": "8669c6d0-5b1f-40c4-8577-feac3689e799"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:38.560582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.561207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.565068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.599711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] Creating event network-vif-deleted:8669c6d0-5b1f-40c4-8577-feac3689e799 for instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 on n-h1-830883-28 Aug 30 16:15:38.610039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-597e4e3c-610d-491e-8eb7-af4ee3832b3c req-fac2926e-2d6f-4521-9a2d-d4530eeddade service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125313 Aug 30 16:15:38.611053 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1297/2878] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:38.624044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:38.625128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:38.641639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.644534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.645175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.647124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.648908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.649636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.808909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:38.821943 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4ef639f-6117-4ed9-b316-9bce77252e14 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1274 microversion: 2.1 time: 0.456960 Aug 30 16:15:38.822825 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1582/2879] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:38 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1274 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:38.829807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:38.830847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:38.841255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.842561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.843126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:38.844132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:38.844610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:38.845062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:39.016808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:39.076858 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac4159af-a67a-4389-b33b-8a124ed3649b tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.463191 Aug 30 16:15:39.101206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1298/2880] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:38 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:39.480822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:39.497518 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34393416-f94f-494f-81bf-d99b3563d5e7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.672708 Aug 30 16:15:39.499436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1583/2881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:38 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:39.519816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:39.528687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:39.547063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:39.549436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:39.550337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:39.552919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:39.557566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:39.558275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:39.657535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:39.660516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:39.661257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:39.663874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:39.759586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:39.767918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-052ba7e8-2293-4564-9577-e390c5ee1a0f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 200 len: 1309 microversion: 2.1 time: 0.253219 Aug 30 16:15:39.771511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1299/2882] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:39 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:39.849652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:39.850615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:39.860441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:39.862548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:39.864076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:39.866191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:39.866879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:39.867752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.016132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:40.029568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f822684c-5ba7-41ef-83fd-f11865ec68ce tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1274 microversion: 2.1 time: 0.185521 Aug 30 16:15:40.033048 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1584/2883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:39 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:40.115707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.116333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:40.132538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.133595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.134516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.137560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.138079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.144195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.393157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:40.429441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4257ed84-712b-43a1-a5e1-73b8a2b48f12 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.325702 Aug 30 16:15:40.430494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1300/2884] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:40 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:40.521636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.523207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:40.538901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.541753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.542614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.543965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.544657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.545328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.794736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.795469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:40.814049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.814826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.815434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.816298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.816943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.817610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.843909 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 HTTP/1.1 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8ef789cb-7ef1-4cdc-8653-f17f5b9849b4'} Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:40.845869 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. Aug 30 16:15:40.851784 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.858510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:40.859818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4da64d91-3266-4f83-aa1c-1e3ddf98bc91 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4" status: 404 len: 111 microversion: 2.1 time: 0.069024 Aug 30 16:15:40.860961 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1301/2885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:40 2022] GET /compute/v2.1/servers/8ef789cb-7ef1-4cdc-8653-f17f5b9849b4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:40.868314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:40.872652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.874226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:40.881704 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f4c9bd65-dbea-44a1-8905-ff4b723946b8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.362595 Aug 30 16:15:40.884074 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1585/2886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:40 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:40.899899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.900403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.900843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.901545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.901997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.902447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.924810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb HTTP/1.1 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb'} Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:40.926341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:40.932571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2df3cfcd-ecfd-438d-927e-b3af8a0574e9 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb" status: 404 len: 111 microversion: 2.1 time: 0.062895 Aug 30 16:15:40.938221 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1302/2887] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:40 2022] GET /compute/v2.1/servers/1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:40.939598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82999f7c-4776-4cc6-b511-7491a8f73b7f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.959959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:40.960466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:40.976286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.977097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.977719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:40.978646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:40.979254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:40.979838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.000145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82999f7c-4776-4cc6-b511-7491a8f73b7f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/67be9e3b-0a2d-4295-ab5b-28f98aba2fe1" status: 204 len: 0 microversion: 2.1 time: 0.065873 Aug 30 16:15:41.001585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1586/2888] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:15:40 2022] DELETE /compute/v2.1/os-server-groups/67be9e3b-0a2d-4295-ab5b-28f98aba2fe1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:15:41.012416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:41.023234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb", "name": "network-vif-deleted", "tag": "62164293-779d-4a42-9a09-5062f22e0e6d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:41.051002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.055167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.056248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.079976 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] Creating event network-vif-deleted:62164293-779d-4a42-9a09-5062f22e0e6d for instance 1a6ed0a6-79f2-413f-b6c4-cfe838aeb6cb on n-h2-830883-28 Aug 30 16:15:41.097400 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b8c9f0c2-341b-40ef-a25a-703f30282eec req-5867be1f-846c-483a-b317-bf2c468f7d16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086673 Aug 30 16:15:41.100445 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1587/2889] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:41.118549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.119245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.137726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.139043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.139827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.142084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.143478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.143926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.148274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ae9e2cc1-50c9-4b0e-a5ec-f3ad2d416c73 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 204 len: 0 microversion: 2.25 time: 0.207342 Aug 30 16:15:41.154136 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1303/2890] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:40 2022] DELETE /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:15:41.165669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.166484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.179288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.179743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.185421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.186200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.186934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.187556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.211913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:41.397960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:41.413321 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9e29af5-bd91-4ef5-a031-5eabd3815620 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 204 len: 0 microversion: 2.1 time: 0.308731 Aug 30 16:15:41.414372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1588/2891] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:41 2022] DELETE /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:41.437968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.439444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.456614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.458054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.459694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.460685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.461587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.462288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.498972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:41.502672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:41.509302 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-497435b8-8e44-4ac7-ba72-0dfb34d3b738 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.353808 Aug 30 16:15:41.515343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1304/2892] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:41 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:41.529939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.530504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.547629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.551056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.551056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.552887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.553863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.556170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.652609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:41.835599 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed1515f7-0d63-4b92-bc78-ccca9d6a151e tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 204 len: 0 microversion: 2.1 time: 0.318790 Aug 30 16:15:41.839151 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1305/2893] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:41 2022] DELETE /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:41.842096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.842839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.861230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.861749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.862195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.862940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.863401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.863839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.909831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:41.927832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:41.934046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:41.937272 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3e25615-a8aa-4b32-92bc-e8fdb9f963c9 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1729 microversion: 2.25 time: 0.521384 Aug 30 16:15:41.941453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1589/2894] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:41 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1729 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:41.954088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:41.954940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:41.975050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.975559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.976000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:41.979886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:41.980449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:41.980872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.095845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:42.151006 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27ee8937-2e2f-499b-b582-3f5f5167f35a tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.313064 Aug 30 16:15:42.153158 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1306/2895] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:41 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:42.159457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:42.166345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:42.179571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.180463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.181113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.182232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.182911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.183595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.450969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:42.461265 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-197a4c9c-15aa-4222-982f-76a0572a0a93 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1473 microversion: 2.1 time: 0.518228 Aug 30 16:15:42.463535 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1590/2896] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:41 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1473 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:42.532462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:42.533818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:42.547226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.551347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.552017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.552794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.559897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.560391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.628337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:42.640990 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9de46c28-e63f-43b6-96e7-d5e7e23b3a17 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.485903 Aug 30 16:15:42.648915 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1307/2897] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:42 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:42.975763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:42.981615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:42.996139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.996900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.997521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:42.998477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:42.999098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:42.999690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.167082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:43.184475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:43.187070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:43.189104 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc044417-5caa-47a3-a7f2-929f48115561 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1729 microversion: 2.25 time: 0.224525 Aug 30 16:15:43.190686 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1308/2898] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:42 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:43.197176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:43.197798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:43.211483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.211995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.212441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.213151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.218260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.218740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.222348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:43.234255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dab98e47-efb9-4550-920c-5bad44592531 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.706022 Aug 30 16:15:43.249428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1591/2899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:42 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:43.256435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc113d65-52f3-440f-819a-e070aa624a6d", "tag": "bf7d7f31-702f-4abd-91bd-b4765ffb7b62"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:43.269614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.270511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.272504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.287870 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] Creating event network-changed:bf7d7f31-702f-4abd-91bd-b4765ffb7b62 for instance dc113d65-52f3-440f-819a-e070aa624a6d on n-h2-830883-28 Aug 30 16:15:43.295061 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9943feeb-55e0-4659-80e8-6edf1e94f094 req-ef9b76b6-da7a-42d1-9ae7-fb926e9aa3e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044242 Aug 30 16:15:43.296071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1592/2900] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:43.338475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:43.360292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-853021a2-2bfa-4c85-ae55-1435b26475e5 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.168297 Aug 30 16:15:43.361088 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1309/2901] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:43 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:43.486787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:43.488145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:43.501232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.501777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.502408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.503564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.504278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.504780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.677460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:43.678182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:43.698244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.698785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.699232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.699951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:43.700412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:43.700895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:43.847161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:43.859792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f2568e6-97d6-4125-a7fe-50edbf81a8b6 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1473 microversion: 2.1 time: 0.377904 Aug 30 16:15:43.861824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1593/2902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:43 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1473 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:44.002377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:44.012989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1ebff29-3988-4107-8d07-6bb96130b3de tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.339940 Aug 30 16:15:44.013585 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1310/2903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:43 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:44.219903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:44.220662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:44.230731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.231369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.231695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.232427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.232898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.234056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.258379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:44.259277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:44.274508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.275198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.275803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.276674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.277291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.277906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.581957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:44.597726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:44.602636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:44.606961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cfc64ed7-ac66-41e4-a9c4-ef59a4fa7dd3 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1729 microversion: 2.25 time: 0.397488 Aug 30 16:15:44.622338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1594/2904] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:44 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1729 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:44.631966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:44.632601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:44.639953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.640910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.641526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.642495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.643180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.643770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.780884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:44.815594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8cf26a2d-aaa3-42c3-b1db-70a45347a0a0 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.193229 Aug 30 16:15:44.817764 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1595/2905] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:44 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:44.887794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:44.889939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:44.897320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:44.916867 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c19bfcf3-f4b7-4e86-8fe7-71e7dac70ae8 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.663917 Aug 30 16:15:44.930397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.931140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1311/2906] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:44 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:44.932390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.933579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:44.935139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:44.935714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:44.936283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:45.036462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:45.037789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:45.046589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:45.047600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:45.048524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:45.049609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:45.050941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:45.051778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:45.187421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:45.194265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:45.207448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0cdbcfe2-0302-45b0-9218-db4ea0600cc2 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1473 microversion: 2.1 time: 0.330234 Aug 30 16:15:45.209020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1596/2907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:44 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1473 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:45.635186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:45.636748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:45.638994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:45.652812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:45.654956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:45.655893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:45.665637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:45.665637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:45.665637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:45.673561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:45.904317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:45.988743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:46.013656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:46.016506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:46.020471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d04b6fe-4882-40ba-b238-319567dd9c98 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1729 microversion: 2.25 time: 0.390840 Aug 30 16:15:46.026589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1597/2908] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:45 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:46.033748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:46.034671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:46.043396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.043907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.044363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.045813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.046244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.046717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.266296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:46.323727 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e936af02-2d79-47f3-baa4-34d5254aaaf1 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1929 microversion: 2.75 time: 0.295702 Aug 30 16:15:46.324358 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1598/2909] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:46 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1929 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:46.338741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:46.338741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:46.341147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.342237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.342730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.343448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.343908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.344333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.453086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:46.469553 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-22af0b70-08cf-45e9-9d7f-bfd439e030ca tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 1.436646 Aug 30 16:15:46.470145 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1312/2910] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:45 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:46.499397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:46.500314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:46.513165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.515160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.516845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.520095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:46.520813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:46.523189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:46.670266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:46.682691 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26ac710f-b4f9-4904-85a7-57c14a4de537 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.357183 Aug 30 16:15:46.687547 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1599/2911] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:46 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:47.048853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:47.049745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:47.063995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.065067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.066020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.073860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.075553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.079428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.425510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:47.440090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:47.447464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:47.450640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:47.466114 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f29f80a2-0b0b-4f38-87f9-64f84bdc4e81 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1729 microversion: 2.25 time: 0.422153 Aug 30 16:15:47.467326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b6e1be5-b3c0-4ccf-ae37-e9decffe08b8 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1473 microversion: 2.1 time: 0.990547 Aug 30 16:15:47.468493 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1600/2912] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:47 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1729 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:47.469206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1313/2913] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:46 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1473 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:47.474634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:47.475448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:47.482571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.483311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.484045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.485576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.487001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.487582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.695719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:47.771372 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b0bf307-8723-4a07-a607-86828f465768 tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1935 microversion: 2.75 time: 0.300126 Aug 30 16:15:47.773742 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1314/2914] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:47 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1935 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:47.789342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d06940-7b7c-4a45-be79-0e368aaa02a1", "name": "network-vif-deleted", "tag": "38bb2556-4dc2-4917-b360-f582454b1c09"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:47.812679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.813641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.814369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.848199 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] Creating event network-vif-deleted:38bb2556-4dc2-4917-b360-f582454b1c09 for instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 on n-h2-830883-28 Aug 30 16:15:47.877956 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-675fd309-21a0-4cd1-8d8c-6b50a2afbfc6 req-9dfbb6b3-f6f4-4627-8fcb-9996fe89defd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101231 Aug 30 16:15:47.882582 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1315/2915] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:47.902728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:47.903870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:47.911509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.912307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.913277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:47.914338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:47.914918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:47.916316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:48.040787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-786063704", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "2962a4fb-633a-43e4-ba2d-341c7625b077"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:48.149821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] validate_networks() for [('2962a4fb-633a-43e4-ba2d-341c7625b077', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:15:48.402908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:48.411873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbf85fd2-736b-45cd-b8b9-d82538885dcb tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.523346 Aug 30 16:15:48.412477 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1316/2916] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:47 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:48.451916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:48.452548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:48.501128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:48.501844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:48.507175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:48.507969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:48.508462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:48.516931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:48.941925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:15:48.942439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:15:48.943134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:15:48.944034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:15:48.944341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:15:48.962187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:48.962724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:48.965659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:48.969493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:48.970022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:48.970523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:48.976384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:48.992303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fcbdb1db-f642-41e7-a5d1-d852c1ccde20 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.564865 Aug 30 16:15:48.993106 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1317/2917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:48 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:49.001027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.001988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:49.012421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.013091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.014165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.015653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.016368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.017094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.030124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Getting quotas for project 2b2420775d95412a86632d8786a24756. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:15:49.042779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Getting quotas for user 7962738e5363429c82edd8f42890b29a and project 2b2420775d95412a86632d8786a24756. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:15:49.074675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Going to run 3 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:15:49.077530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:15:49.128715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.129534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.132050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.132761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 1e04c935-0f3a-4def-abd4-b6fae92fa742 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:49.146162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=9b3d93f9-6311-453c-ae28-0be8b94cbf28,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:15:49.256399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=046f7bc4-73c6-4f20-a0e2-73b32af92643,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:15:49.260613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:49.272682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc0afebb-0fa3-4e49-8a46-9d20fcc5287f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1307 microversion: 2.1 time: 0.278221 Aug 30 16:15:49.278336 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1318/2918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:48 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:49.284054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.284879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:49.294915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.295944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.297533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.298531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.299219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.300731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.308156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:49.413719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74265e57-b0a4-46ec-8bb3-77417187137f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943130 Aug 30 16:15:49.415097 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1601/2919] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:15:49.420750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.421630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:49.431353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.432109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.432720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.433610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.434503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.435293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.542804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:49.558035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] Lazy-loading 'services' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:49.559844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:49.563414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:49.566993 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e052070-2385-431e-ae4e-5a63ffd57b61 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1663 microversion: 2.25 time: 0.288293 Aug 30 16:15:49.568441 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1319/2920] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:49 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1663 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:49.579697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.605323 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f130b9a-8f34-4147-a893-17156acc873c tempest-ServersAdmin275Test-789162336 tempest-ServersAdmin275Test-789162336-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1920 microversion: 2.75 time: 0.188632 Aug 30 16:15:49.606533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1602/2921] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:49 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1920 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:49.606805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:49.607975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:15:49.629251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.632782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:49.647817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.653416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.653995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.655110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.656966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.660372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.670784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.672866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.674080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.676667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.678688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.682129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.765576 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95b67308-87c8-412f-8fbd-84d65b2d1793 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.193688 Aug 30 16:15:49.774667 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1320/2922] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:15:49 2022] GET /compute/v2.1/servers => generated 1015 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:49.810290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:49.812409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:49.827018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.827707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.828859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.830984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:49.831633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:49.832340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:49.889502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:50.025599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.042261 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b6f2d26-c94f-4c59-8d33-52d7a4dd0d5a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.431244 Aug 30 16:15:50.043715 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1603/2923] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:49 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:50.046726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:50.064589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d79dad17-e587-4001-aee6-322c1177fca6 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:50.065410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d79dad17-e587-4001-aee6-322c1177fca6 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:50.087556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d3f03c1-7d1c-4109-9c7e-c17f42568446 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "DELETE /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 204 len: 0 microversion: 2.75 time: 0.310861 Aug 30 16:15:50.088397 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1321/2924] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:49 2022] DELETE /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:15:50.095719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e04c935-0f3a-4def-abd4-b6fae92fa742", "name": "network-vif-deleted", "tag": "d96d0f95-6048-4426-8848-0e85c6aad430"}, {"server_uuid": "b6f53ebf-eba8-4fd5-9391-de6ef762c057", "name": "network-vif-deleted", "tag": "904962d6-b75e-497c-acaa-223db206ae08"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:50.165638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.166162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.166609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.175068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d79dad17-e587-4001-aee6-322c1177fca6 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.191738 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d79dad17-e587-4001-aee6-322c1177fca6 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1222 microversion: 2.1 time: 0.146890 Aug 30 16:15:50.193588 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1604/2925] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:50 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:50.219178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Creating event network-vif-deleted:d96d0f95-6048-4426-8848-0e85c6aad430 for instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 on n-h2-830883-28 Aug 30 16:15:50.220860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:50.221815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:50.222724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] Creating event network-vif-deleted:904962d6-b75e-497c-acaa-223db206ae08 for instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 on n-h2-830883-28 Aug 30 16:15:50.235834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.241593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.242505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.243510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.244828 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e93e34a7-badc-4f97-b84c-2cd21702af1a req-4b02be03-f0dd-46eb-9345-84222f9381cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.154107 Aug 30 16:15:50.245516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.246081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.246409 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1322/2926] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:50.275898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:50.279844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:50.294883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.295679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.298093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.299234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.301712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.304534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.481883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.495626 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9e189c2-c15f-4cb1-931a-2f7d6bf702b1 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.300351 Aug 30 16:15:50.496774 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1605/2927] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:50 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:50.514637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:50.515692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:50.524315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.525208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.525915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.527241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.527996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.529134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.593328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.595129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.595944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.597171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 1e04c935-0f3a-4def-abd4-b6fae92fa742 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:50.650161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.664802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.667559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.674704 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8149d586-375a-4dfa-9e8f-0acbe0357d41 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1443 microversion: 2.75 time: 0.426496 Aug 30 16:15:50.675514 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1323/2928] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:50 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1443 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:50.685980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:50.688145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:50.715574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.721038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.721561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.722019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.722804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:50.723271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:50.726955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d204fcad-501a-4fa3-9576-1c473432a30f tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 200 len: 1307 microversion: 2.1 time: 0.227113 Aug 30 16:15:50.727971 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1606/2929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:50 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:50.742615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:50.893815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.910688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.912615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:50.918048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-057908d3-55cb-43f5-8eb9-6b49691dcc25 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1663 microversion: 2.25 time: 0.241024 Aug 30 16:15:50.919488 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1324/2930] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:50 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1663 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:51.065943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.067363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.090585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.094093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.094749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.096474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.100454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.101004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.222185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-81c7af2a-7504-40e2-b2e1-4da1600b57fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.223123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-81c7af2a-7504-40e2-b2e1-4da1600b57fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.392301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-81c7af2a-7504-40e2-b2e1-4da1600b57fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.406445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-81c7af2a-7504-40e2-b2e1-4da1600b57fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1222 microversion: 2.1 time: 0.196524 Aug 30 16:15:51.407395 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1325/2931] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:51.466204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.480966 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5e7e4c4-3003-44b7-bd67-9670d32fac98 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.419746 Aug 30 16:15:51.502700 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1607/2932] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:51.522487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.523423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.534649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.548135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.548679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.549429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.549901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.556431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.705743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.707200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.724635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.727174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.729745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.730664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.731092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.731981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.834074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.843269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.844997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.852069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8016224-523e-4be6-8ba3-acc1103bca33 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1443 microversion: 2.75 time: 0.150241 Aug 30 16:15:51.853250 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1608/2933] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:51.858800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.859622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 1e04c935-0f3a-4def-abd4-b6fae92fa742] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.866510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.867487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.868140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.869235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.869894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.870592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.879131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:51.891547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 HTTP/1.1 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1e04c935-0f3a-4def-abd4-b6fae92fa742'} Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:51.893782 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. Aug 30 16:15:51.899690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.903008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df987a74-c925-42ec-9cf7-e82e4ac7b59e tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.385665 Aug 30 16:15:51.903613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1326/2934] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:51.912901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 1e04c935-0f3a-4def-abd4-b6fae92fa742 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:51.914409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6cfb9e18-237f-4a56-a6d6-6a8e0cb9d200 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742" status: 404 len: 111 microversion: 2.1 time: 0.059822 Aug 30 16:15:51.915173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1609/2935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/1e04c935-0f3a-4def-abd4-b6fae92fa742 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:51.930685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.931683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 14d06940-7b7c-4a45-be79-0e368aaa02a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.940053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.940558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.941215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.941935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.942619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.943786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.950264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:51.951173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:51.964460 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 HTTP/1.1 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '14d06940-7b7c-4a45-be79-0e368aaa02a1'} Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:51.966466 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. Aug 30 16:15:51.971960 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:51.972618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.972618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.972618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.974431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:51.974431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:51.974620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 14d06940-7b7c-4a45-be79-0e368aaa02a1 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:51.975830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:51.982821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4105f3fc-741d-4d89-b7cd-93fa9d3e1c85 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1" status: 404 len: 111 microversion: 2.1 time: 0.059466 Aug 30 16:15:51.986621 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1327/2936] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/14d06940-7b7c-4a45-be79-0e368aaa02a1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:52.004001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59ce1a90-04b3-46e0-a885-04701bf6bc35 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.115323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.116145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.116983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.117625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lazy-loading 'fault' on Instance uuid b6f53ebf-eba8-4fd5-9391-de6ef762c057 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:52.154114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59ce1a90-04b3-46e0-a885-04701bf6bc35 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/77a6ff0e-eaab-49f4-b166-bd7f68d69e5e" status: 204 len: 0 microversion: 2.1 time: 0.165918 Aug 30 16:15:52.155038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1328/2937] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:15:51 2022] DELETE /compute/v2.1/os-server-groups/77a6ff0e-eaab-49f4-b166-bd7f68d69e5e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:15:52.164466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.164979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:52.174359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:52.192324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:52.195669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.206775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.207406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.207742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:52.209450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.211277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.211507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-abbefbed-7812-4308-a399-0d89788621ad tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 200 len: 1375 microversion: 2.25 time: 0.269099 Aug 30 16:15:52.212539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.220904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1610/2938] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:51 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 1375 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:52.285837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:52.434255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.435203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:52.451805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.452689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.453266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.454026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.456545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.457073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.481346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4507da90-0c9b-44d9-affa-c276a861ae36 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 204 len: 0 microversion: 2.1 time: 0.321061 Aug 30 16:15:52.482888 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1329/2939] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:15:52 2022] DELETE /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:15:52.493494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.495589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:52.504241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.505379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.506287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.507572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.508329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.509031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.587353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:52.595806 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f124de1-5f73-45fb-a8d5-9f9793f60263 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1274 microversion: 2.1 time: 0.169397 Aug 30 16:15:52.597708 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1611/2940] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:52 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:52.603817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.604749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:52.612504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.613197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.613931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.614924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.615547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.616142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.933300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:52.948629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a5322b9-4e85-4006-bd1d-1b71259fe9d6 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.349561 Aug 30 16:15:52.949698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1612/2941] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:52 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:52.967928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:52.968947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:52.977481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.978404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.979137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:52.980711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:52.981186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:52.981794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.145063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.157797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.159907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.166822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-446e7482-cbc2-4940-b82e-7d37047dd4bf tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1443 microversion: 2.75 time: 0.215774 Aug 30 16:15:53.170347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1613/2942] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:52 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1443 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:53.173933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:53.174616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:53.179577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.189581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.190260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.190743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.191474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.191943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.192388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.193362 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-472179f9-d77f-4f3c-bfe9-9606a6603ab5 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1472 microversion: 2.1 time: 0.705902 Aug 30 16:15:53.193979 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1330/2943] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:52 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1472 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:53.240188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:53.241262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: b6f53ebf-eba8-4fd5-9391-de6ef762c057] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:53.251517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.266843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.267784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.268576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.269054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.272554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.294093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] HTTP exception thrown: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Request method failure captured: Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 HTTP/1.1 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjYGDmge_lEVDMTaUMIY6p6FUu5ZszHJ7sb5gmAPNICJ9zyxhTLblLRJHJKGfwqjpw56upavNhfi9ZkreBh_yCKw3olCdlunKd7jeRH7lbF8Q5aZxJZdFDeC4LOvF4Yye-SlDRcPTxm6g12TaG4ChMj5TIa93JmXGc3tlqqEJRgMli0 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}] Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 81b24fcdb0a749caa02a34817e8fe9f8 Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b6f53ebf-eba8-4fd5-9391-de6ef762c057'} Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. Aug 30 16:15:53.296150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. Aug 30 16:15:53.300722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:53.301415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Returning 404 to user: Instance b6f53ebf-eba8-4fd5-9391-de6ef762c057 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:53.303008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8cfab7d-75ae-439b-9b7c-3ee6e5fcd705 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057" status: 404 len: 111 microversion: 2.25 time: 0.069772 Aug 30 16:15:53.303710 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1331/2944] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:53 2022] GET /compute/v2.1/servers/b6f53ebf-eba8-4fd5-9391-de6ef762c057 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:15:53.319837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77a3f532-4ed6-4667-9ff0-6bf9a7b6a6aa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '.version_select at 0x7fd35c2eee50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:53.359270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77a3f532-4ed6-4667-9ff0-6bf9a7b6a6aa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361998287" status: 204 len: 0 microversion: 2.25 time: 0.046242 Aug 30 16:15:53.360904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1332/2945] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361998287 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:15:53.470527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.473721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:53.483127 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a7582ee-2d72-429a-af29-799fec5f86ad tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.314258 Aug 30 16:15:53.487456 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1614/2946] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:53 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:53.618104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:53.619171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:53.632778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.633861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.634518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.635839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.636302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.636731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.808802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:53.821514 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8321e386-99bb-4271-a17e-ce8a1cfc8c89 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1280 microversion: 2.1 time: 0.207392 Aug 30 16:15:53.822704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1333/2947] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:53 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:53.979098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:53.979985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:53.987918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.988936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.990334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:53.991311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:53.991986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:53.992631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.213896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:54.216251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:54.241626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.245956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.247866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.251083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.255327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.257571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.401487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:54.416335 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa013c22-2f9a-437e-a414-df17c721cd5b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.446604 Aug 30 16:15:54.438268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1615/2948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:53 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:54.445125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:54.446323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:54.453630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.454975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.455649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.456620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.457246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.457840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.578657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:54.590941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:54.592699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:54.599528 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-121dc54e-2e2a-41af-ad3a-53fa4055d5c7 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1443 microversion: 2.75 time: 0.407712 Aug 30 16:15:54.612327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1334/2949] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:54 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1443 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:15:54.652904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:54.656489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:54.687889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.697196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.697857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:54.699333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:54.701512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:54.702117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.165236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.178323 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07bf8893-3b8f-4656-a170-951b41e9c248 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1472 microversion: 2.1 time: 0.738461 Aug 30 16:15:55.182873 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1616/2950] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:54 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1472 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:55.196687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:55.197769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:55.211773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.219950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.220635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.221575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.222227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.223039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.401282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.403329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.425784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-997dcab5-f685-4cc7-8105-eb6072cd217d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1280 microversion: 2.1 time: 0.241512 Aug 30 16:15:55.439913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e02b0abb-f4e2-4c18-8f26-190a61d263e5 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.826055 Aug 30 16:15:55.440538 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1335/2951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:54 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:55.450984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1617/2952] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:55 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1280 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:55.469844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:55.472046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:55.474733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:55.475620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:55.485323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.486234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.487040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.488184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.489087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.490596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.492042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.492250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.495494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.496372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.497181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.497643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.533429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:15:55.668339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:55.740912 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea61bba0-50a9-4cd4-a9d0-4beef7c055e1 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 204 len: 0 microversion: 2.25 time: 0.292869 Aug 30 16:15:55.745095 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1336/2953] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:15:55 2022] DELETE /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:15:55.748896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:55.749474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:55.763115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.764388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.765010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.765839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.766322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.767148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.820711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.821809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:55.821978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:55.822800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lazy-loading 'fault' on Instance uuid 86cf1997-29de-4827-a8af-0c2fc18979db {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:55.915261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.930083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.935711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a9c9c525e1348e2b06930950040d24f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1c5a70408c4c3f8b122fc442f2a278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:55.950821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90c8dd43-cbdc-49c5-a94c-785a86d75474 tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 200 len: 1448 microversion: 2.75 time: 0.205645 Aug 30 16:15:55.963465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1337/2954] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:55 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 1448 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:55.982503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:55.983911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:55.995515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:55.995860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.000192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.001099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.001582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.002030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.051176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:56.060733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2fa56039-bc45-4c84-b76b-e051071ad11a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1733 microversion: 2.1 time: 0.608511 Aug 30 16:15:56.074719 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1618/2955] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:55 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1733 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:56.260626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c146e18-6f96-4c5a-bbc6-ff7ef570db71", "name": "network-vif-deleted", "tag": "231cbb7b-609b-4730-81ad-8e92a9423f57"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:56.265647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:56.273248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.273747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.274414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.293344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] Creating event network-vif-deleted:231cbb7b-609b-4730-81ad-8e92a9423f57 for instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 on n-h1-830883-28 Aug 30 16:15:56.304039 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f7fccaa9-6593-48c2-9511-b89f5f31aada req-e01de63a-5f2b-412c-a6fa-e4a8741b4e05 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227958 Aug 30 16:15:56.305313 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1619/2956] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:56.321645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:56.324131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:56.339315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.347496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.348342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.350615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.351642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.352341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.499897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:56.510046 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aafe356d-727b-4880-b65b-77e0fbc6b727 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1430 microversion: 2.1 time: 0.203290 Aug 30 16:15:56.511014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1620/2957] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:56 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1430 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:56.516960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:56.517941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:56.526223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.526983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.527742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.528744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.529488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.530177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.720239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:56.729795 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ca66f4d-eb2d-4eec-b71b-fac31f86d078 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.217709 Aug 30 16:15:56.730413 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1621/2958] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:56 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:56.735925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:56.736699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:56.745086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.745880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.746709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.747649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.748294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.748910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.861159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:56.876706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a5ae4af-8eb9-4865-b485-8572f082be95 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1280 microversion: 2.1 time: 0.144032 Aug 30 16:15:56.878882 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1622/2959] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:56 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:56.885915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc113d65-52f3-440f-819a-e070aa624a6d", "name": "network-vif-plugged", "status": "completed", "tag": "bf7d7f31-702f-4abd-91bd-b4765ffb7b62"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:56.898093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.898738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:56.899281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:56.912582 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] Creating event network-vif-plugged:bf7d7f31-702f-4abd-91bd-b4765ffb7b62 for instance dc113d65-52f3-440f-819a-e070aa624a6d on n-h2-830883-28 Aug 30 16:15:56.917822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-66bc5f64-1c34-4938-aa2c-ec54aa0e41aa req-1cf35645-d98a-443c-8329-930f087c71c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037569 Aug 30 16:15:56.918790 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1623/2960] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:15:56.990774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:56.991797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] [instance: 86cf1997-29de-4827-a8af-0c2fc18979db] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:56.999076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:56.999892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.000544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.001369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.002030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.002718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.020611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] HTTP exception thrown: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Request method failure captured: Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db HTTP/1.1 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjdi8OJURv4F51q7ziWzcv51Ao4wjHk9hGBFmqez4ev9WJG16lJD48-xyS5emxbdd3oNyWYaE_RNfNSB2nZt4Y_1JuaCgRIJc69aqxtdrRR5u7dORZOGNzE9TTKkT0oyzCzqAF-pUg4DStpjocpwgLtcw0J2NuZ8svhhKFCsSJrl5Ec Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.75 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ce1c5a70408c4c3f8b122fc442f2a278 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdmin275Test-1889398702 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ce1c5a70408c4c3f8b122fc442f2a278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ce1c5a70408c4c3f8b122fc442f2a278"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ce1c5a70408c4c3f8b122fc442f2a278"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ce1c5a70408c4c3f8b122fc442f2a278"}]}] Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdmin275Test-1889398702 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ce1c5a70408c4c3f8b122fc442f2a278 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdmin275Test-1889398702 Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdmin275Test-1889398702-project Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 5a9c9c525e1348e2b06930950040d24f Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdmin275Test-1889398702-project Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '86cf1997-29de-4827-a8af-0c2fc18979db'} Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:57.022561 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] Returning 404 to user: Instance 86cf1997-29de-4827-a8af-0c2fc18979db could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48ebee45-eb37-4b31-9f0c-afe93a15b59d tempest-ServersAdmin275Test-1889398702 tempest-ServersAdmin275Test-1889398702-project] 10.222.0.47 "GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db" status: 404 len: 111 microversion: 2.75 time: 0.048379 Aug 30 16:15:57.026908 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1624/2961] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:56 2022] GET /compute/v2.1/servers/86cf1997-29de-4827-a8af-0c2fc18979db => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:15:57.089029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:57.089613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.098159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.098784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.099567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.100243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.101070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.102207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.116289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:57.124694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:57.126124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:57.127364 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5ebb36c-e802-4ff9-85d0-a7e4fd2ec042 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1549 microversion: 2.25 time: 1.162530 Aug 30 16:15:57.127867 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1338/2962] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:55 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1549 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:57.269105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:57.278089 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-917b6b10-423a-4459-8fad-abc45c65b703 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1713 microversion: 2.1 time: 0.193080 Aug 30 16:15:57.278706 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1625/2963] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:57 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1713 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:57.463632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:57.464131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.470922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.471411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.471847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.472549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.473000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.473422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.532466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:57.533084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.548270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.549017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.549651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.550557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.551169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.551757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.591832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.592688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.593319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.594202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lazy-loading 'fault' on Instance uuid 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:15:57.628060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Cannot 'detach_volume' instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 while it is in vm_state rescued Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments/1cc86da6-daf7-4dcd-9159-54e6254cf8e5 HTTP/1.1 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'detach_volume' instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 while it is in vm_state rescued Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '0ba50491-c695-4c19-a36e-09d614d1b9a2', 'id': '1cc86da6-daf7-4dcd-9159-54e6254cf8e5'} Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 while it is in vm_state rescued Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.629805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 while it is in vm_state rescued Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 409 to user: Cannot 'detach_volume' instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 while it is in vm_state rescued {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:57.634711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e1bf699-e2f2-496d-a8d9-89c4cfe74b1a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments/1cc86da6-daf7-4dcd-9159-54e6254cf8e5" status: 409 len: 152 microversion: 2.1 time: 0.172076 Aug 30 16:15:57.635935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1339/2964] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:15:57 2022] DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments/1cc86da6-daf7-4dcd-9159-54e6254cf8e5 => generated 152 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:15:57.640795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:15:57.641334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.648781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.649334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.649779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.651305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.651305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.651514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.659181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07ded691ce047bd857e8ff51aa88668', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f17545909b3c4b559a571813e373cd09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:57.666975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-458e7cbc-0d5e-491d-9215-ca6fab20dd48 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 200 len: 1306 microversion: 2.1 time: 0.138271 Aug 30 16:15:57.667813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1626/2965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:57 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:57.750790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:57.751943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.759704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.760538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.761218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.766596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.767024 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27b498c4-d7c7-471c-9b42-c5c9c82591a3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/action" status: 202 len: 0 microversion: 2.1 time: 0.128868 Aug 30 16:15:57.767783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.772272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1340/2966] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:15:57 2022] POST /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:15:57.773279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.779619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:57.780859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:57.790354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.790852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.791335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:57.792036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:57.792716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:57.793441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.151532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.163608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad0cb27c-cf5f-4357-9a99-e7213842f568 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1316 microversion: 2.1 time: 0.415771 Aug 30 16:15:58.165720 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1627/2967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:57 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:58.176313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:58.177977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:58.185216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.185894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.186391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.187107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.187574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.188009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.501203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.516220 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79106a33-4115-476b-bb03-8e96d005e88b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.348713 Aug 30 16:15:58.516475 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1628/2968] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:58 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:58.526362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.546022 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db80b364-0e04-4f72-a413-3427aacb00f9 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1721 microversion: 2.1 time: 0.770657 Aug 30 16:15:58.547107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:58.551454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:58.569315 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1341/2969] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:57 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1721 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:15:58.591707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.592827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.595114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.596352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.598363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.599076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.691010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:58.692143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] [instance: 2c146e18-6f96-4c5a-bbc6-ff7ef570db71] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:58.717641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.719325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.720610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.722393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:58.723254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:58.724830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:58.764786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] HTTP exception thrown: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Request method failure captured: Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 HTTP/1.1 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbfqvf5-wOVgLMpMX0yaxgYjJmrwnZmDLNDjV9W2Wzmldg6URePEZQsj9pqoG1YzEGqigbfgiSfrG8dzdy5nklj4pDlkYOrcguz6s7O88u9tPxqImrOXPOnKT13UxYEeW79h58kvzu7N6Whiu4oi-5Os-1C4BLxPxRSba5MHsQYvZE Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f17545909b3c4b559a571813e373cd09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f17545909b3c4b559a571813e373cd09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f17545909b3c4b559a571813e373cd09"}]}] Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f17545909b3c4b559a571813e373cd09 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-53997208 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f07ded691ce047bd857e8ff51aa88668 Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersOnMultiNodesTest-53997208-project Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '2c146e18-6f96-4c5a-bbc6-ff7ef570db71'} Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:15:58.767235 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. Aug 30 16:15:58.772850 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:15:58.775259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] Returning 404 to user: Instance 2c146e18-6f96-4c5a-bbc6-ff7ef570db71 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:15:58.776424 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0426afa8-fd69-4d39-85b4-440707048097 tempest-ServersOnMultiNodesTest-53997208 tempest-ServersOnMultiNodesTest-53997208-project] 10.222.0.47 "GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71" status: 404 len: 111 microversion: 2.1 time: 0.090155 Aug 30 16:15:58.786527 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1342/2970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:58 2022] GET /compute/v2.1/servers/2c146e18-6f96-4c5a-bbc6-ff7ef570db71 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:15:58.840954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.859834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.862908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:58.865051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa4fec74-64d5-4b25-886e-f83543237ddb tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1549 microversion: 2.25 time: 0.329806 Aug 30 16:15:58.878331 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1629/2971] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:15:58 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1549 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:15:59.186172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:59.186907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:59.193385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.194160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.194805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:59.195759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.196404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.197030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:59.540650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:59.541549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:59.546106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:59.551514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.552851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.553538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:59.554739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.555443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.556136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:59.725831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:15:59.839333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:15:59.855610 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c9d5019-9839-4d2f-9f53-999c4eaec9fe tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.319625 Aug 30 16:15:59.867638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1630/2972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:59 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:15:59.879007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:15:59.879849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:15:59.892349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.893261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.893882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:15:59.894940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:15:59.896616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:15:59.898162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.180688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:00.195710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:00.230940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c73b149-670e-4b71-b49b-95bd5a851239 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1721 microversion: 2.1 time: 0.340587 Aug 30 16:16:00.245612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1631/2973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:59 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:00.263499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.264265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.283124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.283636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.290464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.291374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.291934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.292393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.331984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:00.344077 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6fbd2a6-8507-409e-a925-9fedf1ab6504 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1505 microversion: 2.1 time: 1.158972 Aug 30 16:16:00.344849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1343/2974] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:15:59 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1505 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:00.354327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d9ce8c-247b-4ece-adb0-7b6a2d3f8060", "name": "network-vif-deleted", "tag": "70e8d58f-9b98-4cd0-b643-5fb0ece3ac19"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:00.385796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.386460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.386911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.407781 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] Creating event network-vif-deleted:70e8d58f-9b98-4cd0-b643-5fb0ece3ac19 for instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 on n-h2-830883-28 Aug 30 16:16:00.413269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.415221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.420438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.423529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lazy-loading 'fault' on Instance uuid 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:00.428682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-862e00d7-c2db-4f79-a310-3e2bdb3e0376 req-4d0d7872-d8f4-4a9e-8c17-c557b155d881 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081836 Aug 30 16:16:00.429303 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1344/2975] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:00.435520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.436093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.457218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.457876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.458722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.459610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.460216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.460785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.605248 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-67e7f2b1-f58f-494b-949d-5cf7f78c5394 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.174604 Aug 30 16:16:00.606233 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1345/2976] 10.222.0.47 () {58 vars in 1296 bytes} [Tue Aug 30 16:16:00 2022] DELETE /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d/os-server-password => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:16:00.615732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.616437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.635997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.636491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.636927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.637694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.638264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.638731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.664090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1369a03e-35ee-4b06-bb7d-463df0d80fc6 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053020 Aug 30 16:16:00.665379 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1346/2977] 10.222.0.47 () {58 vars in 1293 bytes} [Tue Aug 30 16:16:00 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d/os-server-password => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:16:00.678492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.679386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.690113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.692486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:00.694487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.700761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:00.701434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.702266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.702863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.703794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.706009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:00.713843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:00.715344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26e9fd5d-e757-4ec9-a8b2-09c723a63ebe tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 200 len: 1352 microversion: 2.25 time: 0.468425 Aug 30 16:16:00.731144 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1632/2978] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:00 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 1352 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:16:00.757245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:00.883599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.885990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.903760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.904558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.905234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.906166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.908026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.908698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.930898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c1fd37c6-78e7-4ffd-9d3b-8e79ede17e2a tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 204 len: 0 microversion: 2.1 time: 0.259351 Aug 30 16:16:00.931552 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1347/2979] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:00 2022] DELETE /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:16:00.940710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:00.941419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:00.978162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.980170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.981435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:00.985644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:00.992786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:00.998928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.258922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:01.268373 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33d8e99d-4108-4a17-a87a-cc7bd8b00049 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.393170 Aug 30 16:16:01.272353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1633/2980] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:00 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:01.285434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:01.287305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:01.319217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.319970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.321793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.323064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.323782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.324263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.401125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:01.727597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:01.743909 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac0a67ad-b769-429f-89a4-9fd787e015c1 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1721 microversion: 2.1 time: 0.469722 Aug 30 16:16:01.758883 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1634/2981] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:01 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:01.772176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:01.775156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:01.792607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.793455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.794140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.795970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.796687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.797369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.828466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] HTTP exception thrown: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Request method failure captured: Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 HTTP/1.1 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYGDmge_lEVDMTaUMIY6p6FUu5ZszHJ7sb5gmAPNICJ9zyxhTLblLRJHJKGfwqjpw56upavNhfi9ZkreBh_yCKw3olCdlunKd7jeRH7lbF8Q5aZxJZdFDeC4LOvF4Yye-SlDRcPTxm6g12TaG4ChMj5TIa93JmXGc3tlqqEJRgMli0 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}] Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 81b24fcdb0a749caa02a34817e8fe9f8 Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '97d9ce8c-247b-4ece-adb0-7b6a2d3f8060'} Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. Aug 30 16:16:01.830844 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Returning 404 to user: Instance 97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d7a99af-7e3f-4077-a125-e2dd155195d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060" status: 404 len: 111 microversion: 2.25 time: 0.072451 Aug 30 16:16:01.836004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1635/2982] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:01 2022] GET /compute/v2.1/servers/97d9ce8c-247b-4ece-adb0-7b6a2d3f8060 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:01.845148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:01.846093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:01.854214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.854755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.855295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.856008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:01.856468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:01.856902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:01.903516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:01.907628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:01.925499 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d99bdd1-11ab-4cc1-b466-bad5fccb21c2 tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1511 microversion: 2.1 time: 0.987425 Aug 30 16:16:01.948972 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1348/2983] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:00 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1511 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:02.126013 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6c95ce6-f438-4b04-b556-cb830275aece tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 204 len: 0 microversion: 2.25 time: 0.286141 Aug 30 16:16:02.131613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1636/2984] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:16:01 2022] DELETE /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:16:02.139829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:02.140955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:02.153335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.154169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.155388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.156892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.157933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.158511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.396429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9527df7-c7fe-4f4b-a11e-528cfba8edc9 tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T16%3A16%3A02.187615&end=2022-08-31T16%3A16%3A02.187615" status: 404 len: 112 microversion: - time: 0.204401 Aug 30 16:16:02.404036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1637/2985] 10.222.0.47 () {58 vars in 1316 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T16%3A16%3A02.187615&end=2022-08-31T16%3A16%3A02.187615 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:16:02.409819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:02.411981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:02.421462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.422221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.423153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.424308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.425051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.425853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.637120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:02.648099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b1b14716-2015-4aa2-aec5-7bec551ce5f0 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.242649 Aug 30 16:16:02.649169 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1638/2986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:02.654985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-713812c9-b7f9-44a2-b1e7-aa6488a2a5ff tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] Calling method '.version_select at 0x7fd35cc04820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:02.660448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-713812c9-b7f9-44a2-b1e7-aa6488a2a5ff tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 30 16:16:02.665827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-713812c9-b7f9-44a2-b1e7-aa6488a2a5ff tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] Request method failure captured: Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-simple-tenant-usage/e7212dc4ee1e4530982694cd7c808f31?start=2022-08-31T16%3A16%3A02.187615&end=2022-08-29T16%3A16%3A02.187615 HTTP/1.1 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjfByFo3Xyr_9TF_yoAnCWERqkCBLQa-DwHPH9vArLtUAkr_xj5_l08r4PZ_O4AZIKS0PTtbUMs0M8HkF25S9C27thQZN9_vXPyAnBezhfJkB8434Wf01bu6mmz7ZOrn01xSFrrVaq7F3bvaIMB0A2YQK3rONTg93POtwhtvIlibSko Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8351cc8025fe462b95e7f6a711e6a13d Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1398509021 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8351cc8025fe462b95e7f6a711e6a13d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8351cc8025fe462b95e7f6a711e6a13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8351cc8025fe462b95e7f6a711e6a13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8351cc8025fe462b95e7f6a711e6a13d"}]}] Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1398509021 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8351cc8025fe462b95e7f6a711e6a13d Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1398509021 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 6ad191412bd84d3c959fc3937bab9137 Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid start time. The start time cannot occur after the end time. Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'e7212dc4ee1e4530982694cd7c808f31'} Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 30 16:16:02.673956 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:02.679755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-713812c9-b7f9-44a2-b1e7-aa6488a2a5ff tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:02.679847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:02.680906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:02.682098 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dff44fa8-86b6-4502-ae20-609b761581fa tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1564 microversion: 2.25 time: 0.546694 Aug 30 16:16:02.683540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-713812c9-b7f9-44a2-b1e7-aa6488a2a5ff tempest-TenantUsagesNegativeTestJSON-1398509021 tempest-TenantUsagesNegativeTestJSON-1398509021-project-admin] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage/e7212dc4ee1e4530982694cd7c808f31?start=2022-08-31T16%3A16%3A02.187615&end=2022-08-29T16%3A16%3A02.187615" status: 400 len: 111 microversion: 2.1 time: 0.033248 Aug 30 16:16:02.684710 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1639/2987] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/os-simple-tenant-usage/e7212dc4ee1e4530982694cd7c808f31?start=2022-08-31T16%3A16%3A02.187615&end=2022-08-29T16%3A16%3A02.187615 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:02.688886 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1349/2988] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1564 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:16:02.690791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3d93f9-6311-453c-ae28-0be8b94cbf28", "tag": "dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:02.717472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.718435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.719040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.734501 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] Creating event network-changed:dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d for instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 on n-h2-830883-28 Aug 30 16:16:02.740934 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-25217a67-c477-4240-bae7-48fdbb6e9107 req-b7db8591-27fd-4b75-b810-9c4d6a9d34f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055284 Aug 30 16:16:02.742258 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1640/2989] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:02.774555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:02.775834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:02.783949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.784807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.785563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:02.788492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:02.789466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:02.790137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.027705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:03.044289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04de064f-a942-4d01-9c57-74e4cd05194b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1721 microversion: 2.1 time: 0.274985 Aug 30 16:16:03.045547 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1641/2990] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:03.073795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:03.075352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:03.088994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.089761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.090584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.093044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.095545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.095988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.147069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba48c677-e74d-4165-908c-e85b34449384 tempest-TenantUsagesNegativeTestJSON-752324261 tempest-TenantUsagesNegativeTestJSON-752324261-project] Calling method '.version_select at 0x7fd35c2b3670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:03.151262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ba48c677-e74d-4165-908c-e85b34449384 tempest-TenantUsagesNegativeTestJSON-752324261 tempest-TenantUsagesNegativeTestJSON-752324261-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '01e30c5bc45e4ef48437d1e35aa567da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7212dc4ee1e4530982694cd7c808f31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba48c677-e74d-4165-908c-e85b34449384 tempest-TenantUsagesNegativeTestJSON-752324261 tempest-TenantUsagesNegativeTestJSON-752324261-project] Request method failure captured: Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T16%3A16%3A02.187615&end=2022-08-31T16%3A16%3A02.187615&detailed=1 HTTP/1.1 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfBGKExNk0GoYYke28phvId0eexD0eK8oMNROz-C2iowDtqFACaEQANaQ6I-lhX4464PgFmBSXRe_Qn9rdSlESzD-LtoST-MqeeyeO1zW0I__PfNB8zg4mKOecRgx28FzqbaEl9L7Ab2oPso-TlDqaafsImhJAqm7fcGuir1iHTqXw Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e7212dc4ee1e4530982694cd7c808f31 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-752324261 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7212dc4ee1e4530982694cd7c808f31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e7212dc4ee1e4530982694cd7c808f31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e7212dc4ee1e4530982694cd7c808f31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e7212dc4ee1e4530982694cd7c808f31"}]}] Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-752324261 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e7212dc4ee1e4530982694cd7c808f31 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-752324261 Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TenantUsagesNegativeTestJSON-752324261-project Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 01e30c5bc45e4ef48437d1e35aa567da Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-752324261-project Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:16:03.154341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 16:16:03.159228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:03.161314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba48c677-e74d-4165-908c-e85b34449384 tempest-TenantUsagesNegativeTestJSON-752324261 tempest-TenantUsagesNegativeTestJSON-752324261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:03.163698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba48c677-e74d-4165-908c-e85b34449384 tempest-TenantUsagesNegativeTestJSON-752324261 tempest-TenantUsagesNegativeTestJSON-752324261-project] 10.222.0.47 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T16%3A16%3A02.187615&end=2022-08-31T16%3A16%3A02.187615&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.461972 Aug 30 16:16:03.169495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1350/2991] 10.222.0.47 () {58 vars in 1335 bytes} [Tue Aug 30 16:16:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T16%3A16%3A02.187615&end=2022-08-31T16%3A16%3A02.187615&detailed=1 => generated 123 bytes in 468 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:03.312959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:03.324778 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f650046-106b-48cd-a537-a74b2979b80c tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1511 microversion: 2.1 time: 0.277886 Aug 30 16:16:03.326530 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1642/2992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:03 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:03.671501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:03.672489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:03.683191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.683933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.684737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.685722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.687204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.688734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.714142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:03.715292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:03.733435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.736206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.737018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.738544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:03.740906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:03.741459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:03.754454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=7,nova_cell1:UPDATE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:04.010752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.026437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.029163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.031044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fac5b08-fa8f-43ec-a5b2-d3f91aba79c6 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1564 microversion: 2.25 time: 0.323620 Aug 30 16:16:04.032634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1643/2993] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:03 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1564 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:16:04.069622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.079364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:04.115568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.118526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.120364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.121307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.123162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.124550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.324745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.347926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-57f6123e-c43a-46c2-9fd4-9fa47efd517f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1727 microversion: 2.1 time: 0.285152 Aug 30 16:16:04.351634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1644/2994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1727 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:04.507161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.514931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.515751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.516501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.517700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.518522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.519232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.576780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23d0f572-39b4-4002-a875-6a3f85c2653d tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.223074 Aug 30 16:16:04.577117 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1645/2995] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/os-services => generated 949 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:04.594804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.595783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:04.603560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.604088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.604525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.605224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.605689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.606116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.759862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.769152 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-214db00c-be83-42e0-93eb-77cdfb285a8f tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1511 microversion: 2.1 time: 0.190207 Aug 30 16:16:04.769964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1646/2996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:04.782546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.782546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:04.787339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.787829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.788269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.789149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.789613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.790029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.888116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf77d778-1e22-4026-a79b-1046c096f14e tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116787 Aug 30 16:16:04.888716 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1647/2997] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:04.896992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.900603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.901377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.901857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.902886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.903348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.903775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.922524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:04.940561 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0eb9e49a-c003-44d7-af45-dc73129fe80d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 1.275110 Aug 30 16:16:04.941388 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1351/2998] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:03 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:04.950626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7339080e-b2f9-4613-b5e1-88506d86a7ea", "tag": "0fadbe55-c08a-4a21-85da-cc4f49dc87e8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:04.963081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-525c4d19-d0b0-4707-a588-66fd43eedc26 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-830883-28" status: 200 len: 581 microversion: 2.1 time: 0.067065 Aug 30 16:16:04.963730 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1648/2999] 10.222.0.47 () {58 vars in 1174 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/os-services?host=n-d-830883-28 => generated 581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:04.965460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:04.973290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.974561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.975278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.977008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:04.982971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.983606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.984146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.984975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:04.985530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:04.986189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:04.997179 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] Creating event network-changed:0fadbe55-c08a-4a21-85da-cc4f49dc87e8 for instance 7339080e-b2f9-4613-b5e1-88506d86a7ea on n-h2-830883-28 Aug 30 16:16:05.005519 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-61acf28e-f121-4f56-a686-0ce3fd2cfdc2 req-9f3b4cab-15a6-466a-8d41-65a3e9435662 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061548 Aug 30 16:16:05.008527 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1352/3000] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:05.012757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-acdaeddb-27f1-46ba-bdb7-c3155dc39117 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040268 Aug 30 16:16:05.013501 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1649/3001] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:16:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:05.028932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:05.032403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.032883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.034520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.035479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.036106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.037085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.056647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:05.057511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:05.065327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07d3778f-7ab7-401d-ae31-3efd5c633d50 tempest-ServicesAdminTestJSON-1095813213 tempest-ServicesAdminTestJSON-1095813213-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.040290 Aug 30 16:16:05.065948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1353/3002] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:16:05 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:05.067765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.068983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.069658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.071429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.072123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.073035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.478673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:05.492216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:05.495412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:05.498262 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-073ffcf4-07ea-4081-9160-8d1ff8c9e3d0 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1564 microversion: 2.25 time: 0.444963 Aug 30 16:16:05.502377 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1650/3003] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:05 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1564 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:16:05.794161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:05.795042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:05.809519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.810730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.812475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.814191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.815290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.818653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.966098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:05.966756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:05.980012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.980403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.980853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:05.982416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:05.982890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:05.983328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:06.018520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:06.040299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c3b9ac1-4bdf-4973-b552-42dd248681de tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1469 microversion: 2.1 time: 0.250916 Aug 30 16:16:06.042598 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1354/3004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:05 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:06.524622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:06.525565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:06.534715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:06.535563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:06.536436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:06.537945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:06.538686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:06.539397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:06.580850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:06.581573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:06.582366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:06.584246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lazy-loading 'fault' on Instance uuid d099e350-f039-4f9c-bc02-ca37ebe42d0d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:06.678878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:06.691811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:06.695914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81b24fcdb0a749caa02a34817e8fe9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8325d53f9148ab83a9416259312f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:06.701557 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eb2353c9-9edc-4e7f-9e97-eefceb969322 tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 200 len: 1351 microversion: 2.25 time: 0.179031 Aug 30 16:16:06.702676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1355/3005] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:06 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 1351 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:16:06.744261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:06.754447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-971cba6b-4654-4b3f-9346-6f4d66dbde94 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.792924 Aug 30 16:16:06.755259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1651/3006] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:05 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:07.067697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:07.069306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:07.079304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.080076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.080771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.081974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.083406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.084442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.149036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.149973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.150725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.152485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lazy-loading 'fault' on Instance uuid dc113d65-52f3-440f-819a-e070aa624a6d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:07.180634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc113d65-52f3-440f-819a-e070aa624a6d", "name": "network-vif-deleted", "tag": "bf7d7f31-702f-4abd-91bd-b4765ffb7b62"}, {"server_uuid": "d099e350-f039-4f9c-bc02-ca37ebe42d0d", "name": "network-vif-deleted", "tag": "5c85db8f-e596-48fe-a929-7968141fd055"}, {"name": "network-changed", "server_uuid": "046f7bc4-73c6-4f20-a0e2-73b32af92643", "tag": "81eb1298-f1c8-4b35-b46d-cd42cbac8284"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:07.210246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.218437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.218775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.255892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Creating event network-vif-deleted:bf7d7f31-702f-4abd-91bd-b4765ffb7b62 for instance dc113d65-52f3-440f-819a-e070aa624a6d on n-h2-830883-28 Aug 30 16:16:07.258337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Creating event network-vif-deleted:5c85db8f-e596-48fe-a929-7968141fd055 for instance d099e350-f039-4f9c-bc02-ca37ebe42d0d on n-h1-830883-28 Aug 30 16:16:07.260143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] Creating event network-changed:81eb1298-f1c8-4b35-b46d-cd42cbac8284 for instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 on n-h1-830883-28 Aug 30 16:16:07.281571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1a363a01-0da9-4ad1-97f8-d527e305b3a1 req-09809e39-0281-4a86-9e5b-40e8c0b9d3c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.107258 Aug 30 16:16:07.283334 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1652/3007] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:07.290403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:07.305888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.306765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.308078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.324347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] Creating event network-changed:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:16:07.330913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf39f4cee5740f7b12e1e31ef1820fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f8254fcb64493a3660a7f15ee09b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:07.343414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6afee6f1-2f82-4d09-8a13-cded03cee9ac tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 200 len: 1306 microversion: 2.1 time: 0.281419 Aug 30 16:16:07.345052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1356/3008] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:07 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 1306 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:07.346755 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ad084c1a-f1f3-4e81-b439-bc26678d8a0f req-c875994e-933e-4909-807f-d8455b4a13a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059269 Aug 30 16:16:07.348275 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1653/3009] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:07.599661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:07.600438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:07.618841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.620758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.623298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.626767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.631409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.632651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.726884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:07.736386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] [instance: d099e350-f039-4f9c-bc02-ca37ebe42d0d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:07.753660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.757742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.758676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.759652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.760337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.761028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.800370 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] HTTP exception thrown: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Request method failure captured: Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d HTTP/1.1 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjYGDmge_lEVDMTaUMIY6p6FUu5ZszHJ7sb5gmAPNICJ9zyxhTLblLRJHJKGfwqjpw56upavNhfi9ZkreBh_yCKw3olCdlunKd7jeRH7lbF8Q5aZxJZdFDeC4LOvF4Yye-SlDRcPTxm6g12TaG4ChMj5TIa93JmXGc3tlqqEJRgMli0 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7f8325d53f9148ab83a9416259312f4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7f8325d53f9148ab83a9416259312f4d"}]}] Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 7f8325d53f9148ab83a9416259312f4d Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-87021359 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 81b24fcdb0a749caa02a34817e8fe9f8 Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-87021359-project Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd099e350-f039-4f9c-bc02-ca37ebe42d0d'} Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. Aug 30 16:16:07.803869 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. Aug 30 16:16:07.808524 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:07.810143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] Returning 404 to user: Instance d099e350-f039-4f9c-bc02-ca37ebe42d0d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:07.815969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34964537-dcdf-4a3e-8642-ed538e01305d tempest-LiveAutoBlockMigrationV225Test-87021359 tempest-LiveAutoBlockMigrationV225Test-87021359-project] 10.222.0.47 "GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d" status: 404 len: 111 microversion: 2.25 time: 0.094480 Aug 30 16:16:07.816830 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1654/3010] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:07 2022] GET /compute/v2.1/servers/d099e350-f039-4f9c-bc02-ca37ebe42d0d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:07.830910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:07.831954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:07.847031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.848004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.849130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.850679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:07.851763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:07.852495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:07.884581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:08.351980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:08.369730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bd4af78-dd66-4345-af1c-f5bcb4b29571 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.548124 Aug 30 16:16:08.372206 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1655/3011] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:07 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:08.385409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:08.386577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] [instance: dc113d65-52f3-440f-819a-e070aa624a6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:08.406499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:08.407296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:08.409172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:08.410382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:08.413161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:08.413731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:08.454626 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] HTTP exception thrown: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Request method failure captured: Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d HTTP/1.1 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjekWmYMID1wbcaL6rt82JTrSBjOokJI8D0si6yHmOs0iztAbqKhOp4eEkSst7mHJGQYU9EOFQOPEhk0UUyiqhnWFsWd96dfNKqoQjeXzXw85YHmtM-1qYq-BJ-JFMqakRyj0EPZ8LRH7NoG2EoPxtLveE1_uVtyO8-FJ-SnLQ0qqBQ Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 0b9f8254fcb64493a3660a7f15ee09b6 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerPasswordTestJSON-1290102305 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0b9f8254fcb64493a3660a7f15ee09b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0b9f8254fcb64493a3660a7f15ee09b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0b9f8254fcb64493a3660a7f15ee09b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0b9f8254fcb64493a3660a7f15ee09b6"}]}] Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerPasswordTestJSON-1290102305 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 0b9f8254fcb64493a3660a7f15ee09b6 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1290102305 Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerPasswordTestJSON-1290102305-project Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: edf39f4cee5740f7b12e1e31ef1820fb Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerPasswordTestJSON-1290102305-project Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'dc113d65-52f3-440f-819a-e070aa624a6d'} Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:08.459668 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. Aug 30 16:16:08.463601 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:08.466730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] Returning 404 to user: Instance dc113d65-52f3-440f-819a-e070aa624a6d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:08.467763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-64a49c39-e474-408f-ba3d-c68f505b23dc tempest-ServerPasswordTestJSON-1290102305 tempest-ServerPasswordTestJSON-1290102305-project] 10.222.0.47 "GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d" status: 404 len: 111 microversion: 2.1 time: 0.094346 Aug 30 16:16:08.468891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1656/3012] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:08 2022] GET /compute/v2.1/servers/dc113d65-52f3-440f-819a-e070aa624a6d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:08.574031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:08.589125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:08.592037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:08.596246 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e8b295a-4acc-45fd-b213-16468447a24c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2950 microversion: 2.32 time: 1.003551 Aug 30 16:16:08.596828 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1357/3013] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:16:07 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2950 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:16:08.624176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:08.626371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:08.644801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:08.646425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:08.647215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:08.649776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:08.652326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:08.655700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:08.861238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ac28d6f-87d0-417c-b78e-9f69355307a4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e/os-interface" status: 200 len: 1833 microversion: 2.32 time: 0.242760 Aug 30 16:16:08.862671 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1657/3014] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:16:08 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e/os-interface => generated 1833 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:16:09.380909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:09.397133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:09.397929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:09.424881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:09.425399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:09.428552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:09.429515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:09.431597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:09.433243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:09.434044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:09.435080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:09.435732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:09.481724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] Creating event network-changed:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:16:09.490545 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-547ec6cf-7c11-439e-b6bd-39b88d177702 req-481982ef-2856-4edc-8071-7d8b21650405 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112316 Aug 30 16:16:09.491719 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1358/3015] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:09.922064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:09.936679 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bf736e7e-60db-401d-85a7-792fd760772a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.547207 Aug 30 16:16:09.958768 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1658/3016] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:09 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:10.893894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3d93f9-6311-453c-ae28-0be8b94cbf28", "name": "network-vif-plugged", "status": "completed", "tag": "dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:10.925862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:10.928153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:10.930063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:10.960318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:10.961167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:10.976543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:10.977037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:10.977674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] Creating event network-vif-plugged:dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d for instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 on n-h2-830883-28 Aug 30 16:16:10.982142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:10.982901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:10.983705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:10.984294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:10.990047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-faf2a11d-bb75-4a62-aa2f-c9c752f7edbf req-24d18298-3bfb-4a19-a61a-ee75476e179c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099884 Aug 30 16:16:10.994908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1359/3017] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:11.333639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-418f5c8b-d5aa-4dbc-8d7f-89e8b78736bc tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cad39d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:11.393854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-418f5c8b-d5aa-4dbc-8d7f-89e8b78736bc tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59" status: 200 len: 661 microversion: 2.1 time: 0.065322 Aug 30 16:16:11.394955 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1360/3018] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:11 2022] GET /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59 => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:11.410574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2de8ec35-9f11-4a14-b7c1-f11a9eb756b4 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f13040>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:11.475915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2de8ec35-9f11-4a14-b7c1-f11a9eb756b4 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59" status: 200 len: 661 microversion: 2.1 time: 0.069905 Aug 30 16:16:11.476946 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1361/3019] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:11 2022] GET /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59 => generated 661 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:11.665988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:11.676484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c881a8c-a12a-4077-92eb-a78fc3791c83 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.720911 Aug 30 16:16:11.691935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1659/3020] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:10 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:12.701134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:12.701869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:12.718015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:12.718795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:12.719426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:12.720304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:12.720910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:12.721487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:13.054602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ddb5cb03-a205-4c98-929c-d1bc2dfb865e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cda8040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:13.136728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ddb5cb03-a205-4c98-929c-d1bc2dfb865e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5" status: 200 len: 661 microversion: 2.1 time: 0.093717 Aug 30 16:16:13.137691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1660/3021] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:13 2022] GET /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5 => generated 661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:13.153387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-902ca029-22b5-4ed2-bb69-ed6290e296d6 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360fb6430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:13.233975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-902ca029-22b5-4ed2-bb69-ed6290e296d6 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5" status: 200 len: 661 microversion: 2.1 time: 0.087280 Aug 30 16:16:13.237242 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1661/3022] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:13 2022] GET /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:13.608561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:13.616985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-677e1678-c337-4b09-ab2d-0f39113b3852 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.921470 Aug 30 16:16:13.622762 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1362/3023] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:12 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:14.644329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:14.644961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:14.658944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:14.663666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:14.667890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:14.668665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:14.669146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:14.669585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:14.754123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-008f10da-50ff-44b9-9f52-ba4c8d8ed688 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c307f70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:14.817014 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-008f10da-50ff-44b9-9f52-ba4c8d8ed688 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a" status: 200 len: 662 microversion: 2.1 time: 0.068100 Aug 30 16:16:14.818157 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1363/3024] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:14 2022] GET /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:14.832155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85f929c4-d3b4-4694-8fe2-4cc22844827f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2b3670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:14.880154 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85f929c4-d3b4-4694-8fe2-4cc22844827f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a" status: 200 len: 662 microversion: 2.1 time: 0.052000 Aug 30 16:16:14.881202 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1364/3025] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:14 2022] GET /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:14.939460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2074550992", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:14.992017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:15.016652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:16:15.043191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:15.136818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:15.145774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d5263dc-a02a-45c0-bd05-4f1687f0b868 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.505155 Aug 30 16:16:15.153933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1662/3026] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:14 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:15.585033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:16:15.585462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:16:15.585932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:16:15.586424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:16:15.587028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:16:15.610683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:15.611416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:15.612009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:15.612953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:15.613751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:15.614427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:15.638472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Getting quotas for project 2b02bdc94d6c47b09250eb66f615791e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:16:15.646190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Getting quotas for user 648f74c3412a4c44b1bbce93c4b2789b and project 2b02bdc94d6c47b09250eb66f615791e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:16:15.662898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:16:15.665659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:16:15.730209 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-008065b8-ac39-4126-9cd7-3d6f2b894083 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793895 Aug 30 16:16:15.731551 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1365/3027] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:16:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:16:15.896654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-566556882", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:16.046395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:16:16.169426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:16.170035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:16.184865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:16.185648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:16.186263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:16.187220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:16.187829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:16.188427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:16.705904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:16:16.707089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:16:16.708740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:16:16.709027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:16:16.709684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:16:16.744396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:16.747287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:16.747933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:16.751446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:16.753247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:16.753956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:16.795583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:16.811609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Getting quotas for project 2b02bdc94d6c47b09250eb66f615791e. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:16:16.840166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Getting quotas for user 648f74c3412a4c44b1bbce93c4b2789b and project 2b02bdc94d6c47b09250eb66f615791e. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:16:16.859247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:16:16.862425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:16:16.938873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-faa7a3d0-9a72-405f-9012-1e1356de360e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052930 Aug 30 16:16:16.940300 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1663/3028] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:16:16.952128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c620d24d-cd52-4d63-9b56-9285d602a165 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:16.953056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c620d24d-cd52-4d63-9b56-9285d602a165 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:17.110485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c620d24d-cd52-4d63-9b56-9285d602a165 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:17.133389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c620d24d-cd52-4d63-9b56-9285d602a165 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1217 microversion: 2.1 time: 0.183408 Aug 30 16:16:17.136850 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1664/3029] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:16 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:17.142467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7339080e-b2f9-4613-b5e1-88506d86a7ea", "name": "network-vif-plugged", "status": "completed", "tag": "0fadbe55-c08a-4a21-85da-cc4f49dc87e8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:17.171893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:17.173690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:17.174659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:17.199161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] Creating event network-vif-plugged:0fadbe55-c08a-4a21-85da-cc4f49dc87e8 for instance 7339080e-b2f9-4613-b5e1-88506d86a7ea on n-h2-830883-28 Aug 30 16:16:17.208826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1603967a-1221-4445-9c9a-b075a0216375 req-7d312560-b684-439a-81dd-f3e4d5558e89 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069455 Aug 30 16:16:17.209257 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1665/3030] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:18.160233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:18.162618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:18.179684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:18.183113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:18.184456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:18.186715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:18.189179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:18.191026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:18.382482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:18.407308 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c26b308-7fef-4149-b1f4-7d1422a2c3fa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1213 microversion: 2.1 time: 0.253792 Aug 30 16:16:18.407936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1666/3031] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:18 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1213 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:18.504349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:18.516688 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1191d3f-037e-4b07-aed6-cee6314b0a1d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 2.351500 Aug 30 16:16:18.522350 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1366/3032] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:16 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:19.261698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046f7bc4-73c6-4f20-a0e2-73b32af92643", "name": "network-vif-plugged", "status": "completed", "tag": "81eb1298-f1c8-4b35-b46d-cd42cbac8284"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:19.304586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:19.305567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:19.306173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:19.337559 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] Creating event network-vif-plugged:81eb1298-f1c8-4b35-b46d-cd42cbac8284 for instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 on n-h1-830883-28 Aug 30 16:16:19.349519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b4388a54-d39a-4361-b67d-aadfe0dc0c42 req-b25c7176-8b55-473b-84b2-1c385f8c4734 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101016 Aug 30 16:16:19.372522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1667/3033] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:19.429613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:19.430233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:19.457474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:19.459162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:19.459793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:19.460803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:19.461435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:19.462025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:19.544435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:19.545136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:19.555684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:19.556565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:19.557210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:19.558123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:19.558984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:19.559590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:19.659643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:19.670562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-62553137-8529-48ce-b8bf-cf8efd5b4bb3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1277 microversion: 2.1 time: 0.244830 Aug 30 16:16:19.671721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1367/3034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:19 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:19.919281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:19.931771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11988ca4-e134-44dc-b39e-477d6e78d87a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1322 microversion: 2.1 time: 0.391456 Aug 30 16:16:19.932898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1668/3035] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:19 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:20.693545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:20.694166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:20.701304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:20.701787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:20.703235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:20.704175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:20.704849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:20.705519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:20.905596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:20.926095 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2bc5637f-4df7-430e-b878-240e55eea73f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1275 microversion: 2.1 time: 0.230850 Aug 30 16:16:20.930729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1368/3036] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:20 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:20.955358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:20.956788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:20.985477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:20.986246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:20.986743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:20.987503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:20.991218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:20.991928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:21.462246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:21.477558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29bd77d7-a07a-44be-982b-f1c290f4d169 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1515 microversion: 2.1 time: 0.525630 Aug 30 16:16:21.478323 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1669/3037] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:20 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1515 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:21.508104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:21.508988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:21.520321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:21.524241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:21.526604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:21.527525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:21.528150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:21.529260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:21.894749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:21.912988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8025b473-33dc-49e3-a3dd-f14787e3eb8e tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 200 len: 1516 microversion: 2.1 time: 0.407879 Aug 30 16:16:21.914418 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1369/3038] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:21 2022] GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:21.947820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:21.948951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:21.964677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:21.966392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:21.984578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:21.986090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:21.989036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:21.989853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:21.990686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:21.992122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:22.026400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:22.028669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:22.029408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:22.032277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:22.033231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:22.035561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:22.313886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:22.324443 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-407ea091-65fe-40f3-8775-37c82049cb3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1275 microversion: 2.1 time: 0.371000 Aug 30 16:16:22.337823 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1370/3039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:21 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:23.345306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:23.347126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:23.355050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:23.355541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:23.355971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:23.356671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:23.357118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:23.357538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:23.695136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:23.714251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83ac0f0c-d2b8-4043-97e4-91399343f45d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1516 microversion: 2.1 time: 1.783514 Aug 30 16:16:23.715756 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1670/3040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:21 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1516 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:23.749357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:23.749642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:23.774053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:23.774951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:23.779473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:23.781996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:23.782636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:23.783352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:23.823382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:23.955897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75ea4c49-7d18-4088-aef1-c705e913e624 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 204 len: 0 microversion: 2.1 time: 0.219622 Aug 30 16:16:23.957146 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1671/3041] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:23 2022] DELETE /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:16:23.970710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:23.971628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:23.998054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:23.998593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.001511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.002601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:24.004399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:24.005877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:24.088218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:24.097355 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba0b7fed-33f3-4f09-ad02-b114d2df6b64 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.756089 Aug 30 16:16:24.098714 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1371/3042] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:23 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:24.378411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:24.402123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3767af0-16b0-4a28-a85b-bcc77f72b0c1 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1522 microversion: 2.1 time: 0.439881 Aug 30 16:16:24.404420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1672/3043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:23 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:25.126169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:25.130471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:25.143924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:25.175516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:25.179481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:25.185961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:25.187803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:25.190141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:25.426138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:25.428288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:25.458207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:25.459275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:25.459933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:25.460921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:25.462152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:25.463830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:25.628229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:25.655965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:25.876125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:25.908339 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e56215a6-9086-48d8-b7a9-110403c6dbea tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1522 microversion: 2.1 time: 0.484525 Aug 30 16:16:25.909964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1673/3044] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:25 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:26.211949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae3e5974-cb4e-4885-9708-9e727c89962a tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Action: 'create', calling method: .version_select at 0x7fd35cd2caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1930365467"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:26.460786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:26.476976 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7afea31-a73e-4182-b6c0-0e338c5c6f34 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 1.358801 Aug 30 16:16:26.479018 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1372/3045] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:25 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:26.789454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:26.837173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae3e5974-cb4e-4885-9708-9e727c89962a tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.905171 Aug 30 16:16:26.837972 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1674/3046] 10.222.0.47 () {60 vars in 1155 bytes} [Tue Aug 30 16:16:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 908 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 16:16:26.854415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12c66d36-9e5c-427b-9961-ce3e639548e2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2a10d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:26.931507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:26.932426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:26.943561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:26.944096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:26.944574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:26.945256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:26.945715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:26.946422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:27.001048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12c66d36-9e5c-427b-9961-ce3e639548e2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.153004 Aug 30 16:16:27.002140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1373/3047] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:26 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:27.009805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:27.035281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:27.035767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:27.038996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:27.056591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] Creating event network-changed:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:16:27.072063 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ca7c4899-3357-45a0-b791-392e9390f647 req-915836de-0b34-4b6b-9ab6-d3f1c3ef9506 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068269 Aug 30 16:16:27.073580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1374/3048] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:27.129354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:27.290519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:27.301424 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e0b68a44-a583-4383-977b-80b980b48b96 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1522 microversion: 2.1 time: 0.374717 Aug 30 16:16:27.315173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1675/3049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:26 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:27.501819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:27.502701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:27.510079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:27.511040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:27.512022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:27.512974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:27.513655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:27.514905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:28.015391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a320ac49-a619-4cd8-a7ad-bb89cc43d5ca tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd360f82790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:28.137959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a320ac49-a619-4cd8-a7ad-bb89cc43d5ca tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.126809 Aug 30 16:16:28.138989 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1676/3050] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:28 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:28.326634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:28.327281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:28.336717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:28.337529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:28.337987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:28.338761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:28.339254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:28.339692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:28.525785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:28.540694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3fe98dcd-5880-4cc5-bd09-e0cf7782cdba tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1522 microversion: 2.1 time: 0.221196 Aug 30 16:16:28.544024 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1677/3051] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:28 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:28.803971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:28.813818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ffa3a47-7b23-4544-b7bd-317e4b8444a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 1.318197 Aug 30 16:16:28.842895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1375/3052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:27 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:29.154861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-187e62b6-db50-4f06-a4ea-11a83b7f25f9 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd360fb68b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:29.299455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3d93f9-6311-453c-ae28-0be8b94cbf28", "name": "network-vif-deleted", "tag": "dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:29.329711 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-187e62b6-db50-4f06-a4ea-11a83b7f25f9 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 346 microversion: 2.1 time: 0.180348 Aug 30 16:16:29.331418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1678/3053] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:29 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 346 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:29.341761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.342253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.345967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.348520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e2ba336-8df7-4654-b180-e0d52ab9382d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Action: 'create', calling method: .version_select at 0x7fd35c0cf3a0>, body: {"snapshot": {"volume_id": "747f232e-091b-4fa9-b2e2-0a3222b6916c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-474019329"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:29.371907 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] Creating event network-vif-deleted:dd6d2c71-fece-47f0-b0b2-fc17e2b0d64d for instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 on n-h2-830883-28 Aug 30 16:16:29.389106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5dc23feb-a0bd-4047-93dc-bbdc767b4922 req-5bfbe21f-f5e7-4b48-bd14-355f88b6e358 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183699 Aug 30 16:16:29.390174 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1376/3054] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:29.573067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:29.573948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:29.613353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.614044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.621801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.623359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.624029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.624633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.630978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.700047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.700792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.701400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.702017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lazy-loading 'fault' on Instance uuid 9b3d93f9-6311-453c-ae28-0be8b94cbf28 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:29.712309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e2ba336-8df7-4654-b180-e0d52ab9382d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.371218 Aug 30 16:16:29.713366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1679/3055] 10.222.0.47 () {60 vars in 1162 bytes} [Tue Aug 30 16:16:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:29.723590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27b97e56-dec7-46dc-8e93-55b014b9aedc tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35ce520d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:29.835448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27b97e56-dec7-46dc-8e93-55b014b9aedc tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 286 microversion: 2.1 time: 0.115561 Aug 30 16:16:29.841877 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1680/3056] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:29 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:29.846770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:29.847407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:29.854670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.855175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.855629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.856903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:29.857726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:29.866266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:29.883800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:29.944824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:29.959573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ef13793-38aa-4bda-ac08-504991054735 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 200 len: 1312 microversion: 2.1 time: 0.394058 Aug 30 16:16:29.960517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1377/3057] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:29 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:29.971731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0847e5d1-05a7-4f85-8618-ec18fcab1964 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2669d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:30.106086 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0847e5d1-05a7-4f85-8618-ec18fcab1964 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.138824 Aug 30 16:16:30.106742 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1378/3058] 10.222.0.47 () {58 vars in 1140 bytes} [Tue Aug 30 16:16:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:30.121071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35f54300-fc53-453c-821e-33817bca76e9 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c26af70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:30.225523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:30.239989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1fe30e7a-6f89-4604-8b20-d3bbf8e2ff61 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.392698 Aug 30 16:16:30.244072 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35f54300-fc53-453c-821e-33817bca76e9 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 286 microversion: 2.1 time: 0.129791 Aug 30 16:16:30.249011 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1379/3059] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:30 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:30.257325 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1681/3060] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:29 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:30.984590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:30.985221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:30.996942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:30.997697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:30.998142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:30.998956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:30.999497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.000410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.019132 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] HTTP exception thrown: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 HTTP/1.1 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b3d93f9-6311-453c-ae28-0be8b94cbf28'} Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.022341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:31.028878 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.032007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 404 to user: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:31.033978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e06c5cf-1e07-49e2-97a8-471497cca3f7 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 404 len: 111 microversion: 2.1 time: 0.057057 Aug 30 16:16:31.043880 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1380/3061] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:30 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:31.048072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.053781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.054722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.060497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.062561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.062561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.062561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.063331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.064050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.154930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4110c870-eda8-4a6c-89d2-1caa49d6422f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.111801 Aug 30 16:16:31.156229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1682/3062] 10.222.0.47 () {58 vars in 1230 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:16:31.176187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8729d910-ec13-42f5-9000-24ea431de14d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8729d910-ec13-42f5-9000-24ea431de14d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 16:16:31.181458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.185755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8729d910-ec13-42f5-9000-24ea431de14d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:31.186745 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8729d910-ec13-42f5-9000-24ea431de14d tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.013058 Aug 30 16:16:31.188510 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1381/3063] 10.222.0.47 () {58 vars in 1182 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:31.198796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.204948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.206774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.215244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.216005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.216671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.217874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.218625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.219495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.257091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-684efcf3-7f96-45e2-b41e-b32e2653c7a3 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c266280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.279199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:16:31.317869 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cef3d8f6-b7a7-4012-abe8-a1c62aa6976b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.123789 Aug 30 16:16:31.319331 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1683/3064] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers => generated 681 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:31.337787 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-684efcf3-7f96-45e2-b41e-b32e2653c7a3 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 286 microversion: 2.1 time: 0.085121 Aug 30 16:16:31.338914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1382/3065] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:31.344587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.347614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.350116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:31.355455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.356235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.servers [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Removing options 'limit' from query {{(pid=122351) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1518}} Aug 30 16:16:31.357525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.360194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.361100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.361561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.362521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.362989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.363609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.365404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.366129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.367105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.368592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.369446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.370160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.407056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:16:31.488356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-659640bd-f7cd-48c9-bf07-4e697016ac69 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.147610 Aug 30 16:16:31.496819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1383/3066] 10.222.0.47 () {58 vars in 1144 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:31.502239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93325f64-29a2-47b7-8d5a-77e6f36fd32d", "tag": "0a0c19b5-e069-412c-abea-7ad0778fad7c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:31.513061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.513538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.513984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.537786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] Creating event network-changed:0a0c19b5-e069-412c-abea-7ad0778fad7c for instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d on n-h2-830883-28 Aug 30 16:16:31.552580 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3f9e1a3c-88c1-4e0a-8344-11635e96976e req-d678cb0a-d5d4-4e79-b6f4-ccb73f20995d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053864 Aug 30 16:16:31.553558 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1384/3067] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:31.573784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acfb04bd-43ef-4cc9-a224-0306d0090382 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acfb04bd-43ef-4cc9-a224-0306d0090382 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi '-1' Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 16:16:31.580407 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 16:16:31.585077 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.595585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acfb04bd-43ef-4cc9-a224-0306d0090382 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:31.597837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acfb04bd-43ef-4cc9-a224-0306d0090382 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.041359 Aug 30 16:16:31.605420 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1385/3068] 10.222.0.47 () {58 vars in 1142 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:31.613476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebc45d46-79d9-4e5f-8e04-9740df8d0e9a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebc45d46-79d9-4e5f-8e04-9740df8d0e9a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: action_args: {} Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'testing' Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 16:16:31.618997 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebc45d46-79d9-4e5f-8e04-9740df8d0e9a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:31.623365 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebc45d46-79d9-4e5f-8e04-9740df8d0e9a tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015221 Aug 30 16:16:31.624997 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1386/3069] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:16:31.634978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30f42d52-9f51-4e35-a6b1-f9f427050ebb tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.641575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30f42d52-9f51-4e35-a6b1-f9f427050ebb tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.642397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30f42d52-9f51-4e35-a6b1-f9f427050ebb tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.650255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.servers [None req-30f42d52-9f51-4e35-a6b1-f9f427050ebb tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Flavor 'non_existing_flavor' could not be found {{(pid=122351) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 30 16:16:31.651358 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30f42d52-9f51-4e35-a6b1-f9f427050ebb tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023067 Aug 30 16:16:31.652161 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1387/3070] 10.222.0.47 () {58 vars in 1178 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:16:31.666419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.673207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.674360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.683322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.684776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.685454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.686580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.687503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.688222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.725217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.733236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-46455139-bd43-42cf-b5c3-37be8fb747ef tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.412207 Aug 30 16:16:31.733841 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1684/3071] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:31.807271 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27d15c11-e013-460f-8b05-d2b2f45c0136 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.146392 Aug 30 16:16:31.808222 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1388/3072] 10.222.0.47 () {58 vars in 1174 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:16:31.821103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.827312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.828273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.834997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.835861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.836487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.837402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.838049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.838673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.941251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4429b662-d803-4dc3-9161-91675cc07cdf tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.123083 Aug 30 16:16:31.943388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1685/3073] 10.222.0.47 () {58 vars in 1184 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:16:31.954561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:31.961056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:31.961916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:31.968011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.969043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.969714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:31.970707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:31.971397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:31.972042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.008239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:16:32.062279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:32.073502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.078562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.079019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.356492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43bea22d-2a91-421e-8abf-675685c617cd tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35ce0f040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.398816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43bea22d-2a91-421e-8abf-675685c617cd tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 287 microversion: 2.1 time: 0.046655 Aug 30 16:16:32.406936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1686/3074] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:32 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:32.414281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-551ba2b1-74cd-4bdb-b0f5-3a562887d057 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35d50d280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.506452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-551ba2b1-74cd-4bdb-b0f5-3a562887d057 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 202 len: 0 microversion: 2.1 time: 0.097714 Aug 30 16:16:32.507153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1687/3075] 10.222.0.47 () {58 vars in 1254 bytes} [Tue Aug 30 16:16:32 2022] DELETE /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:16:32.516486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9bfb623-a1a1-442e-89b8-f686f6ae120a tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35ce52790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.555320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9bfb623-a1a1-442e-89b8-f686f6ae120a tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 286 microversion: 2.1 time: 0.043283 Aug 30 16:16:32.561329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1688/3076] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:32 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:32.656701 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35e1ff6f-874b-4f84-a7d7-fd9fe8e25d05 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.705933 Aug 30 16:16:32.657462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1389/3077] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:16:31 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:32.681967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cda3fbc4-0d99-4a12-aa0a-6f501a79a4f3 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.688576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cda3fbc4-0d99-4a12-aa0a-6f501a79a4f3 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:32.690191 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cda3fbc4-0d99-4a12-aa0a-6f501a79a4f3 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013746 Aug 30 16:16:32.704681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.711436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1689/3078] 10.222.0.47 () {58 vars in 1178 bytes} [Tue Aug 30 16:16:32 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:16:32.711850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:32.712809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Searching by: {'deleted': False, 'project_id': '2b2420775d95412a86632d8786a24756'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:16:32.718434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.718884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.720159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.721314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.721925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.722549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.755487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.756426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:32.760186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:16:32.767428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.768142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.768744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.769626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.775909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.776652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.812594 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-99ecb2e7-5f00-4b36-b0b5-23b59f04e316 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.112253 Aug 30 16:16:32.814084 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1390/3079] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:16:32 2022] GET /compute/v2.1/servers => generated 681 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:32.831729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.832717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:32.844824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.846023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.847482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.851142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.852044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.852837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.873291 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] HTTP exception thrown: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 HTTP/1.1 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b3d93f9-6311-453c-ae28-0be8b94cbf28'} Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:32.876088 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:32.881456 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:32.886938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 404 to user: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:32.888450 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ae89c4ba-6b9a-49a4-8e47-595f38a0b518 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 404 len: 111 microversion: 2.1 time: 0.064130 Aug 30 16:16:32.889261 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1391/3080] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:32 2022] DELETE /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:16:32.906001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:32.908231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:32.929833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.932138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.932811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:32.936093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:32.937886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:32.938690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.011115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:33.187480 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a011a6ae-1d32-4bc2-b867-9c4a6de01ac2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 204 len: 0 microversion: 2.1 time: 0.292071 Aug 30 16:16:33.188776 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1392/3081] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:32 2022] DELETE /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:16:33.226296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:33.227255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:33.234241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.235023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.235635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.236539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.237154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.237741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.276006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:33.320406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:33.329439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a9e043a-e133-469e-a26b-5eeeac12acda tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.578269 Aug 30 16:16:33.352014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1690/3082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:32 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:33.448147 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41204512-a7ab-4afc-b753-d6e871634ee2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 204 len: 0 microversion: 2.1 time: 0.253758 Aug 30 16:16:33.450039 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1393/3083] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:33 2022] DELETE /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:16:33.461830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:33.462724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 9b3d93f9-6311-453c-ae28-0be8b94cbf28] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:33.477256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.478856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.481114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.482904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.483932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.485236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.525833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] HTTP exception thrown: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 HTTP/1.1 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9b3d93f9-6311-453c-ae28-0be8b94cbf28'} Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:33.530660 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 404 to user: Instance 9b3d93f9-6311-453c-ae28-0be8b94cbf28 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:33.535563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35fe3948-657f-4b25-8e97-9e1887dd665f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28" status: 404 len: 111 microversion: 2.1 time: 0.080709 Aug 30 16:16:33.538670 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1691/3084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:33 2022] GET /compute/v2.1/servers/9b3d93f9-6311-453c-ae28-0be8b94cbf28 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:33.547987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:33.549017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:33.560047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.562079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.562753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.570350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-786bf0de-bb15-46ad-bfac-1592db2623e3 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd360fd6280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:33.577751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:33.578499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:33.579325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:33.633565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-786bf0de-bb15-46ad-bfac-1592db2623e3 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 200 len: 286 microversion: 2.1 time: 0.068722 Aug 30 16:16:33.634481 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1692/3085] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:33 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:33.889273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:33.903189 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-adc35709-3e42-446b-acc8-fe9c267ddf0f tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 200 len: 1522 microversion: 2.1 time: 0.359420 Aug 30 16:16:33.903995 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1394/3086] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:33 2022] GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:34.359353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:34.359977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:34.370594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:34.371133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:34.372068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:34.373835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:34.377131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:34.377800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:34.647245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90dbeae9-5744-4425-8369-6ec385347d63 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2605e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:34.671414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:34.685363 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e817d45-dfae-4c7e-a261-ef2b9bba9de9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.329828 Aug 30 16:16:34.687974 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1693/3087] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:34 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:34.698493 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-90dbeae9-5744-4425-8369-6ec385347d63 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] HTTP exception thrown: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90dbeae9-5744-4425-8369-6ec385347d63 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Request method failure captured: Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 HTTP/1.1 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfZRqWSDVLJw-hot7-CWgtrGIVnSnLiKBO00xDibKJUem_enf_bJ4SxVu6CIUlB0BCoI-fcQ4HxT93eQrMa2cn7nqRxRcgC78rOwLHpVNH-b_NeDZAcuQM_cWGdcfPeV-qB-KrhC2YnDwRr2SkGWmsIJ6aMYk6FC47PNZZ4KtMDOaM Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6af041301f56414d95a6e753063a77ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}] Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 6b5046f8fac64c169bb64cf87dfa48da Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: exception: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6f98b9e3-8101-4b15-8711-41b6b67a3572'} Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. (HTTP 404) (Request-ID: req-d5651ee4-39f4-4278-a52c-30116d937782) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:16:34.701106 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. Aug 30 16:16:34.705099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:34.710612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90dbeae9-5744-4425-8369-6ec385347d63 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Returning 404 to user: Snapshot 6f98b9e3-8101-4b15-8711-41b6b67a3572 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:34.711822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90dbeae9-5744-4425-8369-6ec385347d63 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572" status: 404 len: 111 microversion: 2.1 time: 0.069148 Aug 30 16:16:34.721248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b75712f3-326f-4643-bff0-3c8cb104097c tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35cc53790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:34.721826 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1395/3088] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 16:16:34 2022] GET /compute/v2.1/os-snapshots/6f98b9e3-8101-4b15-8711-41b6b67a3572 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:34.861841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b75712f3-326f-4643-bff0-3c8cb104097c tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 202 len: 0 microversion: 2.1 time: 0.144346 Aug 30 16:16:34.870190 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1694/3089] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:16:34 2022] DELETE /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:16:34.875165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dcf2e33b-cd0c-4270-88c3-59924bf5cf76 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35d2f9820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:34.928355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:34.928991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:34.945441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:34.946210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:34.952209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:34.953090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:34.953606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:34.954037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:35.055142 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dcf2e33b-cd0c-4270-88c3-59924bf5cf76 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.187401 Aug 30 16:16:35.062595 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1396/3090] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:34 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:35.632724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:35.647919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ddbc732-2c12-4036-8c8b-3b33a5d324fa tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 200 len: 1522 microversion: 2.1 time: 0.724069 Aug 30 16:16:35.649201 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1695/3091] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:34 2022] GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:35.731838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:35.732476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:35.746269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:35.771324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:35.775028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:35.775506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:35.784433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:35.788771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:35.795432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:36.070827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac416d3e-9511-4444-812f-0c7ee6d2897b tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35d1f33a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:36.215002 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac416d3e-9511-4444-812f-0c7ee6d2897b tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.149798 Aug 30 16:16:36.215605 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1696/3092] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:36 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:36.545473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:36.555521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:36.591177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:36.617497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:36.618394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:36.619387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:36.621315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:36.622938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:36.894335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'services' on Instance uuid 0ba50491-c695-4c19-a36e-09d614d1b9a2 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:37.187339 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca40581f-6f1a-4422-9dff-ee01e3cc1873 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments/1cc86da6-daf7-4dcd-9159-54e6254cf8e5" status: 202 len: 0 microversion: 2.1 time: 0.647911 Aug 30 16:16:37.191815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1697/3093] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:16:36 2022] DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments/1cc86da6-daf7-4dcd-9159-54e6254cf8e5 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:16:37.229579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:37.230676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:37.238968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.268958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.269945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.271734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.272345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.272808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.358406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.363116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.363841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.364523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lazy-loading 'fault' on Instance uuid 046f7bc4-73c6-4f20-a0e2-73b32af92643 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:37.494136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:37.557056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b1b38fd-4885-43e1-a5bb-cb7202db7650 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 1.851154 Aug 30 16:16:37.558764 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1397/3094] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:35 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:37.578238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "046f7bc4-73c6-4f20-a0e2-73b32af92643", "name": "network-vif-deleted", "tag": "81eb1298-f1c8-4b35-b46d-cd42cbac8284"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:37.642914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.644660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.670784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.703129 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] Creating event network-vif-deleted:81eb1298-f1c8-4b35-b46d-cd42cbac8284 for instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 on n-h1-830883-28 Aug 30 16:16:37.712612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d67cd08a-54b3-4a23-8728-dcb26d86ead8 req-b9425a23-0999-4e41-849a-c131d5c934f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149786 Aug 30 16:16:37.713856 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1398/3095] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:37.726346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:37.738244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:37.754933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.760256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.760969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.764598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:37.764598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:37.764598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:37.875535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e76a1c84-b0ab-48f8-89e4-790b6981832f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159259 Aug 30 16:16:37.879589 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1399/3096] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:37 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:37.896646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0bfce20a-af3c-498a-85cf-e62efa6271f7 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2ab160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:37.906620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:37.915119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db97b7e2-6713-4245-b956-714833f37c50 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 200 len: 1312 microversion: 2.1 time: 0.721297 Aug 30 16:16:37.915734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1698/3097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:37 2022] GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 1312 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:38.054173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0bfce20a-af3c-498a-85cf-e62efa6271f7 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.171742 Aug 30 16:16:38.060666 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1400/3098] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:37 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:38.583404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:38.584169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:38.604379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.604897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.605345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:38.606070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.606566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.606993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:38.869740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:38.888691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:38.891901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:38.899284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3fc629b8-a094-40d0-bb67-79b713b9fe5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.320203 Aug 30 16:16:38.900280 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1699/3099] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:38 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:38.913269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.914076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.918876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:38.920085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.920717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.922122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:38.938234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:38.939444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 046f7bc4-73c6-4f20-a0e2-73b32af92643] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:38.955397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.955900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.956350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:38.957062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:38.957525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:38.957986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:39.023839 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] HTTP exception thrown: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 HTTP/1.1 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '046f7bc4-73c6-4f20-a0e2-73b32af92643'} Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:39.033482 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 404 to user: Instance 046f7bc4-73c6-4f20-a0e2-73b32af92643 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1f8b3db-d450-4a88-bdff-8396588ad462 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643" status: 404 len: 111 microversion: 2.1 time: 0.100994 Aug 30 16:16:39.038435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1700/3100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:38 2022] GET /compute/v2.1/servers/046f7bc4-73c6-4f20-a0e2-73b32af92643 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:39.043582 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6113b14d-9ef8-4aac-bfc6-d4f903838728 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157297 Aug 30 16:16:39.050482 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1401/3101] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:38 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:39.064544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:39.065186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:39.069255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e909cc31-d88c-46a3-b6ec-7ae6077c3acf tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35cb60940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:39.105571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:39.106079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:39.106556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:39.107279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:39.107743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:39.108164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:39.185794 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e909cc31-d88c-46a3-b6ec-7ae6077c3acf tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 200 len: 345 microversion: 2.1 time: 0.121547 Aug 30 16:16:39.186901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1402/3102] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:39 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:39.472625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:39.482771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41792c7b-8912-4cd7-9c32-e4c7776549d2 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1521 microversion: 2.1 time: 0.440734 Aug 30 16:16:39.501130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1701/3103] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:39 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:39.511511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-plugged", "status": "completed", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:39.532939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:39.534367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:39.542470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:39.574564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:39.580411 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] Creating event network-vif-plugged:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:16:39.596286 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7d216da2-3ad9-47b4-b7f1-484d8b4ded58 req-d43eea95-47f0-4b43-8029-d77c27355c65 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087226 Aug 30 16:16:39.600198 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1403/3104] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:39.930903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:39.931463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:39.945110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:39.945919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:39.947942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:39.950639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:39.951275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:39.953878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:40.057102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:40.060626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:40.099062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:40.100017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:40.101556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:40.104696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:40.105310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:40.106615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:40.209099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b44b94d4-7fee-4ff4-9537-5bec25d7efe0 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155169 Aug 30 16:16:40.214218 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1404/3105] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:40 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:40.223006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-841f4b4a-780c-463d-a44f-3d73f3d9854d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2c3790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:40.290941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-841f4b4a-780c-463d-a44f-3d73f3d9854d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] HTTP exception thrown: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-841f4b4a-780c-463d-a44f-3d73f3d9854d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Request method failure captured: Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c HTTP/1.1 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfZRqWSDVLJw-hot7-CWgtrGIVnSnLiKBO00xDibKJUem_enf_bJ4SxVu6CIUlB0BCoI-fcQ4HxT93eQrMa2cn7nqRxRcgC78rOwLHpVNH-b_NeDZAcuQM_cWGdcfPeV-qB-KrhC2YnDwRr2SkGWmsIJ6aMYk6FC47PNZZ4KtMDOaM Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6af041301f56414d95a6e753063a77ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}] Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 6b5046f8fac64c169bb64cf87dfa48da Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '747f232e-091b-4fa9-b2e2-0a3222b6916c'} Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. (HTTP 404) (Request-ID: req-56d8ffee-ed21-4f29-8598-10395a050722) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:16:40.293436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.297343 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.304801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-841f4b4a-780c-463d-a44f-3d73f3d9854d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Returning 404 to user: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:40.305958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-841f4b4a-780c-463d-a44f-3d73f3d9854d tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 404 len: 109 microversion: 2.1 time: 0.090406 Aug 30 16:16:40.307074 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1405/3106] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:40 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:40.319128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58ddcdf2-8090-4a2f-9a22-9214e38227d2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c273af0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:40.370646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-58ddcdf2-8090-4a2f-9a22-9214e38227d2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] HTTP exception thrown: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58ddcdf2-8090-4a2f-9a22-9214e38227d2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Request method failure captured: Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c HTTP/1.1 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfZRqWSDVLJw-hot7-CWgtrGIVnSnLiKBO00xDibKJUem_enf_bJ4SxVu6CIUlB0BCoI-fcQ4HxT93eQrMa2cn7nqRxRcgC78rOwLHpVNH-b_NeDZAcuQM_cWGdcfPeV-qB-KrhC2YnDwRr2SkGWmsIJ6aMYk6FC47PNZZ4KtMDOaM Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6af041301f56414d95a6e753063a77ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}] Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 6b5046f8fac64c169bb64cf87dfa48da Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '747f232e-091b-4fa9-b2e2-0a3222b6916c'} Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. (HTTP 404) (Request-ID: req-d261b96d-ba92-4781-9d2a-e8f1124362d3) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:16:40.372936 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.376835 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.383633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58ddcdf2-8090-4a2f-9a22-9214e38227d2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Returning 404 to user: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:40.384556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58ddcdf2-8090-4a2f-9a22-9214e38227d2 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 404 len: 109 microversion: 2.1 time: 0.071333 Aug 30 16:16:40.385217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1406/3107] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:16:40 2022] DELETE /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:16:40.393392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72fd871f-619e-48c6-a0b3-5d7c4819def8 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Calling method '.version_select at 0x7fd35c2ab430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:40.432814 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-72fd871f-619e-48c6-a0b3-5d7c4819def8 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] HTTP exception thrown: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72fd871f-619e-48c6-a0b3-5d7c4819def8 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Request method failure captured: Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c HTTP/1.1 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfZRqWSDVLJw-hot7-CWgtrGIVnSnLiKBO00xDibKJUem_enf_bJ4SxVu6CIUlB0BCoI-fcQ4HxT93eQrMa2cn7nqRxRcgC78rOwLHpVNH-b_NeDZAcuQM_cWGdcfPeV-qB-KrhC2YnDwRr2SkGWmsIJ6aMYk6FC47PNZZ4KtMDOaM Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6af041301f56414d95a6e753063a77ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6af041301f56414d95a6e753063a77ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6af041301f56414d95a6e753063a77ce"}]}] Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 6af041301f56414d95a6e753063a77ce Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1203548376 Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 6b5046f8fac64c169bb64cf87dfa48da Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1203548376-project Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '747f232e-091b-4fa9-b2e2-0a3222b6916c'} Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. (HTTP 404) (Request-ID: req-745d5c7d-7c7e-416e-b11a-b9e457410bcc) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:16:40.435108 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. Aug 30 16:16:40.440000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:40.445640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72fd871f-619e-48c6-a0b3-5d7c4819def8 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] Returning 404 to user: Volume 747f232e-091b-4fa9-b2e2-0a3222b6916c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:40.445640 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72fd871f-619e-48c6-a0b3-5d7c4819def8 tempest-VolumesSnapshotsTestJSON-1203548376 tempest-VolumesSnapshotsTestJSON-1203548376-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c" status: 404 len: 109 microversion: 2.1 time: 0.055466 Aug 30 16:16:40.445640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1407/3108] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:16:40 2022] GET /compute/v2.1/os-volumes/747f232e-091b-4fa9-b2e2-0a3222b6916c => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:16:40.512246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:40.513209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:40.530555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:40.533335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:40.535247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:40.539184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:40.543104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:40.543851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:41.017691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:41.037538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93795c98-3d0c-4729-80a5-dbb773f605b9 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1479 microversion: 2.1 time: 0.530382 Aug 30 16:16:41.040862 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1408/3109] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:40 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1479 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:41.222540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:41.225086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:41.243171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:41.243668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:41.244416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:41.247685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:41.248582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:41.250066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:41.272297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:41.295629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6f816ef-490f-4b1d-929e-0f5a677ee93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 1.379045 Aug 30 16:16:41.296237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1702/3110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:39 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:41.351614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18aa81d2-7e73-4584-aa61-0ef25adc9353 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133550 Aug 30 16:16:41.360943 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1409/3111] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:41 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:41.503218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7339080e-b2f9-4613-b5e1-88506d86a7ea", "name": "network-vif-deleted", "tag": "0fadbe55-c08a-4a21-85da-cc4f49dc87e8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:41.529202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:41.531198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:41.531662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:41.582517 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] Creating event network-vif-deleted:0fadbe55-c08a-4a21-85da-cc4f49dc87e8 for instance 7339080e-b2f9-4613-b5e1-88506d86a7ea on n-h2-830883-28 Aug 30 16:16:41.597304 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-635b8716-b558-4493-b18b-047435af3872 req-3a7ddb4d-cf08-4f55-90c1-5dc186bbd370 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097851 Aug 30 16:16:41.607675 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1703/3112] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:41.695697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7339080e-b2f9-4613-b5e1-88506d86a7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "0fadbe55-c08a-4a21-85da-cc4f49dc87e8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:41.710672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:41.715402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:41.719116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:41.738421 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] Creating event network-vif-unplugged:0fadbe55-c08a-4a21-85da-cc4f49dc87e8 for instance 7339080e-b2f9-4613-b5e1-88506d86a7ea on n-h2-830883-28 Aug 30 16:16:41.754341 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-49b5272c-0dce-4c89-b3bb-cc5e6fb40b0c req-2dc02243-daa4-4547-bf0e-14d9b2ae3e32 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062112 Aug 30 16:16:41.755726 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1410/3113] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:42.068990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:42.069899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:42.106338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:42.116176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.118637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.120004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.122535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.123827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.125755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.232321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.234247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.234892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.236421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lazy-loading 'fault' on Instance uuid 7339080e-b2f9-4613-b5e1-88506d86a7ea {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:16:42.319194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:42.320079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:42.323366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:42.345891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.349832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.350603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.351625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.355640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.356662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.403290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7962738e5363429c82edd8f42890b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2420775d95412a86632d8786a24756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:42.435740 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c7f81b6-5025-4d51-9ef1-711d66a5bc4b tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 200 len: 1312 microversion: 2.1 time: 0.355549 Aug 30 16:16:42.441523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1704/3114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:42 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 1312 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:42.465668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:42.476326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:42.493622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.498454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.499178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.502563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:42.503460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:42.506479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:42.597348 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af41ee60-a060-46b6-aa97-5c1e4e5a6f20 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152278 Aug 30 16:16:42.601812 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1705/3115] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:42 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:42.741893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:42.762988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:42.784664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9030a9fc-cdf0-480b-820f-03f4af475eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.471091 Aug 30 16:16:42.804011 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1411/3116] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:42 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:43.461978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:43.463247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] [instance: 7339080e-b2f9-4613-b5e1-88506d86a7ea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:43.488429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.490105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.496113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.504161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.504676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.512706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.580559 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] HTTP exception thrown: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Request method failure captured: Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea HTTP/1.1 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjeyf54f8AIxxXLMQVJbJZMKCHZZ4oqap9N1pVI-Fjxx9a51UzR2kZnDWgGY-rOzHHZQtG2NkoWARFEf9rc-W434sMvv0iyP-fcko_IJh51vymFLC-aOuRxLkyLTFsLmLwBRSBRFJvtRObg17IAWMgaWBBSt2QY8ueoo1hgHySGnjgo Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b2420775d95412a86632d8786a24756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b2420775d95412a86632d8786a24756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b2420775d95412a86632d8786a24756"}]}] Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 2b2420775d95412a86632d8786a24756 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-516872966 Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7962738e5363429c82edd8f42890b29a Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListServersNegativeTestJSON-516872966-project Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7339080e-b2f9-4613-b5e1-88506d86a7ea'} Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:43.588877 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:43.594565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] Returning 404 to user: Instance 7339080e-b2f9-4613-b5e1-88506d86a7ea could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:43.596364 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5abe711a-6a89-4406-8801-cccfe8d0ba18 tempest-ListServersNegativeTestJSON-516872966 tempest-ListServersNegativeTestJSON-516872966-project] 10.222.0.47 "GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea" status: 404 len: 111 microversion: 2.1 time: 0.133041 Aug 30 16:16:43.597036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1706/3117] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:43 2022] GET /compute/v2.1/servers/7339080e-b2f9-4613-b5e1-88506d86a7ea => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:16:43.614780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:43.617262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:43.633499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.633991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.642888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.644036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.644812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.647761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.772614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96a62207-428a-4726-9307-12942bb1e7ad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163194 Aug 30 16:16:43.789149 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1412/3118] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:43 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:43.811105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:43.811999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:43.830998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.833927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.836661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.837633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:43.838323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:43.844878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:43.961132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:44.323711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93325f64-29a2-47b7-8d5a-77e6f36fd32d", "name": "network-vif-plugged", "status": "completed", "tag": "0a0c19b5-e069-412c-abea-7ad0778fad7c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:44.360447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:44.361286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:44.366079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:44.471445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] Creating event network-vif-plugged:0a0c19b5-e069-412c-abea-7ad0778fad7c for instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d on n-h2-830883-28 Aug 30 16:16:44.499503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-349ca5c2-d999-4486-a4e1-4c5dcad5de79 req-70ab6816-89a1-4aa8-879d-1ba676d908bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181523 Aug 30 16:16:44.507118 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1413/3119] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:44.796574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:44.804007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:44.838951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:44.839809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:44.842826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:44.844338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:44.851006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:44.852863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:44.990587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:45.000732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3aca435-761c-4dff-80e8-4879a50fad3e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 1.195269 Aug 30 16:16:45.013687 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1707/3120] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:43 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:45.013803 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4462965-f766-4ba6-8776-f5e1f6225922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212910 Aug 30 16:16:45.013803 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1414/3121] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:44 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:45.714339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e237735-1067-499a-bd37-0f6c274e3645 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] Calling method '.version_select at 0x7fd357f674c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:45.761286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e237735-1067-499a-bd37-0f6c274e3645 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.753447 Aug 30 16:16:45.767843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1708/3122] 10.222.0.47 () {60 vars in 1226 bytes} [Tue Aug 30 16:16:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:16:45.773834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68e88b4a-d9be-444b-a51f-f3ff50458a27 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c2c3430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:45.970970 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68e88b4a-d9be-444b-a51f-f3ff50458a27 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.201225 Aug 30 16:16:45.973306 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1415/3123] 10.222.0.47 () {62 vars in 1247 bytes} [Tue Aug 30 16:16:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:16:45.985123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24f0f1b4-b61a-4ed6-8acc-85c4ebe9f3e8 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] Calling method '.version_select at 0x7fd35ce0f550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:46.008289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24f0f1b4-b61a-4ed6-8acc-85c4ebe9f3e8 tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.027719 Aug 30 16:16:46.010518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1709/3124] 10.222.0.47 () {60 vars in 1226 bytes} [Tue Aug 30 16:16:45 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:16:46.025217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1dfe839-d610-4714-929a-53f88216b9fe tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c2ab280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:46.056968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:46.062856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:46.110938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:46.114077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:46.115980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:46.117500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:46.132403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:46.134395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:46.312628 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1dfe839-d610-4714-929a-53f88216b9fe tempest-QuotaClassesAdmin257Test-1697334303 tempest-QuotaClassesAdmin257Test-1697334303-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.295297 Aug 30 16:16:46.319646 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1416/3125] 10.222.0.47 () {62 vars in 1247 bytes} [Tue Aug 30 16:16:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:16:46.342114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:46.347937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:46.380617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:46.381418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:46.382124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:46.388141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:46.388686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:46.389139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:46.439200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6d1a6cc-65e8-43d6-9d01-c3fd7dd5598f tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117268 Aug 30 16:16:46.439874 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1417/3126] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:46 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:46.770479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:46.784343 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d944d77-421d-4e7e-818a-c549bd7d0467 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1317 microversion: 2.1 time: 0.745010 Aug 30 16:16:46.803063 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1710/3127] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:46 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:47.452590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:47.456040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:47.492530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:47.494041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:47.497158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:47.510045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:47.511607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:47.527404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:47.675222 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe36bba8-665b-44f2-9b9f-75a2552acfde tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227150 Aug 30 16:16:47.690023 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1418/3128] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:47 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:47.809929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:47.811219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:47.826650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:47.830703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:47.831439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:47.835610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:47.837393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:47.838048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:47.839337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:48.696611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:48.699337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:48.713672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:48.717519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:48.718035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:48.718811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:48.719280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:48.719707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:48.806990 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a3cf550d-3f24-4ed0-85b3-8fe81fbfa577 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115558 Aug 30 16:16:48.811333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1419/3129] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:48 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:49.569964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:49.584344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e2658c9-d00b-4084-8c97-4173e971347d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1467 microversion: 2.1 time: 1.775223 Aug 30 16:16:49.588610 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1711/3130] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:47 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1467 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:49.617035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:49.617651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:49.632078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:49.634904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:49.638432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:49.640670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:49.644753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:49.645248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:49.820878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:49.824251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:49.841608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:49.842877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:49.844942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:49.847299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:49.849889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:49.852983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:49.941733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04a5ce76-c1ee-45c4-9ab9-ed46e648a30b tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125670 Aug 30 16:16:49.949702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1712/3131] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:49 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:16:50.121987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:50.136458 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e2ab290-fc53-4faf-819c-8038eccf901c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1468 microversion: 2.1 time: 0.523694 Aug 30 16:16:50.139518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1420/3132] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:49 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1468 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:50.175162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1936674928"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:50.178801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:50.219063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:50.223587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:50.225166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:50.229210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:50.235037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:50.235800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:50.858176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de291cb3-699d-4a0a-8202-ce9e84dabc99 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "POST /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d/action" status: 202 len: 0 microversion: 2.1 time: 0.679410 Aug 30 16:16:50.862230 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1713/3133] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:16:50 2022] POST /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:16:50.875471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45401f5b-54e6-43b3-9bdf-b01a3df72d40 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c253670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:50.983775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:50.992424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:51.006923 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45401f5b-54e6-43b3-9bdf-b01a3df72d40 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.131341 Aug 30 16:16:51.012988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1421/3134] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:50 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:51.037753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.040003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.056477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.057548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.059969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.061468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.199654 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0a30e25-e227-4cb2-97e6-5639d1dfba88 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.239689 Aug 30 16:16:51.210582 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1714/3135] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:16:50 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2/os-volume_attachments => generated 25 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:16:51.384518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:51.389421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:51.404465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.405262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.405887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.406943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.407566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.408160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.512633 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Cannot 'reboot' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action HTTP/1.1 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 28 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: {"reboot": {"type": "HARD"}} Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'reboot' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'd46f46bb-9e12-4dd3-bde5-d0f564fa07b3', 'body': {'reboot': {'type': 'HARD'}}} Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1059, in _action_reboot Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1063, in _action_reboot Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:16:51.515955 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 409 to user: Cannot 'reboot' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:51.520273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f1b6f5f-b431-4b1f-889f-1f75bcb385e8 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action" status: 409 len: 145 microversion: 2.1 time: 0.140534 Aug 30 16:16:51.532634 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1422/3136] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:16:51 2022] POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action => generated 145 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:16:51.545348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:51.550856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:51.568119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.570732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.572560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.575899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.576647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.578102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.641415 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Cannot 'rebuild' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action HTTP/1.1 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 65 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'rebuild' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd46f46bb-9e12-4dd3-bde5-d0f564fa07b3', 'body': {'rebuild': {'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325'}}} Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1251, in _action_rebuild Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:51.645144 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1259, in _action_rebuild Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued Aug 30 16:16:51.649797 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:16:51.657457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 409 to user: Cannot 'rebuild' instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 while it is in vm_state rescued {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:16:51.659634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66daf5d5-e6b1-4339-a8c1-6aa6b223f66d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action" status: 409 len: 146 microversion: 2.1 time: 0.122543 Aug 30 16:16:51.668066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1715/3137] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:16:51 2022] POST /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3/action => generated 146 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:16:51.673555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:51.674294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:51.691208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.691965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.692905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.694029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:51.695905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:51.698253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:51.757768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:16:51.957020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ad3ae02-2324-4804-a462-0cbbf1c365a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 204 len: 0 microversion: 2.1 time: 0.287517 Aug 30 16:16:51.958368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1423/3138] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:16:51 2022] DELETE /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:16:51.977306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:51.980208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:52.006765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:52.010170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:52.011637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:52.015421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:52.016463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:52.018295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:52.042956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ba7f0a7-04f8-4400-8da0-107091efccb4 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1fa790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:52.150108 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ba7f0a7-04f8-4400-8da0-107091efccb4 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.112560 Aug 30 16:16:52.163307 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1424/3139] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:52 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:52.569270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:52.593566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0986d74e-2481-4243-81c9-2f75faa17dd3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1687 microversion: 2.1 time: 0.630216 Aug 30 16:16:52.595314 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1716/3140] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:51 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1687 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:53.186477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a2167b8-92d5-4f24-ac09-37f439753b52 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2c3790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:53.287303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a2167b8-92d5-4f24-ac09-37f439753b52 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.111382 Aug 30 16:16:53.292807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1425/3141] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:53 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:53.629668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:53.631617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:53.648676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:53.649946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:53.650645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:53.652174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:53.652865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:53.653522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:54.313096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e1d565c-73c5-45bb-be01-20363f74202e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c273e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:54.430324 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e1d565c-73c5-45bb-be01-20363f74202e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.120891 Aug 30 16:16:54.434671 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1426/3142] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:54 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:54.480198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:54.491857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25bf7962-de9c-4078-be04-82028c969634 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1687 microversion: 2.1 time: 0.866007 Aug 30 16:16:54.509153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1717/3143] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:53 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1687 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:55.455799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b7f22f6-ab38-4519-9f0d-64f253d29179 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2423a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:55.517353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:55.517891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:55.551338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:55.552554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:55.552998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:55.553715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:55.554985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:55.554985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:55.560656 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b7f22f6-ab38-4519-9f0d-64f253d29179 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.110834 Aug 30 16:16:55.568301 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1427/3144] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:55 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:56.009597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:56.404385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:56.418528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:16:56.432219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2cf3d93-c4e7-4c3d-944f-2b4789cc844c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1687 microversion: 2.1 time: 0.918624 Aug 30 16:16:56.435430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1718/3145] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:55 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1687 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:56.579669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01bdaf50-bcc1-4dbb-876a-3ac8c143307c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35ce475e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:56.663273 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01bdaf50-bcc1-4dbb-876a-3ac8c143307c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 0.085390 Aug 30 16:16:56.673288 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1719/3146] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:56 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:16:57.106287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-plugged", "status": "completed", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:57.129551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:57.130755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:57.131205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:57.157030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] Creating event network-vif-plugged:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:16:57.173735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1f5bf492-62e4-4d40-accf-bc6072c6bd2a req-3b402051-74d2-49dc-aba5-bb252b319868 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076114 Aug 30 16:16:57.176305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0068c086-4b3a-495e-b86b-5da7b654ca38 tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] Action: 'create', calling method: .version_select at 0x7fd35c273b80>, body: {"security_group": {"name": "tempest-securitygroup-1606436754", "description": "tempest-description-561403947"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:57.177878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1720/3147] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:57.456779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:57.457518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:57.472090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:57.475815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:57.476360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:57.479295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:57.479793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:57.481967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:57.846383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:57.862780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3cf98c3f-2069-4653-9add-1617ab92e2d3 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1687 microversion: 2.1 time: 0.412725 Aug 30 16:16:57.864659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1721/3148] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:57 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1687 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:57.874031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93ef7b1e-3c90-4545-a1fe-e007149667ad tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4a1b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:58.713329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0068c086-4b3a-495e-b86b-5da7b654ca38 tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.295060 Aug 30 16:16:58.723664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1428/3149] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:16:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:58.730405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28273549-2a79-42ea-8fca-0d97694d0579 tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] Action: 'create', calling method: .version_select at 0x7fd35c2408b0>, body: {"security_group": {"name": "tempest-securitygroup-841945492", "description": "tempest-description-2042352872"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:59.519232 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28273549-2a79-42ea-8fca-0d97694d0579 tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.794231 Aug 30 16:16:59.519935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1429/3150] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:16:58 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:16:59.525138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:16:59.526144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:16:59.547318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:59.552460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:59.555326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:59.560968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:59.563939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:59.570556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:59.803302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:16:59.816439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3891222-0b34-4930-b0ae-acc6c6021474 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 200 len: 1620 microversion: 2.1 time: 0.295300 Aug 30 16:16:59.819892 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1430/3151] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:16:59 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 1620 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:16:59.830624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba50491-c695-4c19-a36e-09d614d1b9a2", "name": "network-vif-deleted", "tag": "01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:16:59.856668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:16:59.856941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:16:59.858965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:16:59.895061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] Creating event network-vif-deleted:01d17bee-8b1a-4a03-95c9-bff9ed9d4b3d for instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 on n-h1-830883-28 Aug 30 16:16:59.910696 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3fef0f69-fe80-4a69-adbb-5b8d2ed2c4cb req-6fa149de-1965-41cb-9299-d326a15c3f3a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088354 Aug 30 16:16:59.914234 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1431/3152] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:00.434561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a44f5096-ab42-4068-a03b-6978cfb63148 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] Action: 'create', calling method: .version_select at 0x7fd35c2ee1f0>, body: {"security_group": {"name": "tempest-securitygroup-775719207", "description": "tempest-description-2014488100"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:02.632693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a44f5096-ab42-4068-a03b-6978cfb63148 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.716927 Aug 30 16:17:02.633324 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1432/3153] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:16:59 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:02.638563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:02.639305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: 0ba50491-c695-4c19-a36e-09d614d1b9a2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:02.652342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:02.652850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:02.653299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:02.654015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:02.654560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:02.655000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:02.726708 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 HTTP/1.1 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '0ba50491-c695-4c19-a36e-09d614d1b9a2'} Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:02.729559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 404 to user: Instance 0ba50491-c695-4c19-a36e-09d614d1b9a2 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7cfa3b5b-b843-4516-a861-6655d0ce9680 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2" status: 404 len: 111 microversion: 2.1 time: 0.096667 Aug 30 16:17:02.733959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1433/3154] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:02 2022] GET /compute/v2.1/servers/0ba50491-c695-4c19-a36e-09d614d1b9a2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:02.774410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4891131e-f943-4637-a7bf-e595ff514924 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] Action: 'create', calling method: .version_select at 0x7fd35c2c3d30>, body: {"security_group": {"name": "tempest-securitygroup-192630393", "description": "tempest-description-951879557"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:03.754919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4891131e-f943-4637-a7bf-e595ff514924 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.022215 Aug 30 16:17:03.756705 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1434/3155] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:17:02 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:03.761546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59d2b20d-a087-445c-b89a-edbbd644b9a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '.version_select at 0x7fd35c266790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:03.823423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59d2b20d-a087-445c-b89a-edbbd644b9a7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054806290" status: 202 len: 0 microversion: 2.1 time: 0.065393 Aug 30 16:17:03.824249 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1435/3156] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054806290 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:17:03.838182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b646cc7-64d1-470b-8720-1dc3be988fd0 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] Calling method '.version_select at 0x7fd35c24d790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:07.469959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=19 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:07.851851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:12.721318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:13.807693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=15,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:16.743645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b646cc7-64d1-470b-8720-1dc3be988fd0 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] 10.222.0.47 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10986 microversion: 2.1 time: 12.917629 Aug 30 16:17:16.745211 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1436/3157] 10.222.0.47 () {58 vars in 1191 bytes} [Tue Aug 30 16:17:03 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10986 bytes in 12920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:17:16.770101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1a3c0ed-1bd2-4a50-b753-a135fa215b0a tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] Calling method '.version_select at 0x7fd35c2abd30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:17.855953 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1a3c0ed-1bd2-4a50-b753-a135fa215b0a tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] 10.222.0.47 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.089817 Aug 30 16:17:17.856883 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1437/3158] 10.222.0.47 () {58 vars in 1191 bytes} [Tue Aug 30 16:17:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:17.870114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4181715b-a9d1-4676-9317-ac10f8dba885 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] Calling method '.version_select at 0x7fd35c2425e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:18.615762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4181715b-a9d1-4676-9317-ac10f8dba885 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/6c9e3b0a-4a8d-443c-81af-aeeca5fff605" status: 202 len: 0 microversion: 2.1 time: 0.749246 Aug 30 16:17:18.616417 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1438/3159] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:17:17 2022] DELETE /compute/v2.1/os-security-groups/6c9e3b0a-4a8d-443c-81af-aeeca5fff605 => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:17:19.620211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2095715415", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "cf94be17-ef1a-466a-9cc0-beccf569945a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:22.042836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93ef7b1e-3c90-4545-a1fe-e007149667ad tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1455 microversion: 2.1 time: 24.172490 Aug 30 16:17:22.044287 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1722/3160] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:16:57 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1455 bytes in 24179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:22.053914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d8dc2e4-f954-49ee-b5ce-882b831ec931 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] Calling method '.version_select at 0x7fd35c4d4f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:22.063893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] validate_networks() for [('cf94be17-ef1a-466a-9cc0-beccf569945a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:23.085800 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d8dc2e4-f954-49ee-b5ce-882b831ec931 tempest-SecurityGroupsTestAdminJSON-1878396479 tempest-SecurityGroupsTestAdminJSON-1878396479-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/a53d501b-4647-4633-85e9-aa551825d0d9" status: 202 len: 0 microversion: 2.1 time: 1.038693 Aug 30 16:17:23.090085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1723/3161] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:17:22 2022] DELETE /compute/v2.1/os-security-groups/a53d501b-4647-4633-85e9-aa551825d0d9 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:17:23.359285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:23.363503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:23.364834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:23.365550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:23.366059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:23.387023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:23.389708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:23.390411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:23.392706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:23.393603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:23.396469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:23.453104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Getting quotas for project 57b387b23b5844c9b9f2e1877c6e9034. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:23.478370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Getting quotas for user cdd0dd3752d44ce4b78ee1e872cc3fda and project 57b387b23b5844c9b9f2e1877c6e9034. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:23.532391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:23.537376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:23.677136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d43db914-c923-41ca-b684-ecb02d902440 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Action: 'create', calling method: .version_select at 0x7fd35c4d4d30>, body: {"keypair": {"name": "tempest-keypair-1114468263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcmdUJIbWTkg+FBwR9+W6MkQkZRBC3g6dcYBCISy25pKhGSUAQEBNfR/auclT0NGsoHkgIq3a0J5xEcaC6lGnA5HbcZGla5svl/yKOJEcyQt1qBepDAtDeBDm/yn1QtkA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:23.717103 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3d02330-bac2-4b3a-b4c0-66ab1cfff706 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.098405 Aug 30 16:17:23.718337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1439/3162] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 5101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:17:23.725699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d43db914-c923-41ca-b684-ecb02d902440 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Getting quotas for project c2da89aa82a943b498bec542e8d0cbe2. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:23.729094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:23.735292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:23.748018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:23.750933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:23.753174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:23.754111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:23.754247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d43db914-c923-41ca-b684-ecb02d902440 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Getting quotas for user 814577c02957425280092135af2373c8 and project c2da89aa82a943b498bec542e8d0cbe2. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:23.755072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:23.758926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:23.812551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:17:23.816892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d43db914-c923-41ca-b684-ecb02d902440 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.725292 Aug 30 16:17:23.817818 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1724/3163] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:17:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:23.837074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82991797-aa24-47b9-aacf-b0d6a3a00e5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4a10d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:23.908562 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82991797-aa24-47b9-aacf-b0d6a3a00e5c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1464 microversion: 2.1 time: 0.086948 Aug 30 16:17:23.913927 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1725/3164] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:23 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:23.919761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4bf817d-e353-4425-8f86-cfad619c11cf tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] Calling method '.version_select at 0x7fd35c523a60>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.037779 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73f57eed-486c-4f86-8a7f-de4e6b0d11f2 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 204 len: 0 microversion: 2.1 time: 0.313872 Aug 30 16:17:24.039163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1440/3165] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:17:23 2022] DELETE /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:17:24.050431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-363b318b-6b9c-4595-91e1-a8b1103e947e tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.052102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-363b318b-6b9c-4595-91e1-a8b1103e947e tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:24.183021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-363b318b-6b9c-4595-91e1-a8b1103e947e tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:24.217863 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-363b318b-6b9c-4595-91e1-a8b1103e947e tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1225 microversion: 2.1 time: 0.174273 Aug 30 16:17:24.238475 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1441/3166] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:24 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1225 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:24.247199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc5c090f-dba3-4a27-b729-472b6c7c0286 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c3025e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.327790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc5c090f-dba3-4a27-b729-472b6c7c0286 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 200 len: 1464 microversion: 2.1 time: 0.086854 Aug 30 16:17:24.332682 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1442/3167] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:24 2022] GET /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 1464 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:24.342030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.349013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:24.364835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.366748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.369229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.372081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.372789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.374014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.429200 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4bf817d-e353-4425-8f86-cfad619c11cf tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/8a8a0291-0db5-44fc-9591-557411149b06" status: 202 len: 0 microversion: 2.1 time: 0.513597 Aug 30 16:17:24.430046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1726/3168] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:17:23 2022] DELETE /compute/v2.1/os-security-groups/8a8a0291-0db5-44fc-9591-557411149b06 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:17:24.456889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:24.460965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:24.494598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.498476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.499682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.503287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:24.503845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:24.508582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:24.861476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:24.878212 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-054cc24a-b45a-4739-93b8-469e2d169e41 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1508 microversion: 2.1 time: 0.542088 Aug 30 16:17:24.881223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1443/3169] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:24 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1508 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:24.892134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d370072-8cfb-4fa6-a975-a26534b77d9e tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] Calling method '.version_select at 0x7fd35c2ee550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:25.033262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.053456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35f70fee-1f19-4998-a064-c9e864ca0f3b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1468 microversion: 2.1 time: 0.611878 Aug 30 16:17:25.054159 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1727/3170] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:24 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1468 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:25.077711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1351484688"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:25.084039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:25.092434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.093452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.094195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:25.095464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.098761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.098761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:25.322413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d370072-8cfb-4fa6-a975-a26534b77d9e tempest-SecurityGroupsTestAdminJSON-806435225 tempest-SecurityGroupsTestAdminJSON-806435225-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/fa9b6955-5e14-4692-8e71-b725080e9a04" status: 202 len: 0 microversion: 2.1 time: 0.439693 Aug 30 16:17:25.323310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1444/3171] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:17:24 2022] DELETE /compute/v2.1/os-security-groups/fa9b6955-5e14-4692-8e71-b725080e9a04 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:17:25.328928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:25.330109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:25.355408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.355920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.356436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:25.357186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.357645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.358078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:25.474108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:25.485280 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-027530d8-5ec5-4d06-bd66-9a21fe1b3e50 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1229 microversion: 2.1 time: 0.160577 Aug 30 16:17:25.486919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1445/3172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:25 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:25.533836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03d57851-1d83-43a0-a7d6-7cde26758186 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "POST /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d/action" status: 202 len: 0 microversion: 2.1 time: 0.462734 Aug 30 16:17:25.535918 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1728/3173] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:17:25 2022] POST /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:17:25.553770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e488e971-e1c7-452a-8e71-d13ff9073df8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1a0c10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:25.659960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e488e971-e1c7-452a-8e71-d13ff9073df8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.111283 Aug 30 16:17:25.673197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1446/3174] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:25 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:25.903167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:25.904073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:25.917182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.917938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.921596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:25.923293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:25.924049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:25.927158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:26.338232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:26.349587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b88dae2f-266b-4f2c-b2da-658bc4502e22 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1508 microversion: 2.1 time: 0.450300 Aug 30 16:17:26.366158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1729/3175] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:25 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:26.511826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:26.514509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:26.528476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:26.530089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:26.531771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:26.533642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:26.535052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:26.537889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:26.681869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-179ea291-2066-4b19-81f2-88a2d78a2dce tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f2d670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:26.744585 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-179ea291-2066-4b19-81f2-88a2d78a2dce tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.067781 Aug 30 16:17:26.756321 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1730/3176] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:26 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:26.837789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:26.857049 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68a1668b-2229-422b-b64e-9b6d388c61dc tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1277 microversion: 2.1 time: 0.353670 Aug 30 16:17:26.862213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1447/3177] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:26 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:27.133152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-unplugged", "status": "completed", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:27.171000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.171510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.172344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.201332 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] Creating event network-vif-unplugged:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:17:27.209917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9160e17e-e0f9-4a40-8e72-43f649848442 req-d3a86743-19c0-4c4d-816f-25b7269fd9f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082579 Aug 30 16:17:27.210569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1731/3178] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:27.372584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:27.373258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:27.380660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.381533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.381973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.382810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.383527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.384251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.764403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2feb5f9b-2b3c-4c94-b5da-b9b4c763e620 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cda8ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:27.844127 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2feb5f9b-2b3c-4c94-b5da-b9b4c763e620 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.084527 Aug 30 16:17:27.844717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1732/3179] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:27 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:27.890914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:27.891952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:27.892812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:27.902066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e528e706-cab7-457f-8166-e248d9331188 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1508 microversion: 2.1 time: 0.533680 Aug 30 16:17:27.904425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.905261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.906652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.907713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:27.908405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:27.909066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:27.918970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1448/3180] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:27 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1508 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:28.057864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:28.077942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d74cc576-b225-4629-b3a0-0805eafb1e8b tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1283 microversion: 2.1 time: 0.195760 Aug 30 16:17:28.083268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1733/3181] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:27 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:28.812755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d46f46bb-9e12-4dd3-bde5-d0f564fa07b3", "name": "network-vif-deleted", "tag": "99df5124-6f1c-4991-b5b0-e8a58117099a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:28.839375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:28.840109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:28.844454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:28.859436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-261808f0-b272-4991-9608-89a66a420f67 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f2de50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:28.898461 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] Creating event network-vif-deleted:99df5124-6f1c-4991-b5b0-e8a58117099a for instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 on n-h2-830883-28 Aug 30 16:17:28.904879 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-61b25483-0fe3-43e9-b7e8-16902de14f98 req-a66cb973-b987-4089-a1b6-4bae17f153be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097713 Aug 30 16:17:28.906002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1449/3182] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:28.931882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:28.932592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:28.963583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-261808f0-b272-4991-9608-89a66a420f67 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.107921 Aug 30 16:17:28.964192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1734/3183] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:28 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:28.969101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:28.971726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:28.975318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:28.976289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:28.978799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:28.985063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:29.101797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:29.102459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:29.118411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:29.118922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:29.119371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:29.120086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:29.128283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:29.128932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:29.305897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:29.314211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-792f9773-2889-459b-9979-bac1305efb4d tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1466 microversion: 2.1 time: 0.392024 Aug 30 16:17:29.337731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:29.341398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1450/3184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:28 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:29.349605 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b04b5c88-240d-4216-ac70-8d3fa2231f9c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1283 microversion: 2.1 time: 0.252079 Aug 30 16:17:29.365725 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1735/3185] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:29 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:29.429668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-975679058", "imageRef": "4ea34111-b0b7-4731-a29d-7dc811f8ec47", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "40a17c1e-1d50-4305-a54b-ef71596a1ffe"}], "security_groups": [{"name": "tempest-securitygroup--1619156577"}], "key_name": "tempest-keypair-1114468263", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:29.685731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] validate_networks() for [('40a17c1e-1d50-4305-a54b-ef71596a1ffe', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:17:29.978374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a963e0c-c207-4382-80e0-536fcee2ff24 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360fb64c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.100001 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a963e0c-c207-4382-80e0-536fcee2ff24 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.125450 Aug 30 16:17:30.110672 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1736/3186] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:29 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:30.339764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.340658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:30.355207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.357269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.357937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.358857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.375667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.377671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.467801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.468297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.471188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.472843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'fault' on Instance uuid d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:17:30.648403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:17:30.649554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:17:30.650224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:17:30.651270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:17:30.651979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:17:30.665341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.666281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.667315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.668645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.669481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.670222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.716196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Getting quotas for project c2da89aa82a943b498bec542e8d0cbe2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:17:30.727231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Getting quotas for user 814577c02957425280092135af2373c8 and project c2da89aa82a943b498bec542e8d0cbe2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:17:30.762907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:17:30.768791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ea34111-b0b7-4731-a29d-7dc811f8ec47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:17:30.843724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11d3475d-0813-4209-b840-54258060a212 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.418510 Aug 30 16:17:30.850383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1451/3187] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:17:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:17:30.852139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:30.853259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:30.865072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.866193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.866856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:30.867704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:30.868580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:30.869503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.146744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.154797 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7aa826bb-adda-457e-a20c-8614e074a056 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 200 len: 1312 microversion: 2.1 time: 0.818844 Aug 30 16:17:31.158229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1737/3188] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:30 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 1312 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:31.170450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cacf94c-c514-4bd5-9eca-ebcffda628c6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.172521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0cacf94c-c514-4bd5-9eca-ebcffda628c6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:31.330989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0cacf94c-c514-4bd5-9eca-ebcffda628c6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.344578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0cacf94c-c514-4bd5-9eca-ebcffda628c6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1245 microversion: 2.1 time: 0.184469 Aug 30 16:17:31.345711 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1738/3189] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:31.354207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5d068ac-583b-4f7e-9bdc-f75daf2aeaad tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4d44c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:31.418958 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5d068ac-583b-4f7e-9bdc-f75daf2aeaad tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.071493 Aug 30 16:17:31.419649 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1739/3190] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:31 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:31.422398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:31.438683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbaf5ec9-3709-4c90-8261-fd628cbc4f90 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 0.583816 Aug 30 16:17:31.439350 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1452/3191] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:30 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:31.840430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b2f9419-3636-424d-bec2-7f46b13752d0", "tag": "0eaa73f3-c198-48a5-b435-c566c953ede0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:31.866516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:31.867020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:31.868232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:31.908380 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] Creating event network-changed:0eaa73f3-c198-48a5-b435-c566c953ede0 for instance 9b2f9419-3636-424d-bec2-7f46b13752d0 on n-h2-830883-28 Aug 30 16:17:31.921471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-11a43b49-9594-4f74-9245-46113698e817 req-02662211-eeaf-4a0d-b2b6-4d16a0843640 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094307 Aug 30 16:17:31.922990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1740/3192] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:32.176996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.177826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: d46f46bb-9e12-4dd3-bde5-d0f564fa07b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.186918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.187914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.188667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.189619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.190655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.191328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.236857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 HTTP/1.1 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'd46f46bb-9e12-4dd3-bde5-d0f564fa07b3'} Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.245057 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. Aug 30 16:17:32.249553 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.252812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 404 to user: Instance d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:32.257975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4a5008c-dc58-45f5-a5fd-340f3b224468 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3" status: 404 len: 111 microversion: 2.1 time: 0.085427 Aug 30 16:17:32.264125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1453/3193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/d46f46bb-9e12-4dd3-bde5-d0f564fa07b3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:32.282043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.284143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.303795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.304299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.306887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.310430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.311790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.315537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.385423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:17:32.542255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2323eebc-7639-4c44-a244-78e326a0947a tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 204 len: 0 microversion: 2.1 time: 0.275715 Aug 30 16:17:32.544447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1741/3194] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:17:32 2022] DELETE /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:17:32.553971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.555816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.565751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.566676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.568067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.569120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.569783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.570475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.590784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c2c3430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:32.594462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.594955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.595402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.619217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.619831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.620499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.630105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] HTTP exception thrown: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Request method failure captured: Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 HTTP/1.1 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 56 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjgc-Xp0z7cbQ277ZNsZgUkygaakRF9Ey1Kti_Qxb2Kd5eLnJwsy-iZLwQktm5wP7Y11tXy_1XT5VLWKxyTHeSHkV_52MHRHGS9IEwZ4R_AEZq8-ui5mNacRtj9xq08l03yXNNO2tHkjaX4Fd0cxh53XxiLeEJR3Yc_cNyv1mFXNIHM Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}] Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 07af32f5d79a40c4b23194971fbac0ce Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: exception: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b6a41ea6-5cb6-4e75-989b-3a19a4ca6564', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:17:32.632562 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Returning 404 to user: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a08914c9-4d30-48c2-914a-144509bd98b7 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564" status: 404 len: 110 microversion: 2.53 time: 0.307983 Aug 30 16:17:32.636966 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1454/3195] 10.222.0.47 () {62 vars in 1309 bytes} [Tue Aug 30 16:17:32 2022] PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 => generated 110 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:17:32.640356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd223f86-f3b2-4cee-9797-537ae9d15e37 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c266c10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.704004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:32.704791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd223f86-f3b2-4cee-9797-537ae9d15e37 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.068948 Aug 30 16:17:32.705482 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1455/3196] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:32.711703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.712537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.720416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.721129 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4787d482-3d14-4bd3-82ea-c5aa2eb3ecba tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1297 microversion: 2.1 time: 0.173771 Aug 30 16:17:32.721395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.721845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.722697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.723171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.724168 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1742/3197] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1297 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:32.724831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.729544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:32.730163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:32.736706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.737278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.737727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.738649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:32.740351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:32.740795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:32.998493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.001933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.010190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1fdfdfec-95ae-4c1f-9586-3480cbf895e1 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 0.303437 Aug 30 16:17:33.024503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65fa7da2-1863-4dc9-aa73-69e1cc1a0412 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.288328 Aug 30 16:17:33.024503 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1743/3198] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.024503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Action: 'update', calling method: .version_select at 0x7fd35d0ada60>, body: {"status": "disabled"} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:33.025715 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1456/3199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:32 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.029983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.030592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.031166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.039614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.040111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.040556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.047776 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] HTTP exception thrown: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Request method failure captured: Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 HTTP/1.1 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 22 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjgc-Xp0z7cbQ277ZNsZgUkygaakRF9Ey1Kti_Qxb2Kd5eLnJwsy-iZLwQktm5wP7Y11tXy_1XT5VLWKxyTHeSHkV_52MHRHGS9IEwZ4R_AEZq8-ui5mNacRtj9xq08l03yXNNO2tHkjaX4Fd0cxh53XxiLeEJR3Yc_cNyv1mFXNIHM Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}] Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 07af32f5d79a40c4b23194971fbac0ce Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: {"status": "disabled"} Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: exception: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b6a41ea6-5cb6-4e75-989b-3a19a4ca6564', 'body': {'status': 'disabled'}} Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:17:33.049911 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Returning 404 to user: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:33.056254 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-46ff475d-0dd9-4934-8619-bddd34459328 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564" status: 404 len: 110 microversion: 2.53 time: 0.033937 Aug 30 16:17:33.059313 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1744/3200] 10.222.0.47 () {62 vars in 1309 bytes} [Tue Aug 30 16:17:33 2022] PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 => generated 110 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:33.063593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Action: 'update', calling method: .version_select at 0x7fd35c2601f0>, body: {"status": "enabled"} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:33.069686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.070174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.070669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.076830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.076983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.077349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.082403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] HTTP exception thrown: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Request method failure captured: Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 HTTP/1.1 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 21 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjgc-Xp0z7cbQ277ZNsZgUkygaakRF9Ey1Kti_Qxb2Kd5eLnJwsy-iZLwQktm5wP7Y11tXy_1XT5VLWKxyTHeSHkV_52MHRHGS9IEwZ4R_AEZq8-ui5mNacRtj9xq08l03yXNNO2tHkjaX4Fd0cxh53XxiLeEJR3Yc_cNyv1mFXNIHM Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0d26cc3d14bb4a5e8e4ffbbf01274430"}]}] Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 0d26cc3d14bb4a5e8e4ffbbf01274430 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803 Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 07af32f5d79a40c4b23194971fbac0ce Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: {"status": "enabled"} Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: exception: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b6a41ea6-5cb6-4e75-989b-3a19a4ca6564', 'body': {'status': 'enabled'}} Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6217, in service_get_by_id Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6077, in _find_service_in_cell Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6219, in service_get_by_id Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:17:33.084071 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Returning 404 to user: Service b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c2edf34-a0e3-48d7-8d49-20e3c17fdee1 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564" status: 404 len: 110 microversion: 2.53 time: 0.026236 Aug 30 16:17:33.088722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1457/3201] 10.222.0.47 () {62 vars in 1309 bytes} [Tue Aug 30 16:17:33 2022] PUT /compute/v2.1/os-services/b6a41ea6-5cb6-4e75-989b-3a19a4ca6564 => generated 110 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:33.100086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.103779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.104280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.104731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.105535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.105989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.106458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.132850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03a55759-dc06-47e2-8f5b-8af365053e15 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039612 Aug 30 16:17:33.134464 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1745/3202] 10.222.0.47 () {60 vars in 1178 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:33.145626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.149101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.149588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.150025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.150801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.151255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.151669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.175861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b948b14-214c-40b2-8c81-dd33ab3dde8a tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.033837 Aug 30 16:17:33.177040 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1458/3203] 10.222.0.47 () {60 vars in 1211 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:17:33.190054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.194201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.194746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.195192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.195918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.196375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.196806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.230942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ccae7af-d9b0-40f0-92f2-2ef3213e5f55 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044432 Aug 30 16:17:33.231560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1746/3204] 10.222.0.47 () {60 vars in 1178 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:33.254609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.267584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.268213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.269339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.271415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.272323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.272805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.302750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f881be56-d31c-466c-b9f6-5fa9fa89722d tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=n-d-830883-28&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.059357 Aug 30 16:17:33.303921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1459/3205] 10.222.0.47 () {60 vars in 1237 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services?host=n-d-830883-28&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.315045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.319427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.319928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.320377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.321127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.321602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.322039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.349775 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8319c5d6-2113-4836-af33-4ad376c6830e tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038444 Aug 30 16:17:33.362411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.367030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.367426 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1747/3206] 10.222.0.47 () {60 vars in 1178 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:17:33.368123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.368816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.369770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.370471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.371102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.397488 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4c0ab0fb-6e9a-445f-abfe-36e32ee18f77 tempest-ServicesAdminNegativeV253TestJSON-69567803 tempest-ServicesAdminNegativeV253TestJSON-69567803-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.038713 Aug 30 16:17:33.411947 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1460/3207] 10.222.0.47 () {60 vars in 1239 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:33.588934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93325f64-29a2-47b7-8d5a-77e6f36fd32d", "name": "network-vif-plugged", "status": "completed", "tag": "0a0c19b5-e069-412c-abea-7ad0778fad7c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:33.605200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.606729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.607581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.632064 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] Creating event network-vif-plugged:0a0c19b5-e069-412c-abea-7ad0778fad7c for instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d on n-h2-830883-28 Aug 30 16:17:33.639363 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-de416580-c94d-4094-adde-47324ed62d35 req-49196f63-c659-48e5-b273-583c91d6d289 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054066 Aug 30 16:17:33.644314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1461/3208] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:17:33.721709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-425c3f78-03c7-4a63-9629-7204a9ad5545 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1faa60>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.804207 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-425c3f78-03c7-4a63-9629-7204a9ad5545 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.087327 Aug 30 16:17:33.805585 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1462/3209] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:33.812111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fdb3f4a-a301-49d7-b970-b349193cd40d tempest-ServicesAdminNegativeV253TestJSON-1684241828 tempest-ServicesAdminNegativeV253TestJSON-1684241828-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.816081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8fdb3f4a-a301-49d7-b970-b349193cd40d tempest-ServicesAdminNegativeV253TestJSON-1684241828 tempest-ServicesAdminNegativeV253TestJSON-1684241828-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '7a0d514251254b03945206c8777f01e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d219fd890e247fd9e5e9aa0a0d6a7b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fdb3f4a-a301-49d7-b970-b349193cd40d tempest-ServicesAdminNegativeV253TestJSON-1684241828 tempest-ServicesAdminNegativeV253TestJSON-1684241828-project] Request method failure captured: Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjgadf6uyIPndDMwtzOEm-zuj_1QULQrejbklZFtY98Nxk0MkLquGIotmkAR1NLrG9Q_zaylfVsCxMpixyGkpMQNE6mP5POTgLsAbnMhdRv1inxhY4Cs_t7-qj0QR2eovXVk1Z5Pv31aHIdomrEc54L1aQImEAF-xQYhUw1C954eVqc Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8d219fd890e247fd9e5e9aa0a0d6a7b4 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1684241828 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8d219fd890e247fd9e5e9aa0a0d6a7b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8d219fd890e247fd9e5e9aa0a0d6a7b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8d219fd890e247fd9e5e9aa0a0d6a7b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8d219fd890e247fd9e5e9aa0a0d6a7b4"}]}] Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1684241828 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8d219fd890e247fd9e5e9aa0a0d6a7b4 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1684241828 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1684241828-project Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7a0d514251254b03945206c8777f01e5 Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1684241828-project Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: action_args: {} Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 16:17:33.822036 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8fdb3f4a-a301-49d7-b970-b349193cd40d tempest-ServicesAdminNegativeV253TestJSON-1684241828 tempest-ServicesAdminNegativeV253TestJSON-1684241828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:33.829962 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8fdb3f4a-a301-49d7-b970-b349193cd40d tempest-ServicesAdminNegativeV253TestJSON-1684241828 tempest-ServicesAdminNegativeV253TestJSON-1684241828-project] 10.222.0.47 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.417053 Aug 30 16:17:33.834237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1748/3210] 10.222.0.47 () {60 vars in 1178 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:17:33.834346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:33.834346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:33.839157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.839663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.840107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.840824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:33.841283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:33.841717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:33.936473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:33.953813 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff78cf4c-cbdc-4fb5-97f4-9fede431e888 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1297 microversion: 2.1 time: 0.146833 Aug 30 16:17:33.955015 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1463/3211] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:33 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:34.031676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.037475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.038106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:34.041491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:34.050916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.051148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.052040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.052181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.052476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.052647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.053326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.055940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:34.056415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.056848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.057717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:34.058704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:34.330542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.340554 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-54f30811-b36c-4bb6-b018-d26bd3fcd922 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.307615 Aug 30 16:17:34.341386 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1464/3212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:34.403270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:34.415180 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6e8a595-0b2b-4cbd-b93c-8542cf01f72c tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 0.387251 Aug 30 16:17:34.416298 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1749/3213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:34.823295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e9d0d99-5375-412b-a3ef-ac9014316301 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2b3550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.879279 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e9d0d99-5375-412b-a3ef-ac9014316301 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.063585 Aug 30 16:17:34.888366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1465/3214] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:34.990187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:34.991057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.002880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.003780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.005072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.006055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.006770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.007430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.111867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.121562 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5b44916-36ee-4254-bbc4-5b87b2e08ea6 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1297 microversion: 2.1 time: 0.148148 Aug 30 16:17:35.130918 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1750/3215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:34 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:35.366769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.367663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.382491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.386245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.386730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.387680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.388144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.392365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.435618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.436467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:35.448886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.449367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.449811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.455316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:35.456042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:35.456660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:35.461646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:35.752532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:35.764277 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac3becfc-9c03-42f5-9d98-00e827af5131 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 0.332690 Aug 30 16:17:35.780019 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1751/3216] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:35.898543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4dacd40f-cfa4-4205-8582-643f806c2a92 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f2d550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:35.981458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4dacd40f-cfa4-4205-8582-643f806c2a92 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.090378 Aug 30 16:17:35.986189 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1752/3217] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:36.145902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:36.148012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:36.166575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.168000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.172135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.174790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.177201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.178437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.287328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.336497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bac96e11-3c7e-4349-a396-a9de3d962c08 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1521 microversion: 2.1 time: 0.973795 Aug 30 16:17:36.340985 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1466/3218] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:35 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1521 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:36.356407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:36.372906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-023ea6fc-b7f5-451f-b23d-048f3020fb05 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1303 microversion: 2.1 time: 0.231888 Aug 30 16:17:36.374178 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1753/3219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1303 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:36.796136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:36.798327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:36.825393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.830807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.830807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.830807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:36.835058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:36.836250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:36.874185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:37.002235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce1df6c3-1344-4d95-8d68-c7748cf57e2f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4d69d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:37.079472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce1df6c3-1344-4d95-8d68-c7748cf57e2f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.081837 Aug 30 16:17:37.090101 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1754/3220] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:37.361467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:37.362461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:37.389269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.389974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.391987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.394934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.399069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.399625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.578055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:37.589105 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a41e8ce8-603d-4333-a3ca-3c907c5fe49c tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1479 microversion: 2.1 time: 0.231930 Aug 30 16:17:37.609641 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1755/3221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:37 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1479 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:37.624588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:37.628087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:37.638514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.639367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.639991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.641034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:37.641849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:37.642492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:37.781874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:37.798648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f125c2d6-889e-4ef5-a42e-51888599b39e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1303 microversion: 2.1 time: 0.185912 Aug 30 16:17:37.809715 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1756/3222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:37 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:38.095014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6faf9373-00cf-4fc5-a668-1c580902a214 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4a1ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.221801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6faf9373-00cf-4fc5-a668-1c580902a214 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1455 microversion: 2.1 time: 0.130442 Aug 30 16:17:38.225424 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1757/3223] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:38.394917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88926ad-060b-4fa0-a0db-50ebc5b8f70d", "name": "network-vif-deleted", "tag": "bd91cc1d-b602-49d5-8e77-a8dc2197a9aa"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:38.429873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.432790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.436166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.478453 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] Creating event network-vif-deleted:bd91cc1d-b602-49d5-8e77-a8dc2197a9aa for instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d on n-h1-830883-28 Aug 30 16:17:38.503398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4be0eb59-6c16-4bc9-9e09-c71e79c4a44c req-b17751fc-b1fe-40e3-af8b-f05ef7685544 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102329 Aug 30 16:17:38.509228 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1758/3224] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:38.642471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.643558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:38.652337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.654379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.655650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.657310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.659442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.660484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.721230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.722498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.727402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.728524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lazy-loading 'fault' on Instance uuid e88926ad-060b-4fa0-a0db-50ebc5b8f70d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:17:38.831088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.850066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c94027df-d96d-46e1-ab77-a6699fd5353a tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 2.061323 Aug 30 16:17:38.852245 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1467/3225] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:36 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:38.871471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:38.876365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:38.881064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b330d5f913ce45d59c3c5aed0972c7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c014aef8c14c49a199e79223de58d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:38.889749 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfad41bc-7ca3-4eec-b2d2-80fae2df9df7 tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 200 len: 1311 microversion: 2.1 time: 0.257265 Aug 30 16:17:38.894476 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1759/3226] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 1311 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:17:38.920928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.921431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.928132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:38.931338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:38.932014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:38.933521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:39.242601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb5dcf29-df35-4e1d-82bf-492a12adf439 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f2d820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.701657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:40.718173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3439c6b-fbc7-4919-91e0-c37a49946012 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.859963 Aug 30 16:17:40.728860 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1468/3227] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:38 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:40.739874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:40.749286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:40.751044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:40.792741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.793639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.795963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:40.797070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:40.797774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:40.801024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.343755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:41.636754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:41.650329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-22c3ebc4-955e-4517-9238-16f474157fec tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 0.919837 Aug 30 16:17:41.651089 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1469/3228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:40 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:41.665053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:41.666180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] [instance: e88926ad-060b-4fa0-a0db-50ebc5b8f70d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:41.682864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.688995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.689589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.690470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.691139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.692517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.733543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] HTTP exception thrown: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Request method failure captured: Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d HTTP/1.1 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjbLMW6QGRltpwc2zwSoXhjkDx-qf54tFfnbECK5q6KuzX10LWX4gzGbp-3Rj-BF_uUP7905kOfzioY-x8DZo49T7xH6kA4z1vf0_cZvcE989CG4-5bl7MfOGNaEH6rFboYcIugdRXI8eyg7jEu8vtII-9Kp2pKlU0uH6ct-mkZKQME Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f9c014aef8c14c49a199e79223de58d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f9c014aef8c14c49a199e79223de58d5"}]}] Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f9c014aef8c14c49a199e79223de58d5 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1146876990 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b330d5f913ce45d59c3c5aed0972c7e6 Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1146876990-project Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e88926ad-060b-4fa0-a0db-50ebc5b8f70d'} Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:41.737980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:41.745311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] Returning 404 to user: Instance e88926ad-060b-4fa0-a0db-50ebc5b8f70d could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:41.747178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5e9189c-2c64-4268-9b86-6ddb53768cad tempest-ServerRescueNegativeTestJSON-1146876990 tempest-ServerRescueNegativeTestJSON-1146876990-project] 10.222.0.47 "GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d" status: 404 len: 111 microversion: 2.1 time: 0.087266 Aug 30 16:17:41.749314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1470/3229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:41 2022] GET /compute/v2.1/servers/e88926ad-060b-4fa0-a0db-50ebc5b8f70d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:41.762601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2f9419-3636-424d-bec2-7f46b13752d0", "name": "network-vif-plugged", "status": "completed", "tag": "0eaa73f3-c198-48a5-b435-c566c953ede0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:41.788344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.788978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.789533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.818918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] Creating event network-vif-plugged:0eaa73f3-c198-48a5-b435-c566c953ede0 for instance 9b2f9419-3636-424d-bec2-7f46b13752d0 on n-h2-830883-28 Aug 30 16:17:41.832257 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-df60ff89-d1c1-472f-9388-cc62797cd0a5 req-610527d1-4b31-4b20-88c3-2f2e139395f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080763 Aug 30 16:17:41.838499 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1471/3230] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:41.844364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:41.852546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:41.863302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.866946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.870630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:41.871750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:41.872445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:41.873214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.819800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:42.841491 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c33fed06-33ee-4437-9bdf-78de703337f4 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.001165 Aug 30 16:17:42.851490 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1472/3231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:41 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:42.874762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:42.881178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:42.912589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.922990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.931413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:42.933613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:42.934964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:42.936123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:43.334703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:43.378056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:44.251399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:44.269167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4c83a25-3e36-4e21-95ce-9e3ac49393cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1325 microversion: 2.1 time: 1.415734 Aug 30 16:17:44.270835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1473/3232] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:42 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1325 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:44.294129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:44.294813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:44.308382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:44.322765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.324546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.325221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:44.327051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:44.328414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:44.330426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.870780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:45.883662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a91058e-a22a-4a2f-bf4c-6a37ffeaeae8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.599447 Aug 30 16:17:45.884574 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1474/3233] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:44 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:45.891694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:45.899889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:45.923728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.927040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.932367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:45.933525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:45.934231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:45.938434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.701518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:46.713689 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a258fae1-a622-4a64-b313-fd8ba1257410 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1521 microversion: 2.1 time: 0.825271 Aug 30 16:17:46.715585 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1475/3234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:45 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1521 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:46.752611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:46.753558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:46.763175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.764124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.764981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.766099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.766975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.768527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.845177 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] HTTP exception thrown: Instance is not a member of specified network Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Request method failure captured: Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0/ips/invalid HTTP/1.1 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjgNleWlb4uZtipitM_FIt5t0DyEMsz8kvS0vw5upy5lWFf92gdJBPva2BMC9kllYYmJ1zNFF-ZUQFet7i9qFLgHae7VR2DR44JML3IavHUFLpZaoKzyHgg6v_oyY-ymaSf2BSluH5bL_E9cJGA7AjsuiOcRJhRszk0eQvfWzWKFVv8 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}] Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cdd0dd3752d44ce4b78ee1e872cc3fda Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance is not a member of specified network Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '9b2f9419-3636-424d-bec2-7f46b13752d0', 'id': 'invalid'} Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 30 16:17:46.851192 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.861927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:46.869971 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1cb21e44-c6e3-4e2f-b4e9-c0bdefdd5fff tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.124528 Aug 30 16:17:46.881892 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1476/3235] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:17:46 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0/ips/invalid => generated 91 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:17:46.909040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:46.911138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Failed to fetch instance by id 999 {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:17:46.913536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] HTTP exception thrown: Instance 999 could not be found. Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Request method failure captured: Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjgNleWlb4uZtipitM_FIt5t0DyEMsz8kvS0vw5upy5lWFf92gdJBPva2BMC9kllYYmJ1zNFF-ZUQFet7i9qFLgHae7VR2DR44JML3IavHUFLpZaoKzyHgg6v_oyY-ymaSf2BSluH5bL_E9cJGA7AjsuiOcRJhRszk0eQvfWzWKFVv8 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}] Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cdd0dd3752d44ce4b78ee1e872cc3fda Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 999 could not be found. Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '999'} Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 16:17:46.918206 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:17:46.928130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:46.929303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be916310-09cc-4439-a1b2-5420cad772e4 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.043273 Aug 30 16:17:46.930396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1477/3236] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:17:46 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:17:46.944655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:46.945724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:46.957492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.959925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.960904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:46.961829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:46.962521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:46.963126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:47.996639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:48.016879 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-824a1c92-969b-4ca2-ba9e-581862fec8e8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.078206 Aug 30 16:17:48.017755 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1478/3237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:46 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:48.036468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:48.037409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:48.055879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.056760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.057449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.059087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.059804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.060470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.115563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:17:48.333884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27becc5c-8f40-4cb6-b4be-36ab635daee8 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 204 len: 0 microversion: 2.1 time: 0.301507 Aug 30 16:17:48.335599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1479/3238] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:17:48 2022] DELETE /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:17:48.355736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3998c5b0-75dd-492f-a79d-e66a39ab3482", "tag": "ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:48.370449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.371980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.373269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.393327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] Creating event network-changed:ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0 for instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 on n-h1-830883-28 Aug 30 16:17:48.415009 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c88badc1-3877-4075-a622-753d2f5c18bc req-28850531-16ee-4b5f-a021-a4f23b18781b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076040 Aug 30 16:17:48.417797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1480/3239] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:48.442415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:48.444539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:48.477495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.478157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.478657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.485961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:48.485961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:48.485961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:48.719301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:48.886342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=32 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:50.563847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:50.577847 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3092be70-c175-4f17-8cba-a7ecfcc02280 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1527 microversion: 2.1 time: 2.158032 Aug 30 16:17:50.578468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1481/3240] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:48 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1527 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:50.615952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:50.617217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:50.625935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.626831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.627529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:50.628478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:50.629154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:50.630684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.173769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:52.183585 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3dc83edc-a732-4bed-ba2f-75758643cd3a tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.583714 Aug 30 16:17:52.184272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1482/3241] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:50 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:52.219938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:52.223206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:52.241711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.244479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.245151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:52.258531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:52.260677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:52.261592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.276799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:53.305423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-98f3aac6-4a4e-4af5-991f-b945bbb2a065 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1527 microversion: 2.1 time: 1.109310 Aug 30 16:17:53.318633 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1483/3242] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:52 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1527 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:53.339012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:53.340158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:53.363156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.365958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.366704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:53.373080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:53.373920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:53.375422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.491458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:54.522178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b9cfc0e-b3d2-41c0-93f5-9733d3c9d372 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.202125 Aug 30 16:17:54.536533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1484/3243] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:53 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:54.562190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:54.562861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:54.587929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.596020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.596470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.597422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.601677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.602446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.839830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd0dd3752d44ce4b78ee1e872cc3fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b387b23b5844c9b9f2e1877c6e9034', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:54.846453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:17:54.871564 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a43f3b1e-a8dc-4349-973f-eb81ca0469cf tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 200 len: 1485 microversion: 2.1 time: 0.328417 Aug 30 16:17:54.872213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1485/3244] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:54 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 1485 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:54.885616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b2f9419-3636-424d-bec2-7f46b13752d0", "name": "network-vif-deleted", "tag": "0eaa73f3-c198-48a5-b435-c566c953ede0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:54.913312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:54.918479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:54.919438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:54.953644 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] Creating event network-vif-deleted:0eaa73f3-c198-48a5-b435-c566c953ede0 for instance 9b2f9419-3636-424d-bec2-7f46b13752d0 on n-h2-830883-28 Aug 30 16:17:54.960212 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-53071f88-c780-417d-97e3-1f61518567d7 req-ffa430b5-6448-4f2d-af65-2aeb93d9073c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085592 Aug 30 16:17:54.963017 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1486/3245] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:17:56.105380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfb066ab-ceac-4582-ad2f-28d24e18dae4 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Action: 'create', calling method: .version_select at 0x7fd35c1fa040>, body: {"pool": null} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:17:58.704888 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb5dcf29-df35-4e1d-82bf-492a12adf439 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1464 microversion: 2.1 time: 19.467550 Aug 30 16:17:58.720759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1760/3246] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:39 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1464 bytes in 19484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:58.762048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:58.771383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:58.816261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.820122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.826807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:58.833318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:58.833318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:58.833318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.259937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:17:59.278086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-685fb157-2bb7-48fa-b183-afbca73b3ec8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 0.553868 Aug 30 16:17:59.279186 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1761/3247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:58 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:59.286702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:59.287544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] [instance: 9b2f9419-3636-424d-bec2-7f46b13752d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:59.314281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.316041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.316512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.319829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.333309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.333964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.444177 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] HTTP exception thrown: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Request method failure captured: Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 HTTP/1.1 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjgNleWlb4uZtipitM_FIt5t0DyEMsz8kvS0vw5upy5lWFf92gdJBPva2BMC9kllYYmJ1zNFF-ZUQFet7i9qFLgHae7VR2DR44JML3IavHUFLpZaoKzyHgg6v_oyY-ymaSf2BSluH5bL_E9cJGA7AjsuiOcRJhRszk0eQvfWzWKFVv8 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b387b23b5844c9b9f2e1877c6e9034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b387b23b5844c9b9f2e1877c6e9034"}]}] Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 57b387b23b5844c9b9f2e1877c6e9034 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1237738411 Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cdd0dd3752d44ce4b78ee1e872cc3fda Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1237738411-project Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9b2f9419-3636-424d-bec2-7f46b13752d0'} Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:59.457897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. Aug 30 16:17:59.462603 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:17:59.467637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] Returning 404 to user: Instance 9b2f9419-3636-424d-bec2-7f46b13752d0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:17:59.469836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36ea5a4f-6de7-4725-87b1-1e9bcb6efaa2 tempest-ServerAddressesNegativeTestJSON-1237738411 tempest-ServerAddressesNegativeTestJSON-1237738411-project] 10.222.0.47 "GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0" status: 404 len: 111 microversion: 2.1 time: 0.189499 Aug 30 16:17:59.475087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1762/3248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:59 2022] GET /compute/v2.1/servers/9b2f9419-3636-424d-bec2-7f46b13752d0 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:17:59.496979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cf68b4e-2511-4e6d-95c7-3d3c69e383a0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4b1c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:59.611165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cf68b4e-2511-4e6d-95c7-3d3c69e383a0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 200 len: 1464 microversion: 2.1 time: 0.132578 Aug 30 16:17:59.613121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1763/3249] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:17:59 2022] GET /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 1464 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:17:59.630711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:17:59.631304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:17:59.651072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.651571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.653036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:17:59.656923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:17:59.657804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:17:59.659779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.108151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:01.118419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-090d63f3-6928-40e5-93b2-1d054d41ce41 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1467 microversion: 2.1 time: 1.495550 Aug 30 16:18:01.152681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1764/3250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:17:59 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1467 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:01.162608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:01.187724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.195762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.196523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.198237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.199224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.200028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.200653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.385556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfb066ab-ceac-4582-ad2f-28d24e18dae4 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 6.016708 Aug 30 16:18:01.388140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1487/3251] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:17:55 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 6020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:01.393787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2067999356"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:01.397287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:01.411843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.412350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.414475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.415867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:01.416965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:01.419102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:01.860521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed10fc7b-998c-4c08-9268-17d1b4ed9235 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "POST /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d/action" status: 202 len: 0 microversion: 2.1 time: 0.468474 Aug 30 16:18:01.861792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1488/3252] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:18:01 2022] POST /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:18:01.870613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03de7dcb-5055-4897-91f0-26b1276dc598 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd35c502e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.567984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:02.590338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6612db24-ede1-428e-b06e-840b7750350c tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.426984 Aug 30 16:18:02.590338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1765/3253] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:02.601611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c65791e8-d266-442a-8b5d-c11dc7c2471a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cda81f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.655259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03de7dcb-5055-4897-91f0-26b1276dc598 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/7efa2d0d-414e-4e34-be57-2c36da3335b9" status: 200 len: 140 microversion: 2.1 time: 0.789913 Aug 30 16:18:02.656912 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1489/3254] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:18:01 2022] GET /compute/v2.1/os-floating-ips/7efa2d0d-414e-4e34-be57-2c36da3335b9 => generated 140 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:02.662341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93325f64-29a2-47b7-8d5a-77e6f36fd32d", "name": "network-vif-unplugged", "status": "completed", "tag": "0a0c19b5-e069-412c-abea-7ad0778fad7c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:02.675347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c65791e8-d266-442a-8b5d-c11dc7c2471a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.088009 Aug 30 16:18:02.677476 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1766/3255] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:02 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:02.691620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:02.692051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bdb8ae11-c3a2-4e52-b1c5-3d9192955ed4 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd35c44e310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:02.692566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:02.693019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:02.717341 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] Creating event network-vif-unplugged:0a0c19b5-e069-412c-abea-7ad0778fad7c for instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d on n-h2-830883-28 Aug 30 16:18:02.733543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1d35b390-6613-49e7-a29d-6c56b488a8c7 req-5f27f963-7862-4fa2-ba55-309c3db07b01 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075197 Aug 30 16:18:02.734235 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1490/3256] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:03.240219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bdb8ae11-c3a2-4e52-b1c5-3d9192955ed4 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.561235 Aug 30 16:18:03.241808 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1767/3257] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:18:02 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:03.259693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d14495d4-92ef-4251-991b-d92b4ef6a949 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd35ca79160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:03.610129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:03.610795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:03.622899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.623398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.623840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:03.624555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:03.625021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:03.625448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:04.695243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:04.714286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdee52d7-beeb-4019-ac4b-5517a3205357 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.108329 Aug 30 16:18:04.730388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1768/3258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:03 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:04.744304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8410d2fa-a600-4c5c-865b-bd1065efc90a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c44eca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:04.840226 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8410d2fa-a600-4c5c-865b-bd1065efc90a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.108789 Aug 30 16:18:04.842385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1769/3259] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:04 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:05.652887 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d14495d4-92ef-4251-991b-d92b4ef6a949 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/7efa2d0d-414e-4e34-be57-2c36da3335b9" status: 202 len: 0 microversion: 2.1 time: 2.402098 Aug 30 16:18:05.655332 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1491/3260] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:18:03 2022] DELETE /compute/v2.1/os-floating-ips/7efa2d0d-414e-4e34-be57-2c36da3335b9 => generated 0 bytes in 2406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:18:05.667852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73c3fe68-bda3-486d-8437-1e4f994cb416 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Action: 'create', calling method: .version_select at 0x7fd35c44e310>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:05.735921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:05.737009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:05.751041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.752850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.753515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:05.754973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:05.756173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:05.757111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:06.845665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:06.859952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-202da30f-9c23-44e8-a9e9-465e8d67ed4f tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.128037 Aug 30 16:18:06.863011 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1492/3261] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:05 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:06.872790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a07f4f65-c885-4b9d-adac-9d8133943244 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c260430>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:06.964381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a07f4f65-c885-4b9d-adac-9d8133943244 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.098311 Aug 30 16:18:06.965276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1493/3262] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:06 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:06.975753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3998c5b0-75dd-492f-a79d-e66a39ab3482", "name": "network-vif-plugged", "status": "completed", "tag": "ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:07.003500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.004276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.004960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.030978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] Creating event network-vif-plugged:ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0 for instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 on n-h1-830883-28 Aug 30 16:18:07.043043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2ab5761b-9a68-4abf-b283-6fa5d0fcce8a req-cd219274-d922-4f7a-98ac-197ea49a060f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073562 Aug 30 16:18:07.045527 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1494/3263] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:07.897034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:07.898561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:07.916472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.918816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.924241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:07.925337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:07.926030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:07.927293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:08.876829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:08.885957 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb3f44b3-8b6c-4784-8d87-9ea8a8c17847 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1371 microversion: 2.1 time: 1.001519 Aug 30 16:18:08.898728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1495/3264] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:07 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1371 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:08.906870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab8c4eab-984f-412a-9fd0-0a8f9952b43d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2a1160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:09.035844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab8c4eab-984f-412a-9fd0-0a8f9952b43d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.135205 Aug 30 16:18:09.036672 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1496/3265] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:08 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:09.222454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-plugged", "status": "completed", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:09.246774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.247461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.250004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.278503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] Creating event network-vif-plugged:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:18:09.290618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-92c65edc-1902-47da-bb81-c7695d84e465 req-ca869a1c-780c-45d6-b7bd-966424edfdd0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071937 Aug 30 16:18:09.291817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1497/3266] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:09.923714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:09.925133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:09.946253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.948467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.949537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:09.952011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:09.952801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:09.954396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:10.620484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73c3fe68-bda3-486d-8437-1e4f994cb416 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.959903 Aug 30 16:18:10.622052 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1770/3267] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:18:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:10.627255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0eeeed37-b731-459b-9af7-bf9f79e323a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35d1f33a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:10.713531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0eeeed37-b731-459b-9af7-bf9f79e323a7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.089701 Aug 30 16:18:10.714987 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1771/3268] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:10 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:10.719732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdb16683-cbc2-45d6-8291-4192c2a09745 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd35cbecc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.363919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:12.381068 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b4993d50-b3d6-45e4-9907-935da0785284 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1556 microversion: 2.1 time: 2.463424 Aug 30 16:18:12.398659 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1498/3269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:09 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1556 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:12.419628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5d748ed7-f687-4fc3-ab64-339ce667a107 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35caf0700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.498886 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5d748ed7-f687-4fc3-ab64-339ce667a107 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.095494 Aug 30 16:18:12.518901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1499/3270] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:12.527586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.537378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:12.559955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.561279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.564885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.566245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:12.567614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:12.669733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.102s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:12.782817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdb16683-cbc2-45d6-8291-4192c2a09745 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c" status: 202 len: 0 microversion: 2.1 time: 2.066500 Aug 30 16:18:12.784618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1772/3271] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:18:10 2022] DELETE /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c => generated 0 bytes in 2069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:18:12.794331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd35c44e700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:12.908974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a46e0622-752b-4a09-bb40-bed4cf59401c could not be found", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:18:12.909930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] HTTP exception thrown: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Request method failure captured: Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c HTTP/1.1 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjgz0aXLQ2iIu9X6q3S5z1oqsbXlyX1scVHj8yJmfSbSVV7QY3xY2GNmne3AYR6CYK0oaoXmhwcVokxyNccKnT-zPMfkpsiYaZR1yMe0LUl3y-r3VzO8b6_JHZ0vuS_QCbK7N_8OFtFxHPZknhXlt6qQdeED219lvUDk9yt8l4EyNb4 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 77022ba676ae491cb8645fb5f4f8769d Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77022ba676ae491cb8645fb5f4f8769d"}]}] Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 77022ba676ae491cb8645fb5f4f8769d Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsTestJSON-1550950563-project Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ea4dc13e17504f42a3205e4e2fbf3869 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsTestJSON-1550950563-project Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: exception: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a46e0622-752b-4a09-bb40-bed4cf59401c'} Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a46e0622-752b-4a09-bb40-bed4cf59401c could not be found Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d32446cb-39bf-42b3-980e-bcd37de0f0d0'] Aug 30 16:18:12.916069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c. Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Returning 404 to user: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7651498b-8633-48e2-92a8-8d4674790e01 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c" status: 404 len: 111 microversion: 2.1 time: 0.131269 Aug 30 16:18:12.921439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1773/3272] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:12.940031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Calling method '.version_select at 0x7fd360f2d5e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:13.043484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a46e0622-752b-4a09-bb40-bed4cf59401c could not be found", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:18:13.044906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] HTTP exception thrown: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Request method failure captured: Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c HTTP/1.1 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjgz0aXLQ2iIu9X6q3S5z1oqsbXlyX1scVHj8yJmfSbSVV7QY3xY2GNmne3AYR6CYK0oaoXmhwcVokxyNccKnT-zPMfkpsiYaZR1yMe0LUl3y-r3VzO8b6_JHZ0vuS_QCbK7N_8OFtFxHPZknhXlt6qQdeED219lvUDk9yt8l4EyNb4 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 77022ba676ae491cb8645fb5f4f8769d Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/77022ba676ae491cb8645fb5f4f8769d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/77022ba676ae491cb8645fb5f4f8769d"}]}] Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 77022ba676ae491cb8645fb5f4f8769d Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1550950563 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPsTestJSON-1550950563-project Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ea4dc13e17504f42a3205e4e2fbf3869 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPsTestJSON-1550950563-project Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: exception: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a46e0622-752b-4a09-bb40-bed4cf59401c'} Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a46e0622-752b-4a09-bb40-bed4cf59401c could not be found Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-094cb2ae-f9e0-4d67-bdc7-a24d1da111f8'] Aug 30 16:18:13.047706 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c. Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] Returning 404 to user: Floating IP not found for ID a46e0622-752b-4a09-bb40-bed4cf59401c {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b44db605-100b-47da-94c5-a731493a0925 tempest-FloatingIPsTestJSON-1550950563 tempest-FloatingIPsTestJSON-1550950563-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c" status: 404 len: 111 microversion: 2.1 time: 0.123214 Aug 30 16:18:13.057522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1774/3273] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:18:12 2022] DELETE /compute/v2.1/os-floating-ips/a46e0622-752b-4a09-bb40-bed4cf59401c => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:13.205414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a546e97-925c-43d4-8533-9b278c722986 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.684382 Aug 30 16:18:13.206250 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1500/3274] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:18:12 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-interface => generated 284 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:13.541056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c83672c4-3c5b-44d2-b70b-0770afa4dd3a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c44e820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:13.605822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c83672c4-3c5b-44d2-b70b-0770afa4dd3a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.072326 Aug 30 16:18:13.607773 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1775/3275] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:13 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:14.111434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b2c609a-d480-4519-9be0-12b887200fd3 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] Calling method '.version_select at 0x7fd35c1fa670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.292527 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b2c609a-d480-4519-9be0-12b887200fd3 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.519822 Aug 30 16:18:14.293313 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1501/3276] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:18:13 2022] GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c/defaults => generated 371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:14.306501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-860d5ef1-90b2-41e0-8a6a-45b8202b9b71 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] Calling method '.version_select at 0x7fd35c4d4670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.327554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:14.538653 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-860d5ef1-90b2-41e0-8a6a-45b8202b9b71 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c" status: 200 len: 371 microversion: 2.1 time: 0.231844 Aug 30 16:18:14.542222 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1776/3277] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:18:14 2022] GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c => generated 371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:14.556761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f31952c-aa16-463d-b307-71e4498ade12 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] Calling method '.version_select at 0x7fd35c4a1dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.706588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=26 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:14.764992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.765508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:14.767288 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f31952c-aa16-463d-b307-71e4498ade12 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.217403 Aug 30 16:18:14.769270 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1777/3278] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:18:14 2022] GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c/defaults => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:14.776081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:14.799245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd00b9fc-b184-454e-902b-994197888858 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c365b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:14.803535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.804047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.804494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.805280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:14.805751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:14.806188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:14.877593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:18:14.904894 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd00b9fc-b184-454e-902b-994197888858 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.126700 Aug 30 16:18:14.906039 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1778/3279] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:14 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:14.916320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07d2072d-b574-42b9-b6cb-eab1fbc0e58c tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] Calling method '.version_select at 0x7fd35cce4d30>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.075764 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8bc7a6ec-f5a3-4901-8442-2f6aef1446ae tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "DELETE /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 204 len: 0 microversion: 2.32 time: 0.614113 Aug 30 16:18:15.077642 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1502/3280] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:18:14 2022] DELETE /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:18:15.093745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.094607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:15.102471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.103334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.106000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.107034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:15.108765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:15.110468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:15.218557 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07d2072d-b574-42b9-b6cb-eab1fbc0e58c tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c" status: 200 len: 371 microversion: 2.1 time: 0.310913 Aug 30 16:18:15.219804 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1779/3281] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:18:14 2022] GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c => generated 371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:15.237455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a04ec3e-8834-4a37-a526-fc45a1e025d3 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] Calling method '.version_select at 0x7fd35c44e280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.454923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a04ec3e-8834-4a37-a526-fc45a1e025d3 tempest-QuotasTestJSON-1724635412 tempest-QuotasTestJSON-1724635412-project] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c?user_id=3d3ce3eabd3540c19edeb8911b9221e6" status: 200 len: 371 microversion: 2.1 time: 0.227014 Aug 30 16:18:15.455712 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1780/3282] 10.222.0.47 () {58 vars in 1323 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/os-quota-sets/cf2234cefee14b2b87b390dccbd60c6c?user_id=3d3ce3eabd3540c19edeb8911b9221e6 => generated 371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:15.920244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3a6824a-b915-4be9-9bcc-f45994cf6d6d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2d3f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:15.990735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3a6824a-b915-4be9-9bcc-f45994cf6d6d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.074013 Aug 30 16:18:15.992014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1781/3283] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:17.007317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4f89811f-37cc-4595-8139-f363b148020e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c365700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:17.082103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4f89811f-37cc-4595-8139-f363b148020e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.079222 Aug 30 16:18:17.084669 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1782/3284] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:17 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:17.181098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:17.200093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:17.201960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:17.208158 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5cfb857f-000d-4256-ba5c-c6f5bdbcb510 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 2.119485 Aug 30 16:18:17.210606 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1503/3285] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:15 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:18.101457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac401437-d03c-480d-98cb-3c7752d11965 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c306ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:18.229368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac401437-d03c-480d-98cb-3c7752d11965 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.131507 Aug 30 16:18:18.238319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:18.240071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:18.244906 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1783/3286] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:18 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:18.260598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.261264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.262010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.263758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.270098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.271539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.444328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3998c5b0-75dd-492f-a79d-e66a39ab3482", "tag": "ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:18.465544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:18.467563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:18.468215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:18.503460 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] Creating event network-changed:ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0 for instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 on n-h1-830883-28 Aug 30 16:18:18.527243 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ed2c4730-f10a-4e78-b667-9a843cbf0391 req-f0cda625-59ba-4aba-aa10-e967aa4ec98b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087261 Aug 30 16:18:18.546794 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1784/3287] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:19.285735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e569214c-c671-4b34-8860-db3351740eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c548700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:19.380113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:19.398469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:19.403522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:19.405924 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee2c3bc8-773c-4f27-ba46-d11415ed31f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.171978 Aug 30 16:18:19.409041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1504/3288] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:18 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:19.446801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e569214c-c671-4b34-8860-db3351740eb9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.203255 Aug 30 16:18:19.448526 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1785/3289] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:19 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:20.438053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:20.438718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:20.463633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ffb42299-5e00-43b5-aead-a51660384090 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cbec700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:20.480257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.480755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.481193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.489585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:20.490126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:20.494610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:20.586221 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ffb42299-5e00-43b5-aead-a51660384090 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.126776 Aug 30 16:18:20.586588 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1786/3290] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:20 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:21.603398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d42a2a87-ecee-4031-b75e-7d8a64cd77b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c3654c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:21.699135 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d42a2a87-ecee-4031-b75e-7d8a64cd77b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.102103 Aug 30 16:18:21.702259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1787/3291] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:21 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:21.840558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:21.855934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:21.860833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:21.862582 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b60403ff-a16c-404a-84cb-c3d64896bc1e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.430434 Aug 30 16:18:21.874338 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1505/3292] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:20 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:22.454869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "15b97f03-f08d-4051-bbbf-dbdc86d23c04"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:22.488716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:22.491122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:22.492151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:22.530325 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] Creating event network-vif-unplugged:15b97f03-f08d-4051-bbbf-dbdc86d23c04 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:22.540915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-458a8e05-7537-46c2-99aa-d308e596604c req-dd29d185-9a3f-4147-80b6-638c83433f8a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090865 Aug 30 16:18:22.543000 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1788/3293] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:22.714438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29bc3908-96ca-43cb-b8b4-a71db600e44a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c260670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:22.797551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29bc3908-96ca-43cb-b8b4-a71db600e44a tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.087609 Aug 30 16:18:22.799047 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1506/3294] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:22 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:22.896327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:22.899095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:22.916272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:22.917033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:22.921599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:22.923901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:22.924633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:22.928237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:23.675113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:23.691979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:23.694087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:23.705492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a06e45b-c7f0-4fa4-ba8f-6082487e7ff6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 0.816646 Aug 30 16:18:23.711924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1789/3295] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:22 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:23.817176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aadce692-ff1f-4b26-a3e4-a6d34f669936 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2eeca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:23.911354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aadce692-ff1f-4b26-a3e4-a6d34f669936 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.099625 Aug 30 16:18:23.912092 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1507/3296] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:23 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:24.721239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "b19c0404-0b11-4f1f-8b59-13ad213dcf6a"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "f9a22e9e-f2ce-4969-bccc-323838f099f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:24.737052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:24.737848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:24.749547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.762047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.769269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.770422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.770945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:24.772450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.773099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:24.773654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.775411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:24.833562 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Creating event network-vif-unplugged:b19c0404-0b11-4f1f-8b59-13ad213dcf6a for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:24.834515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] Creating event network-vif-unplugged:f9a22e9e-f2ce-4969-bccc-323838f099f8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:24.843748 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e2cca3ba-8c49-4f77-9bed-2d93c7f30843 req-eb53b832-54c2-40c5-9843-825c2ab4bdb1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.126012 Aug 30 16:18:24.846744 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1790/3297] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:24.928255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d0c547b-d910-4ddf-8ae4-ad622d9c6f8c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cdd51f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:25.078900 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d0c547b-d910-4ddf-8ae4-ad622d9c6f8c tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.155141 Aug 30 16:18:25.087645 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1791/3298] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:24 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:25.848898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:25.852514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:25.866911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:25.886122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:25.888091 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca9d55be-b3bb-4e91-8bc5-583c568f6502 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.154919 Aug 30 16:18:25.891989 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1508/3299] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:24 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:26.091762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:26.096981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09c92642-69fc-4c64-99d1-f8685e3aa7bc tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35ce47ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:26.247487 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09c92642-69fc-4c64-99d1-f8685e3aa7bc tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.156562 Aug 30 16:18:26.255908 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1792/3300] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:26 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:26.921170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:26.922223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:26.963044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:26.963668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:26.964355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:26.966440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:26.967496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:26.968086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:27.013929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1063548698", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:27.180600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:18:27.766340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:27.783900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:27.789786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:27.791699 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8671e1b1-1e4a-4870-879b-cfca7376d88c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 0.876224 Aug 30 16:18:27.825309 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1793/3301] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:26 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:27.843632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "9b75d5dd-b5a1-44aa-b140-428ef42dc6e7"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "bf706539-23c6-4579-a131-4f6071e58ec8"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:27.906839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:27.907648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:27.908315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:27.946054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Creating event network-vif-unplugged:9b75d5dd-b5a1-44aa-b140-428ef42dc6e7 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:27.950199 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Creating event network-vif-unplugged:bf706539-23c6-4579-a131-4f6071e58ec8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:27.951022 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] Creating event network-vif-unplugged:1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:27.975764 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-96d4e150-699a-46e8-9e7d-0e3021a0d331 req-4d41a3d9-a23d-43f9-bf3a-589bfb932977 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.146905 Aug 30 16:18:27.977177 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1794/3302] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:27.989375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb547e56-5124-4e5e-a5a2-72bd4de97576 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4c79d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:28.117186 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb547e56-5124-4e5e-a5a2-72bd4de97576 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.138629 Aug 30 16:18:28.118559 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1795/3303] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:27 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:28.829934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:28.831584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:28.853054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:28.853967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:28.854659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:28.855639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:28.857012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:28.859636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:29.020216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:18:29.021260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:18:29.021899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:18:29.022513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:18:29.023101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:18:29.060473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:29.061573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:29.062195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:29.063394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:29.064036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:29.064627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:29.122454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:18:29.140332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:18:29.177406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:18:29.180625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:18:29.325093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b61ccb8-ffd0-46a2-9087-1fc19474f97d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.504264 Aug 30 16:18:29.329038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1509/3304] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:18:29.345924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c94c5bf2-2d58-4d11-ae75-23153f38e2b9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cad31f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:29.441522 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c94c5bf2-2d58-4d11-ae75-23153f38e2b9 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1455 microversion: 2.1 time: 0.110093 Aug 30 16:18:29.442507 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1510/3305] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:29 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:29.467112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef1d5a34-5f78-4f04-9d4f-d6540f3da053 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:29.467914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef1d5a34-5f78-4f04-9d4f-d6540f3da053 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:29.597457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef1d5a34-5f78-4f04-9d4f-d6540f3da053 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:29.606483 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef1d5a34-5f78-4f04-9d4f-d6540f3da053 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1193 microversion: 2.1 time: 0.150887 Aug 30 16:18:29.609662 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1511/3306] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:29 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1193 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:30.197337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-unplugged", "status": "completed", "tag": "73080464-a53a-4f5f-a6b6-6e893e0ca8be"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:30.227944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.232482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.233664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.248864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] Creating event network-vif-unplugged:73080464-a53a-4f5f-a6b6-6e893e0ca8be for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:30.274406 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-fdf9e150-cea6-42b5-aba6-288004fc5e36 req-1467874c-c221-4491-9631-e04db1602e43 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077643 Aug 30 16:18:30.276128 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1512/3307] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:30.311956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:30.348577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:30.353032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:30.357677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0487b25c-2478-445a-8156-eb41359404d2 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.530046 Aug 30 16:18:30.361129 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1796/3308] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:28 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:30.462053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1be3881-7438-429c-8c42-0f469ac79518 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c5023a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:30.589511 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1be3881-7438-429c-8c42-0f469ac79518 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1464 microversion: 2.1 time: 0.135151 Aug 30 16:18:30.593624 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1513/3309] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:30 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:30.607750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dacc7bbb-d575-407e-9042-9a1a9b57cf33 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd360f2dc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:30.632129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:30.633745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:30.648535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.649072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.650279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.651789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.652750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.652750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.708826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dacc7bbb-d575-407e-9042-9a1a9b57cf33 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 200 len: 1464 microversion: 2.1 time: 0.102115 Aug 30 16:18:30.710911 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1797/3310] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:30 2022] GET /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:30.730185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:30.733076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:30.748860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.749821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.750752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.752099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:30.752859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:30.753518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:30.893760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:30.909685 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-252a7eac-8da7-41fa-88a3-35ea78a162f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1189 microversion: 2.1 time: 0.280893 Aug 30 16:18:30.917168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1514/3311] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:30 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1189 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:31.391459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:31.392890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:31.410403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:31.411206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:31.411680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:31.415495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:31.415495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:31.415495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:31.714561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:31.740505 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1dd8025e-8db8-4025-a8bc-e761bdaee0d5 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1468 microversion: 2.1 time: 1.010161 Aug 30 16:18:31.742002 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1798/3312] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:30 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1468 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:31.766178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59f5c462-f97a-4b0c-b028-31e671d58e32 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd357f3c5e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:31.996630 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59f5c462-f97a-4b0c-b028-31e671d58e32 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?changes-since=2022-08-30T16%3A16%3A13Z" status: 200 len: 2802 microversion: 2.1 time: 0.234136 Aug 30 16:18:32.012533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1799/3313] 10.222.0.47 () {58 vars in 1199 bytes} [Tue Aug 30 16:18:31 2022] GET /compute/v2.1/images?changes-since=2022-08-30T16%3A16%3A13Z => generated 2802 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:32.018014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.018991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:32.028545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:32.029375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:32.030049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:32.032047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:32.032671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:32.033703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:32.254036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:32.264631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ea9c9b92-69d6-4b2c-8613-9a33d65bc9a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1251 microversion: 2.1 time: 0.250677 Aug 30 16:18:32.286538 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1800/3314] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1251 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:32.295475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8c96151-aa1b-405c-af47-443054ae7dc3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4a19d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.414856 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8c96151-aa1b-405c-af47-443054ae7dc3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-100784963" status: 200 len: 484 microversion: 2.1 time: 0.122850 Aug 30 16:18:32.415595 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1801/3315] 10.222.0.47 () {58 vars in 1229 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-100784963 => generated 484 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:32.431127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63e82c05-5712-4197-b37b-9ba5e6e35047 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4c70d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.602642 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63e82c05-5712-4197-b37b-9ba5e6e35047 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?server=22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 958 microversion: 2.1 time: 0.175353 Aug 30 16:18:32.618139 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1802/3316] 10.222.0.47 () {58 vars in 1209 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/images?server=22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 958 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:32.626596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7dffeb4c-a724-45a3-892e-85cb7ad6ef7b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4c7040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.784479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7dffeb4c-a724-45a3-892e-85cb7ad6ef7b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 485 microversion: 2.1 time: 0.161166 Aug 30 16:18:32.787226 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1803/3317] 10.222.0.47 () {58 vars in 1317 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 485 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:32.802869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69a534a7-5a7b-4d30-9ca6-8a64edb8bae3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cc53700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:32.840714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:32.857383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:32.862637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:32.867342 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e97333f-cfbd-4ada-aaba-349c7df791b6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.482925 Aug 30 16:18:32.868298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1515/3318] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:31 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:32.902956 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69a534a7-5a7b-4d30-9ca6-8a64edb8bae3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 485 microversion: 2.1 time: 0.107398 Aug 30 16:18:32.905087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1804/3319] 10.222.0.47 () {58 vars in 1303 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 485 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:32.931762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de0b4e36-a8d0-4f36-88ac-ec73e778d9aa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cb914c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.120765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de0b4e36-a8d0-4f36-88ac-ec73e778d9aa tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.200658 Aug 30 16:18:33.134536 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1516/3320] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:18:32 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:33.140600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a333682-c001-499f-baf3-988233a001b6 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c365ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.272314 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a333682-c001-499f-baf3-988233a001b6 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.136312 Aug 30 16:18:33.272904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1805/3321] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:33.287618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd50408f-c203-40d1-85a9-fd5018181aa7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1a0700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.293047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.293956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:33.308668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:33.309354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:33.310428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:33.312608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:33.313249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:33.314619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:33.370830 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd50408f-c203-40d1-85a9-fd5018181aa7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.087722 Aug 30 16:18:33.381389 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1517/3322] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:33.394206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19672118-a275-4a08-87af-4928370f88ae tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cb91d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.663104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:33.683931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8bbe04b6-467d-451a-b407-52d9be3a614f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1251 microversion: 2.1 time: 0.394674 Aug 30 16:18:33.704825 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1806/3323] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1251 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:33.743157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19672118-a275-4a08-87af-4928370f88ae tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?changes-since=2022-08-30T16%3A16%3A10Z" status: 200 len: 7022 microversion: 2.1 time: 0.359744 Aug 30 16:18:33.744009 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1518/3324] 10.222.0.47 () {58 vars in 1220 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-30T16%3A16%3A10Z => generated 7022 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:33.764226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad8cc671-2401-4d81-8501-00a55b92db70 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35ce57430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.839393 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad8cc671-2401-4d81-8501-00a55b92db70 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-100784963" status: 200 len: 664 microversion: 2.1 time: 0.078981 Aug 30 16:18:33.860305 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1807/3325] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-100784963 => generated 664 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:33.879123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5576ad4a-c85a-4918-9738-e33553801e97 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35ccc2280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.905433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:33.907441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:33.931660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:33.933294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:33.934163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:33.936851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:33.937609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:33.940036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.009864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5576ad4a-c85a-4918-9738-e33553801e97 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1467 microversion: 2.1 time: 0.135008 Aug 30 16:18:34.016305 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1519/3326] 10.222.0.47 () {58 vars in 1338 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fv2.1%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1467 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:34.042754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3fad060-cf42-45ac-99af-0671cc1dd6c0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cc733a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.215254 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3fad060-cf42-45ac-99af-0671cc1dd6c0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1467 microversion: 2.1 time: 0.191634 Aug 30 16:18:34.227094 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1520/3327] 10.222.0.47 () {58 vars in 1324 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.47%2Fcompute%2Fservers%2F93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1467 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:34.245539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8da68e92-7815-4119-b00c-5054ed8dbea8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cc76160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.508109 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8da68e92-7815-4119-b00c-5054ed8dbea8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7797 microversion: 2.1 time: 0.267232 Aug 30 16:18:34.509306 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1521/3328] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7797 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:34.535760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a333815f-2c06-4274-87ff-5754eb9bebc2 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cb91f70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.680664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a333815f-2c06-4274-87ff-5754eb9bebc2 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.151989 Aug 30 16:18:34.682131 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1522/3329] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:34.687550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-unplugged", "status": "completed", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:34.715391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.727125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.727948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.756994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] Creating event network-vif-unplugged:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:18:34.773363 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ae02d156-97af-4e12-925a-54a45aae3b3c req-fac15d57-9012-4480-8ea5-2295ceb201a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089243 Aug 30 16:18:34.774408 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1523/3330] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:34.782688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b30cfd95-5298-4dc0-a0fa-46767c95fec3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1fab80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.852210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b30cfd95-5298-4dc0-a0fa-46767c95fec3 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325" status: 200 len: 784 microversion: 2.1 time: 0.076285 Aug 30 16:18:34.852821 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1524/3331] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:34.872543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:34.883936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:34.897841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.900091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.900507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:34.902849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:34.903531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:34.906676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:35.206625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.233985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38b7ecae-045c-46e0-bfa2-9e28afb0deb3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1251 microversion: 2.1 time: 0.373817 Aug 30 16:18:35.245253 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1525/3332] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:34 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1251 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:35.254381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-784d221c-9ecc-4328-bf14-5317f3a7215f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35cb91310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:35.343974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-784d221c-9ecc-4328-bf14-5317f3a7215f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.097078 Aug 30 16:18:35.344571 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1526/3333] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:18:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:35.368281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00f15fe3-79af-4190-be3f-24d0175ce4f7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1faaf0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:35.478246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.500258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.505865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:35.511702 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-178724cf-18e8-459e-a8a5-ce78919c833c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2956 microversion: 2.32 time: 1.617335 Aug 30 16:18:35.533617 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1808/3334] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:33 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2956 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:36.270932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:36.271849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:36.292454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.292977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.294725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.297173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.297659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.298172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.570097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:36.590216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a7e6ecd-3976-42c5-9357-be0bac23318f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1251 microversion: 2.1 time: 0.326994 Aug 30 16:18:36.608642 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1809/3335] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:36 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1251 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:36.615455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:36.616276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:36.638590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.641065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.641632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.644840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:36.655059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:36.657756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:36.825335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00f15fe3-79af-4190-be3f-24d0175ce4f7 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963" status: 204 len: 0 microversion: 2.1 time: 1.465511 Aug 30 16:18:36.827454 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1527/3336] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:35 2022] DELETE /compute/v2.1/images/e84c40e9-a057-4067-9f5f-09d78d3ee963 => generated 0 bytes in 1468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:36.836594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51112558-a730-4676-8088-b54ece4c6dc2 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c1fa940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:37.688126 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51112558-a730-4676-8088-b54ece4c6dc2 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed" status: 204 len: 0 microversion: 2.1 time: 0.856176 Aug 30 16:18:37.689221 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1528/3337] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:36 2022] DELETE /compute/v2.1/images/6dc47ff7-e856-47d5-893a-6364266849ed => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:37.703321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:37.704742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:37.720390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.724047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.724986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.727686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:37.728443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:37.730067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:37.808421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:37.845590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:37.854657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:37.858068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3c8b386-b342-4f7b-9ef2-6bd400695a3d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2935 microversion: 2.32 time: 1.247364 Aug 30 16:18:37.859750 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1810/3338] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:36 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2935 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:37.877305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40c49edb-67b1-4552-a1c2-420e4ba09815 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35d111b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:38.619707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:38.647962 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cad32849-7f7c-4c47-ad8e-494a4d835917 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.957358 Aug 30 16:18:38.651900 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1529/3339] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:37 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:38.891968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:38.893237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:38.904909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.910043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.911780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:38.912782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.914464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.917128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:38.936045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40c49edb-67b1-4552-a1c2-420e4ba09815 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182" status: 204 len: 0 microversion: 2.1 time: 1.072291 Aug 30 16:18:38.938114 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1811/3340] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:37 2022] DELETE /compute/v2.1/images/90f20e1d-8854-4c0b-808a-1c16092cc182 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:38.949132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:38.950472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:38.977996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.981209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.983864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:38.988040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:38.990169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:38.990849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.041497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:18:39.085042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:39.196964 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d1b1c6a-2747-46e1-8354-87c8380b9740 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 204 len: 0 microversion: 2.1 time: 0.253218 Aug 30 16:18:39.198630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1812/3341] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:18:38 2022] DELETE /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:18:39.209447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:39.210618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:39.228356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.229183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.231567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.232925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.233469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.234296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.587623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:39.606344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:39.612236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc153372-b88c-42f0-91f4-fcd3274f41d8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1473 microversion: 2.1 time: 0.407051 Aug 30 16:18:39.626422 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1813/3342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:39 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1473 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:39.673419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:39.674166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:39.694244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.697082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.699180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:39.701053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:39.701627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:39.703929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.241840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:40.256026 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-598d9127-febd-4ed9-86e5-e26d411d8203 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.587502 Aug 30 16:18:40.256623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1814/3343] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:39 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:40.525461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:40.534915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:40.541963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:40.543606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-918f467f-77fd-4e20-892a-15a83d5999a9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2935 microversion: 2.32 time: 1.656764 Aug 30 16:18:40.547047 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1530/3344] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:38 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2935 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:40.589248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63e12f77-0e90-421b-b5b3-3bf60e9ec98a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: .version_select at 0x7fd35d8353a0>, body: {"keypair": {"name": "tempest-keypair-322317343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDbkp83txeERFNwVRLWv3ZbUF2nQPlYVC5t7/yjPz8mCfstxOfZoV2l3bCmTXZNA336qvM+LBxsSRdJM0Yy0rDa+tP4hGvf6eaKlFKI79SwUi10aGmmpnxkn//lqLFHJQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:40.606221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-63e12f77-0e90-421b-b5b3-3bf60e9ec98a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for project 8253158502424d52b6415ec18e55be2b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:18:40.613058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-63e12f77-0e90-421b-b5b3-3bf60e9ec98a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for user 8088798e433c4056be1b6ec5d67cbc29 and project 8253158502424d52b6415ec18e55be2b. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:18:40.639028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:40.639944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:40.655426 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63e12f77-0e90-421b-b5b3-3bf60e9ec98a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.292283 Aug 30 16:18:40.662577 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1815/3345] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:18:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:40.662753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.280288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:41.282679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:41.299479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.303690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.304634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.311968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.313227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.314074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.375693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:41.386559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52b64145-080d-46c7-8b9d-a2ee1a55902b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1473 microversion: 2.1 time: 0.751255 Aug 30 16:18:41.387150 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1531/3346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:40 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1473 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:41.577469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:41.578085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:41.587712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.590661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.591299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.592255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:41.602221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:41.603235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:41.696322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:41.708725 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5a33998-70ee-4a0b-a32b-82aa907803ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.433543 Aug 30 16:18:41.721502 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1816/3347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:41 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:42.409121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:42.410492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:42.426286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.433494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.434350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:42.435466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.436143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.447076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:42.477712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:42.822430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:42.834424 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0bb7ea1-85a4-4aeb-a61b-b34331b7b9b0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1473 microversion: 2.1 time: 0.429095 Aug 30 16:18:42.835430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1817/3348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:42 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1473 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:18:42.860898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:42.881691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:42.885507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:42.886608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:42.896477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:42.904155 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9c844a8-c993-4f86-975b-9d3e9beb6199 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2914 microversion: 2.32 time: 1.324420 Aug 30 16:18:42.905389 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1532/3349] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:41 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2914 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:42.920853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.923335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.924015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:42.927742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:42.929540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:42.931606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.464576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:43.477437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7dc88763-397d-4a16-bb27-f84ca508778d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.629442 Aug 30 16:18:43.478409 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1818/3350] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:42 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:43.637925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50657af5-762a-41eb-adaa-d95ad49b76c6", "tag": "21b14365-c282-4f22-93ed-e461fc118e36"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:43.654380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:43.654872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:43.662364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.696371 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] Creating event network-changed:21b14365-c282-4f22-93ed-e461fc118e36 for instance 50657af5-762a-41eb-adaa-d95ad49b76c6 on n-h2-830883-28 Aug 30 16:18:43.708438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-84940606-c233-40db-b7a3-0461a219680e req-08e113a6-8b3d-44a3-8bd9-bc6b01ee0b6e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069882 Aug 30 16:18:43.712007 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1533/3351] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:43.860295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:43.860923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:43.881179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:43.881955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:43.882613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.883649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:43.884281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:43.884942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.944404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:43.946154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:43.953996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:43.954774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:43.955422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:43.956669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:43.957665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:43.958699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:44.222974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:44.242728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-641d8b19-36a4-470d-ab96-b838ac41e93d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1473 microversion: 2.1 time: 0.386336 Aug 30 16:18:44.243945 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1819/3352] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:43 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:44.249907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-837105285", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed0cfc5b-6a05-4f17-a25d-b16f771732b3"}], "security_groups": [{"name": "tempest-securitygroup--305098586"}], "key_name": "tempest-keypair-322317343", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:44.462494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] validate_networks() for [('ed0cfc5b-6a05-4f17-a25d-b16f771732b3', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:18:44.955534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:45.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:18:45.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:18:45.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:18:45.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:18:45.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:18:45.804258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:45.808153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:45.808792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:45.809692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:45.810437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:45.812292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:45.860468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for project 8253158502424d52b6415ec18e55be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:18:45.879704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for user 8088798e433c4056be1b6ec5d67cbc29 and project 8253158502424d52b6415ec18e55be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:18:45.930609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:18:45.933454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:18:46.068562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:46.084072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:46.089015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:46.094937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f963c78-d497-47c2-ab57-aa32d4f60e4d tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2914 microversion: 2.32 time: 2.160097 Aug 30 16:18:46.098291 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1534/3353] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:43 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2914 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:46.107776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:46.108866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:46.115233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:46.116650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.117148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.117799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.118938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.119600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.120206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.138838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae0faa18-9680-4c83-bd9b-ec5cf4f6dd20 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.893322 Aug 30 16:18:46.146922 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1820/3354] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:18:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:18:46.156470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:46.157180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:46.178895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.179701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.180892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.181802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.182508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.183106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.274790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.275598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.276244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.277019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lazy-loading 'fault' on Instance uuid 93325f64-29a2-47b7-8d5a-77e6f36fd32d {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:18:46.474470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:46.496550 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aeda6a6b-6242-47a8-8976-6cde8e2580f8 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 200 len: 1307 microversion: 2.1 time: 0.349679 Aug 30 16:18:46.501608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1821/3355] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:46 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:46.529894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93325f64-29a2-47b7-8d5a-77e6f36fd32d", "name": "network-vif-deleted", "tag": "0a0c19b5-e069-412c-abea-7ad0778fad7c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:46.569848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:46.570875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:46.571904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:46.607345 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] Creating event network-vif-deleted:0a0c19b5-e069-412c-abea-7ad0778fad7c for instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d on n-h2-830883-28 Aug 30 16:18:46.624359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9032a373-566b-4d44-9d69-3f45c2dea07c req-602d0e8d-8724-40a2-8a76-cb96b390fbd1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120903 Aug 30 16:18:46.656174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1822/3356] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:46.694087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9bcd4db3-f99e-44dd-b0c0-019849a1338d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:46.694980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9bcd4db3-f99e-44dd-b0c0-019849a1338d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:47.078946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9bcd4db3-f99e-44dd-b0c0-019849a1338d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.087098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9bcd4db3-f99e-44dd-b0c0-019849a1338d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1236 microversion: 2.1 time: 0.430034 Aug 30 16:18:47.087613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1823/3357] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:46 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1236 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:47.128608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:47.129950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:47.140701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:47.141432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:47.143534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:47.144868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:47.147369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:47.152418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:47.820431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.830436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.842641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-759f1d99-a4bf-4749-b913-180cfb458b1d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 1.742625 Aug 30 16:18:47.843252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1535/3358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:46 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:47.857716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.863076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:47.870070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75e31914-4763-4a21-b327-601f3973b93b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2868 microversion: 2.32 time: 0.743857 Aug 30 16:18:47.870816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:47.871448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 93325f64-29a2-47b7-8d5a-77e6f36fd32d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:47.875451 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1824/3359] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:47 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2868 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:47.899703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:47.905498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:47.906241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:47.907804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:47.915648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:47.916119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:47.964048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] HTTP exception thrown: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Request method failure captured: Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d HTTP/1.1 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfJ0Rfra8WUh-sTAQh5sVCnuimmhsurBF6TiUtXhh-9TqL0Hc4z-zrmCcKonXpITS40nmc53LX7vvudyNOktmIPxAu_RCDlX9yASrdlCSaQdW9Inr9-mVwPtL88cj5_pB21VWoQpTToTqQrWy0rnM7HpRvij1rpGJhQ-ZJLeWZnKBk Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b02bdc94d6c47b09250eb66f615791e Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b02bdc94d6c47b09250eb66f615791e"}]}] Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b02bdc94d6c47b09250eb66f615791e Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListImageFiltersTestJSON-1585993862-project Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 648f74c3412a4c44b1bbce93c4b2789b Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListImageFiltersTestJSON-1585993862-project Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '93325f64-29a2-47b7-8d5a-77e6f36fd32d'} Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:47.972286 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. Aug 30 16:18:47.977803 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:47.979635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Returning 404 to user: Instance 93325f64-29a2-47b7-8d5a-77e6f36fd32d could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:47.980691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e40f129a-6e36-4fac-a60a-dac0b679763d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d" status: 404 len: 111 microversion: 2.1 time: 0.116305 Aug 30 16:18:47.993080 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1536/3360] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:47 2022] GET /compute/v2.1/servers/93325f64-29a2-47b7-8d5a-77e6f36fd32d => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:48.001993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:48.002548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:48.040643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.041165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.041625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.046374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.046907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.047354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.159128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:18:48.280206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] Calling method '.version_select at 0x7fd35c306dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:48.395903 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25f04dc5-f16a-4199-9504-644da7415fbb tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 204 len: 0 microversion: 2.1 time: 0.397511 Aug 30 16:18:48.397007 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1537/3361] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:18:47 2022] DELETE /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:48.403534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:48.406592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:48.444099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.444605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.445054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.445785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.446231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.446702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.696963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:48.705801 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3109c71-a1fe-42ba-833e-b4cb4cfc348a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1288 microversion: 2.1 time: 0.307108 Aug 30 16:18:48.722956 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1538/3362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:48 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1288 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:48.736323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34539db7-e86c-4b0f-9496-35660b88b33d"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:48.739649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:48.755214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.755716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.756157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.761770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.762325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.765852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.889630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG neutronclient.v2_0.client [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 09b28061-94ea-4917-b3bd-74006e08451c could not be found", "detail": ""}} {{(pid=122352) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 16:18:48.894620 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] HTTP exception thrown: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] Request method failure captured: Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-floating-ips/09b28061-94ea-4917-b3bd-74006e08451c HTTP/1.1 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhnRjlixDOAXiSb320VJENPzim9irUTt2n6FDSk004T5FZOvCiC-Rg1sj4UdqnOMYKYAqBG7eozXTC2svwLO07MG0FBfz8ZEzYITK9xGkxypWa_W5WHS8X7ZfJrQilCB3wPjaTGKHjWTEp4LhiUqsN6ZjQ0DDV6w5Ae6gbcEoSr95U Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e8937f937ca348c0aafd383e4be9f9b0 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1592746613 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e8937f937ca348c0aafd383e4be9f9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e8937f937ca348c0aafd383e4be9f9b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e8937f937ca348c0aafd383e4be9f9b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e8937f937ca348c0aafd383e4be9f9b0"}]}] Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1592746613 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e8937f937ca348c0aafd383e4be9f9b0 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1592746613 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9c900064322449ab9586f3ab5b7a51c0 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: exception: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '09b28061-94ea-4917-b3bd-74006e08451c'} Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 16:18:48.898690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 09b28061-94ea-4917-b3bd-74006e08451c could not be found Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1096b3d-b4e1-479b-aa7b-ae4983747001'] Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c. Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c Aug 30 16:18:48.904873 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:18:48.910018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] Returning 404 to user: Floating IP not found for ID 09b28061-94ea-4917-b3bd-74006e08451c {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:48.912248 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35c4bd6d-c394-47fc-8971-e27843f3326b tempest-FloatingIPDetailsNegativeTestJSON-1592746613 tempest-FloatingIPDetailsNegativeTestJSON-1592746613-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/09b28061-94ea-4917-b3bd-74006e08451c" status: 404 len: 111 microversion: 2.1 time: 1.033380 Aug 30 16:18:48.914197 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1825/3363] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:18:47 2022] GET /compute/v2.1/os-floating-ips/09b28061-94ea-4917-b3bd-74006e08451c => generated 111 bytes in 1038 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:18:48.945357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:48.949135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:48.963680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.964646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.965254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:48.966358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:48.966986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:48.967902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:49.272574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:49.294406 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5dc5640-7394-4b8b-a251-5c13e8d99156 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1474 microversion: 2.1 time: 0.367203 Aug 30 16:18:49.302842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1826/3364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:48 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:49.308418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:49.309231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:49.323760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.324527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.325173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:49.326044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:49.327536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:49.329523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.096162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.124728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc8aeb7b-d3ba-41ed-a269-2c6430375ee7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.820428 Aug 30 16:18:50.141991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1827/3365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:49 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:50.170702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:50.182716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:50.200743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.206685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.209078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.212091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.216730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.217276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.355363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:50.372619 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe6ff3dc-acfa-46a6-8139-21dbee965083 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "POST /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.648031 Aug 30 16:18:50.378228 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1539/3366] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:18:48 2022] POST /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments => generated 194 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:50.407272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-deleted", "tag": "9b75d5dd-b5a1-44aa-b140-428ef42dc6e7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:50.445279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.445764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.446197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.493579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] Creating event network-vif-deleted:9b75d5dd-b5a1-44aa-b140-428ef42dc6e7 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:50.507831 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3bb19e1f-569b-4ca2-812e-c569dd9f12a1 req-5f53f572-4055-4dbb-bae3-eb4cd18fb4bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132636 Aug 30 16:18:50.508935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1540/3367] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:50.518173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:50.521488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:50.544081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.548918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.551176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.552070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.553882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.556527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.747419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.766627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.768252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.769659 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-388b0a8d-ba75-42aa-be3d-0265bedb25e6 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2868 microversion: 2.32 time: 0.626266 Aug 30 16:18:50.775776 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1828/3368] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:50 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2868 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:50.811895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:50.812552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:50.828107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.828614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.832461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.833583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:50.834088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:50.834653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:50.984053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:50.996074 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3cdfd2bf-2fa3-4804-bcbd-6b1fed414dbf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1294 microversion: 2.1 time: 0.484928 Aug 30 16:18:51.002002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1541/3369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:50 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1294 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:51.166486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:51.167114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:51.184849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.185359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.185806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.187149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.187628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.188066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.287895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:51.297815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af910663-1d3e-4e0b-93ad-4938bc33800b tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1474 microversion: 2.1 time: 0.506199 Aug 30 16:18:51.303101 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1829/3370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:50 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1474 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:51.806258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:51.807610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:51.819027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.819156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.819536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:51.820248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:51.820710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:51.821141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.367481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:52.381431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db32d925-d9f7-4e02-a218-81e8765d1f90 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 1.218685 Aug 30 16:18:52.395680 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1542/3371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:51 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:52.407252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:52.407525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:52.407869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:52.424241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.426431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.427051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.427778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.428236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.430942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:52.433307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:52.436572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.439057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cb74097-a26e-4fbb-9eeb-b84c6cf8b3f9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2534 microversion: 2.32 time: 0.634807 Aug 30 16:18:52.442544 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1830/3372] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:51 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2534 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:52.450881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:52.458284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:52.471014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.472113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.473788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:52.474741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:52.476481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:52.477361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.185792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:53.194934 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5803d547-980e-49de-ae77-9c4b6275daf0 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1474 microversion: 2.1 time: 0.751128 Aug 30 16:18:53.206705 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1831/3373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:52 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1474 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.406050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:53.406842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:53.413466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.413968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.421513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.423005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.423005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.423215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.529101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:53.543716 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1a8461f-d6a3-43d0-a951-ecc9fe78d76b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1294 microversion: 2.1 time: 1.154014 Aug 30 16:18:53.544850 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1543/3374] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:52 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1294 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.555623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:53.561687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:53.570146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.581910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.583203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.584082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.584664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.585202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.846593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:53.862143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8cb4c630-466a-428b-bc21-03aa4cffa9b6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.461145 Aug 30 16:18:53.881568 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1832/3375] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:53 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:53.886667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-deleted", "tag": "f9a22e9e-f2ce-4969-bccc-323838f099f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:53.910170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:53.910918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:53.911444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:53.931283 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] Creating event network-vif-deleted:f9a22e9e-f2ce-4969-bccc-323838f099f8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:18:53.955683 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fba6aff8-ab3f-4fd8-9b67-5a52e7bc7e01 req-de91b112-b82d-413f-877b-016a94c280f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072705 Aug 30 16:18:53.956566 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1833/3376] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:54.220494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:54.221200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:54.235107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.235608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.236100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:54.236729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.237277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.237590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:54.895624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:54.906719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-474a84a7-01b7-4c78-b67f-458a319b9447 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1474 microversion: 2.1 time: 0.687895 Aug 30 16:18:54.930683 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1834/3377] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:54 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1474 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:54.936616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:54.937434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:54.953747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.954528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.955156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:54.956041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:54.960032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:54.960724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.177884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:55.186496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf5a6719-a2d6-478c-a8c7-93f91e35c098 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1294 microversion: 2.1 time: 0.254007 Aug 30 16:18:55.187169 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1835/3378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:54 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1294 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:55.202714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:55.203533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:55.212824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.217023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.217661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.220391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.221050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.222584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.224861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:55.245040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:55.246781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:55.255461 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6088b7ea-c442-4691-b0c0-0262b254abd3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2534 microversion: 2.32 time: 1.704435 Aug 30 16:18:55.257056 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1544/3379] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:53 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2534 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:55.272007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50657af5-762a-41eb-adaa-d95ad49b76c6", "name": "network-vif-plugged", "status": "completed", "tag": "21b14365-c282-4f22-93ed-e461fc118e36"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:55.306752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.307493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.311273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.329737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] Creating event network-vif-plugged:21b14365-c282-4f22-93ed-e461fc118e36 for instance 50657af5-762a-41eb-adaa-d95ad49b76c6 on n-h2-830883-28 Aug 30 16:18:55.359145 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3e5c3416-d57d-470d-8cb5-98970cc112dd req-00c28dd5-949d-4fb8-988b-fd1cdf166c30 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089993 Aug 30 16:18:55.361390 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1545/3380] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:55.836136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:55.930060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:55.931473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:55.941944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.942700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.943913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:55.945269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:55.948121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:55.950635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.178641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:56.193812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-235a134f-24c0-460a-9a69-f8568f99f3f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 1.005559 Aug 30 16:18:56.194474 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1836/3381] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:55 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:56.221514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:56.222187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:56.243476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.243870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.251739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.252972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.253736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.254330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.631689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:56.638659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:56.640923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41de16b4-3052-4002-8463-c7b73d0dc30e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1294 microversion: 2.1 time: 0.435158 Aug 30 16:18:56.645664 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1837/3382] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:56 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1294 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:56.662320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:56.663718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:56.684889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.686181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.686832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.688077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.689319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.690491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:56.940293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648f74c3412a4c44b1bbce93c4b2789b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b02bdc94d6c47b09250eb66f615791e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:56.953533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-849856e1-d05e-4707-84d9-b80159250d81 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 200 len: 1432 microversion: 2.1 time: 1.028763 Aug 30 16:18:56.968686 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1546/3383] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:55 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 1432 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:56.978163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f27ee8-0056-48cf-b48f-1a42266aa45d", "name": "network-vif-deleted", "tag": "e84b62ea-d93f-48c4-851e-c65f66407ee6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:18:56.991655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:56.992494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:56.993188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.020043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] Creating event network-vif-deleted:e84b62ea-d93f-48c4-851e-c65f66407ee6 for instance 22f27ee8-0056-48cf-b48f-1a42266aa45d on n-h1-830883-28 Aug 30 16:18:57.025877 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2fcc8cfd-51c4-4947-b6f7-f758a93d2443 req-59b9384c-ce08-4f7d-a752-b6a002f10e23 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055458 Aug 30 16:18:57.026870 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1547/3384] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:18:57.087168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:18:57.220849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:57.224580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:57.236201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.237799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.241088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.242943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.245582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.246144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.578020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.590601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.593259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.595965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a7cb11d-a34b-40f0-a548-34f137119f54 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2374 microversion: 2.32 time: 0.946450 Aug 30 16:18:57.598011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1838/3385] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:56 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2374 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:18:57.665640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:57.666680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:57.679471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.685236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.685974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.686926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:57.687565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:57.688240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:57.912579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:57.924825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3aa42f7a-7160-45a4-a0a2-da2b69a097a8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1293 microversion: 2.1 time: 0.706788 Aug 30 16:18:57.939727 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1548/3386] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:57 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:57.989135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:57.996528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] [instance: 22f27ee8-0056-48cf-b48f-1a42266aa45d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:58.024595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.026139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.027235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.029329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.031496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.032061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.101652 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] HTTP exception thrown: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Request method failure captured: Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d HTTP/1.1 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfJ0Rfra8WUh-sTAQh5sVCnuimmhsurBF6TiUtXhh-9TqL0Hc4z-zrmCcKonXpITS40nmc53LX7vvudyNOktmIPxAu_RCDlX9yASrdlCSaQdW9Inr9-mVwPtL88cj5_pB21VWoQpTToTqQrWy0rnM7HpRvij1rpGJhQ-ZJLeWZnKBk Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2b02bdc94d6c47b09250eb66f615791e Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2b02bdc94d6c47b09250eb66f615791e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2b02bdc94d6c47b09250eb66f615791e"}]}] Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2b02bdc94d6c47b09250eb66f615791e Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1585993862 Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListImageFiltersTestJSON-1585993862-project Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 648f74c3412a4c44b1bbce93c4b2789b Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListImageFiltersTestJSON-1585993862-project Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '22f27ee8-0056-48cf-b48f-1a42266aa45d'} Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:18:58.107159 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. Aug 30 16:18:58.112386 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:18:58.116848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Returning 404 to user: Instance 22f27ee8-0056-48cf-b48f-1a42266aa45d could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:18:58.119228 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3f38afb5-e2c5-4ba0-bcbc-97c205e8431e tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d" status: 404 len: 111 microversion: 2.1 time: 0.136909 Aug 30 16:18:58.124104 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1549/3387] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:57 2022] GET /compute/v2.1/servers/22f27ee8-0056-48cf-b48f-1a42266aa45d => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:18:58.150898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1321360-626d-46fa-ae06-da6474e9c361 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c2ee9d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:58.429037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:58.448516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7acdb01a-a1ca-4ca0-86f7-11f970e9345c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.786626 Aug 30 16:18:58.449111 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1839/3388] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:57 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:58.624699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:58.625333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:58.634255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.634776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.656447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:58.657508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:58.658153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:58.658777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:59.058404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1321360-626d-46fa-ae06-da6474e9c361 tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a" status: 204 len: 0 microversion: 2.1 time: 0.932172 Aug 30 16:18:59.062636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1550/3389] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:58 2022] DELETE /compute/v2.1/images/8460a0de-730d-4c5c-8c10-ac5bc8fa7c0a => generated 0 bytes in 935 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:18:59.068127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:59.069135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:59.081277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:59.087159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:59.088023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:59.089019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:59.090509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:59.091206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:59.389086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.405732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.407764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.411968 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eb3a2dfc-dddb-44cb-a538-a577931f18fe tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2328 microversion: 2.32 time: 0.791792 Aug 30 16:18:59.432439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1840/3390] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:18:58 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2328 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:18:59.442933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-51719e12-b917-450e-a31e-6cee37f1c46d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4d6430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:59.897266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:18:59.916301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ac7a241-eaec-47d3-9829-84a30739d009 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1474 microversion: 2.1 time: 0.852115 Aug 30 16:18:59.917412 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1551/3391] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:59 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1474 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:18:59.923266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:18:59.924052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:18:59.937700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:59.941919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:59.943046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:18:59.943977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:18:59.944956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:18:59.950206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.171083 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-51719e12-b917-450e-a31e-6cee37f1c46d tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5" status: 204 len: 0 microversion: 2.1 time: 0.738202 Aug 30 16:19:00.171684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1841/3392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:59 2022] DELETE /compute/v2.1/images/27927ebe-d1ab-480b-8afe-77ea7e587dc5 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:00.184413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-deleted", "tag": "b19c0404-0b11-4f1f-8b59-13ad213dcf6a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:00.214405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:00.220063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:00.232009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:00.287836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] Creating event network-vif-deleted:b19c0404-0b11-4f1f-8b59-13ad213dcf6a for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:19:00.319387 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-14f852cd-f9d2-40db-8065-41408902d231 req-728a95b2-a806-4068-96ac-665775ab50c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139701 Aug 30 16:19:00.320008 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1842/3393] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:00.328459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37a24b2a-206b-4a79-8bd4-27a8be0ded8f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] Calling method '.version_select at 0x7fd35c4a19d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:00.828016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37a24b2a-206b-4a79-8bd4-27a8be0ded8f tempest-ListImageFiltersTestJSON-1585993862 tempest-ListImageFiltersTestJSON-1585993862-project] 10.222.0.47 "DELETE /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59" status: 204 len: 0 microversion: 2.1 time: 0.506709 Aug 30 16:19:00.828550 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1843/3394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:00 2022] DELETE /compute/v2.1/images/a0532de6-a909-40b9-8d2c-7d19616a5a59 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:00.839156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-445426215", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:00.947498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:01.599520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:01.609688 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76528ac3-9415-4756-b1f3-582483607c1b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 1.691067 Aug 30 16:19:01.611599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1552/3395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:18:59 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:01.621578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:01.626091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:01.639263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.646902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.647677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.648651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:01.649325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:01.650128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:01.979200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:01.997425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:02.007130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:02.015231 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b54ad89-dda0-45a8-b4d8-53b3fd12d8b7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 2103 microversion: 2.32 time: 0.398952 Aug 30 16:19:02.020560 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1553/3396] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:01 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 2103 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:02.435404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-deleted", "tag": "1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8"}, {"server_uuid": "58f75a19-3870-4167-8aff-a3ded5c7549e", "name": "network-vif-deleted", "tag": "bf706539-23c6-4579-a131-4f6071e58ec8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:02.457994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:02.460237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:02.460779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:02.461259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:02.461794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:02.504569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.505257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.511351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.512843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.517299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.521942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.523764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.528627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.530560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.576528 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Creating event network-vif-deleted:1acbb3ba-7dcb-4149-9572-ee6f0ceb39e8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:19:02.580236 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] Creating event network-vif-deleted:bf706539-23c6-4579-a131-4f6071e58ec8 for instance 58f75a19-3870-4167-8aff-a3ded5c7549e on n-h1-830883-28 Aug 30 16:19:02.597919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-06979d68-448d-4f36-bde7-d6d1ddadceef req-2eea61c5-e720-4034-9672-a51057a8825e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167684 Aug 30 16:19:02.606329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1554/3397] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:02.633458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:02.634177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:02.650887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:02.676719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.677538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.679410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.682260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:02.682650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:02.683383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:02.683989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:02.715808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:02.744599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:02.886476 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5940f257-f845-49a5-b51a-4f96961e0b34 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052269 Aug 30 16:19:02.887591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1844/3398] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:02.901499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a547cc46-5ee1-46aa-84fd-4d0d044a2324 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:02.904489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a547cc46-5ee1-46aa-84fd-4d0d044a2324 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:02.960899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a547cc46-5ee1-46aa-84fd-4d0d044a2324 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:19:03.001206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.016701 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-beb1261a-771a-4712-bd22-bfdebf4ad5a9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.388069 Aug 30 16:19:03.038330 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1555/3399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:02 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:03.045124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:03.045935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:03.061280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:03.062104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:03.069043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:03.070149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:03.070923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:03.071573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:03.381891 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a547cc46-5ee1-46aa-84fd-4d0d044a2324 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2" status: 204 len: 0 microversion: 2.1 time: 0.487494 Aug 30 16:19:03.382947 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1845/3400] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:02 2022] DELETE /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:03.398596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:03.399642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:03.416115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.444570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.452274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:03.459157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f66aacdc-d24b-4a8c-9898-a98e2a7c0c1b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.416427 Aug 30 16:19:03.475255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:19:03.477015 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1556/3401] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:03 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 HTTP/1.1 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2'} Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:03.495057 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:19:03.501263 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:03.508069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:03.510206 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b2585eb-f201-42b4-8b1a-c7459242951a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2" status: 404 len: 111 microversion: 2.1 time: 0.122075 Aug 30 16:19:03.520597 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1846/3402] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:03 2022] GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:03.756095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1967078802", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:03.929151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:04.051169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:04.052354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:04.071985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.072484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.073202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.073897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.074376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.074802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.654229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:04.666616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d412655d-2297-4bcc-a97e-87c5e773c994 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.619858 Aug 30 16:19:04.683431 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1847/3403] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:04 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:04.699126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:04.699958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:04.705539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:04.716907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.717504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.718014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:04.718829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:04.722106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:04.723386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.390059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.415076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.416598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.417817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f8ff191-85c6-435b-87e4-dbd904ebe21f tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.733265 Aug 30 16:19:05.418400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1848/3404] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:04 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:05.443992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cef9d81-c51e-4f33-9295-eb52e722d2aa", "tag": "a4f9a7e4-672c-4032-add3-8e6b40a72a6a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:05.463451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.464109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.470426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.501259 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] Creating event network-changed:a4f9a7e4-672c-4032-add3-8e6b40a72a6a for instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa on n-h2-830883-28 Aug 30 16:19:05.514656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0b443e82-0a0a-479e-abd9-8495ed1e7afc req-501b6677-d375-4772-95a8-eeb76fd7045e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087509 Aug 30 16:19:05.515723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1849/3405] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:05.689856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7590c292-1387-495c-a854-56e182d3926e tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd357f3c280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk9x/y/DNuP/Oc1mkw2Rh9lIzrBczP20v4HiGCSTjykHdpuZQQnqDi6/KnPPDgzW5Z5uTcJSoQmG1wd6o70Pj3Q8+FsCTGFxGowDeeNkXghbNpblxuju8AN50j567NKYA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7590c292-1387-495c-a854-56e182d3926e tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 257 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk9x/y/DNuP/Oc1mkw2Rh9lIzrBczP20v4HiGCSTjykHdpuZQQnqDi6/KnPPDgzW5Z5uTcJSoQmG1wd6o70Pj3Q8+FsCTGFxGowDeeNkXghbNpblxuju8AN50j567NKYA=="}} Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOk9x/y/DNuP/Oc1mkw2Rh9lIzrBczP20v4HiGCSTjykHdpuZQQnqDi6/KnPPDgzW5Z5uTcJSoQmG1wd6o70Pj3Q8+FsCTGFxGowDeeNkXghbNpblxuju8AN50j567NKYA=='}}} Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 30 16:19:05.695851 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:05.701838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7590c292-1387-495c-a854-56e182d3926e tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:05.705861 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7590c292-1387-495c-a854-56e182d3926e tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.182741 Aug 30 16:19:05.705861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1850/3406] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:05 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:19:05.711544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:05.712434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:05.721516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.723439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.724235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.725080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:05.725970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:05.726535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:05.936098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:05.953820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-753ad798-c37a-49cb-8969-511d0964ff74 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.248793 Aug 30 16:19:05.969321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:05.972107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:05.972873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:05.976123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:05.977002 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1851/3407] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:05 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:05.981530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:05.986935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35ce47940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-594436580", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.030333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.032096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.034744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.035408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.036933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.038329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.040441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.049970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for user 190ce928173341b5906231acb93d9dd1 and project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:06.072466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.079487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:06.085959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.099433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:06.102688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 2166 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-594436580", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:06.114764 n-d-830883-28 devstack@n-api.service[122352]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-594436580', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:06.117599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.121522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.126353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:06.126353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e97154bd-71ab-405e-aac9-dbe79102a170 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.146164 Aug 30 16:19:06.128153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1852/3408] 10.222.0.47 () {60 vars in 1160 bytes} [Tue Aug 30 16:19:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:06.144923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f643902b-ded1-48f8-8348-04477ad0bae2 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35c523e50>, body: {"keypair": {"name": "tempest-keypair-1268234408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvkysN3H/JkYqxkZfma14JnN+ytxjNADtFaMreVO32RPUGQpII7pdz3aI3RaheBNZlFjWi9vz02MD05vlS+2gE95ssqOvMLQwk9QAWWGpSZjDD1Gl4wqs60onN2ySEMOw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.168837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f643902b-ded1-48f8-8348-04477ad0bae2 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.175230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f643902b-ded1-48f8-8348-04477ad0bae2 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for user 190ce928173341b5906231acb93d9dd1 and project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:06.221870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c8a185f-04e9-4909-895f-9e5d57696e46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471608 Aug 30 16:19:06.223668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1557/3409] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:06.233799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aeee9d0f-e56d-4d81-847e-af8f771dc545 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.234445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aeee9d0f-e56d-4d81-847e-af8f771dc545 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.259600 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f643902b-ded1-48f8-8348-04477ad0bae2 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121054 Aug 30 16:19:06.260736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1853/3410] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:06.279667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35c5485e0>, body: {"keypair": {"name": "tempest-keypair-1268234408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Nq2FfadO0+rdg+qrEEV4iZkHK51MK77PhS49nrfZjbz3TXszLkTidTRB0QEBEJzfFbnzQLSbGYY4werLSqBAoSAqOMI2zbiT7reNJTkt4FGAIQZfo95Bz6JV7KInqRg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.348263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.365485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for user 190ce928173341b5906231acb93d9dd1 and project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:06.415086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] HTTP exception thrown: Key pair 'tempest-keypair-1268234408' already exists. Aug 30 16:19:06.416784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aeee9d0f-e56d-4d81-847e-af8f771dc545 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.424384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aeee9d0f-e56d-4d81-847e-af8f771dc545 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1221 microversion: 2.1 time: 0.194756 Aug 30 16:19:06.424963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1558/3411] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:06 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 273 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "tempest-keypair-1268234408", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Nq2FfadO0+rdg+qrEEV4iZkHK51MK77PhS49nrfZjbz3TXszLkTidTRB0QEBEJzfFbnzQLSbGYY4werLSqBAoSAqOMI2zbiT7reNJTkt4FGAIQZfo95Bz6JV7KInqRg=="}} Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: exception: Key pair 'tempest-keypair-1268234408' already exists. Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1268234408', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Nq2FfadO0+rdg+qrEEV4iZkHK51MK77PhS49nrfZjbz3TXszLkTidTRB0QEBEJzfFbnzQLSbGYY4werLSqBAoSAqOMI2zbiT7reNJTkt4FGAIQZfo95Bz6JV7KInqRg=='}}} Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '190ce928173341b5906231acb93d9dd1-tempest-keypair-1268234408' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 16:19:06.425669 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result.read() Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 16:19:06.430791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '190ce928173341b5906231acb93d9dd1-tempest-keypair-1268234408' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 16, 19, 6, 404322), 'updated_at': None, 'name': 'tempest-keypair-1268234408', 'user_id': '190ce928173341b5906231acb93d9dd1', 'fingerprint': '4a:29:e1:26:43:c1:fb:ec:34:9d:30:18:22:bd:d4:71', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8Nq2FfadO0+rdg+qrEEV4iZkHK51MK77PhS49nrfZjbz3TXszLkTidTRB0QEBEJzfFbnzQLSbGYY4werLSqBAoSAqOMI2zbiT7reNJTkt4FGAIQZfo95Bz6JV7KInqRg==', 'type': 'ssh'}] Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6787, in import_key_pair Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi keypair.create() Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._create() Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1268234408' already exists. Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 30 16:19:06.444526 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1268234408' already exists. Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1268234408' already exists. Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 409 to user: Key pair 'tempest-keypair-1268234408' already exists. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e26a7c1c-31de-4c17-bf45-26d95c95e2c7 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.166327 Aug 30 16:19:06.455075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1854/3412] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:19:06.457905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.457905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.467876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.468374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.468811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.469505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.469955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.475169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-313f4308-80c7-4a77-8f06-2021a4cd63d5 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Calling method '.version_select at 0x7fd35c3063a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.483498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.532466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-313f4308-80c7-4a77-8f06-2021a4cd63d5 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268234408" status: 202 len: 0 microversion: 2.1 time: 0.081301 Aug 30 16:19:06.533061 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1855/3413] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268234408 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:19:06.546169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62f1da3e-2f43-4a7e-8596-d5b8570da4aa tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35c48f5e0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkcagFpeaYgKa51VniKDdaRAmBNv0L/vPXyERuHEODbVulXbMFAsZO9zwb/VDaSOXU04pGqp4sqqzz+pI/QQ8nPqIaqf8odtMut2DEMifU1hN+PlYgvfqU+5iUhpLhpxw=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62f1da3e-2f43-4a7e-8596-d5b8570da4aa tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 247 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkcagFpeaYgKa51VniKDdaRAmBNv0L/vPXyERuHEODbVulXbMFAsZO9zwb/VDaSOXU04pGqp4sqqzz+pI/QQ8nPqIaqf8odtMut2DEMifU1hN+PlYgvfqU+5iUhpLhpxw=="}} Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkcagFpeaYgKa51VniKDdaRAmBNv0L/vPXyERuHEODbVulXbMFAsZO9zwb/VDaSOXU04pGqp4sqqzz+pI/QQ8nPqIaqf8odtMut2DEMifU1hN+PlYgvfqU+5iUhpLhpxw=='}}} Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '' Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:19:06.550525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:19:06.555436 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.559996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62f1da3e-2f43-4a7e-8596-d5b8570da4aa tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:06.561099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62f1da3e-2f43-4a7e-8596-d5b8570da4aa tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018889 Aug 30 16:19:06.566800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1856/3414] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:19:06.572091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35cdb9b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-626471687", "public_key": " "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.605388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.612613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for user 190ce928173341b5906231acb93d9dd1 and project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:06.638592 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 94 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-626471687", "public_key": " "}} Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-626471687', 'public_key': ' '}}} Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.641370 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:06.648012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.651768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:06.653097 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ff2c8ef-a729-4207-ba27-2f0383bad273 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084775 Aug 30 16:19:06.653978 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1857/3415] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:06.669369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.672167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.681546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.682329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.682987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.683951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.684587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.685241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.724764 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee815891-8f96-49f5-a1a6-04a72cd735de tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061268 Aug 30 16:19:06.726084 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1858/3416] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:19:06 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:06.731024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16128a88-cce8-4ac7-a26b-6f432c2efb40 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35c48ff70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyvr/h9dVtS4TOyQEWKsL71GLsFfbiA6JYnWJ4NT89A9/9ftC3C5aQCUb39HrvQHNQEhCZ3ZmWtLKAWtsqmYuMn2KQC4q7RkFbKAfVbIWnHFrgR0p2UCgYeCUSX2h93JA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16128a88-cce8-4ac7-a26b-6f432c2efb40 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 507 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyvr/h9dVtS4TOyQEWKsL71GLsFfbiA6JYnWJ4NT89A9/9ftC3C5aQCUb39HrvQHNQEhCZ3ZmWtLKAWtsqmYuMn2KQC4q7RkFbKAfVbIWnHFrgR0p2UCgYeCUSX2h93JA=="}} Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyvr/h9dVtS4TOyQEWKsL71GLsFfbiA6JYnWJ4NT89A9/9ftC3C5aQCUb39HrvQHNQEhCZ3ZmWtLKAWtsqmYuMn2KQC4q7RkFbKAfVbIWnHFrgR0p2UCgYeCUSX2h93JA=='}}} Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 16:19:06.735658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 16:19:06.740846 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:06.745848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16128a88-cce8-4ac7-a26b-6f432c2efb40 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:06.746066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16128a88-cce8-4ac7-a26b-6f432c2efb40 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018098 Aug 30 16:19:06.747111 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1859/3417] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:19:06.758686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:06.759672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:06.776635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.778647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.786757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.787676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:06.789198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:06.789657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:06.853265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.885904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.889334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:06.890616 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8df8de2a-bdd0-4cc8-a0db-f49cf3376fc3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.447094 Aug 30 16:19:06.895197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1559/3418] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:06 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:06.914536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Action: 'create', calling method: .version_select at 0x7fd35c5024c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-377101970", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:06.920434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lazy-loading 'services' on Instance uuid 3998c5b0-75dd-492f-a79d-e66a39ab3482 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:19:06.944515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:06.953994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Getting quotas for user 190ce928173341b5906231acb93d9dd1 and project 70d877426ee247a6b9e6906ebb9b5aec. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:07.007467 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 117 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-377101970", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-377101970', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6784, in import_key_pair Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6857, in _generate_fingerprint Aug 30 16:19:07.010533 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3169e088-065a-438d-8072-0c7a0a181db6 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.112940 Aug 30 16:19:07.016405 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1560/3419] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:19:07.025672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.027255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:07.051851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.052708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.053366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.054353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.054988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.055620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.065498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35e430d4-5353-47d2-b2c4-9836ce08cac5 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments/34539db7-e86c-4b0f-9496-35660b88b33d" status: 202 len: 0 microversion: 2.1 time: 0.311835 Aug 30 16:19:07.069769 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1860/3420] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:19:06 2022] DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments/34539db7-e86c-4b0f-9496-35660b88b33d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:19:07.102893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1e1c30-c757-4962-bf01-314a98903212 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Calling method '.version_select at 0x7fd35c06d790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.179028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9a1e1c30-c757-4962-bf01-314a98903212 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1e1c30-c757-4962-bf01-314a98903212 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Request method failure captured: Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-343550911 HTTP/1.1 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjh4b1DrJnSsHza1xC-3OUswMVBc_OvJADmQvrh_7Uy-l3GYsiIELOTvWTj_v_o6mHz6jGxtn6v2JwcDqKdh8Cr3LwUEwUhjr13z5XYSRgjTnIo1W_2Hu5bW-E56XmRJoXO_uwHA6b8LScKq5fOqjt9cIHGvjrjOge46xaLiFnNbkHY Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/70d877426ee247a6b9e6906ebb9b5aec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/70d877426ee247a6b9e6906ebb9b5aec"}]}] Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 70d877426ee247a6b9e6906ebb9b5aec Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-667095001 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-KeyPairsNegativeTestJSON-667095001-project Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: exception: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'tempest-keypair-non-existent-343550911'} Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6871, in delete_key_pair Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6892, in get_key_pair Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.184274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1e1c30-c757-4962-bf01-314a98903212 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] Returning 404 to user: Keypair tempest-keypair-non-existent-343550911 not found for user 190ce928173341b5906231acb93d9dd1 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:07.188884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a1e1c30-c757-4962-bf01-314a98903212 tempest-KeyPairsNegativeTestJSON-667095001 tempest-KeyPairsNegativeTestJSON-667095001-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-343550911" status: 404 len: 144 microversion: 2.1 time: 0.120284 Aug 30 16:19:07.195268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1861/3421] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-343550911 => generated 144 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:07.462459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.464343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:07.483826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.489720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.493284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.494289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.495052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.495597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.697445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:07.712451 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ed85386-7635-434b-bc49-1f559f299a5a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1225 microversion: 2.1 time: 0.253727 Aug 30 16:19:07.715904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1862/3422] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:07 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1225 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:07.918991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:07.919761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:07.942438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.947404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.950411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:07.953643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:07.955803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:07.958327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.119459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.131838 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5db9c9f-2ad4-41be-b9b8-f466eb1a3c80 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 1.117833 Aug 30 16:19:08.132439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1561/3423] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:07 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:08.166663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.194757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.200111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:08.201763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2de5ceb7-941c-4911-940b-7b51e6015581 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.287107 Aug 30 16:19:08.209387 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1863/3424] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:07 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:08.736900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:08.737816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:08.748276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.748765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.749294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:08.749890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:08.763153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:08.770797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.047946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.056758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61bd636c-9e4e-44b2-8b03-8447bb3de44c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1281 microversion: 2.1 time: 0.323517 Aug 30 16:19:09.065557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1562/3425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:08 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:09.154107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:09.154811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:09.165349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.171093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.171848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.172793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.173418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.174044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.238938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:09.241826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:09.260195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.260786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.261506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.262554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:09.263291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:09.263960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:09.305995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:09.499551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.512249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.515658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.517714 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51e5d640-99e1-42aa-8c6e-1423aaa51fd7 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.285964 Aug 30 16:19:09.518709 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1563/3426] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:09 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:09.637534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:09.649998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9079a38c-85ab-49fb-b4c7-bb98143bcb81 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.500013 Aug 30 16:19:09.658646 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1864/3427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:09 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:10.098643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:10.099285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:10.111340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.115430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.118224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.119894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.121529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.123290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.542535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:10.544756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:10.554540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.565401 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-975f1816-7578-45d9-9067-a20c1c0e0989 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1279 microversion: 2.1 time: 0.477759 Aug 30 16:19:10.569726 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1564/3428] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:10 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1279 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:10.596295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.597412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.598294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.600357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.602817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.606132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.674825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:10.676796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:10.694220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.699373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.699844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.700593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:10.708821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:10.709457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:10.964050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.992674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.996437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:10.999711 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a78f9560-bebf-47ad-80aa-24ea6fba0ece tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.461197 Aug 30 16:19:11.001712 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1865/3429] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:10 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:11.529869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:11.538121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-530a6027-5641-4624-9509-41aa41ec4a08 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.867857 Aug 30 16:19:11.544544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1565/3430] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:10 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:11.591304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:11.592174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:11.602003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.609605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.611789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:11.614001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:11.618883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:11.621308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.027310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:12.028026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:12.043842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.062833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.063754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.064747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.065447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.074663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.589483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:12.591705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:12.605830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:12.614959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:12.616231 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4aa1822c-6770-44bc-9164-afe398ff817e tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.593168 Aug 30 16:19:12.616821 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1566/3431] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:12 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:19:12.641007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:12.642005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:12.665161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.690561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.693173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.700774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:12.701365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:12.701820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:12.867453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:12.879203 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-951a5567-1a08-4952-99c1-2e55de8706a6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 1.292320 Aug 30 16:19:12.879803 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1866/3432] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:11 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:13.182501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:13.200927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a60e36b-49fe-49b0-adb8-40c5f473f53a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.577844 Aug 30 16:19:13.201542 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1567/3433] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:12 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:13.639773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:13.640470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:13.657089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:13.657584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:13.659805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:13.661581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:13.666864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:13.669684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:13.861871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:13.897973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:13.904136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:13.905023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:13.910714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:13.915107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df697b28-fd09-4718-9e8c-5e1f31c139b1 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.279216 Aug 30 16:19:13.919114 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1867/3434] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:13 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:13.925890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:13.930388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:13.933121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:13.936531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:13.942013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:13.942797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.221481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:14.223182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:14.232417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.234705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.236371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.246163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.252241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.252947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.734976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:14.738991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:14.747238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc439caf-65ec-4b07-b853-7f8b6d1b212c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.529604 Aug 30 16:19:14.749996 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1868/3435] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:14 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:14.941959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:14.942638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:14.961665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.964705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.965402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:14.968094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:14.970531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:14.973036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:15.418722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:15.436236 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-109c35de-71c3-47a1-aff2-30710ccc95ec tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 1.535937 Aug 30 16:19:15.450107 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1568/3436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:13 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:15.560741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:15.576485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:15.583196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:15.585160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9cf8977-c739-415e-a50a-2133527eaad4 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.647795 Aug 30 16:19:15.588344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1869/3437] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:14 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:15.771738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:15.773224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:15.785545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:15.786540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:15.787388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:15.788512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:15.789239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:15.790684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.058124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:16.457528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:16.458160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:16.469684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.472883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.473257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.474009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.474519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.475128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.487436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.499483 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19b5e4f1-3964-4006-af39-66e5228044c2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.731650 Aug 30 16:19:16.500108 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1569/3438] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:15 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:16.618162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:16.619377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:16.621534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:16.622683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=24 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:16.639502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.640585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.641333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.642286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:16.644092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:16.644920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:16.827795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.843632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.848890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.854258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec4e14bf-e332-42cb-a848-514a565326eb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.242668 Aug 30 16:19:16.855317 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1570/3439] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:16 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:16.865556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:16.882241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-76c32067-c6cc-4d72-b44f-f6a8bf6fccd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 0.428861 Aug 30 16:19:16.884793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1870/3440] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:16 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:17.127636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cef9d81-c51e-4f33-9295-eb52e722d2aa", "name": "network-vif-plugged", "status": "completed", "tag": "a4f9a7e4-672c-4032-add3-8e6b40a72a6a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:17.131279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a4d17b-3979-4ecb-8e45-476b1f0c287e", "tag": "b87e3082-7ff5-43da-8e78-0f5a36123486"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:17.140748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:17.160700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.161214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.161662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.162108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.162727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.163404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.196000 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] Creating event network-vif-plugged:a4f9a7e4-672c-4032-add3-8e6b40a72a6a for instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa on n-h2-830883-28 Aug 30 16:19:17.210471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1214489c-979d-4098-9e52-4b38ecf35889 req-e2ea623f-101f-44b4-acf6-da7574f56638 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090221 Aug 30 16:19:17.215872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1871/3441] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:17.223273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] Creating event network-changed:b87e3082-7ff5-43da-8e78-0f5a36123486 for instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e on n-h1-830883-28 Aug 30 16:19:17.236618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-248a2cf6-7ef4-4a54-8edb-b69b535b7d57 req-ca7144ee-e271-41bb-ab86-3ec2d593e260 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117084 Aug 30 16:19:17.237450 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1571/3442] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:17.524324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:17.525179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:17.545481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.547747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.548769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.551095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.553931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.555212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.880901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:17.881771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:17.898407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.900246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.903127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:17.904115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:17.906442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:17.907066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:18.120480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.137034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.138424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.139818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-293ac78a-0ebe-48af-b0d7-9a3926d7a59c tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.264453 Aug 30 16:19:18.142186 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1572/3443] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:17 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:18.155951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:18.160318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:18.178851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:18.179616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:18.180239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:18.181122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:18.184048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:18.194445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:18.459121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.473986 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-358e783d-902d-4ece-ac44-a4fc7ff468a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 0.956204 Aug 30 16:19:18.478598 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1872/3444] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:17 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:18.732639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:18.746295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f37bfb34-3779-4f18-b80f-62c11e2cbdac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 0.602772 Aug 30 16:19:18.749622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1573/3445] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:18 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:19.166258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:19.166912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:19.178220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.178764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.179221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.179952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.180417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.180858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.417209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:19.419449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:19.445306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.445818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.446262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.447024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.447484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.448181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.513388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6cacb5c2-76e1-40b3-bae3-06e82f1ffbdd tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100191 Aug 30 16:19:19.524414 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1574/3446] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:19:19 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:19.530378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:19.531010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:19.547339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.547840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.548281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.548999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.549460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.549893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.906432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:19.936881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:19.938253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:19.942623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cc135dd-15b1-49cf-8d51-3ff4d25762ca tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.780853 Aug 30 16:19:19.951478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1873/3447] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:19 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:19.961303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:19.979355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:19.986494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.987906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.988549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:19.991212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:19.991961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:19.994981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.386351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:20.411017 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7c7a25c-b87a-4ce6-a13f-0afa7d1d6c41 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 0.456256 Aug 30 16:19:20.411613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1874/3448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:19 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:20.525720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:20.528068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:20.542003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.544177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.546037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.547325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.552435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.554543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.615866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-248194a7-8c5b-4b5f-9e8b-ecbf43971c0b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092963 Aug 30 16:19:20.618648 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1875/3449] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:19:20 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:19:20.699551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:20.712502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:20.722633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:20.739994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c03fe77b-a9ed-406d-b9a2-5d10d413fd14 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1361 microversion: 2.1 time: 1.213987 Aug 30 16:19:20.740814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1575/3450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:19 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1361 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:20.747535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.748331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.749000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.749909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.750612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.751247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.824857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36258144-8d3f-4455-b1bb-6257424fc813 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123446 Aug 30 16:19:20.837131 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1876/3451] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:19:20 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:19:20.939173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:20.939978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:20.954776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.955432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.955971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.957023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.957940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.958523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.976055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:20.976692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:20.989062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.989690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.991584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:20.996052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:20.996824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:20.997437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.017831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:19:21.137628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:21.155798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:21.162267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:21.167595 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc21086c-90a1-49e9-871a-e15f6feaf5fb tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.193608 Aug 30 16:19:21.181335 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1877/3452] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:20 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:21.204090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fedb5512-0b1f-47c9-bed9-e18d34371a4d tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 204 len: 0 microversion: 2.1 time: 0.269494 Aug 30 16:19:21.208609 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1576/3453] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:20 2022] DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:21.222756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:21.223802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:21.231901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.232635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.233282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.234415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.235041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.235764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.433591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:21.434559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:21.446781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.447349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.448309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:21.449265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:21.454731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:21.455445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.153464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.167346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2386a83e-736b-4fd3-881e-f7abb57e203a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 0.738247 Aug 30 16:19:22.169563 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1577/3454] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:21 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:22.177758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.189446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:22.190662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:22.194028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-31265fc0-f4b8-4b2c-989a-f662e5463f2e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1681 microversion: 2.1 time: 0.983044 Aug 30 16:19:22.207463 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1878/3455] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:21 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1681 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:22.217835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.220785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.221525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.223744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.224461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.225165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.226593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:22.227236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:22.249375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.249893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.250411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.251673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.252750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.254456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.396604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.409610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.414446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.416205 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-476ad638-b9bc-4006-a86c-023a90410979 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.219222 Aug 30 16:19:22.417365 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1879/3456] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:22 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:22.828166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:22.841216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b7693f3-2f33-4ee0-84a9-d603cb2ddede tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1546 microversion: 2.1 time: 0.669763 Aug 30 16:19:22.854516 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1578/3457] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:22 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1546 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:22.873162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:22.874451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:22.884002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.884799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.885526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:22.887642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:22.888963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:22.889609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.197099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:23.198771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:23.216246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:23.217615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:23.218562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.220427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:23.227461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:23.228951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.248230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-573bb430-ba62-4bb7-b7a3-e1791c3c159d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.383617 Aug 30 16:19:23.249889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1880/3458] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:19:22 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-interface => generated 284 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:23.264105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:23.265015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:23.292108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:23.292621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:23.299896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.302144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:23.302708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:23.303173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:23.350214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:24.617347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:24.625509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e90e6468-98a3-4d35-9102-52575794c28e tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1681 microversion: 2.1 time: 1.366213 Aug 30 16:19:24.634707 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1881/3459] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:23 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1681 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:24.643239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:24.644661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:24.655070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:24.668766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:24.669277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:24.669900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:24.670820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:24.671444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:24.672062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:24.896996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:24.905609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-541ad3fc-7e8d-4d27-bcc0-fa372dc2c34d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 1.712762 Aug 30 16:19:24.911615 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1579/3460] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:23 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:24.926385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3998c5b0-75dd-492f-a79d-e66a39ab3482", "name": "network-vif-unplugged", "status": "completed", "tag": "ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:24.957917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:24.958601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:24.959066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:24.987119 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] Creating event network-vif-unplugged:ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0 for instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 on n-h1-830883-28 Aug 30 16:19:25.003057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-39cccb10-7e0a-4b6a-883a-79c085ae9745 req-8513ba14-0708-417c-81af-fc0247689647 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087081 Aug 30 16:19:25.004679 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1580/3461] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:25.081381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:25.094028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:25.095526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:25.096737 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1561247-cf17-4b56-aec5-eaf175157b03 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.460751 Aug 30 16:19:25.097874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1882/3462] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:24 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:25.651542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:25.652465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:25.669484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.670162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.670817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:25.671712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.672328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.672930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:25.931136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:25.932516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:25.945936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.946715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.947345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:25.949959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:25.950678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:25.953107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.164040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:26.176029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36f156f1-914f-4b2b-92fa-20895a054903 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1681 microversion: 2.1 time: 0.529217 Aug 30 16:19:26.193988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1581/3463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:25 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1681 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:26.199658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:26.216696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:26.250981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:26.252900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:26.253968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.256511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:26.257230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:26.257870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.414697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:26.432110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:26.433521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:26.434992 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44bf5ae8-dd52-478f-9f45-f1caa463ed4b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.239629 Aug 30 16:19:26.439399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1582/3464] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:26 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:26.806831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cef9d81-c51e-4f33-9295-eb52e722d2aa", "tag": "a4f9a7e4-672c-4032-add3-8e6b40a72a6a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:26.834276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:26.834798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:26.835240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:26.868955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] Creating event network-changed:a4f9a7e4-672c-4032-add3-8e6b40a72a6a for instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa on n-h2-830883-28 Aug 30 16:19:26.881257 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2c4b68f2-8efd-4908-9b29-d3a8531d13c8 req-d1ba3932-732b-4002-9586-ec96562109af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080479 Aug 30 16:19:26.884431 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1583/3465] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:27.203307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:27.204693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:27.220733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:27.221663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:27.230566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:27.234935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:27.235730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:27.236357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:27.288452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:27.309027 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d846948d-8d3f-461d-a640-9c1a1827698b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 1.380946 Aug 30 16:19:27.312554 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1883/3466] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:25 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:27.355986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a4d17b-3979-4ecb-8e45-476b1f0c287e", "name": "network-vif-plugged", "status": "completed", "tag": "b87e3082-7ff5-43da-8e78-0f5a36123486"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:27.395969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:27.396603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:27.396935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:27.455336 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] Creating event network-vif-plugged:b87e3082-7ff5-43da-8e78-0f5a36123486 for instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e on n-h1-830883-28 Aug 30 16:19:27.477447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1d0105f0-720a-429a-bf06-e85cd46e1763 req-d80ef90e-3ccf-45b6-9ae9-c7b38954de02 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125554 Aug 30 16:19:27.483733 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1884/3467] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:27.490028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:27.490792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:27.512130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:27.513317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:27.514027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:27.515666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:27.516238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:27.516868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:27.604154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:27.618945 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d44574cd-928c-48a8-8fbd-ff7d83ae5066 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1613 microversion: 2.1 time: 0.423246 Aug 30 16:19:27.622051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1584/3468] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:27 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1613 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:28.054653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:28.077291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:28.084470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:28.086442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-28817692-6b69-403a-bd87-18c5f86ec15b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.601408 Aug 30 16:19:28.089831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1885/3469] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:27 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:28.333796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:28.334643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:28.352894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.353815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.354534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.355668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.356407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.357076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.647031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:28.647748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:28.657793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.662979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.666177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.667288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.676100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.677183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.762545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:28.763039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:28.763479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:28.763936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lazy-loading 'fault' on Instance uuid 3998c5b0-75dd-492f-a79d-e66a39ab3482 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:19:28.996868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814577c02957425280092135af2373c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2da89aa82a943b498bec542e8d0cbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.009958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:29.017555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae8a470d-931b-4eb0-8d5c-7d0f4cbe03c8 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 200 len: 1331 microversion: 2.1 time: 0.371446 Aug 30 16:19:29.024570 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1886/3470] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:28 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 1331 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:29.119317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:29.120262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:29.138619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:29.139539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:29.140222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:29.141180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:29.148916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:29.149716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:29.171663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.182584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e86fbfa-8314-41ea-9887-ccd9f38e7571 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1321 microversion: 2.1 time: 0.853271 Aug 30 16:19:29.199244 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1585/3471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:28 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1321 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:29.216650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3998c5b0-75dd-492f-a79d-e66a39ab3482", "name": "network-vif-deleted", "tag": "ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:29.290447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:29.293484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:29.298376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:29.331299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] Creating event network-vif-deleted:ccc9d20b-ce6b-4cc8-b93c-0a614dd5f9d0 for instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 on n-h1-830883-28 Aug 30 16:19:29.343334 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cadcb3d3-0b8b-4cfa-aafc-b37d3ed53951 req-88ce461a-136c-4609-82d4-1105c3f39e3f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141824 Aug 30 16:19:29.345369 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1586/3472] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:29.472967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.486382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.500115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:29.505976 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8368dc9c-4309-4068-a79a-cc8202b5b5ea tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.391557 Aug 30 16:19:29.513561 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1887/3473] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:29 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:30.046233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.047263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:30.060425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.068363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.069097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.070636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.071375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.072037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.102081 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] HTTP exception thrown: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Request method failure captured: Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 HTTP/1.1 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfTJFb3PlZcbKxDQQDERhNXv5_e3qowIcG7DZGrjh231_MWJxFndDStLhgxaUPJagAplYNMgL_MkKh7WKTYhlpdzfLvVECbThkK3wjPwR_WBuvkmBHh6gN_uyrCl7ZGwbdtZ9LNV45GSvCRCmtecZEnzO13mwkMHJ6kFI_NXnb26AU Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}] Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 814577c02957425280092135af2373c8 Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3998c5b0-75dd-492f-a79d-e66a39ab3482'} Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:30.105000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:30.111557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Returning 404 to user: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:30.113671 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc2ad8e7-657e-466c-86dc-0a622fda7e45 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 404 len: 111 microversion: 2.1 time: 0.071053 Aug 30 16:19:30.120310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1587/3474] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:30 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:30.126523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-42139f5f-b6a5-4cbd-bbb7-48c0e40b8d5b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '.version_select at 0x7fd35c03f940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.167328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-42139f5f-b6a5-4cbd-bbb7-48c0e40b8d5b tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114468263" status: 202 len: 0 microversion: 2.1 time: 0.045021 Aug 30 16:19:30.168584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1888/3475] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114468263 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:19:30.228261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.230186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:30.247582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.251512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.258040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.259046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.261663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.262333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.538119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.538757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:30.549556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.553582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.554235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.555193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.555821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.556560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.698397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:30.708821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45b20b2b-51ce-467b-9119-a2aa0c4706bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1503 microversion: 2.1 time: 0.495408 Aug 30 16:19:30.717319 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1588/3476] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:30 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1503 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:30.738871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:30.739705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:30.747436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.748201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.748798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.749672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:30.750294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:30.750902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:30.803073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:30.814677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:30.822102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:30.823646 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e89b9663-a18e-4a41-9f12-f2f50b6cba13 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.289921 Aug 30 16:19:30.847058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1889/3477] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:30 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:31.185489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:31.223119 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3112a80c-ce84-4e54-b15f-9a700ae17895 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1503 microversion: 2.1 time: 0.487923 Aug 30 16:19:31.235757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1589/3478] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:30 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:31.246798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:31.247313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:31.293387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.294071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.298007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.301049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.304135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.311259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.381130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:19:31.605457 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7deb56cf-1535-4ed7-ac5a-b31608e709cf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 204 len: 0 microversion: 2.1 time: 0.362207 Aug 30 16:19:31.606099 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1890/3479] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:31 2022] DELETE /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:19:31.615358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:31.615924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:31.625080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.625585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.626026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.631971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.638335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.640294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.851350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:31.852170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:31.861801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.864559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.865285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:31.868545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:31.869289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:31.872470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:32.040694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:32.057229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-672f98e0-d18f-4c97-abdf-85f713a9ba95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1509 microversion: 2.1 time: 0.446501 Aug 30 16:19:32.076465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1590/3480] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:31 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:32.076647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:32.095278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:32.099769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:32.101038 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee490d8d-bf91-41c8-9877-81a2f21e5ae9 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.254561 Aug 30 16:19:32.101612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1891/3481] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:31 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:33.084307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:33.086127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:33.109306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.110440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.114620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.116811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.126663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.130052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.185370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ad9df1b-ef22-4b8f-8db1-d1a7cd65bb5c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: .version_select at 0x7fd35c2604c0>, body: {"keypair": {"name": "tempest-keypair-755286941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCB23HxCQsSI8LAG3qd4owaZiNPNQFiVR7KdqIm/ORhHcK+XnbOqxJ5iaMCrMi+7hwbWkkuDzf1fZQoMxN3NVe/PwVEeQB6hqPo77TEjpA7NhZ6DVp+aj9mloLwLo1Jl/Q=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:33.225170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5ad9df1b-ef22-4b8f-8db1-d1a7cd65bb5c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:33.231881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-5ad9df1b-ef22-4b8f-8db1-d1a7cd65bb5c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:33.288894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ad9df1b-ef22-4b8f-8db1-d1a7cd65bb5c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.343615 Aug 30 16:19:33.290195 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1591/3482] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:33.295329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:33.296545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:33.310453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.312149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.316395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.317425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:33.320794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:33.321454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:33.674741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:33.708220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:33.712303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:33.713799 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bec32af7-2056-4987-8816-01aa2c89b5d5 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.422279 Aug 30 16:19:33.746223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1592/3483] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:33 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:33.872389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:33.885397 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a743966-6e47-494c-a407-8ed17d85c71d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1509 microversion: 2.1 time: 0.800790 Aug 30 16:19:33.889122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1892/3484] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:33 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1509 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:34.745343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:34.746038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:34.773786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.776546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.777017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:34.785754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.786327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.786789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:34.914323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:34.914949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:34.937234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.937989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.938232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:34.938972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:34.939439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:34.939878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:35.240342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:35.269037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:35.275206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389b6f29e0274334aa4661e16414797d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8fe3a2308cf43d88d7c8f3e954257f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:35.286414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de520f72-0572-498a-9aee-2cb9e72070f3 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 200 len: 1605 microversion: 2.32 time: 0.546523 Aug 30 16:19:35.293807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1593/3485] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:34 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 1605 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:19:35.442864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-382129067", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "7f742002-67a6-4717-9e08-014bc03c8bc3"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:35.557057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] validate_networks() for [('7f742002-67a6-4717-9e08-014bc03c8bc3', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:35.574684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:35.583301 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-301a4724-01c1-4a58-b633-e7bbf65696dd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1509 microversion: 2.1 time: 0.674014 Aug 30 16:19:35.598785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1893/3486] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:34 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1509 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:36.095327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a4d17b-3979-4ecb-8e45-476b1f0c287e", "name": "network-vif-deleted", "tag": "b87e3082-7ff5-43da-8e78-0f5a36123486"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:36.123886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.124941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.129443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.163864 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] Creating event network-vif-deleted:b87e3082-7ff5-43da-8e78-0f5a36123486 for instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e on n-h1-830883-28 Aug 30 16:19:36.176572 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-502f2881-3f18-42c7-a3aa-3177e712b895 req-b3355825-0b10-401d-b2e3-4789b043794f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083995 Aug 30 16:19:36.178573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1894/3487] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 16:19:36.322640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:36.323961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:36.339032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.344065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.345218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.348117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.350922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.352705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.391819 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] HTTP exception thrown: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Request method failure captured: Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e HTTP/1.1 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbF6hlOuiXLCOdbas_6yubL9jRdnpbUTsIOKVY_HcZuYDTsrmZTNpgOZEGn7hU0fqVE2kFvC-JUInKxAd2AB3pn7LRaI6ALvv0WmAyp-eqToEzdlu4paaKeZb5v_sPlBhg5xcDkf-eG4OR_o-Tr7b084Vj5dg27I-Zj22Otq6fL--Y Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}] Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 389b6f29e0274334aa4661e16414797d Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '58f75a19-3870-4167-8aff-a3ded5c7549e'} Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:36.397809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:36.404348 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:36.406334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Returning 404 to user: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:36.411749 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6efd5dcd-6ea7-4b9c-ac8a-0b40ff61098b tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 404 len: 111 microversion: 2.32 time: 0.098016 Aug 30 16:19:36.413576 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1895/3488] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:36 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:19:36.422253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77add08f-7b05-42c1-9472-79e825a98f32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '.version_select at 0x7fd357fe9dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:36.459940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77add08f-7b05-42c1-9472-79e825a98f32 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574705844" status: 204 len: 0 microversion: 2.32 time: 0.038476 Aug 30 16:19:36.461333 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1896/3489] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574705844 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:19:36.617003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:36.618338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:36.632437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.633264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.635537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.636537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.638141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.639902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.757473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:36.758178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:36.758793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:36.760031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lazy-loading 'fault' on Instance uuid 64a4d17b-3979-4ecb-8e45-476b1f0c287e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:19:37.267084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:37.279524 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-197ca3c1-abf4-4690-82bf-09d948a4c636 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 200 len: 1311 microversion: 2.1 time: 0.667547 Aug 30 16:19:37.280727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1897/3490] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:36 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 1311 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:37.340973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:37.341948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:37.342655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:37.343277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:37.344595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:37.355323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:37.356122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:37.356756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:37.357687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:37.358416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:37.359035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:37.424041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Getting quotas for project 3b00ddbb5c9c4744bec18f7dd2973a2f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:37.453533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Getting quotas for user 03ba3ad8f34540bd9d7b9b8d96ea84ef and project 3b00ddbb5c9c4744bec18f7dd2973a2f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:37.489728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:37.511640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:37.674360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfde0547-e9b2-4a52-a4d3-395aa6030b67 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378936 Aug 30 16:19:37.677028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1594/3491] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:37.689489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0583f494-bddc-4f4d-bf21-64776dd815f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:37.691437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0583f494-bddc-4f4d-bf21-64776dd815f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:37.820771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0583f494-bddc-4f4d-bf21-64776dd815f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:37.830144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0583f494-bddc-4f4d-bf21-64776dd815f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1215 microversion: 2.1 time: 0.145587 Aug 30 16:19:37.830779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1898/3492] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:37 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:38.306089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:38.306785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:38.316731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:38.325016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:38.327015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:38.330943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:38.332728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:38.333674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:38.379505 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e HTTP/1.1 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '64a4d17b-3979-4ecb-8e45-476b1f0c287e'} Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:38.385805 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:19:38.391351 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:38.392892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:38.397872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1e1fb40-5d0f-4ae9-9250-ba511c0d3aaf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 404 len: 111 microversion: 2.1 time: 0.093530 Aug 30 16:19:38.404013 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1595/3493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:38 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:38.418205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-51af4220-95e1-431c-940e-01628d16f43b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: .version_select at 0x7fd35c06ddc0>, body: {"keypair": {"name": "tempest-key-1969259102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw0AiEQP6Zafl3QJlRndQX3qH9FJJbUqE4FeP7by7pTHDJ1qS04As26CUyiEOumBkWsmgcqRu38nEC8JRVW/01DZ0aOBxRFALA5kFtwAHaaNa4kOh+2RarD15xaJClk0Q=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:38.461885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-51af4220-95e1-431c-940e-01628d16f43b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:38.478717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-51af4220-95e1-431c-940e-01628d16f43b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:38.555894 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-51af4220-95e1-431c-940e-01628d16f43b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.141956 Aug 30 16:19:38.557066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1899/3494] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:19:38 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:38.567507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be1244f4-6ff8-486f-ab63-e78b121ca549 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '.version_select at 0x7fd35cd788b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:38.572423 n-d-830883-28 devstack@n-api.service[122351]: WARNING oslo_db.sqlalchemy.utils [None req-be1244f4-6ff8-486f-ab63-e78b121ca549 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:19:38.589612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be1244f4-6ff8-486f-ab63-e78b121ca549 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.024177 Aug 30 16:19:38.592213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1596/3495] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:19:38 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:38.858248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3cdf67e-b7e1-4677-ac1e-c0d25a9cc0c0 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:38.859372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3cdf67e-b7e1-4677-ac1e-c0d25a9cc0c0 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:38.861033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-18166784", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-key-1969259102", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:38.984826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:39.015024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3cdf67e-b7e1-4677-ac1e-c0d25a9cc0c0 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:39.051458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3cdf67e-b7e1-4677-ac1e-c0d25a9cc0c0 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1215 microversion: 2.1 time: 0.198793 Aug 30 16:19:39.054799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1900/3496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:38 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:39.082120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-678706965", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14da368a-1038-4232-aa6a-32d46d4c24f8"}], "security_groups": [{"name": "tempest-securitygroup--665941534"}], "key_name": "tempest-keypair-755286941", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:39.353511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] validate_networks() for [('14da368a-1038-4232-aa6a-32d46d4c24f8', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:19:40.159754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:40.166855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:40.167553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:40.168152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:40.168751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:40.181745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.184135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.184629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.185411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.185880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.186327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.266384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:40.288751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:40.348083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:40.355288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:40.492379 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65e02f23-2ef7-4744-9f2c-a247128f61ec tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.436344 Aug 30 16:19:40.500891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1901/3497] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:40.516113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:40.516945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:40.530438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.535942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.536572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.537439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:40.538016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:40.538580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:40.661604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:40.674607 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60d7b528-7671-4b46-a4b0-827bafe1a039 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1273 microversion: 2.1 time: 0.172254 Aug 30 16:19:40.688460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1902/3498] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:40 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:40.688460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b28a7f95-9b73-4312-8951-e7245deadda7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:40.688460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b28a7f95-9b73-4312-8951-e7245deadda7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:40.805417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b28a7f95-9b73-4312-8951-e7245deadda7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:40.814966 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b28a7f95-9b73-4312-8951-e7245deadda7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1237 microversion: 2.1 time: 0.136010 Aug 30 16:19:40.819886 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1903/3499] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:41.705155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:41.708044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:41.730172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:41.732885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:41.734716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:41.738201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:41.738788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:41.745194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:41.876915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:41.906029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6916f5c7-f04c-40e7-98a8-eacdc2ac1da3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1273 microversion: 2.1 time: 0.211998 Aug 30 16:19:41.927492 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1904/3500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:41 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:41.940861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:41.943898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:41.949408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:19:41.949974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:19:41.950742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:19:41.951358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:19:41.952080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:19:42.017154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.020231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.022726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.023470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.024270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.024917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.025919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.026955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.030928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.031706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.032251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.032865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.152064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:19:42.181872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:19:42.236581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:19:42.239999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:19:42.327130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:42.388960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc3fcab3-bb66-434f-bbd3-cefa7c96552d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.532202 Aug 30 16:19:42.391386 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1597/3501] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:19:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:19:42.414212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:42.417121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:42.435409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.437403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.439134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.442531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.443277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.443983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.477275 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] HTTP exception thrown: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Request method failure captured: Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 HTTP/1.1 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjfTJFb3PlZcbKxDQQDERhNXv5_e3qowIcG7DZGrjh231_MWJxFndDStLhgxaUPJagAplYNMgL_MkKh7WKTYhlpdzfLvVECbThkK3wjPwR_WBuvkmBHh6gN_uyrCl7ZGwbdtZ9LNV45GSvCRCmtecZEnzO13mwkMHJ6kFI_NXnb26AU Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}] Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 814577c02957425280092135af2373c8 Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3998c5b0-75dd-492f-a79d-e66a39ab3482'} Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:42.480310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.484718 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.488780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Returning 404 to user: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:42.493642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d822579-983d-4682-9d9d-fbfdaf66c5bb tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 404 len: 111 microversion: 2.1 time: 0.092002 Aug 30 16:19:42.497415 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1598/3502] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:42 2022] DELETE /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:42.507726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d79e5283-50ca-41db-9abe-e621d9fe96a2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:42.508356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d79e5283-50ca-41db-9abe-e621d9fe96a2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:42.745480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:42.757181 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-385cdec2-aa4d-45d7-9497-54a20bad3226 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1289 microversion: 2.1 time: 0.825697 Aug 30 16:19:42.758817 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1905/3503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:41 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1289 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:42.773743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:42.774429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] [instance: 3998c5b0-75dd-492f-a79d-e66a39ab3482] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:42.800969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.806863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.807408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.813124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.813528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.817269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.839157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d79e5283-50ca-41db-9abe-e621d9fe96a2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:42.856573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d79e5283-50ca-41db-9abe-e621d9fe96a2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1227 microversion: 2.1 time: 0.355339 Aug 30 16:19:42.872980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1599/3504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:42 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1227 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:42.874256 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] HTTP exception thrown: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Request method failure captured: Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 HTTP/1.1 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjfTJFb3PlZcbKxDQQDERhNXv5_e3qowIcG7DZGrjh231_MWJxFndDStLhgxaUPJagAplYNMgL_MkKh7WKTYhlpdzfLvVECbThkK3wjPwR_WBuvkmBHh6gN_uyrCl7ZGwbdtZ9LNV45GSvCRCmtecZEnzO13mwkMHJ6kFI_NXnb26AU Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c2da89aa82a943b498bec542e8d0cbe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c2da89aa82a943b498bec542e8d0cbe2"}]}] Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c2da89aa82a943b498bec542e8d0cbe2 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-795902580 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 814577c02957425280092135af2373c8 Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-795902580-project Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '3998c5b0-75dd-492f-a79d-e66a39ab3482'} Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:42.875273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] Returning 404 to user: Instance 3998c5b0-75dd-492f-a79d-e66a39ab3482 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8a3ac8e-1b9d-4040-afe9-ca5eb661d3b0 tempest-AttachSCSIVolumeTestJSON-795902580 tempest-AttachSCSIVolumeTestJSON-795902580-project] 10.222.0.47 "GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482" status: 404 len: 111 microversion: 2.1 time: 0.116610 Aug 30 16:19:42.881120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1906/3505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:42 2022] GET /compute/v2.1/servers/3998c5b0-75dd-492f-a79d-e66a39ab3482 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:19:42.939386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:42.940288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:42.968109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.968761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.975668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:42.980899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:42.983926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:42.986624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.778432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:43.779244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:43.791403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.791912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.792363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.793088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:43.807270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:43.810689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:43.969262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:43.986962 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-798d95ef-1260-43df-a69e-a9a9ed74d6b2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 1.051817 Aug 30 16:19:44.006890 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1600/3506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:42 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:44.022007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:44.023154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:44.054045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.055480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.056044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.056860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:44.057441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:44.057979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:44.187821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:44.201931 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac4a0fdb-a637-47cb-a6d5-deda3f6b0502 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1295 microversion: 2.1 time: 0.427418 Aug 30 16:19:44.216375 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1907/3507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:43 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1295 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:44.220412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:44.229802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dde8ba0-6162-4bc5-b4a6-92491487da77 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1279 microversion: 2.1 time: 0.219871 Aug 30 16:19:44.230537 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1601/3508] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:44 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:45.025966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:45.027558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:45.035632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.036330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.036898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.037852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.038612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.039118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.235280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:45.236510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:45.244011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.244776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.245411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.246339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.246987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.247577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.387204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:45.396026 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bf8ea6c-5df7-49a6-a319-30f171e6e3d9 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.374003 Aug 30 16:19:45.396615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1908/3509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:45 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:45.402754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:45.403651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:45.413200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:45.416092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.416877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.420635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.421796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:45.422703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:45.423913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:45.452988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:45.468655 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08e8e66e-f102-4278-a393-5fde14dd9b88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1295 microversion: 2.1 time: 0.243701 Aug 30 16:19:45.482333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1602/3510] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:45 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:45.586730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:45.598125 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77f63d71-b8d4-4e63-9b2e-925dd0f3105e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1285 microversion: 2.1 time: 0.200183 Aug 30 16:19:45.599301 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1909/3511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:45 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:46.420201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:46.420831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:46.435124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.435840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.436451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.437338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.449453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.449912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.493698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:46.494964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:46.506658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.512206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.513148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.514117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:46.514848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:46.515510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:46.520465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:47.052456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:47.066657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f7d27c8-363e-4303-857d-451d587d3b6b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.577840 Aug 30 16:19:47.067970 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1910/3512] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:46 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:47.078418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:47.081509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:47.102607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:47.103439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:47.104100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:47.105052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:47.105475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:47.105904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:47.141366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:47.176605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4dc980fc-bf49-41b5-af71-edc51cbe1335 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.758610 Aug 30 16:19:47.179062 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1603/3513] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:46 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:47.286668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:47.299601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd5f5a2e-f831-4d64-9bf9-bd96a8240aae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1285 microversion: 2.1 time: 0.229979 Aug 30 16:19:47.300233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1911/3514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:47 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:47.614067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bf8a7e-634e-4d22-96e0-96daa53b41e0", "tag": "e36ba253-7e6a-4e90-aa46-b365abffda76"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:47.624978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:47.625745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:47.626434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:47.648786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:47.665677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] Creating event network-changed:e36ba253-7e6a-4e90-aa46-b365abffda76 for instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 on n-h1-830883-28 Aug 30 16:19:47.674408 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-743f78c8-8744-4df2-866e-a589f47fc8ed req-824f2e24-8bca-48bd-9039-9ea6a8874c34 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140634 Aug 30 16:19:47.676128 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1604/3515] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:48.089796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.090483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.104436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.106017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.108259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.109579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.110059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.112068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.199848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.200917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.216891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.219835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.220300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.221053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.221521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.222698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.383296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:48.394122 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6e51352-89cf-4899-9fd6-e62e648af229 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.308686 Aug 30 16:19:48.411714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1912/3516] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:48.419241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.421175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.429735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.433237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.434171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.435852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.437549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.438417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.460738 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] HTTP exception thrown: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Request method failure captured: Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e HTTP/1.1 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbF6hlOuiXLCOdbas_6yubL9jRdnpbUTsIOKVY_HcZuYDTsrmZTNpgOZEGn7hU0fqVE2kFvC-JUInKxAd2AB3pn7LRaI6ALvv0WmAyp-eqToEzdlu4paaKeZb5v_sPlBhg5xcDkf-eG4OR_o-Tr7b084Vj5dg27I-Zj22Otq6fL--Y Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}] Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 389b6f29e0274334aa4661e16414797d Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '58f75a19-3870-4167-8aff-a3ded5c7549e'} Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:48.464094 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.470134 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.475308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Returning 404 to user: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:48.476616 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c47d2749-496c-4369-99ca-61e80366e784 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "DELETE /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 404 len: 111 microversion: 2.32 time: 0.063471 Aug 30 16:19:48.478715 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1913/3517] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:19:48 2022] DELETE /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:19:48.484900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.485962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.493237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.494327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.495032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.496029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.496788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.498423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.765746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:48.775584 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0d4e23f-6ae1-4595-aa48-5d6551f9ef8a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.295414 Aug 30 16:19:48.791283 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1914/3518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:48.796031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:48.797129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] [instance: 58f75a19-3870-4167-8aff-a3ded5c7549e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:48.806255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.807162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.807912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.812292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:48.812898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:48.813730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:48.836378 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] HTTP exception thrown: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Request method failure captured: Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e HTTP/1.1 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjbF6hlOuiXLCOdbas_6yubL9jRdnpbUTsIOKVY_HcZuYDTsrmZTNpgOZEGn7hU0fqVE2kFvC-JUInKxAd2AB3pn7LRaI6ALvv0WmAyp-eqToEzdlu4paaKeZb5v_sPlBhg5xcDkf-eG4OR_o-Tr7b084Vj5dg27I-Zj22Otq6fL--Y Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f8fe3a2308cf43d88d7c8f3e954257f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f8fe3a2308cf43d88d7c8f3e954257f7"}]}] Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: f8fe3a2308cf43d88d7c8f3e954257f7 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1425526156 Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 389b6f29e0274334aa4661e16414797d Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TaggedBootDevicesTest-1425526156-project Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '58f75a19-3870-4167-8aff-a3ded5c7549e'} Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.840552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:19:48.846219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] Returning 404 to user: Instance 58f75a19-3870-4167-8aff-a3ded5c7549e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:19:48.848712 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c056e12-ce1f-4987-93c7-273f16dd6289 tempest-TaggedBootDevicesTest-1425526156 tempest-TaggedBootDevicesTest-1425526156-project] 10.222.0.47 "GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e" status: 404 len: 111 microversion: 2.32 time: 0.056452 Aug 30 16:19:48.849763 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1915/3519] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/58f75a19-3870-4167-8aff-a3ded5c7549e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:19:49.417633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:49.418443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:49.434253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.436461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.438724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.440646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.442185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.443879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.484360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:49.499810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0548f145-687e-4ce5-b34c-70f711b62e45 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 1.305966 Aug 30 16:19:49.500428 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1605/3520] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:48 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:49.797171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:49.797892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:49.814823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.816107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.816625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.817433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:49.817955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:49.818635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:49.857868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:49.898340 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0152c8a9-e426-4e0a-a4f2-a0a96bcc608f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.485405 Aug 30 16:19:49.903338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1916/3521] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:49 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:50.521311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:50.523132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:50.526752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:50.546003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.546913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.547607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.548557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.549273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.550540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.610993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:50.622531 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77d4d2f2-5a50-4ffd-aaa0-5869a62870bf tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.829496 Aug 30 16:19:50.623427 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1606/3522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:49 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:50.810553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=16 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:50.849523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:50.862014 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b536a0a-5cc4-4d23-9880-1a1f713250f2 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.344734 Aug 30 16:19:50.863507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1917/3523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:50 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:50.925816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:50.927924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:50.937509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.938284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.938913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:50.943287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:50.963708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:50.964942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.421004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:51.441804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.442434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.448193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.472704 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] Creating event network-changed:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:19:51.497068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f4f20a04-511a-44b7-be98-588a54079dfc req-87be9b74-4ce3-4ce5-b2a5-539dadf0c688 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080358 Aug 30 16:19:51.498714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1918/3524] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:19:51.645286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:51.646682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:51.661924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.663967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.665740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:51.667384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:51.669246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:51.670320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.060680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:52.259926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:52.275634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee07fed5-c423-4c48-90a4-19118aa52474 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.635246 Aug 30 16:19:52.277525 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1919/3525] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:51 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:52.283368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:52.285321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:52.320142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.320975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.323068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.325221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:52.327628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:52.328498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:52.599290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:52.630142 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-97f6a667-4393-4d60-be0d-f3159a220098 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 1.709883 Aug 30 16:19:52.633593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1607/3526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:50 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:52.739393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:52.752919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a311e39-f51f-4502-882f-831b59666a6f tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.471526 Aug 30 16:19:52.754511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1920/3527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:52 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:53.297298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:53.297904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:53.299853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=18 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:19:53.318580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.319336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.319960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.321101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.321778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.322440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.653617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:53.654563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:53.670281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.671120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.671721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.673027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:53.673653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:53.677017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:53.992827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:54.001708 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5af7b694-86da-4697-9c14-a29b6cdf8f21 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.708172 Aug 30 16:19:54.003148 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1608/3528] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:53 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:54.011921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:54.016311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:54.028223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.028727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.029170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.029895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.034077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.035200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.357017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:54.375535 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd5115fa-3366-4e82-b3d8-505b014b2523 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.726385 Aug 30 16:19:54.391615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1921/3529] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:53 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:54.602917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:54.613633 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebcfdcb4-9373-432a-82c1-eee0bb8e19ec tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.608567 Aug 30 16:19:54.615366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1609/3530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:54 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:54.693092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e962c8-c6e0-49e1-888c-c40a348283e4", "tag": "020a8485-a982-43c9-8b46-443b0bb0ab45"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:54.720147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:54.722526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:54.726940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:54.747814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] Creating event network-changed:020a8485-a982-43c9-8b46-443b0bb0ab45 for instance 51e962c8-c6e0-49e1-888c-c40a348283e4 on n-h2-830883-28 Aug 30 16:19:54.755900 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e170cb96-2227-4c4d-8e67-c751a8e4c3fc req-78f12c0d-c94e-4035-a625-602193028172 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067962 Aug 30 16:19:54.757263 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1922/3531] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:55.027646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:55.028521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:55.038811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.041081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.041761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.042996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.043642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.044254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.400066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:55.401056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:55.408649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.409708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.410608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.411577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.412294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.412980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.665796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:55.688629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99da56d6-9a8d-444e-af7b-83de7a8c5068 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.294946 Aug 30 16:19:55.710390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1923/3532] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:55 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:55.716890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:55.718144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:55.729374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.730207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.730963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.731910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:55.732606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:55.733269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:55.987166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:55.997298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-812e2e5d-9dbc-429d-8a5f-dcd703539bb6 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.285445 Aug 30 16:19:56.010818 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1924/3533] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:55 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:56.025127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:56.040865 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd2e368b-06f7-4bf5-bdb7-6a9529653c69 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 1.021512 Aug 30 16:19:56.056602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1610/3534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:55 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:56.665432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bf8a7e-634e-4d22-96e0-96daa53b41e0", "name": "network-vif-plugged", "status": "completed", "tag": "e36ba253-7e6a-4e90-aa46-b365abffda76"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:19:56.677251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.678428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.679124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:56.701020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] Creating event network-vif-plugged:e36ba253-7e6a-4e90-aa46-b365abffda76 for instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 on n-h1-830883-28 Aug 30 16:19:56.731402 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-eee54111-fefa-447a-a6fb-1b592d3f5ca7 req-8d467d49-044c-42c6-8b38-2c9880b85ea2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234834 Aug 30 16:19:56.731626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:56.732102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:56.734623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1925/3535] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:19:56.746451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.747183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.747827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:56.748762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:56.759060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:56.759856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.023151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:57.024207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:57.041479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.043692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.044375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.045609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.046536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.047187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.160071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:57.192346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b306030f-5dc1-495c-85f5-07fed0b1f665 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.460570 Aug 30 16:19:57.194673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1611/3536] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:56 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:57.204844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:57.209207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:57.218631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.219702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.220389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.221386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:57.223685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:57.224575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:57.439938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:57.456555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d59cd2e-63a0-4729-a5cf-6de116582959 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.259317 Aug 30 16:19:57.457164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1612/3537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:57 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:57.543057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:57.555602 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd00aa43-0cf8-46d6-95b3-85e1ca647099 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1315 microversion: 2.1 time: 0.537197 Aug 30 16:19:57.557575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1926/3538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:57 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:19:58.224468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:58.225067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:58.247680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.248454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.251285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.252272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.253021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.255031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.481514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:58.482556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:58.497567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.497978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.498449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.504614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.505196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.505643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.741028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:58.753875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72c06cad-aabf-4c0f-9c61-f782e950f224 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.537312 Aug 30 16:19:58.757122 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1613/3539] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:58 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:58.771308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:58.772235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:58.785583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.786438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.787043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:58.787946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:58.788563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:58.789152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.114259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:59.126805 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf6efbdb-afc9-45ae-9b86-2a7ab937481a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1502 microversion: 2.1 time: 0.368266 Aug 30 16:19:59.128843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1614/3540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:58 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:59.152784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:59.153351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:59.187660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.190387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.192678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.198592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.199228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.199668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.346573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:19:59.434364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:59.451779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35b8a8cf-db5e-4a4a-b119-99a58832a8e1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.973005 Aug 30 16:19:59.455125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1927/3541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:58 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:19:59.551222 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78622462-447a-4684-8a3c-aad30bfc6f4e tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 204 len: 0 microversion: 2.1 time: 0.401098 Aug 30 16:19:59.552906 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1615/3542] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:19:59 2022] DELETE /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:19:59.561929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:59.562779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:59.573743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.574865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.575785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.576673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.577931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.578716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.782421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:19:59.783465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:19:59.797495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.800491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.803967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.804944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:19:59.805657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:19:59.809134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:19:59.914789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:19:59.922878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-485b679b-81bc-4f13-925c-28bde62982bd tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1508 microversion: 2.1 time: 0.365767 Aug 30 16:19:59.939676 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1928/3543] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:59 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:00.479229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:00.480511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:00.481088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:00.492802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d28bd02d-d254-4f0a-b961-1ff407f904c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.717879 Aug 30 16:20:00.493826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.495117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.496726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.498166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.499986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.500167 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1616/3544] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:19:59 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:00.504044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.819669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:00.834183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-305436bd-efc7-46d1-a1f8-c0c5b604fd28 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.360870 Aug 30 16:20:00.841195 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1929/3545] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:00 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:00.951912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:00.952605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:00.964195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.964700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.965143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:00.969102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:00.972464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:00.972914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.515167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:01.516537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:01.525016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.525778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.526384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.527286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.528138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.528691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.536856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:01.836586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:01.848396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58ac4dc3-2828-4165-9661-705c2956f9ac tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.337895 Aug 30 16:20:01.849110 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1930/3546] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:01 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:01.861047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:01.861672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:01.875229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.875731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.876207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:01.879186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:01.881207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:01.881851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.097631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:02.105859 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-270ad6cb-c821-49a5-8a35-0d763880cd5a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1508 microversion: 2.1 time: 1.165540 Aug 30 16:20:02.120717 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1617/3547] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:00 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1508 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:02.207589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:02.228499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f35a88f0-ca11-4e63-abff-e2d5dfafdd3f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.373019 Aug 30 16:20:02.240854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1931/3548] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:01 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:02.873474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:02.874477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:02.896898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.899835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.900647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.903020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.904985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.905919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:02.932660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-plugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:02.961665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:02.964496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:02.965175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.009846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] Creating event network-vif-plugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:20:03.027716 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ccff0ca8-db58-43b5-b79e-e51004c190d0 req-bedaa63a-1132-42be-b22b-22dcb66358b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097958 Aug 30 16:20:03.030878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1932/3549] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:03.132369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:03.133443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:03.158287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.158971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.159620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.160364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.160834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.161300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.348582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:03.362913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-914b4e0a-777a-42bf-a6f3-943c230115e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.494190 Aug 30 16:20:03.363564 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1618/3550] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:02 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:03.371658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:03.375005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:03.388625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.389393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.403045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.404073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:03.404726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:03.405334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:03.490187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:03.504640 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-903e2f62-e5b7-420e-bc59-67599be908d8 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1508 microversion: 2.1 time: 0.376107 Aug 30 16:20:03.507961 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1933/3551] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:03 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:04.386544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:04.387186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:04.394723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.395226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.401475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.402258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.411634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.416791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.801446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:04.810359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68d73e99-1d5b-4185-ba01-d5fc975478d6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1362 microversion: 2.1 time: 0.427917 Aug 30 16:20:04.812354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1934/3552] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:04 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:04.817815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:04.818654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:04.826548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.827749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.828365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.829261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:04.830091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:04.831099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:04.947134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ba3ad8f34540bd9d7b9b8d96ea84ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b00ddbb5c9c4744bec18f7dd2973a2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:04.964944 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3cf54cb1-5499-466f-aefe-e92cafced9bc tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 200 len: 1466 microversion: 2.1 time: 0.151311 Aug 30 16:20:04.968231 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1935/3553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:04 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 1466 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:05.014460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:05.017253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:05.026028 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e1b9d30-3851-47fc-ad08-101c1a2134e8 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 1.661180 Aug 30 16:20:05.027368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1619/3554] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:03 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:05.028624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bf8a7e-634e-4d22-96e0-96daa53b41e0", "name": "network-vif-deleted", "tag": "e36ba253-7e6a-4e90-aa46-b365abffda76"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:05.059007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e962c8-c6e0-49e1-888c-c40a348283e4", "name": "network-vif-plugged", "status": "completed", "tag": "020a8485-a982-43c9-8b46-443b0bb0ab45"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:05.069988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.078931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.079415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.095468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.095986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.096970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.109619 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] Creating event network-vif-deleted:e36ba253-7e6a-4e90-aa46-b365abffda76 for instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 on n-h1-830883-28 Aug 30 16:20:05.125762 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7dddcb21-c31e-497f-92e8-49bd91043aa7 req-b315b0a5-aeed-4c3d-bf92-f4dcc5790ee8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101523 Aug 30 16:20:05.127377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] Creating event network-vif-plugged:020a8485-a982-43c9-8b46-443b0bb0ab45 for instance 51e962c8-c6e0-49e1-888c-c40a348283e4 on n-h2-830883-28 Aug 30 16:20:05.131197 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1936/3555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:05.145092 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a9056dd7-ea0b-4340-b182-7ebf3f932cd0 req-ce7c28ce-0ca1-4048-b44b-944fcf62e4f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089775 Aug 30 16:20:05.156015 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1620/3556] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:05.833824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:05.834569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:05.841010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.841506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.841943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.842663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:05.843122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:05.843544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:05.990556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:05.991374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.004839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.005669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.006388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.007319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.007955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.008610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.043134 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 HTTP/1.1 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '99bf8a7e-634e-4d22-96e0-96daa53b41e0'} Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.046133 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.053104 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.055272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.056349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f063b86-63da-432e-9247-c5688e559c0b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 404 len: 111 microversion: 2.1 time: 0.072170 Aug 30 16:20:06.057472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1621/3557] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:05 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:20:06.064921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.067083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.082569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.084948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.085598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.086744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.087383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.087987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.437673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:06.446657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53eb0a81-a317-43ee-9352-4b15c080ec19 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1548 microversion: 2.1 time: 0.618080 Aug 30 16:20:06.452322 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1937/3558] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:05 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1548 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:06.458054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1195441645", "metadata": {"image_type": "test"}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:06.469663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.483634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.484326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.484885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.485731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.489837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.490424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.508487 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0/action HTTP/1.1 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 112 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1195441645", "metadata": {"image_type": "test"}}} Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '99bf8a7e-634e-4d22-96e0-96daa53b41e0', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1195441645', 'metadata': {'image_type': 'test'}}}} Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1347, in _action_create_image Aug 30 16:20:06.510431 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e342ebbf-a00c-4a28-9375-5b7d20d93b86 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "POST /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0/action" status: 404 len: 111 microversion: 2.1 time: 0.058475 Aug 30 16:20:06.515149 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1938/3559] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Aug 30 16:20:06 2022] POST /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:06.523251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.524562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.530961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.531802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.532452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.533370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.534647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.535541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.658708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:06.668429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f721e9a-99e9-4790-b5d3-114a22648736 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1327 microversion: 2.1 time: 0.609623 Aug 30 16:20:06.672552 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1622/3560] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1327 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:06.678010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1387300928", "metadata": {"image_type": "test"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:06.679326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09cc40e8-e961-4794-b876-b21eff8615a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164345 Aug 30 16:20:06.680487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Failed to fetch instance by id tempest-invalid-1710955548 {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:20:06.683742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance tempest-invalid-1710955548 could not be found. Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/tempest-invalid-1710955548/action HTTP/1.1 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 112 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1387300928", "metadata": {"image_type": "test"}}} Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance tempest-invalid-1710955548 could not be found. Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'tempest-invalid-1710955548', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1387300928', 'metadata': {'image_type': 'test'}}}} Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1710955548 could not be found. Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1347, in _action_create_image Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.685584 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1710955548 could not be found. Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1710955548 could not be found. Aug 30 16:20:06.691184 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.692147 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1939/3561] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:06.707605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance tempest-invalid-1710955548 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.708492 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c2dd6aef-27ed-4f32-b676-d2ab1e36465d tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "POST /compute/v2.1/servers/tempest-invalid-1710955548/action" status: 404 len: 101 microversion: 2.1 time: 0.034763 Aug 30 16:20:06.714614 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1623/3562] 10.222.0.47 () {60 vars in 1249 bytes} [Tue Aug 30 16:20:06 2022] POST /compute/v2.1/servers/tempest-invalid-1710955548/action => generated 101 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:06.724034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1816381670"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:06.733146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:20:06.739621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 57 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: {"createImage": {"name": "tempest-test-snap-1816381670"}} Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1816381670'}}} Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1347, in _action_create_image Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.746334 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.755445 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.760328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.761477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8afec984-ffd8-41f0-9e39-c3042ff69c1b tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.046540 Aug 30 16:20:06.763174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1940/3563] 10.222.0.47 () {60 vars in 1275 bytes} [Tue Aug 30 16:20:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:06.773438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1069662182"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:06.775926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:20:06.776440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 57 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: {"createImage": {"name": "tempest-test-snap-1069662182"}} Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1069662182'}}} Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1347, in _action_create_image Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.778092 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 16:20:06.784741 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.787553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.789381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4936859-02b8-413b-a1a8-924fe83f7ad3 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020293 Aug 30 16:20:06.796543 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1624/3564] 10.222.0.47 () {60 vars in 1281 bytes} [Tue Aug 30 16:20:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:06.801965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.802977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.816851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.817385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.817838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.819833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.820340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.823194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.852183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 HTTP/1.1 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '99bf8a7e-634e-4d22-96e0-96daa53b41e0'} Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.855656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.860198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.861049 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ac79719-1c3f-408c-8db1-c3fef536590a tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "DELETE /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 404 len: 111 microversion: 2.1 time: 0.065334 Aug 30 16:20:06.864804 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1941/3565] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:20:06 2022] DELETE /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:06.872034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:06.872960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] [instance: 99bf8a7e-634e-4d22-96e0-96daa53b41e0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:06.884475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.886219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.886868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.887876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:06.889142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:06.889761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:06.906700 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] HTTP exception thrown: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Request method failure captured: Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 HTTP/1.1 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiWp1Oa_HLFxh8HK_Da148pQvUqlN31A_rE4qlqiaJqZnQmldiNobRLxGWZ_h8KsqQXVG2POEipm53aIvPzzj8BnkDQKDCWAe8vNF3zUH9JI8Xv_s291zyapCSQeYTS4iNCxCvlvAwt4baggWQCrWM-g_HeXpnQzLxtmzXFctf98QE Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3b00ddbb5c9c4744bec18f7dd2973a2f"}]}] Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3b00ddbb5c9c4744bec18f7dd2973a2f Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1642517931 Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 03ba3ad8f34540bd9d7b9b8d96ea84ef Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesNegativeTestJSON-1642517931-project Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '99bf8a7e-634e-4d22-96e0-96daa53b41e0'} Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:06.910096 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. Aug 30 16:20:06.914649 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:06.917503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] Returning 404 to user: Instance 99bf8a7e-634e-4d22-96e0-96daa53b41e0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:06.919482 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-047e9500-3dfa-4880-ba5b-d3ce2f5f46f1 tempest-ImagesNegativeTestJSON-1642517931 tempest-ImagesNegativeTestJSON-1642517931-project] 10.222.0.47 "GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0" status: 404 len: 111 microversion: 2.1 time: 0.053006 Aug 30 16:20:06.921511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1625/3566] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:06 2022] GET /compute/v2.1/servers/99bf8a7e-634e-4d22-96e0-96daa53b41e0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:07.693319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:07.693916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:07.713258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.713763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.714226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:07.717367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:07.717847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:07.718322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.488144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:08.506350 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6cc97935-81e2-45d0-b14d-c8439a9e4005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1509 microversion: 2.1 time: 0.817573 Aug 30 16:20:08.526748 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1942/3567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:07 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1509 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:08.537691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:08.538341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:08.563123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.567335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.567899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:08.568660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:08.569138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:08.569573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.300334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:09.319117 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a29e96c5-4b85-4059-b914-818790f9ec70 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1509 microversion: 2.1 time: 0.791818 Aug 30 16:20:09.321144 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1626/3568] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:08 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1509 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:09.341524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:09.342036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:09.350534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.351035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.351485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.352194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.352660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.353123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.385823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:20:09.518600 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-13f31638-802b-49c0-ab71-d5e33c733c37 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 204 len: 0 microversion: 2.1 time: 0.180315 Aug 30 16:20:09.519736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1943/3569] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:20:09 2022] DELETE /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:20:09.533168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:09.535446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:09.544359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.545666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.546371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.547364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:09.548034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:09.548668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:09.997297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:10.014681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:10.020068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:10.020533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:10.020988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:10.029271 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f56e34d-c6f8-46b2-bb54-73d823ecdd1e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1515 microversion: 2.1 time: 0.505475 Aug 30 16:20:10.036183 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1627/3570] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:09 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1515 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:10.044801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] Creating event network-changed:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:20:10.050403 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-41168c73-d929-49a1-a412-671af4f1faaa req-3812639a-ddb7-4394-a241-8e7ef74bd816 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057565 Aug 30 16:20:10.059208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1944/3571] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:20:11.060121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:11.060754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:11.084574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.085104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.085558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:11.086289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:11.086780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:11.087214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:12.269653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:12.280190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e524b6e7-7468-49d4-a7fb-42674a778c5c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1515 microversion: 2.1 time: 1.227105 Aug 30 16:20:12.291384 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1628/3572] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:11 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1515 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:13.311487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:13.312346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:13.332812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.333395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.333855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.335755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:13.336913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:13.337381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:13.624968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:13.646636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9780203c-801a-4e2d-99e9-68e1d8fc7209 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1515 microversion: 2.1 time: 0.346326 Aug 30 16:20:13.647240 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1945/3573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:13 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:14.582749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e962c8-c6e0-49e1-888c-c40a348283e4", "name": "network-vif-deleted", "tag": "020a8485-a982-43c9-8b46-443b0bb0ab45"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:14.620957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:14.629936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.630517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.647528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.667775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:14.669028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:14.675589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] Creating event network-vif-deleted:020a8485-a982-43c9-8b46-443b0bb0ab45 for instance 51e962c8-c6e0-49e1-888c-c40a348283e4 on n-h2-830883-28 Aug 30 16:20:14.689411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.690459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.691248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.692127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:14.692538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:14.692981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:14.699316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-406c6fe2-8769-4f1e-82d1-c7e9b055e351 req-6651eeed-1a1f-4745-8441-bcbd7cddbd1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121255 Aug 30 16:20:14.700259 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1629/3574] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:15.043143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:15.053018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc064e25-c0d0-4d25-8113-da72ece6fec6 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 200 len: 1312 microversion: 2.1 time: 0.389347 Aug 30 16:20:15.058758 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1946/3575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:14 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:16.074207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:16.076632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:16.094450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.097606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.098322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.101676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:16.103774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:16.104443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:16.143486 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 HTTP/1.1 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '51e962c8-c6e0-49e1-888c-c40a348283e4'} Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:16.148781 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:20:16.154477 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:16.159793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:16.160952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4832a94b-aada-44ea-9b19-155cd175186c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 404 len: 111 microversion: 2.1 time: 0.091339 Aug 30 16:20:16.162070 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1630/3576] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:16 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:20:16.170186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da4e1404-7b68-45cb-a418-c6a38af46c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '.version_select at 0x7fd357e58280>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:16.194616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:16.220777 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da4e1404-7b68-45cb-a418-c6a38af46c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-key-1969259102" status: 202 len: 0 microversion: 2.1 time: 0.054459 Aug 30 16:20:16.222423 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1947/3577] 10.222.0.47 () {58 vars in 1209 bytes} [Tue Aug 30 16:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1969259102 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:20:16.437657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1805083060", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:16.572296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:17.777597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:20:17.778271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:20:17.779050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:20:17.780063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:20:17.780691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:20:17.803108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.803610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.805274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.807836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:17.808480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:17.809006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:17.860653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:20:17.904983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:20:17.932045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:20:17.936602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:20:18.029119 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af16e012-e36f-4402-801d-7c2fa5ea34c2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593609 Aug 30 16:20:18.029730 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1631/3578] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:20:18.045260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5217980f-1049-4354-bbd2-59336a93c405 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:18.046381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5217980f-1049-4354-bbd2-59336a93c405 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:18.153090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5217980f-1049-4354-bbd2-59336a93c405 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:18.163537 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5217980f-1049-4354-bbd2-59336a93c405 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1209 microversion: 2.1 time: 0.124154 Aug 30 16:20:18.167402 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1948/3579] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:18 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:19.212861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:19.213727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:19.249093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.258332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.260848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.276445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:19.278732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:19.279164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:19.508267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:19.526438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d73b6b6-95be-4b12-b1c4-ef4342314cdb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1205 microversion: 2.1 time: 0.334322 Aug 30 16:20:19.528932 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1632/3580] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:19 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1205 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:20.553875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:20.554555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:20.574465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.574764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.575217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.581424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:20.581958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:20.584525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:20.890141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:20.906036 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e550e4a3-1da2-4742-89d7-cbc93077403d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1267 microversion: 2.1 time: 0.357559 Aug 30 16:20:20.909924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1949/3581] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:20 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:21.556337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17eaf61f-840f-4433-99ec-781b0e1d90ad tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:21.565915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17eaf61f-840f-4433-99ec-781b0e1d90ad tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.473877 Aug 30 16:20:21.577319 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1633/3582] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:20:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:21.931962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:21.942585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:21.965575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.968881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.970412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:21.974050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:21.975887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:21.976413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:22.139407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:22.153362 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2ee2b9a-a65b-4f35-850f-e6d5ad889e4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1267 microversion: 2.1 time: 0.225860 Aug 30 16:20:22.173902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1950/3583] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:21 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:22.405577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1424481833", "imageRef": "f7d58651-7ff0-420c-b6e3-b7a7983d7f8c", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:22.475897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:23.184495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:23.187843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:23.219691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.220537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.223160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.224191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:23.226031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:23.226811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:23.318526 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] Request method failure captured: Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 143 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjEvYBMWSry7pH7Su8XAN_mgRr2Qe1pCx09RwgKipMMaE--JYcm779EU9BDVYYbJ-PC7b5R61PO2ZbuebFhmyWKj72rGDOl01ia9dQ2tUkqK4O52ODEz2Nb2Npl2qVf_NCIIyLxAz5VD2UJcgrBh1EXbQreur3xk-t5x5oxeLQjJcg Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: edd9c95f1fb1473dace371d8855fee98 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-FlavorsV2NegativeTest-1258528378 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/edd9c95f1fb1473dace371d8855fee98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_edd9c95f1fb1473dace371d8855fee98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/edd9c95f1fb1473dace371d8855fee98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/edd9c95f1fb1473dace371d8855fee98"}]}] Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-FlavorsV2NegativeTest-1258528378 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: edd9c95f1fb1473dace371d8855fee98 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1258528378 Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-FlavorsV2NegativeTest-1258528378-project Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 112ccd3e5dce427fa1a1d40349e2b17f Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-FlavorsV2NegativeTest-1258528378-project Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1424481833", "imageRef": "f7d58651-7ff0-420c-b6e3-b7a7983d7f8c", "flavorRef": "452"}} Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: exception: Flavor's memory is too small for requested image. Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1424481833', 'imageRef': 'f7d58651-7ff0-420c-b6e3-b7a7983d7f8c', 'flavorRef': '452'}}} Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:23.320311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16fa6c34-c8a7-42ef-b519-5bf53d4cbb50 tempest-FlavorsV2NegativeTest-1258528378 tempest-FlavorsV2NegativeTest-1258528378-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.921689 Aug 30 16:20:23.325398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1634/3584] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:22 2022] POST /compute/v2.1/servers => generated 93 bytes in 923 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:20:23.649229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:23.654878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:23.672503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f13c3536-e846-4b3c-a63a-99559ceaccd5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 0.499928 Aug 30 16:20:23.673747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1951/3585] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:23 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:24.699625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:24.700094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:24.719121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.720569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.722285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:24.723615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:24.724360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:24.725018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:25.884907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:25.899011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3030f0d0-d737-42f6-ba1e-5d21e8431156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 1.209337 Aug 30 16:20:25.921647 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1635/3586] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:24 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:26.512287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe181eb7-9350-429d-bbed-ea16bf037911", "tag": "8295a932-75c2-4274-84d8-50512e32fae8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:26.571520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.574752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.576333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.632757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] Creating event network-changed:8295a932-75c2-4274-84d8-50512e32fae8 for instance fe181eb7-9350-429d-bbed-ea16bf037911 on n-h2-830883-28 Aug 30 16:20:26.657299 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-82b84c4d-a862-4ff8-b258-29a254416837 req-92e2d47b-4c1c-4652-a4f1-db69a0ec3c50 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149753 Aug 30 16:20:26.659507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1952/3587] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:26.922358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:26.926896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:26.959279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.962499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.968839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:26.970243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:26.970916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:26.972996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:27.827676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:27.925243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:28.744108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:28.767714 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3010b9be-dae0-454f-b990-d77eb0c1d63a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 1.849417 Aug 30 16:20:28.768742 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1636/3588] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:26 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:29.798060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:29.804564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:29.807299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:29.841672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.842733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.845468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:29.847192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:29.849032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:29.849721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:30.937246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:30.950093 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dcc5e2e7-04a4-481c-99f3-1a8f42f64192 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 1.151975 Aug 30 16:20:30.950952 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1953/3589] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:29 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:31.976842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:31.977719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:31.990407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:31.994894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:31.996612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:32.000073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:32.003291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:32.004285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:32.708882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:32.718187 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1150a4d2-67a2-496e-8b26-c4bccd9a1804 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 0.745424 Aug 30 16:20:32.724467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1637/3590] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:31 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:33.198217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1266752259", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "e8608350-4e18-447f-b2d0-f6df04a4a834"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:33.343741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] validate_networks() for [('e8608350-4e18-447f-b2d0-f6df04a4a834', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:33.744223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:33.744975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:33.759581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:33.763768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:33.771019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:33.782247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:33.782939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:33.784444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.001305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:20:34.002057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:20:34.003675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:20:34.004285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:20:34.004879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:20:34.020325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:34.021145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:34.021764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.022958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:34.023592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:34.024365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.050270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:20:34.057054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for user e34a71bf74dd4f0aba0a8001d6011f2b and project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:20:34.073504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:20:34.076162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:20:34.165417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01a031fd-0c6a-4368-9b60-f58391abeb36 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667112 Aug 30 16:20:34.167354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1954/3591] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:20:34.202064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02dff619-2697-48a6-9263-1b00a246e808 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:34.203871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02dff619-2697-48a6-9263-1b00a246e808 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:34.379379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02dff619-2697-48a6-9263-1b00a246e808 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:34.411889 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02dff619-2697-48a6-9263-1b00a246e808 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1225 microversion: 2.1 time: 0.216895 Aug 30 16:20:34.414726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1955/3592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:34 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:34.493106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:34.495023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:34.517789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:34.522153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:34.523114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.525491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:34.527581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:34.528297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:34.597583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb8dafea-7953-47d5-9b4a-4a13837107b3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/ips" status: 200 len: 145 microversion: 2.1 time: 0.143446 Aug 30 16:20:34.607658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:34.613623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1956/3593] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:20:34 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/ips => generated 145 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:34.639591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6fffa355-bac9-45db-b188-c594bb17afd9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 0.899521 Aug 30 16:20:34.640192 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1638/3594] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:33 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:35.432938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-382ab5b8-4bed-4c16-82a6-b0c020bd9d84 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:35.434240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-382ab5b8-4bed-4c16-82a6-b0c020bd9d84 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:35.612846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-382ab5b8-4bed-4c16-82a6-b0c020bd9d84 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:35.636499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-382ab5b8-4bed-4c16-82a6-b0c020bd9d84 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1225 microversion: 2.1 time: 0.207299 Aug 30 16:20:35.642608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1957/3595] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:35 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1225 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:35.665800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:35.667436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:35.693300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:35.695058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:35.699520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:35.703289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:35.704240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:35.705084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:36.144392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:36.150999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=72 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:36.163292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ff13cb3-e99f-454f-a3f1-12b2f3cf79f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 0.495302 Aug 30 16:20:36.178517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1639/3596] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:35 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:36.662579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:36.663477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:36.680832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:36.687175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:36.688637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:36.695223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:36.696219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:36.696904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:36.876595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:36.890183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-599232d1-cf6b-4175-8cb3-b10b2c753d7d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1285 microversion: 2.1 time: 0.231529 Aug 30 16:20:36.899433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1958/3597] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:36 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:37.194148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:37.194957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:37.213628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.214531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.215301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:37.216230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.216868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.217481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:37.285760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:37.286417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:37.302367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.303509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.306084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:37.307109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:37.317968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:37.321123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.209215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:38.236117 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aae289e9-527a-473a-b0b7-6abd777b7472 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.948281 Aug 30 16:20:38.237623 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1959/3598] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:38.247466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe181eb7-9350-429d-bbed-ea16bf037911", "name": "network-vif-plugged", "status": "completed", "tag": "8295a932-75c2-4274-84d8-50512e32fae8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:38.293555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.294280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.301552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.351071 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] Creating event network-vif-plugged:8295a932-75c2-4274-84d8-50512e32fae8 for instance fe181eb7-9350-429d-bbed-ea16bf037911 on n-h2-830883-28 Aug 30 16:20:38.375978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9cce294e-a4d2-4f56-8000-d52e988d697a req-dd6f98b6-fd7e-4b6c-90e2-09633f453490 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134913 Aug 30 16:20:38.383222 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1960/3599] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:38.390519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:38.391247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:38.410993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.414427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.415230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.419919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.420685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.423477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.560812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:38.573247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2fbd934-6aba-4b19-b517-ed839c217bfc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 1.384478 Aug 30 16:20:38.587191 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1640/3600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:37 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:38.602982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:38.605312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:38.623231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.624002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.624629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:38.625742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:38.626486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:38.627760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.121097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:39.137187 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3637a755-2810-4f06-aae4-ca0a7dfd46a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.545679 Aug 30 16:20:39.142929 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1641/3601] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:38 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:39.158930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:39.160114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:39.176299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.177086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.179287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.179999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:39.180245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.180748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.181268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.193578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-895992a0-3a38-432a-ae5e-e8c08c34b3e6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1283 microversion: 2.1 time: 0.807303 Aug 30 16:20:39.196902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1961/3602] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:38 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1283 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:39.600146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:39.600794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:39.608542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.609297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.610376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.612090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.612751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.614144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.650648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:39.665722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-22ca0315-6c28-402d-ad45-5909464d901d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.511056 Aug 30 16:20:39.667731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1642/3603] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:39.693052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1985345018"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:39.696251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:39.703424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.704239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.704896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:39.706802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:39.707542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:39.708186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.048200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b56fffe-8442-4ec2-ac6f-b7886617a519 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.359658 Aug 30 16:20:40.050382 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1643/3604] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:20:39 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 30 16:20:40.057397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19977a52-9192-4671-bd79-4d445519f76f"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:40.073792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:40.097745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:40.098255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:40.098715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.106993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:40.108547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:40.112122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.352379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:40.360907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-167def47-397c-4e1f-801c-cad935ca9919 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1309 microversion: 2.1 time: 0.766294 Aug 30 16:20:40.361986 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1962/3605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:39 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1309 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:40.379801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:40.380822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:40.387865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:40.388850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:40.389640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.390773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:40.391403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:40.392009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:40.763595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-389cdd27-8d7e-4024-a2c2-62465a24b12c tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709266 Aug 30 16:20:40.766624 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1644/3606] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:20:40 2022] POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:41.241207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:41.262935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c782c96d-a322-4f15-87f1-634b4be85791 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.896424 Aug 30 16:20:41.269747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1963/3607] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:40 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:41.384664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:41.385514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:41.424915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.428740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.429429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:41.431920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:41.437450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:41.440154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.292843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:42.293512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:42.320016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.321098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.339339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.340474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:42.341172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:42.341905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:42.755368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:42.764816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3bd80176-e7c5-4615-ac0b-5ecca09cbb3d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.478846 Aug 30 16:20:42.769967 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1964/3608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:42 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:43.018625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:43.052559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-79745e64-e8be-400a-a542-079575003725 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1490 microversion: 2.1 time: 1.673395 Aug 30 16:20:43.060827 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1645/3609] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:41 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1490 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:43.389283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1805083060", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:43.543530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:20:43.790962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:43.791948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:43.818546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:43.825530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:43.827040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:43.830021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:43.831600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:43.837284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:44.041906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:44.224284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:44.253197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ea12466-bee7-47f8-878f-95eff7d85c9b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.467806 Aug 30 16:20:44.260224 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1646/3610] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:43 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:45.279766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:45.280658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:45.308992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:45.309596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:45.310057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:45.312421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:45.313309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:45.313754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:45.625879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:46.776456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:20:46.777114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:20:46.777356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:20:46.777967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:20:46.778593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:20:46.802399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:46.802902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:46.803342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:46.809240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:46.816477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:46.819176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:46.862672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:20:46.893095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:20:46.932027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:20:46.941588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:20:47.003687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:47.013039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c53bcd5-f0ee-4abb-bd76-40532194ea01 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 1.738271 Aug 30 16:20:47.036021 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1647/3611] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:45 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:47.072069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-370df08f-ce2d-434e-aaec-fb84d720bc3e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.683443 Aug 30 16:20:47.084685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e8eb460-91e6-44f9-9562-db93ce699b73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:47.086000 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1965/3612] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:20:47.091241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e8eb460-91e6-44f9-9562-db93ce699b73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:47.093407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:47.640056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e8eb460-91e6-44f9-9562-db93ce699b73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:47.656657 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e8eb460-91e6-44f9-9562-db93ce699b73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1209 microversion: 2.1 time: 0.575784 Aug 30 16:20:47.677704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1648/3613] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:47 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1209 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:48.057179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:48.057805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:48.085001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:48.097377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.099030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.103052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.106432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.112983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.113830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.688793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:48.689997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:48.715854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.719953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.722054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.727091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:48.729290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:48.731255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:48.911206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:48.921968 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b436abc0-1f36-4581-8878-0d744049ec28 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.869115 Aug 30 16:20:48.946941 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1966/3614] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:48 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:48.992433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750ddea4-f849-4516-8272-ae410a6b1673", "tag": "f0c3b498-3a43-45ff-adb5-c2f51ec60254"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:49.065567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:49.066221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:49.066643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:49.140442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] Creating event network-changed:f0c3b498-3a43-45ff-adb5-c2f51ec60254 for instance 750ddea4-f849-4516-8272-ae410a6b1673 on n-h1-830883-28 Aug 30 16:20:49.155915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bdd87dec-6496-4d83-a572-f4c383db82d1 req-21bdee4f-0224-4b00-9693-32ff5b67676f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202870 Aug 30 16:20:49.157030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1967/3615] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:49.353793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:49.366442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f7609b8-3d6a-4d05-a894-097013c4b45a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1205 microversion: 2.1 time: 0.683953 Aug 30 16:20:49.372662 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1649/3616] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:48 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1205 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:49.958940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:49.959981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:49.974451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.001338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.005504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.007945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.011314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.015794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.389159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:50.389784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:50.402366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.405006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.405824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.408412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:50.410858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:50.411362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:50.712069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:50.727731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bf722d5c-25f5-45d3-af41-af4a050ef1dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.774114 Aug 30 16:20:50.735924 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1968/3617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:49 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:20:51.225810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-plugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:51.272331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:51.272834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:51.273283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:51.309142 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] Creating event network-vif-plugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:20:51.310416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:51.323374 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5d2140b4-8e87-42bb-8bf5-329b46f591b5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1267 microversion: 2.1 time: 0.937824 Aug 30 16:20:51.325235 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1650/3618] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:50 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1267 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:51.326011 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4c9c4828-f91a-4be8-afd4-5484cc167a12 req-c836c8be-694f-4640-909f-0cc711b41fd2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102233 Aug 30 16:20:51.331863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1969/3619] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:51.761638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:51.762723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:51.781739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:51.782850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:51.784729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:51.785578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:51.789744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:51.792967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:52.561485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-873ab0be-a081-4065-99fd-f7b1ec47c6ed tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Action: 'create', calling method: .version_select at 0x7fd357e763a0>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:54.219995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:54.238337 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02066051-da01-41fd-bba1-a45bb0cd464d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 2.476884 Aug 30 16:20:54.259307 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1651/3620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:51 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:54.293563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:54.294184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:54.348554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:54.353642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:54.354192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:54.357808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:54.364599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:54.365240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:55.672083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:55.681136 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d361c8b6-62c1-43db-8d84-e3b60f1b92a7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 1.416138 Aug 30 16:20:55.686642 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1652/3621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:54 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:55.702736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:55.703447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:55.718059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:55.718592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:55.719549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:55.720300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:55.721424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:55.724226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:56.781255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:56.794881 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48a9dd9d-02fc-4c15-81e1-4bca5fb87194 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 1.106944 Aug 30 16:20:56.796236 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1653/3622] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:55 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:56.803384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:56.804508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:56.834011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:56.836400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:56.838568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:56.839108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:56.839878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:56.840493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:56.840930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:56.920946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:57.653492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:58.091338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-873ab0be-a081-4065-99fd-f7b1ec47c6ed tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.016283 Aug 30 16:20:58.093065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1970/3623] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:20:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:58.098608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:58.099569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:58.169794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:58.174569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:58.180010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:58.182031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:58.185874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:58.192587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:58.212464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=71 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:58.467619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:58.470237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:20:58.484273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44700e1f-5a6d-4b23-8898-01e9504c28fd tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 1.685514 Aug 30 16:20:58.493829 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1654/3624] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:56 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:58.515142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb03c86f-431d-4ba4-8024-c676c759bc2b tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Action: 'create', calling method: .version_select at 0x7fd35c260700>, body: {"pool": null} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:59.309515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:20:59.327111 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bfbfdf5-3519-40e4-a5fb-731aaddf7876 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 1.231337 Aug 30 16:20:59.330560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1971/3625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:58 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:20:59.349394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750ddea4-f849-4516-8272-ae410a6b1673", "name": "network-vif-plugged", "status": "completed", "tag": "f0c3b498-3a43-45ff-adb5-c2f51ec60254"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:20:59.384182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:59.386244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:59.387053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:59.414663 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] Creating event network-vif-plugged:f0c3b498-3a43-45ff-adb5-c2f51ec60254 for instance 750ddea4-f849-4516-8272-ae410a6b1673 on n-h1-830883-28 Aug 30 16:20:59.440032 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9508dffd-f3eb-4eef-bbb5-3d54b6cf6044 req-eeb7498e-22b9-4040-91f1-903286db96ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106376 Aug 30 16:20:59.441537 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1972/3626] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:20:59.519872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:20:59.522049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:20:59.545899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:59.546843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:59.547769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:20:59.565848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:20:59.567077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:20:59.567553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:00.010863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:00.021996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-def39bea-208e-4bc8-b28b-5cf7b5ada4b0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.516749 Aug 30 16:21:00.023785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1973/3627] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:20:59 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:00.123165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d173a4b6-4322-437f-9644-9dd981a26dbb", "tag": "6033132e-739c-4eef-9577-565ffcd37530"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:00.169515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:00.170748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:00.190785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:00.227825 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] Creating event network-changed:6033132e-739c-4eef-9577-565ffcd37530 for instance d173a4b6-4322-437f-9644-9dd981a26dbb on n-h2-830883-28 Aug 30 16:21:00.242009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ad7352da-4ebf-4439-9bb7-5cf4ff1e00c8 req-0546efd7-9c9f-47bb-ab98-b1f135ac45de service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128483 Aug 30 16:21:00.243791 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1974/3628] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:21:00.367975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:00.370180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:00.394120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:00.398892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:00.399713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:00.414186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:00.415271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:00.418408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.104723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:01.122679 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b1e2d3c-f176-4f41-9a28-cf9d5464339c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1325 microversion: 2.1 time: 0.768406 Aug 30 16:21:01.124681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1975/3629] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:00 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:01.135679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:01.161451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:01.162133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:01.164285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.320467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:21:01.441075 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc4173aa-4c21-4eaa-a3bd-8e1a8caf8531 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.311880 Aug 30 16:21:01.445010 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1976/3630] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:01 2022] POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:01.465957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:01.466987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:01.478981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:01.479693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:01.480319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.482018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:01.482718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:01.483319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.792450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:01.803128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a19a509a-a62f-4c23-8789-e79ba173f37f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.352731 Aug 30 16:21:01.810166 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1977/3631] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:01 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:01.815520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:01.819935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:01.836534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:01.838898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:01.841455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:01.844689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:01.846140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:01.848254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:02.566340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:02.580567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-39372972-d097-44f1-8aab-9f243a0fe52a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.768873 Aug 30 16:21:02.595310 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1978/3632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:01 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:02.600846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:02.601471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:02.629964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:02.630494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:02.630934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:02.631637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:02.632093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:02.632521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.034851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:03.047267 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69b26342-7e5d-4653-8dba-34d2bec92010 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.447852 Aug 30 16:21:03.048241 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1979/3633] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:02 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:03.055361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:03.055903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:03.077577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.078006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.078474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.079392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.080061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.080656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.316457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:03.338531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2248362-9d50-4e83-a75e-70af8dda8d14 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.286978 Aug 30 16:21:03.347216 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1980/3634] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:03 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:03.354128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:03.365340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:03.376102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.379476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.379932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.380658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.381109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.384068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.678638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:03.692961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-450f11e5-7d72-4fc1-8521-567a74a0f256 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.344337 Aug 30 16:21:03.708439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1981/3635] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:03 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:03.732068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:03.733423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:03.769257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.773455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.774695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:03.778586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:03.779346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:03.780024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.183132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:04.197221 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a23c5496-e11d-41cc-8ee2-689cdc28a9d1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.487185 Aug 30 16:21:04.198376 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1982/3636] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:03 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:04.210670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e91134b0-fc57-4e54-a685-3e8d7c55a4eb tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345455645", "metadata": {"": ""}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e91134b0-fc57-4e54-a685-3e8d7c55a4eb tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action HTTP/1.1 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 107 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1345455645", "metadata": {"": ""}}} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1345455645', 'metadata': {'': ''}}}} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'': ''} Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:21:04.215113 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:04.222852 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:04.226337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e91134b0-fc57-4e54-a685-3e8d7c55a4eb tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:04.228975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e91134b0-fc57-4e54-a685-3e8d7c55a4eb tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action" status: 400 len: 170 microversion: 2.1 time: 0.028287 Aug 30 16:21:04.229662 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1983/3637] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Aug 30 16:21:04 2022] POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action => generated 170 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:21:04.243656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:04.245146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:04.255955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.256704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.257354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.258434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.259937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.260701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.515529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:04.527230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6c2061e-f0cf-4066-b091-222e0f9b8cda tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.287753 Aug 30 16:21:04.530268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1984/3638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:04 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:04.560775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:04.563553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:04.582081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.583098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.583764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.584690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.585164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.590291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.837563 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb03c86f-431d-4ba4-8024-c676c759bc2b tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.342014 Aug 30 16:21:04.838886 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1655/3639] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:20:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:04.854136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:04.858271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:04.880040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.882870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.883884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.885020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:04.887094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:04.888867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:04.974962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:05.005543 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14db3ece-b68e-4cc1-9b60-7d67eced8c79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.454499 Aug 30 16:21:05.011607 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1985/3640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:04 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:05.060621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7fb7a09-cf87-421d-82bd-9761f503cc1e tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Action: 'create', calling method: .version_select at 0x7fd357e130d0>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:05.326140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:05.340051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04b97cfd-7f36-41c5-af5c-a69a3664debc tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.499768 Aug 30 16:21:05.360031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1656/3641] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:04 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:05.365864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:05.369815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:05.384163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:05.386938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:05.387651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:05.393916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:05.394831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:05.395625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:05.956022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:05.965185 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f24df734-84be-421c-98de-31839c113458 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.603102 Aug 30 16:21:05.975086 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1657/3642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:05 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:05.980205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33ea383a-bc4d-4e65-abde-c87172095cee tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761905926", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33ea383a-bc4d-4e65-abde-c87172095cee tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action HTTP/1.1 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 619 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1761905926", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1761905926', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:21:05.990762 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 16:21:05.994529 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:05.998820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33ea383a-bc4d-4e65-abde-c87172095cee tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:06.006965 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33ea383a-bc4d-4e65-abde-c87172095cee tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action" status: 400 len: 938 microversion: 2.1 time: 0.022873 Aug 30 16:21:06.007759 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1658/3643] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Aug 30 16:21:05 2022] POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action => generated 938 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:21:06.016502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:06.018091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:06.042703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:06.043208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:06.043657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:06.044377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:06.044838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:06.045263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:06.669048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:06.679989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-75c09a91-3f5a-4872-aea3-a095c38f6ccf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.667609 Aug 30 16:21:06.705270 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1659/3644] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:06 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:06.717293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:06.717921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:06.733870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:06.734479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:06.734919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:06.735681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:06.739442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:06.739919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.852742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:07.865776 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6fd21a62-dd45-4d5a-8fbb-bb77a2cf471b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 1.158711 Aug 30 16:21:07.884061 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1660/3645] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:06 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:07.898004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:07.902037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:07.920146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.920938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.923281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:07.926255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:07.931435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:07.932095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:08.411568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:08.440231 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-471c3b26-d36c-4556-9f65-353c8797bc9e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.553352 Aug 30 16:21:08.441623 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1661/3646] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:07 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:08.459755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:08.462000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:08.476222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:08.477359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:08.478622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:08.479570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:08.480261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:08.480888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:08.809084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:08.818015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebf3bf8e-fa01-4d3f-bc7b-2461e7ca9e78 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.375110 Aug 30 16:21:08.822469 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1662/3647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:08 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:08.828070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a89c63c6-cc91-4300-b17a-4b7e51399e5e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a89c63c6-cc91-4300-b17a-4b7e51399e5e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action HTTP/1.1 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 285 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:08.832624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:21:08.837292 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:08.842775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a89c63c6-cc91-4300-b17a-4b7e51399e5e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:08.844768 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a89c63c6-cc91-4300-b17a-4b7e51399e5e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action" status: 400 len: 619 microversion: 2.1 time: 0.020371 Aug 30 16:21:08.846810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1663/3648] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Aug 30 16:21:08 2022] POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:21:08.856511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:08.857876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:08.867787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:08.868819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:08.869542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:08.870578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:08.871273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:08.871973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.106511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:09.123322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3a73307-4e72-45e7-835c-fc4c199ee105 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.270877 Aug 30 16:21:09.124669 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1664/3649] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:08 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:09.144880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:09.145910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:09.162346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.167104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.167897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.169194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.169907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.170644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.587815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7fb7a09-cf87-421d-82bd-9761f503cc1e tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.554624 Aug 30 16:21:09.588428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1986/3650] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:21:05 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:09.607203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:09.608624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:09.623556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.631569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.633770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.635403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:09.643025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:09.645055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:09.910196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:09.926391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-734359fe-8956-4427-84f9-6ea276ed630b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.317496 Aug 30 16:21:09.927813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1987/3651] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:09 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:09.939744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5aad56b6-e2b3-43ac-8913-3ebf8cc10dfe tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Action: 'create', calling method: .version_select at 0x7fd35c4d63a0>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:10.334040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:10.343481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b891daa-beaa-4b09-ac61-241cfb310af3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 1.216168 Aug 30 16:21:10.344069 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1665/3652] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:09 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:10.367099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:10.368096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:10.390383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.391080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.391841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:10.392842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.393305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.393738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:10.729548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:10.739064 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a33e109-bea9-4e8c-b8a4-b8eed897011a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.387625 Aug 30 16:21:10.753280 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1666/3653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:10 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:10.769387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1145224792"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:10.771940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:10.819427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.820273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.820928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:10.830125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:10.831432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:10.832071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:11.464080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-564adc02-46ca-40ba-8815-d07607c45db8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action" status: 202 len: 0 microversion: 2.1 time: 0.695547 Aug 30 16:21:11.465596 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1667/3654] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:10 2022] POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:21:11.481423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:11.484579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:11.504439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:11.508168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:11.514257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:11.516570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:11.518600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:11.523245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.206682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:12.240496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90a5c302-9756-46bc-855e-42a1234d87e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.771368 Aug 30 16:21:12.241418 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1668/3655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:11 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:12.263445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2109010247"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:12.271348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:12.278780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.279570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.280242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.283738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.284580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.285365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.333840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Cannot 'createImage' instance 750ddea4-f849-4516-8272-ae410a6b1673 while it is in task_state image_snapshot Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action HTTP/1.1 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 85 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2109010247"}} Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'createImage' instance 750ddea4-f849-4516-8272-ae410a6b1673 while it is in task_state image_snapshot Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2109010247'}}} Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1377, in _action_create_image Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 750ddea4-f849-4516-8272-ae410a6b1673 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1382, in _action_create_image Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:21:12.336116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 750ddea4-f849-4516-8272-ae410a6b1673 while it is in task_state image_snapshot Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 750ddea4-f849-4516-8272-ae410a6b1673 while it is in task_state image_snapshot Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 409 to user: Cannot 'createImage' instance 750ddea4-f849-4516-8272-ae410a6b1673 while it is in task_state image_snapshot {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34b17a8d-75b5-479b-a298-6effabb84a5c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action" status: 409 len: 159 microversion: 2.1 time: 0.083512 Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1669/3656] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:12 2022] POST /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673/action => generated 159 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:12.407355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:12.414156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:12.974690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:12.990745 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37429dc0-35a3-4cc1-a9d9-3c0e8333bff2 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.645593 Aug 30 16:21:12.991918 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1670/3657] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:12 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:13.016855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-451a4156-0336-4310-9978-88edf2391885 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd35cdc3280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:13.275121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-451a4156-0336-4310-9978-88edf2391885 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/images/85832d2e-ed8f-469e-a254-784b3607a3ab" status: 204 len: 0 microversion: 2.1 time: 0.281880 Aug 30 16:21:13.275814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1671/3658] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:12 2022] DELETE /compute/v2.1/images/85832d2e-ed8f-469e-a254-784b3607a3ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:13.281095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d173a4b6-4322-437f-9644-9dd981a26dbb", "name": "network-vif-plugged", "status": "completed", "tag": "6033132e-739c-4eef-9577-565ffcd37530"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:13.305378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:13.308529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:13.310731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:13.346424 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] Creating event network-vif-plugged:6033132e-739c-4eef-9577-565ffcd37530 for instance d173a4b6-4322-437f-9644-9dd981a26dbb on n-h2-830883-28 Aug 30 16:21:13.358678 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-df43be5c-0c9c-47b8-b50e-09d96118813f req-6b89c2a0-3eee-43d1-b970-6982a2cb2cce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078983 Aug 30 16:21:13.359644 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1672/3659] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:13.374772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:13.378354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:13.401643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:13.402633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:13.403473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:13.407024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:13.409457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:13.410727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:13.941613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:13.984664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4f3aa95-dc08-43f1-9ea2-ab5786a4cf88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1309 microversion: 2.1 time: 0.620947 Aug 30 16:21:13.995789 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1673/3660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:13 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1309 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:13.995789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:14.026455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:14.053516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:14.054049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:14.054532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:14.058735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:14.061087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:14.062263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:15.130503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:15.134494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:15.165911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e056eda-12a3-4615-b4e6-bc19b489fe3c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1540 microversion: 2.1 time: 1.165558 Aug 30 16:21:15.170917 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1674/3661] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:13 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1540 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:15.196521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:15.229174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:15.272573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:15.274507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:15.276777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:15.277841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:15.280160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:15.281255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.121138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.135567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b51add0-bf9b-43a5-84ec-acdf1454005d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1721 microversion: 2.1 time: 0.960636 Aug 30 16:21:16.138832 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1675/3662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:15 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1721 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:16.146638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:16.150577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:16.168659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.174756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.178604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.179586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.180220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.181113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.239688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5aad56b6-e2b3-43ac-8913-3ebf8cc10dfe tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.310463 Aug 30 16:21:16.241179 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1988/3663] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:21:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:16.253543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:16.254692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:16.272636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.280350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.282079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.284181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.284753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.285197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.653293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.666153 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1a77bdf-f5f4-4b8b-9b54-87455da93123 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1522 microversion: 2.1 time: 0.423679 Aug 30 16:21:16.685324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1989/3664] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:16 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:16.695429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38d3b472-3104-4403-914e-fa227d3d16b6 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd357e5e430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:16.731649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:16.759086 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-101267dd-00a5-4cc0-8e45-094814cc5e57 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1490 microversion: 2.1 time: 0.618304 Aug 30 16:21:16.759903 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1676/3665] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:16 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1490 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:16.774674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:16.777285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:16.794248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.802522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.803121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.804380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:16.805243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:16.806013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:16.944706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:21:17.168028 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5d7c638-f81f-40c2-9153-3b8d0b6aa4c5 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 204 len: 0 microversion: 2.1 time: 0.405159 Aug 30 16:21:17.169727 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1677/3666] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:21:16 2022] DELETE /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:17.177928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:17.182641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:17.196127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.210650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.211241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.212104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.212950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.227888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.477843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:17.487184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b1eca3a-e3f7-44b5-a61b-fba9684bef88 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1490 microversion: 2.1 time: 0.315670 Aug 30 16:21:17.488036 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1678/3667] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:17 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1490 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:17.493439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:17.494274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:17.500418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:17.505406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.506489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.507165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.508533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.509232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.509869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.526534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38d3b472-3104-4403-914e-fa227d3d16b6 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips/cd1a9cc0-b80b-4b99-abb8-4dd461bb23d1" status: 200 len: 142 microversion: 2.1 time: 0.837440 Aug 30 16:21:17.534341 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1990/3668] 10.222.0.47 () {58 vars in 1260 bytes} [Tue Aug 30 16:21:16 2022] GET /compute/v2.1/os-floating-ips/cd1a9cc0-b80b-4b99-abb8-4dd461bb23d1 => generated 142 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:17.554137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:17.554898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:17.582100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.582989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.585637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.586504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.586992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.592225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.896460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:17.906240 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ad36def3-2874-4086-b9b4-e291f47a16ae tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.416929 Aug 30 16:21:17.912133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1679/3669] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:17 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:17.920342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:17.924148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:17.940615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.941470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.942799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:17.944936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:17.946582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:17.947257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.191559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.220853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ef91139-cd47-475b-8e0d-7359cc8ceb17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1528 microversion: 2.1 time: 0.306830 Aug 30 16:21:18.234700 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1680/3670] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:17 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1528 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:18.240845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:18.241757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:18.250346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.251115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.252494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.253370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.253965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.254739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.365893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.381579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2580d2ae-e127-4956-9aee-9631865c8fe7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1698 microversion: 2.1 time: 0.841015 Aug 30 16:21:18.382590 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1991/3671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:17 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1698 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:18.395262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5345d3f3-be17-43d6-ba2a-7d639f0543e0 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd357dbd3a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:18.461384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:18.474439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-078aac6f-d3f1-4b0a-b869-260b9d367f59 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1490 microversion: 2.1 time: 0.238282 Aug 30 16:21:18.477676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1681/3672] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:18 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1490 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:18.485332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-945793604"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:18.489874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:18.507137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.507634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.508183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.508953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.509414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.509909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.857332 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-905b9371-689d-4911-9903-0a740019cd9f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.376178 Aug 30 16:21:18.857952 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1682/3673] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:18 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 16:21:18.867972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750ddea4-f849-4516-8272-ae410a6b1673", "name": "network-vif-plugged", "status": "completed", "tag": "f0c3b498-3a43-45ff-adb5-c2f51ec60254"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:18.881364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.884088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.884978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.900941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] Creating event network-vif-plugged:f0c3b498-3a43-45ff-adb5-c2f51ec60254 for instance 750ddea4-f849-4516-8272-ae410a6b1673 on n-h1-830883-28 Aug 30 16:21:18.908057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c2412a8d-4283-42bb-ba94-9e7f302d17ee req-17c9ed8f-dcfa-409e-981d-9f8ce26ba33b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048072 Aug 30 16:21:18.908991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1683/3674] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:18.920967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:18.939245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:18.940055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:18.940905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:18.967175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Going to try to start instance {{(pid=122351) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:21:19.054407 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3aed3aa-3a3f-4020-b936-35a735a15dc9 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.139879 Aug 30 16:21:19.055031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1684/3675] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:18 2022] POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:19.064392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:19.066494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:19.082674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.083245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.083928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.086320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.087535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.088174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.130229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:21:19.275238 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2fae7d3c-f146-4a90-999c-e68248dfdb62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 204 len: 0 microversion: 2.1 time: 0.217134 Aug 30 16:21:19.279822 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1685/3676] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:21:19 2022] DELETE /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:19.293522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:19.294779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:19.305615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.306258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.307034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.307955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.308490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.308996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.339911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:19.666735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:19.676030 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb9b0382-95de-4011-94d4-7544f94db921 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1707 microversion: 2.1 time: 0.397649 Aug 30 16:21:19.676836 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1686/3677] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:19 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1707 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:19.698685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:19.699306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:19.706607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.706859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.707300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:19.708312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:19.708468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:19.708894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.192474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:20.201865 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b76dfbd-964d-40c4-a34d-3363f3d5b8d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 200 len: 1528 microversion: 2.1 time: 0.507228 Aug 30 16:21:20.217378 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1687/3678] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:19 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:20.227388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:20.228397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:20.273007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.273776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.275431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.277920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.279474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.280958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.623587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:20.636885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6f5959f-eb1c-4851-80fb-fe77e16f3c73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1496 microversion: 2.1 time: 0.418156 Aug 30 16:21:20.637866 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1688/3679] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:20 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1496 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:20.643167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750ddea4-f849-4516-8272-ae410a6b1673", "name": "network-vif-deleted", "tag": "f0c3b498-3a43-45ff-adb5-c2f51ec60254"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:20.665611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.666128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.666596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.681481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] Creating event network-vif-deleted:f0c3b498-3a43-45ff-adb5-c2f51ec60254 for instance 750ddea4-f849-4516-8272-ae410a6b1673 on n-h1-830883-28 Aug 30 16:21:20.691545 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-41925fc1-dda0-4ffa-a6e9-d3d802bf1838 req-1a47ac24-b420-4de1-a0e0-4900556ccf4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052180 Aug 30 16:21:20.695580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1689/3680] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:20.707326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:20.708249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:20.717165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.718047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.718718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:20.719749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:20.721307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:20.721981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.262830 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5345d3f3-be17-43d6-ba2a-7d639f0543e0 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/cd1a9cc0-b80b-4b99-abb8-4dd461bb23d1" status: 202 len: 0 microversion: 2.1 time: 2.878559 Aug 30 16:21:21.263487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1992/3681] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:21:18 2022] DELETE /compute/v2.1/os-floating-ips/cd1a9cc0-b80b-4b99-abb8-4dd461bb23d1 => generated 0 bytes in 2880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:21.269526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:21.270067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:21.272186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=42 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:21.283039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:21.292177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.292754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.293205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.293983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.294514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.294948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.299650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57553f87-721e-46be-bc8f-5c923de69624 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1707 microversion: 2.1 time: 0.602743 Aug 30 16:21:21.302980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1690/3682] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:20 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1707 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:21.313720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-258cf53f-7a7e-4dcc-b0b0-5bfd81e716e7 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd35cde7af0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:21.320610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:21.349127 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 HTTP/1.1 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673'} Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:21.350788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:21:21.354793 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:21.356039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:21.356908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b935ee6a-e8af-4806-9394-53b696cb629a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 404 len: 111 microversion: 2.1 time: 0.092282 Aug 30 16:21:21.357479 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1993/3683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:21 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:21:21.369879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-173e2086-0643-41be-9072-20379ecc148b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'create', calling method: .version_select at 0x7fd357e3d3a0>, body: {"keypair": {"name": "tempest-keypair-1165820379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8YEDO67GE04N7KUMqW3HN+fTKiaKmsywVXbMDNj6ad+R8YbelD7wiCKG4vTzkcH+n/UakMJj+GKraEqI8gZJOdtTuLyM5ROpk1PXQjC+NY4uPMYuotsW7aJ+prz96arQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:21.410839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-173e2086-0643-41be-9072-20379ecc148b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:21:21.425426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-173e2086-0643-41be-9072-20379ecc148b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for user e34a71bf74dd4f0aba0a8001d6011f2b and project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:21:21.489416 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-173e2086-0643-41be-9072-20379ecc148b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123459 Aug 30 16:21:21.490540 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1994/3684] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:21:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:21:21.662879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:21.663704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:21.674266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.676789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.678913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:21.680256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:21.683021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:21.683603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.111668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:22.125433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc4fe2a1-456d-4c96-9ca2-2c9f93dcc232 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1496 microversion: 2.1 time: 0.466445 Aug 30 16:21:22.126116 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1995/3685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:21 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1496 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:22.135187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-unplugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:22.153736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.154143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.154611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.187986 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] Creating event network-vif-unplugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:21:22.194462 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9b6f17ec-9cea-4452-a8fd-ae2d54f2238d req-c65337fd-8f5f-46c8-829d-2fe42265fee3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066926 Aug 30 16:21:22.199029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1996/3686] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:22.327793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:22.329244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:22.350946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.351941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.352556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.353487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:22.354476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:22.355482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:22.625783 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-258cf53f-7a7e-4dcc-b0b0-5bfd81e716e7 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.320581 Aug 30 16:21:22.628218 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1691/3687] 10.222.0.47 () {58 vars in 1164 bytes} [Tue Aug 30 16:21:21 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:21:22.649112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e389a2ab-8294-44c0-9f76-43f573c18eee tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd35d096700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:23.037920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.060828 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1cf5e90c-05f9-4a40-adb7-178c2a973ef1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1707 microversion: 2.1 time: 0.742087 Aug 30 16:21:23.064940 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1997/3688] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:22 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1707 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:23.153074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:23.159391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:23.178917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.179431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.179881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.191073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.193018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.194590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.452485 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e389a2ab-8294-44c0-9f76-43f573c18eee tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.814759 Aug 30 16:21:23.453082 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1692/3689] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:21:22 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:23.467703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19b6f7c0-2fb0-4208-8d74-c3444be34b94 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd35d10e0d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:23.752728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:23.776820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d270350-a338-4c6a-8948-32a29f543b15 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 200 len: 1454 microversion: 2.1 time: 0.630441 Aug 30 16:21:23.790716 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1998/3690] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:23 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 1454 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:23.795615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d173a4b6-4322-437f-9644-9dd981a26dbb", "name": "network-vif-deleted", "tag": "6033132e-739c-4eef-9577-565ffcd37530"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:23.851554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:23.852058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:23.853874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:23.912660 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] Creating event network-vif-deleted:6033132e-739c-4eef-9577-565ffcd37530 for instance d173a4b6-4322-437f-9644-9dd981a26dbb on n-h2-830883-28 Aug 30 16:21:23.932381 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-80f62d09-b4f6-4af5-aaa3-25b2f9eab746 req-22db52b8-3924-4f79-b8d2-dc573697741c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138224 Aug 30 16:21:23.933011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 1999/3691] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:24.087787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:24.088452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:24.106510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.109303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.112534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.113441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.114063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.115145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.504335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:24.513652 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ee55fc1-dc90-43ba-8e69-ed1c4ee1b1b7 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1711 microversion: 2.1 time: 0.429930 Aug 30 16:21:24.522919 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2000/3692] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:24 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1711 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:24.799933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:24.801371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:24.821269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.823571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.827359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.831403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.831973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.832415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.875732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb HTTP/1.1 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd173a4b6-4322-437f-9644-9dd981a26dbb'} Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:24.897958 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:24.901487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:24.903284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-922f6098-f3f0-4c23-b855-30b81c8ff88a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 404 len: 111 microversion: 2.1 time: 0.105609 Aug 30 16:21:24.908195 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2001/3693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:24 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:21:24.916812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:24.917276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:24.938668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.939463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.950119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:24.956256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:24.957644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:24.958345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.059303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:21:25.282394 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2aa87c8a-f0b6-4feb-a8fd-8d828d9a507d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 204 len: 0 microversion: 2.1 time: 0.372684 Aug 30 16:21:25.283889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2002/3694] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:21:24 2022] DELETE /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:21:25.308535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:25.309407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:25.348908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:25.349384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:25.349842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.363022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:25.363413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:25.363893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:25.910708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:25.931321 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7938cbea-9400-4820-a643-a5c5c855d720 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1496 microversion: 2.1 time: 0.633045 Aug 30 16:21:25.932635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2003/3695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:25 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1496 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:26.952614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:26.953205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:26.968832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.969337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.969786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:26.970778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:26.971420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:26.971859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:27.379322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:27.395624 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0e85e87-aef5-477c-a36b-ad16105f9969 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1496 microversion: 2.1 time: 0.447443 Aug 30 16:21:27.396237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2004/3696] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:26 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1496 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:28.019366 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19b6f7c0-2fb0-4208-8d74-c3444be34b94 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/2bd18700-0c37-48f8-afa2-712897db81f0" status: 202 len: 0 microversion: 2.1 time: 4.555936 Aug 30 16:21:28.021415 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1693/3697] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:21:23 2022] DELETE /compute/v2.1/os-floating-ips/2bd18700-0c37-48f8-afa2-712897db81f0 => generated 0 bytes in 4558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:28.030118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8804c4cd-a697-414c-8297-4aac24d79cb6 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd357e5e1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:28.420648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:28.422205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:28.446435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.452427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.456642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:28.457568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:28.461076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:28.465349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.355542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:29.376007 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f4a9222-febc-42fa-a334-d913ecc04079 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1496 microversion: 2.1 time: 0.959855 Aug 30 16:21:29.397282 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1694/3698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:28 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1496 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:29.730761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe181eb7-9350-429d-bbed-ea16bf037911", "name": "network-vif-deleted", "tag": "8295a932-75c2-4274-84d8-50512e32fae8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:29.773596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:29.775195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:29.776593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:29.814295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] Creating event network-vif-deleted:8295a932-75c2-4274-84d8-50512e32fae8 for instance fe181eb7-9350-429d-bbed-ea16bf037911 on n-h2-830883-28 Aug 30 16:21:29.826611 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-25622d17-eb48-400d-b381-fed22a29b8bc req-023eb780-f8ad-4475-9ec0-f1b9d54093e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100402 Aug 30 16:21:29.828358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1695/3699] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:21:29.836003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-82947860", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:30.576412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8804c4cd-a697-414c-8297-4aac24d79cb6 tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/e98ae093-1ae1-4ed3-bec3-ea020f9e05bb" status: 202 len: 0 microversion: 2.1 time: 2.551211 Aug 30 16:21:30.580659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2005/3700] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:21:28 2022] DELETE /compute/v2.1/os-floating-ips/e98ae093-1ae1-4ed3-bec3-ea020f9e05bb => generated 0 bytes in 2554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:30.602101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:30.607549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:30.655267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.656131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.656724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.657844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.658708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.659384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.703249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.704835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.705509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:30.706335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lazy-loading 'fault' on Instance uuid fe181eb7-9350-429d-bbed-ea16bf037911 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:21:30.918100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:30.930090 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-548c6a4c-0fde-498f-941a-e3fbb0786cd2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 200 len: 1299 microversion: 2.1 time: 0.349120 Aug 30 16:21:30.931851 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2006/3701] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:30 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:30.944176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-plugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:30.975009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:30.977731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:30.978660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:31.009185 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] Creating event network-vif-plugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:21:31.023628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e25a4f40-b6f1-4973-b865-4ed25c012e9f req-369f2082-72ed-4ec5-b347-9d9008a6e112 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089547 Aug 30 16:21:31.027988 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2007/3702] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:31.047352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50d092ad-9733-443d-9922-83182b5d4b3c tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] Calling method '.version_select at 0x7fd357dbd790>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:31.440899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:33.454119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50d092ad-9733-443d-9922-83182b5d4b3c tempest-FloatingIPDetailsTestJSON-1044368085 tempest-FloatingIPDetailsTestJSON-1044368085-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/efb69435-8fc9-45c3-b10d-f4076426304a" status: 202 len: 0 microversion: 2.1 time: 2.425875 Aug 30 16:21:33.461417 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2008/3703] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:21:31 2022] DELETE /compute/v2.1/os-floating-ips/efb69435-8fc9-45c3-b10d-f4076426304a => generated 0 bytes in 2434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:21:33.468789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:33.472915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:33.492210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.492636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.493083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:33.493841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:33.494326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:33.494763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:33.540849 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 HTTP/1.1 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fe181eb7-9350-429d-bbed-ea16bf037911'} Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:21:33.542616 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:21:33.546850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d4af929-ca58-4dc0-9206-51afa5f2b839 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 404 len: 111 microversion: 2.1 time: 0.081419 Aug 30 16:21:33.547587 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2009/3704] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:33 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:21:33.796615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1846660726", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:39.789218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=31 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:39.854168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:43.511306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:43.825838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:46.276223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] validate_networks() for [('e8608350-4e18-447f-b2d0-f6df04a4a834', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:21:46.291170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:21:47.103693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:21:47.104122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:21:47.104711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:21:47.105135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:21:47.105769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:21:47.118341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.118973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.119479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.120282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.120753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.121476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.141176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:21:47.151573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:21:47.168833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:21:47.171868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:21:47.257319 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58101607-e147-4486-87f9-eb851e5e84a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.464324 Aug 30 16:21:47.264560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2010/3705] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:21:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 13467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:21:47.513414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:21:47.513876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:21:47.514328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:21:47.515101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:21:47.515540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:21:47.542320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.542843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.547423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.556130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:47.559736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:47.561337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:47.624778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:21:47.639870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for user e34a71bf74dd4f0aba0a8001d6011f2b and project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:21:47.679423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:21:47.685615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:21:47.688115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1111425717", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:47.780908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a9cfbc3-362a-419d-b8af-99da7c6d7a8d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 17.950202 Aug 30 16:21:47.783551 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1696/3706] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:21:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 17955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:21:47.794881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acee0d38-3aad-48c1-aeae-704bfcdb3701 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:47.800352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-acee0d38-3aad-48c1-aeae-704bfcdb3701 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:47.851560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:21:48.002895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-acee0d38-3aad-48c1-aeae-704bfcdb3701 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.021691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acee0d38-3aad-48c1-aeae-704bfcdb3701 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1209 microversion: 2.1 time: 0.234346 Aug 30 16:21:48.028603 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1697/3707] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:47 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1209 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:48.049486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cab16368-4768-4160-a807-11088c178fb8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:48.053510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cab16368-4768-4160-a807-11088c178fb8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:48.185253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cab16368-4768-4160-a807-11088c178fb8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.197283 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cab16368-4768-4160-a807-11088c178fb8 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1223 microversion: 2.1 time: 0.153608 Aug 30 16:21:48.215043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1698/3708] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:48 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1223 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:48.538393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:48.539445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:48.554946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.555731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.560087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.561087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.561748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.562412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.575289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:21:48.575705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:21:48.576283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:21:48.576763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:21:48.577298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:21:48.592858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.593792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.594660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.595538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:48.596351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:48.596933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:48.620141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Getting quotas for project e099970d4ee04d27a2af27a426ac98e1. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:21:48.627981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Getting quotas for user f543ea78c4814a9ab8ad80da0b343de8 and project e099970d4ee04d27a2af27a426ac98e1. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:21:48.655775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:21:48.660041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:21:48.718058 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6e5ad4a-cbcf-4e4d-ae42-e935d609f76c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457603 Aug 30 16:21:48.720865 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2011/3709] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:21:48.733876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98bb1c9f-c20b-46a8-9b98-09a12fe6b674 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:48.735073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98bb1c9f-c20b-46a8-9b98-09a12fe6b674 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:48.798858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98bb1c9f-c20b-46a8-9b98-09a12fe6b674 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:48.808873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98bb1c9f-c20b-46a8-9b98-09a12fe6b674 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1217 microversion: 2.1 time: 0.080058 Aug 30 16:21:48.809615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2012/3710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:48 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:49.008519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:49.022624 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9671011-b64b-4857-9ad2-88cf0c4a9ac4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.490136 Aug 30 16:21:49.023816 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1699/3711] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:48 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:49.054588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1766220575"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:49.055554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:49.058379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.065022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.084728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.086280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.086972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.089022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.089689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.091327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.094075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.095031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.096353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.099599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.100354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.100990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.260875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:49.269040 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-268cd6bc-22e1-4f59-84e9-dbfbbd00afc2 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1261 microversion: 2.1 time: 0.223421 Aug 30 16:21:49.270401 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1700/3712] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:49 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1261 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:49.283245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:49.286567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.312053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.312687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.314085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.315217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.315700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.316344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.493058 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-abc2eb23-4a7a-432a-a67a-c6dd4eb081d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.447407 Aug 30 16:21:49.493972 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2013/3713] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:21:49 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 16:21:49.516639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:49.517441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.519123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:49.530922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.531583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.532103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.534400 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43740a53-dae1-443d-847b-0369f9e6eced tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1275 microversion: 2.1 time: 0.262636 Aug 30 16:21:49.537915 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1701/3714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:49 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:49.539150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.539661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.540184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.833640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:49.835199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:49.877565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.879533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.880000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.882468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:49.884506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:49.885612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:49.921578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:49.931184 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-674195ba-f0c9-4612-bebc-9e3a30c4bb78 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.432514 Aug 30 16:21:49.946417 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2014/3715] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:49 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:50.040048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.049918 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c650cd22-19c3-4750-bacf-d11d1ac84568 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1213 microversion: 2.1 time: 0.222118 Aug 30 16:21:50.052782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1702/3716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:49 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:50.295043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:50.296847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:50.315919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:50.318267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:50.320869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:50.325459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:50.326892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:50.329917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:50.554882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.567723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:50.568735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:50.569950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-223d2716-0c43-439d-bd4f-1fe576c16782 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1267 microversion: 2.1 time: 0.278646 Aug 30 16:21:50.570609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2015/3717] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:50 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:50.585848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:50.586360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:50.586810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:50.587510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:50.588712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:50.589157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:50.731882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:50.741960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df54ea76-1f62-4385-8aff-0d95b5ad459c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1281 microversion: 2.1 time: 0.179481 Aug 30 16:21:50.752383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1703/3718] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:50 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:50.960673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:50.965451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:50.997053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:50.997786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:50.999849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.005918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.006492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.007457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.080293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:51.080839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:51.096244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.096979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.097598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.098501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.099876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.102272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.239523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:51.249643 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5338012-05a1-4373-8964-6eccf6e73e57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.293215 Aug 30 16:21:51.252710 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2016/3719] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:50 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:51.335952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:51.348323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d278861-fa28-4fda-9cdc-1afa116bcc08 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1275 microversion: 2.1 time: 0.274785 Aug 30 16:21:51.360241 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1704/3720] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:51 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:51.594758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:51.595730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:51.603420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.608165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.610281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.611394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.613946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.614758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.777312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:51.778199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:51.787493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.789785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.790341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:51.791829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:51.795422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:51.796160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.026164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.050090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8fe6124a-f255-4579-8f91-10005db9fb70 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1281 microversion: 2.1 time: 0.276757 Aug 30 16:21:52.058429 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1705/3721] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:51 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:52.096876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-unplugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:52.106227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.131751 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce8b2cd1-d0fb-4e93-b495-974819a01150 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.538338 Aug 30 16:21:52.136835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2017/3722] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:51 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:52.173708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.178811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.181055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.227827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] Creating event network-vif-unplugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:21:52.239127 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bb47300d-be8c-42fc-80eb-854cbbc00051 req-f3521467-8c85-46c5-85be-75278e54b32c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147027 Aug 30 16:21:52.242527 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1706/3723] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:21:52.273812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:52.274385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:52.286570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.287383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.287993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.288872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.289521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.290108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.380625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:52.396865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:52.429303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.430861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.431526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.432650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:52.434451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:52.435358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:52.585364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.593369 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-773da679-4113-48b2-aa2f-dffd4bcca855 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1685 microversion: 2.1 time: 0.323599 Aug 30 16:21:52.593963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2018/3724] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:52 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1685 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:52.764743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:52.777608 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-341b597f-65ef-47d7-a7c7-ce816f445410 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1275 microversion: 2.1 time: 0.407956 Aug 30 16:21:52.779012 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1707/3725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:52 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1275 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:53.077646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:53.078277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:53.090589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.091319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.092568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.094004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.095797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.096682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.162489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:53.163821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:53.173413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.175399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.175855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.176665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.177365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.177804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.533186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:53.544622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18e48131-2cb2-4a5e-83bf-8fd0eb4db938 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.470404 Aug 30 16:21:53.545235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2019/3726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:53 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:53.618759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:53.619720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:53.632485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.633263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.634446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.635367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.636097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.637465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.872588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:53.882752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-51cd653d-ee63-4bd8-9672-e25137d7854e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.268542 Aug 30 16:21:53.885228 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2020/3727] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:53 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:53.890630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:53.892208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:53.900211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.901043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.901734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:53.902699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:53.903370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:53.904272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.042514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:54.055898 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9017a48f-8c9b-450d-80c0-f55f36164827 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1275 microversion: 2.1 time: 0.169230 Aug 30 16:21:54.059815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2021/3728] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:53 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:54.102714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:54.113497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-32d97659-3732-469e-8f8e-2d351d125b9f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.955007 Aug 30 16:21:54.135043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1708/3729] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:53 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:54.569333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:54.570572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:54.584724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.585543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.586099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.588369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.590813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.591532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.914719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:54.915954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:54.930785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.934656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.935390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:54.936297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:54.936909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:54.940069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.001121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.018202 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05dd6816-3848-49ff-aae2-32de8e71e957 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.451427 Aug 30 16:21:55.018202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2022/3730] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:54 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:55.059935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b3dad60-e953-42fb-a348-fa8b19f9254e", "tag": "a5e7da1c-9ee9-4100-9ec9-1986dfaf7961"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:55.097395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.097922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.098401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.127756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] Creating event network-changed:a5e7da1c-9ee9-4100-9ec9-1986dfaf7961 for instance 9b3dad60-e953-42fb-a348-fa8b19f9254e on n-h1-830883-28 Aug 30 16:21:55.142601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-efbb8e22-9ac8-4e56-9841-d8bd384ba083 req-af2d3373-4c2c-4ce9-b644-22c3f837c1fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084947 Aug 30 16:21:55.146258 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2023/3731] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:21:55.153158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:55.160791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:55.169747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.175755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.176911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.178913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.181173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.182556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.503165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.512600 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-953abfb6-2a9e-4d36-90f4-41faf3907b3c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1275 microversion: 2.1 time: 0.364831 Aug 30 16:21:55.528489 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2024/3732] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:55 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:55.565803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:55.568359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:55.583710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.584350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.584812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.585344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:55.585806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:55.591220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:55.795938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:55.817504 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-264ebed6-2203-4ddc-bf71-b1df896f8f30 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.908657 Aug 30 16:21:55.835698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1709/3733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:54 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:55.998690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:56.013625 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16860ad5-7d33-4111-bd71-fb46a8e7f103 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.484981 Aug 30 16:21:56.014249 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2025/3734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:55 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:56.040788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:56.042058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:56.056745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.057256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.057713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.060844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.061578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.064561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.245076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-plugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:56.336217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.339430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.340235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.374328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] Creating event network-vif-plugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:21:56.395477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0e3c4dfc-d48f-40ea-a1f3-7d13cedd9d62 req-78ca0a4c-18e3-41b3-9162-98af5263fc2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178957 Aug 30 16:21:56.404486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2026/3735] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:56.536513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:56.537249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:56.564891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.570149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.570640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.571534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:56.571814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:56.575055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:56.974452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.004994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-78f585a9-da15-42ad-99dd-42ce054fb183 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.471798 Aug 30 16:21:57.019212 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2027/3736] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:56 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:21:57.026506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:57.028456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:57.057500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.059935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.062274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.065212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.066202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.066882 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f6c78f5-9fd6-4117-bd29-d81a7a3e45dd tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 1.030519 Aug 30 16:21:57.067357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.068693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.088706 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1710/3737] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:56 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:57.094871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:57.095803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:57.143993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.145761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.146259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.148523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.149034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.149481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.584073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:57.670121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.678592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:57.692637 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0ea5371-a59a-448f-95da-a964500138d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.675983 Aug 30 16:21:57.709153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2028/3738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:57 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:57.811384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:57.826278 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa988fee-8951-49a3-a3f3-0e1a52cdcaba tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.735323 Aug 30 16:21:57.827769 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1711/3739] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:57 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:57.885394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3", "tag": "f185d61a-90cf-4f76-baa6-7c750f657e78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:21:57.910577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:57.911328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:57.913926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:57.933658 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] Creating event network-changed:f185d61a-90cf-4f76-baa6-7c750f657e78 for instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 on n-h1-830883-28 Aug 30 16:21:57.942757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e6ebc4b8-ab94-4e74-b994-2d9b84765a47 req-3b2702ab-89e3-444d-bcac-5838db958d5b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062766 Aug 30 16:21:57.944353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2029/3740] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:21:58.026997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:58.027611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:58.037526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.038259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.038520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.044152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.044901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.045511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.095944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:58.100626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:58.115616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.116829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.117534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.119721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.120444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.121167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.195124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:58.466552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:58.477880 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-484c064e-4b89-4f35-a547-db0ece3b4435 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.389530 Aug 30 16:21:58.478946 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2030/3741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:58 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:58.722492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:58.723113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:58.727915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:58.744721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.745518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.746150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.747152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:58.748022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:58.748694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:58.804929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=14 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:21:59.010981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.011204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.020003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c615abb-e302-4960-b88a-da7a1745b8ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.996885 Aug 30 16:21:59.027957 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9624af69-73dd-4f98-b444-3e81498c04b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.312533 Aug 30 16:21:59.032777 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2031/3742] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:58 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:59.042793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1712/3743] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:58 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:59.047276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:59.049820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:59.076948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.077879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.080599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.085704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.086679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.089168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.508390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:21:59.509026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:21:59.526965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.527463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.527901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.528604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:21:59.529060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:21:59.529484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:21:59.544945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:21:59.554484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e62733c-629a-466a-8e06-b6b09e415544 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.519068 Aug 30 16:21:59.555197 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2032/3744] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:59 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:21:59.978435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:00.013761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.016444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.016444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.028655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] Creating event network-changed:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:22:00.050014 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e612cff5-8915-4e87-9b28-b44c3d255561 req-040980b5-7ce1-43ab-a8e5-9c4e20ab5b18 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061593 Aug 30 16:22:00.051462 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2033/3745] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:00.061314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:00.062159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:00.081176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.083612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.084219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.085074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.086950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.087518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.389620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.406668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd9ff4aa-bf95-47e9-971a-f359c5f2252d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.353673 Aug 30 16:22:00.408227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2034/3746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:00 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:00.422910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:00.425724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:00.436581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.440306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.440942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.443217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.445158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.447109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.780560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:00.795827 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff0f69b3-c024-4684-9cf3-320050dc21d1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.385837 Aug 30 16:22:00.800823 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2035/3747] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:00 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:00.808984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:00.809617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:00.828751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.829356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.829872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:00.830855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:00.831429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:00.832467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.033440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:01.048195 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21c68e0b-5300-4e0a-88e3-dee8f6f02b07 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 1.549392 Aug 30 16:22:01.049071 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1713/3748] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:21:59 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:01.429660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:01.430767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:01.446644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.450099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.454536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.458085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.458858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.461038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.475679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:01.489907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f35ab5b-7714-405f-9b86-32a85f4b878b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.687900 Aug 30 16:22:01.490860 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2036/3749] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:00 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:01.822006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:01.823814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:01.837381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.837904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.838361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:01.843041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:01.843041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:01.843503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:02.105559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:02.121044 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f0575ba5-6754-413b-9a61-33c24f9779c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.695040 Aug 30 16:22:02.133831 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1714/3750] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:01 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:02.145079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:02.146804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:02.169759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.174095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.175763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:02.177763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.178822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.180332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:02.703115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:02.720346 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9fc5142-f333-4269-93b8-0b42cb23e05b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.897391 Aug 30 16:22:02.722475 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2037/3751] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:01 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:02.724948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:02.728964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:02.732997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:02.736516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:02.740419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1c6fcb8-33c2-493c-97e1-ce7295d9e09a tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.600914 Aug 30 16:22:02.743111 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1715/3752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:02 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:02.749748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.750251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.751488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:02.751488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:02.752079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:02.752507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.083654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:03.107053 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8424805-8918-4192-8214-57ede02142f0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.382764 Aug 30 16:22:03.107660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2038/3753] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:02 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:03.158029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:03.160212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:03.170835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.175310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.175799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.176552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.178509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.181978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.360026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:03.370526 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41cf48e1-18be-4703-8acc-01f07b54f1a4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.217647 Aug 30 16:22:03.376708 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1716/3754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:03 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:03.751385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:03.754151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:03.770548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:03.771178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:03.775085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.778588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.783869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.789037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.789549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.790002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.790787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.791237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:03.792297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.794035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:03.796216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:03.796719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.178180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.189281 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fad5814d-fff1-4877-a4d3-e4e315687fc4 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.424658 Aug 30 16:22:04.189872 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1717/3755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:03 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:04.223617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:04.224474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:04.239852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.240868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.242435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.244365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.245100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.245761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.263337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.273172 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99241d10-834e-4f05-9e54-9ab97a6eafd1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.533159 Aug 30 16:22:04.280994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2039/3756] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:03 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:04.303973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3dad60-e953-42fb-a348-fa8b19f9254e", "name": "network-vif-plugged", "status": "completed", "tag": "a5e7da1c-9ee9-4100-9ec9-1986dfaf7961"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:04.332225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.332720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.333155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.380640 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] Creating event network-vif-plugged:a5e7da1c-9ee9-4100-9ec9-1986dfaf7961 for instance 9b3dad60-e953-42fb-a348-fa8b19f9254e on n-h1-830883-28 Aug 30 16:22:04.387674 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bc22f011-ccc6-48bc-8d77-0e1b0f895d52 req-a48e43b1-70e6-409a-a6f5-7265d029ff41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105204 Aug 30 16:22:04.397156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2040/3757] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:04.403479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:04.405185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:04.414561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.415255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.415863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.416722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:04.417319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:04.417887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:04.531974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.543604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd755180-6899-4a02-b4ef-b31854593871 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.331950 Aug 30 16:22:04.544660 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1718/3758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:04 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:04.774720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:04.784230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b79808ae-4940-48b5-9377-5d2a81dc828c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.385360 Aug 30 16:22:04.789718 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2041/3759] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:04 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:05.215829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:05.217212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:05.233317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.233813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.234575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.235980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.237056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.237483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.295601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:05.305254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:05.324609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.326834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.329784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.332490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.333924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.335111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.747570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:05.762664 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c360c69e-6346-4a8b-8a4c-1db8d30d3b85 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.466763 Aug 30 16:22:05.763971 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2042/3760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:05 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:05.782389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:05.783259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:05.807624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.808399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.809028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.809935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.810985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.812064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.815975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:05.842777 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-395948e4-d90e-43ac-8568-976305721170 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.632150 Aug 30 16:22:05.852913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1719/3761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:05 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:05.874149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:05.875010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:05.892938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.893565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.894407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:05.895301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:05.896063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:05.896716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.347784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:06.357277 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20697e83-e414-47a2-a5bf-f679ed23ecbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1309 microversion: 2.1 time: 0.592145 Aug 30 16:22:06.366096 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2043/3762] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:05 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:06.435406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:06.450080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9efee337-309c-4471-83f5-ace98a7f6200 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.595760 Aug 30 16:22:06.451035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1720/3763] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:05 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:06.786785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:06.788982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:06.800844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.801794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.803439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.804551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.805312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.807756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.869330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:06.870454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:06.877285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.885365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.886198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:06.893526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:06.894264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:06.894748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.175943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:07.190499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-30ac37c5-69f2-4a6d-8cf2-fa5500f6f905 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.409783 Aug 30 16:22:07.191182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2044/3764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:06 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:07.385755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-plugged", "status": "completed", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:07.412684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:07.421210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.421885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.425557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.461271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] Creating event network-vif-plugged:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:22:07.474996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b9058e1c-0b93-4294-9f94-67f2acf3393c req-ad1ef47c-b7fe-4a04-ab6e-ecad703a4e99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097867 Aug 30 16:22:07.477837 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2045/3765] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:07.495822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:07.497869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:07.524571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.525597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.526109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.526923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.527451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.528627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.620631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:07.634337 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f2286340-5e53-4500-9bde-1e62fb08fd80 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.767552 Aug 30 16:22:07.636043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1721/3766] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:06 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:07.649020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:07.651649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:07.672064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.674171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.675153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.677251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.678197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.679386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.824974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:07.835353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5261d089-1787-40a6-9f7e-7b56573b34d0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1490 microversion: 2.1 time: 0.355837 Aug 30 16:22:07.841725 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2046/3767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:07 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1490 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:07.878778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:07.886041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:07.896109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.896855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.897686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:07.898617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:07.899275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:07.900047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.019242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:08.086241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2048b7af-22fa-4762-b7c1-d5601351a2fc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "PUT /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1085 microversion: 2.1 time: 0.224451 Aug 30 16:22:08.100454 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2047/3768] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:22:07 2022] PUT /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1085 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:08.108662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:08.112833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:08.120644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.121337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.121937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.123404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.126695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.127660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.269839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.286345 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0fac0906-f2cc-4cd4-a8f7-2448e4df9250 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.648151 Aug 30 16:22:08.291044 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1722/3769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:07 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:08.300524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:08.301455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:08.316727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.317216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.317657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.318404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.318871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.319303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.529812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.548896 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b6fb4c2-e84b-4479-9cc8-c9a8254258cb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1511 microversion: 2.1 time: 0.444025 Aug 30 16:22:08.549505 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2048/3770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:08 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:08.570209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:08.570888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:08.577330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.577839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.578284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.579098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.579666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.580144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.635380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.648087 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95d3a2a3-ffc8-4f2f-a7d1-7ebc484d296e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.355565 Aug 30 16:22:08.662785 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1723/3771] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:08 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:08.684281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:08.686564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:08.694515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.695373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.696094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.697102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:08.698013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:08.698715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:08.958155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:08.971268 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b99fe2a-46c3-44fe-864a-ac889ccbe92e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.305306 Aug 30 16:22:08.973154 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1724/3772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:08 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:09.018477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:09.028630 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34b2dc0f-503f-4df9-aec9-d70132c52fa1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1511 microversion: 2.1 time: 0.462849 Aug 30 16:22:09.041396 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2049/3773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:08 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:09.053889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:09.054445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:09.069354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.070330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.070982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.072386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.073318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.077136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.161691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:22:09.320761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:09.321625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:09.330096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.330924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.354620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.356031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.356876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.358919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.410169 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3dba3383-6aed-449a-8513-e8f00d5f63a3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 204 len: 0 microversion: 2.1 time: 0.363156 Aug 30 16:22:09.413884 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1725/3774] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:09 2022] DELETE /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:09.419878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:09.420625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:09.440509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.441479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.441479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.442119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.442682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.443022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.720688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:09.746635 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3fe7ca2c-7e43-4a76-b601-91f6fc59b80a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1317 microversion: 2.1 time: 0.423896 Aug 30 16:22:09.753433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2050/3775] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:09 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:09.771330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3", "name": "network-vif-plugged", "status": "completed", "tag": "f185d61a-90cf-4f76-baa6-7c750f657e78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:09.835017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.840880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.843803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.905329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] Creating event network-vif-plugged:f185d61a-90cf-4f76-baa6-7c750f657e78 for instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 on n-h1-830883-28 Aug 30 16:22:09.918063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-645171c3-7ba6-4fbd-ac07-75575ad94fdd req-9df65960-257b-47b5-a64e-c6e33700311e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161716 Aug 30 16:22:09.925180 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2051/3776] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:09.937332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:09.940935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:09.949890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.950797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.951858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:09.953003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:09.954871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:09.955584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.335888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:10.348705 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9dcf1af-89a8-4b47-8a55-c0d321d2a7d5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.420500 Aug 30 16:22:10.352029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2052/3777] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:09 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:10.357849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:10.358504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:10.378151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.381337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.383252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.385808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.387721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.388348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.752903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:10.763003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d215816-4a58-4921-9be1-567d2cef6d17 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.409620 Aug 30 16:22:10.764153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2053/3778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:10 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:10.779434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:10.781174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:10.793964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.794527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.801953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:10.803100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:10.803750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:10.804347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.050392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.065870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-39310fcb-bb5c-4e5d-ad60-3aebb9901f2a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1517 microversion: 2.1 time: 1.650166 Aug 30 16:22:11.066804 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1726/3779] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:09 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1517 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:11.137152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.165035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10500750-40ae-46e1-8cbd-c3111df77408 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1467 microversion: 2.1 time: 0.387763 Aug 30 16:22:11.190454 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2054/3780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:10 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:11.194363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1797794422", "metadata": {"image_type": "test"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:11.207185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:11.210628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:11.228544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.238346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.239040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.240006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.242228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.242954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.373390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:11.374016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:11.386141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Getting quotas for project e099970d4ee04d27a2af27a426ac98e1. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:11.394405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.395324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.395900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.398836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.401241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.401713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.408624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Getting quotas for user f543ea78c4814a9ab8ad80da0b343de8 and project e099970d4ee04d27a2af27a426ac98e1. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:11.795304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:11.806673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68fe04c4-9f35-46e0-85b8-266d348e3581 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.437714 Aug 30 16:22:11.821453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2055/3781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:11 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:11.821453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:11.821453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:11.839601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.840105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.840544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.846991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:11.854999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:11.855470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:11.869441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-66d5d6c8-3677-41d4-a4c8-a5fadf1dbd15 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "POST /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2/action" status: 202 len: 0 microversion: 2.1 time: 0.678110 Aug 30 16:22:11.878934 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1727/3782] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:11 2022] POST /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:22:11.894496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9505ecaa-fd95-4c5a-bf9a-a88fbb82c5ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360f7b310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:12.007917 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9505ecaa-fd95-4c5a-bf9a-a88fbb82c5ad tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.127084 Aug 30 16:22:12.019129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1728/3783] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:11 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:12.098900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:12.100485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:12.116705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.119483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.120495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:12.121400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.122211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.123450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:12.356694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:12.368150 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a5566f8-7a2e-46d6-a029-842c89e28db6 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1323 microversion: 2.1 time: 0.557882 Aug 30 16:22:12.369523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2056/3784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:11 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:12.830720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:12.833318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:12.834242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:12.835225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:12.846385 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5ed9ede-2875-4881-a498-0bf5e775ea46 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1517 microversion: 2.1 time: 0.762343 Aug 30 16:22:12.852849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1729/3785] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:12 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1517 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:12.867274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.871141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.871141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:12.873072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:12.873792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:12.874406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:13.022472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20339b26-b74d-4189-872f-ef24256aca8f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35cc5f160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:13.129473 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-20339b26-b74d-4189-872f-ef24256aca8f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.108648 Aug 30 16:22:13.132028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1730/3786] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:13 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:13.624989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-570346033", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "bad44ab2-5a22-4a1e-a744-280c6065e3cf"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:13.756958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] validate_networks() for [('bad44ab2-5a22-4a1e-a744-280c6065e3cf', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:13.888161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:13.902103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b429699d-ef6d-4ead-b028-c652f56fb6b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 1.076221 Aug 30 16:22:13.905982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2057/3787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:12 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:13.927313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:13.930582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:13.942674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:13.943180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:13.943629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:13.944356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:13.944897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:13.945217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.383050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:14.399414 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07194828-3601-44f0-9602-6b219921843b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1520 microversion: 2.1 time: 0.486434 Aug 30 16:22:14.411290 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2058/3788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:13 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:14.428237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:14.428862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:14.435224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:14.435921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:14.436543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.437402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:14.438778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:14.439446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.483889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:14.484583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:14.487271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.489725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lazy-loading 'fault' on Instance uuid 9b3dad60-e953-42fb-a348-fa8b19f9254e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:22:14.823866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:14.847289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b4e40c0-7f87-46a3-a741-15d836671c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 200 len: 1320 microversion: 2.1 time: 0.430028 Aug 30 16:22:14.870101 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2059/3789] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:14 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:14.881058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b3dad60-e953-42fb-a348-fa8b19f9254e", "name": "network-vif-deleted", "tag": "a5e7da1c-9ee9-4100-9ec9-1986dfaf7961"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:14.910198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:14.910902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:14.911204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:14.960883 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] Creating event network-vif-deleted:a5e7da1c-9ee9-4100-9ec9-1986dfaf7961 for instance 9b3dad60-e953-42fb-a348-fa8b19f9254e on n-h1-830883-28 Aug 30 16:22:14.975446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f0b247a3-c9b9-4b52-9fc3-0e19cc4a0fe9 req-669d15c8-7fec-400e-b887-a5faff341e8b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103853 Aug 30 16:22:14.977839 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2060/3790] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:14.997363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e7c2504-9cd9-42f1-883d-337ab06cfe81 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357e25f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:15.115306 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e7c2504-9cd9-42f1-883d-337ab06cfe81 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.134596 Aug 30 16:22:15.115691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2061/3791] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:14 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:15.161742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:15.162550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:15.191997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.192516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.192971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.195510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.195997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.196438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.337117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:15.337593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:15.338011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:15.338581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:15.339170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:15.351245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.351914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.352500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.353372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.359513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.360949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.432610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Getting quotas for project ec81a72a0c8143d994b45e6d66649113. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:15.450938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Getting quotas for user e441bf510b8441288c28dc6fbc7e8cb8 and project ec81a72a0c8143d994b45e6d66649113. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:15.483059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:15.488598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:15.616612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9b2293c-def8-404d-936d-974c1289f77f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318985 Aug 30 16:22:15.617839 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1731/3792] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:22:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:22:15.639658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:15.641964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:15.669095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.669600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.670045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.670778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:15.671389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:15.671826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:15.740517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:15.749489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-230ad1cc-7e03-458e-b24e-4178632e69df tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1520 microversion: 2.1 time: 0.623926 Aug 30 16:22:15.750054 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2062/3793] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:15 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1520 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:15.772906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ffa0b895-d9f7-4386-be0c-cd33dde71afe tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:15.776647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ffa0b895-d9f7-4386-be0c-cd33dde71afe tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:15.916696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ffa0b895-d9f7-4386-be0c-cd33dde71afe tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:15.926199 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ffa0b895-d9f7-4386-be0c-cd33dde71afe tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1213 microversion: 2.1 time: 0.164732 Aug 30 16:22:15.926806 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2063/3794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:15 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:15.947237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2af6d7e9-1234-4c02-bde3-0ede47663093 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Action: 'create', calling method: .version_select at 0x7fd357e764c0>, body: {"keypair": {"name": "tempest-keypair-1905243212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOrUhN+sY9A2AsexZrGj6nwOhIJ1kCGGHrqwhhikw9f5qRuKMGLdSUG1AfBtFtIMlBRd9/IBuSmkLuT6NO35i6EdxF1gsx7gPYaEPe+j0jIpvo/gm0zpiX1yeaagFBgkg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:16.006357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2af6d7e9-1234-4c02-bde3-0ede47663093 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Getting quotas for project 10923d93d36d491ab095e4c5360fa072. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:16.012719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2af6d7e9-1234-4c02-bde3-0ede47663093 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Getting quotas for user 25918ea9699d41048d84386475ab6592 and project 10923d93d36d491ab095e4c5360fa072. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:16.057417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2af6d7e9-1234-4c02-bde3-0ede47663093 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.123195 Aug 30 16:22:16.058037 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2064/3795] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:22:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:22:16.058808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:16.082179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-410185752"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:16.086609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab00a023-d437-4e19-9044-9e511532baaf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.465694 Aug 30 16:22:16.098721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1732/3796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:15 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:16.099529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:16.105972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:16.106938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:16.107260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.107773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.108852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.109610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.113949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.114507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.130232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.133049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.134826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.135799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:16.138671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:16.139432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:16.187038 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e HTTP/1.1 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b3dad60-e953-42fb-a348-fa8b19f9254e'} Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:16.201870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:16.208480 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3dfeb2ab-abf3-4cb5-b846-88e3d67b785a tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 404 len: 111 microversion: 2.1 time: 0.113649 Aug 30 16:22:16.218418 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1733/3797] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:16 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:16.237055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee1c29d2-b11e-4e3a-8411-a221a7896dc7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35d4f8ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:16.575793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee1c29d2-b11e-4e3a-8411-a221a7896dc7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.353731 Aug 30 16:22:16.577985 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1734/3798] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:16 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:16.589639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-705293691", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1336b37f-bfb4-440a-ab86-3642b5ec4f2f"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:16.622337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a71a262e-c4f3-40d6-9545-18c7af43daa3 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3/action" status: 202 len: 0 microversion: 2.1 time: 0.545346 Aug 30 16:22:16.623453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2065/3799] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:16 2022] POST /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:22:16.650568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d781954a-0acb-4850-b047-9e6e26fa5816 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd357d7d3a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.011443 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d781954a-0acb-4850-b047-9e6e26fa5816 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49" status: 204 len: 0 microversion: 2.1 time: 0.380054 Aug 30 16:22:17.012361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2066/3800] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:16 2022] DELETE /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:17.024619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.024834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] validate_networks() for [('1336b37f-bfb4-440a-ab86-3642b5ec4f2f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:17.027451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:17.041695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.042261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.043427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.044350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.045084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.045618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.202053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:17.210294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:17.211884 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:22:17.213072 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 16:22:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 30 16:22:17.239151 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c0fdcde-6766-47cc-9df0-6c0f0cdef274 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1209 microversion: 2.1 time: 0.218348 Aug 30 16:22:17.242757 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2067/3801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:17.256036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ece13e6-5042-49d7-8bec-30d4dd79b00b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd357d2a0d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.304769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3ece13e6-5042-49d7-8bec-30d4dd79b00b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Image not found. Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ece13e6-5042-49d7-8bec-30d4dd79b00b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49 HTTP/1.1 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '8d71e40a-bd7f-439a-aa28-0fc6d029af49'} Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8d71e40a-bd7f-439a-aa28-0fc6d029af49 Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:22:17.307359 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d71e40a-bd7f-439a-aa28-0fc6d029af49 could not be found. Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ece13e6-5042-49d7-8bec-30d4dd79b00b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:17.311216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ece13e6-5042-49d7-8bec-30d4dd79b00b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49" status: 404 len: 62 microversion: 2.1 time: 0.065606 Aug 30 16:22:17.313867 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2068/3802] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:22:17.326330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.327023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:17.350650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.351731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.352381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.353868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.355166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.355750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.787985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:17.788925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:17.789582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:17.790213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:17.790829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:17.805693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.806527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.807296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.809447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:17.810111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:17.810740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:17.836691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:17.847490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Getting quotas for user ff918cce425e49c19d4726b438e72f43 and project 207b96798dbb4518a4f768c16a71149d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:17.867176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:17.869933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:17.971462 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2157f46c-3f9f-40c2-999c-36c8f6c3dea3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.390218 Aug 30 16:22:17.974370 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1735/3803] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:22:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:22:17.979295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:17.989450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:18.006589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.007436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.008040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.010490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.011163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.012190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.358956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.370326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-635eb614-6ec9-4f2b-9a97-210fd5055249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 1.055692 Aug 30 16:22:18.371653 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2069/3804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:18.383975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daee4879-8de9-4d8e-9676-86375ab385a6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357d11550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:18.400685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.426340 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7b07673-2f25-44f6-9e48-f472ea374f2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1538 microversion: 2.1 time: 0.450684 Aug 30 16:22:18.442328 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1736/3805] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:17 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1538 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:18.442328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cbf70923-0cf8-4aa3-b1af-26f61b7ea1ea tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:18.442328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cbf70923-0cf8-4aa3-b1af-26f61b7ea1ea tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:18.488399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daee4879-8de9-4d8e-9676-86375ab385a6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.114670 Aug 30 16:22:18.498067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2070/3806] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:18 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:18.510744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:18.514439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:18.526332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.526332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.526973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.527760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:18.528327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:18.528968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:18.642692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cbf70923-0cf8-4aa3-b1af-26f61b7ea1ea tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.673978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cbf70923-0cf8-4aa3-b1af-26f61b7ea1ea tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1208 microversion: 2.1 time: 0.234424 Aug 30 16:22:18.681761 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1737/3807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:18 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1208 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:18.806906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:18.820028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a33ef8a2-8e32-4d48-99b1-9e42125e90f2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1271 microversion: 2.1 time: 0.322056 Aug 30 16:22:18.821381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2071/3808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:18 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:19.393816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:19.396435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:19.416362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.431946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.432666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.434382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.437686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.443994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.455138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:19.456825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:19.469479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.474907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.481644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.487345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.488156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.488849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.783580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:19.799366 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16e80c70-75e2-40e3-8fa2-308ec3bcded2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1680 microversion: 2.1 time: 0.407539 Aug 30 16:22:19.800733 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1738/3809] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:19 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1680 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:19.817068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5001428-35bf-47fe-9d1d-077fa46339d5 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c4b1940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:19.932992 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5001428-35bf-47fe-9d1d-077fa46339d5 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.129696 Aug 30 16:22:19.942728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1739/3810] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:19 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:19.949035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:19.952509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:19.967937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.971866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.972792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:19.975184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:19.976145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:19.976742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.106577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.117392 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c74f28b-fd05-4a7b-b354-95b4e789bf85 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1538 microversion: 2.1 time: 0.666014 Aug 30 16:22:20.134812 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2072/3811] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:19 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1538 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:20.140470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-plugged", "status": "completed", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:20.154684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.155406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.155988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.182090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:20.210719 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e156563-c6c4-4a69-a7c3-c496bad884d4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1260 microversion: 2.1 time: 0.251664 Aug 30 16:22:20.212516 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1740/3812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:19 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:20.220531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:20.221667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:20.238231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.239116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.239969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.241986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.244227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.245019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.744536 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] Creating event network-vif-plugged:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:22:20.753596 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7d6b396d-60c1-4c61-8b8e-bcbff2242d33 req-3a61217b-894f-4d44-8403-0d2a96d6452e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.617283 Aug 30 16:22:20.756124 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2073/3813] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:20.769655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:20.770407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:20.791458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.791962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.792411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.793221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:20.793897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:20.794238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:20.892658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lazy-loading 'services' on Instance uuid 7cef9d81-c51e-4f33-9295-eb52e722d2aa {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:22:21.001028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8735a7fb-b945-4462-a27b-6a0e11a3779e tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments/19977a52-9192-4671-bd79-4d445519f76f" status: 202 len: 0 microversion: 2.1 time: 0.239426 Aug 30 16:22:21.001200 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2074/3814] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:22:20 2022] DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments/19977a52-9192-4671-bd79-4d445519f76f => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:21.051030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2128075217", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5da9acd0-7edf-4a5f-9a61-461d74eb50c9"}, {"port": "1bed3514-f847-4fe3-8b2d-599e3a2d21e8", "tag": "port-1"}, {"port": "4330790f-64ef-4c65-8b06-f3d794f22810", "tag": "port-2"}, {"uuid": "bd6de590-0b54-4789-8616-3fd5c8fb3c52", "tag": "net-1"}, {"uuid": "bd6de590-0b54-4789-8616-3fd5c8fb3c52"}, {"uuid": "5db3ec4f-4206-4fbb-9de7-bd5b195d320a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5db3ec4f-4206-4fbb-9de7-bd5b195d320a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "183b826e-07e2-4e94-9722-56cff64d6c7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "67a5e1ea-9cbd-4d73-981a-58ed3c32f464", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cb3f87eb-c922-4c22-a5b9-6d3196586adb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1223334922"}], "key_name": "tempest-keypair-1905243212", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:21.140195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.155210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d2a659a-6372-4506-a3b8-18bc485b3344 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1313 microversion: 2.1 time: 0.941101 Aug 30 16:22:21.170151 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1741/3815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:20 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1313 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:21.173190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:21.174068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:21.182397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.183097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.183883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.184751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:21.185396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:21.186103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:21.504640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:21.515042 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2462c530-5d7a-4472-909b-ee0f5e4aacff tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.355716 Aug 30 16:22:21.519080 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1742/3816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:21 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:21.530108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9ca4254-a53b-4001-8421-17a351e32ec5 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c2eeca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.149539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] validate_networks() for [('5da9acd0-7edf-4a5f-9a61-461d74eb50c9', None, None, None, None, None), (None, None, '1bed3514-f847-4fe3-8b2d-599e3a2d21e8', None, None, None), (None, None, '4330790f-64ef-4c65-8b06-f3d794f22810', None, None, None), ('bd6de590-0b54-4789-8616-3fd5c8fb3c52', None, None, None, None, None), ('bd6de590-0b54-4789-8616-3fd5c8fb3c52', None, None, None, None, None), ('5db3ec4f-4206-4fbb-9de7-bd5b195d320a', '10.2.2.100', None, None, None, None), ('5db3ec4f-4206-4fbb-9de7-bd5b195d320a', '10.2.2.200', None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:22.288670 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9ca4254-a53b-4001-8421-17a351e32ec5 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.768061 Aug 30 16:22:22.291472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1743/3817] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:21 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:22.302512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.303965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:22.325504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.326374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.327024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.327981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.329038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.329731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.594994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.605676 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-951bd880-b6da-4363-b856-fb4311eea731 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1520 microversion: 2.1 time: 0.309463 Aug 30 16:22:22.619319 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1744/3818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:22 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:22.632382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.633483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:22.640534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.642228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.642958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.644024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.644762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.645410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.865210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:22.874105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21fbc8fd-8e82-4d94-ac6d-78119d01c9c5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1266 microversion: 2.1 time: 0.252914 Aug 30 16:22:22.879453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1745/3819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:22 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:22.884623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:22.889804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:22.909124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.909631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.910072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:22.911891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:22.912360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:22.912791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.440551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:23.450179 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eda4701a-bc8e-4c23-b225-32794d8afa94 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1313 microversion: 2.1 time: 0.569361 Aug 30 16:22:23.459156 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1746/3820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:22 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:23.464248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:23.470336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:23.497271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.498109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.506288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.507395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:23.508096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:23.508732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:23.998378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:24.018416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9353c5cd-d184-4369-a006-f901f7623bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.557802 Aug 30 16:22:24.019313 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1747/3821] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:23 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:24.035110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:24.035897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:24.048589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.049331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.049948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.050842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.051446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.052023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.112764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:22:24.318126 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44e00519-7cd6-45c6-bd2a-68139c55b0da tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 204 len: 0 microversion: 2.1 time: 0.297098 Aug 30 16:22:24.319203 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1748/3822] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:24 2022] DELETE /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:24.336548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960f447e-6153-4f68-8ebc-7056b254507c", "tag": "1ae8a6fa-4306-4245-9707-5eda4c496026"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:24.362175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.364139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.364844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.392569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] Creating event network-changed:1ae8a6fa-4306-4245-9707-5eda4c496026 for instance 960f447e-6153-4f68-8ebc-7056b254507c on n-h1-830883-28 Aug 30 16:22:24.415519 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4b5ee654-7008-4011-83ea-f833545b0585 req-dc9d2a1b-03a0-4bd8-bd96-245af4b164ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079997 Aug 30 16:22:24.416486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1749/3823] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:24.422680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3", "name": "network-vif-plugged", "status": "completed", "tag": "f185d61a-90cf-4f76-baa6-7c750f657e78"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:24.457058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:24.459941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:24.462570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:24.489167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] Creating event network-vif-plugged:f185d61a-90cf-4f76-baa6-7c750f657e78 for instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 on n-h1-830883-28 Aug 30 16:22:24.497320 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c600c0f3-232e-443f-837b-0b0e7f898322 req-f1240253-3d33-405c-b041-21521eb5b057 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079299 Aug 30 16:22:24.503990 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1750/3824] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:24.533549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7024a5c2-afff-4ac6-a79a-0525dd227a53 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360ee7820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:26.032061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:26.290093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7024a5c2-afff-4ac6-a79a-0525dd227a53 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 1.784690 Aug 30 16:22:26.293865 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1751/3825] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:24 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:26.301691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:26.307768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:26.330252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:26.331015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:26.333284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:26.334209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:26.336589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:26.339349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:26.940025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:26.958603 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbb98a32-71a5-4668-a48a-efa70d3b032b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1308 microversion: 2.1 time: 0.661475 Aug 30 16:22:26.959666 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1752/3826] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:26 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:26.977148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:26.978398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:26.996424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:26.997751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:26.998601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:26.999657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.000993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.001891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.404592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:27.405087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:27.405650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:27.406818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:27.407607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:27.421121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.421781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.422948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.424006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:27.424591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:27.425138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:27.471043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Getting quotas for project 10923d93d36d491ab095e4c5360fa072. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:27.480369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Getting quotas for user 25918ea9699d41048d84386475ab6592 and project 10923d93d36d491ab095e4c5360fa072. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:27.682032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:27.686076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='183b826e-07e2-4e94-9722-56cff64d6c7d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='67a5e1ea-9cbd-4d73-981a-58ed3c32f464',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb3f87eb-c922-4c22-a5b9-6d3196586adb',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:27.822962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:27.980885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:27.990407 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec4ac65d-a9fc-4dbd-a956-2466103bc998 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 200 len: 1526 microversion: 2.1 time: 1.028579 Aug 30 16:22:28.001337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1753/3827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:26 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 1526 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:28.006558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:28.007187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:28.029070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.030644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.032771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.035403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.037214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.038046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.065169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.588661 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5eb85ed5-4bb0-40bf-bf71-ffd010746952 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.585371 Aug 30 16:22:28.589385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2075/3828] 10.222.0.47 () {62 vars in 1189 bytes} [Tue Aug 30 16:22:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 7587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:22:28.598002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:28.598795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:28.621459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.621978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.622466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.623198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.623666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.624101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.660275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:28.848211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:28.870808 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b18791e-3f45-4fdb-a3ff-04b51fcc152a tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1313 microversion: 2.1 time: 0.868207 Aug 30 16:22:28.873857 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1754/3829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:28 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1313 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:28.889396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "484c0a4d-443c-4b90-a6b2-959e5defdfa0", "tag": "9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:28.910571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.911465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.912178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.937758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] Creating event network-changed:9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8 for instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 on n-h2-830883-28 Aug 30 16:22:28.946365 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-feb35367-e0cf-4ff3-a6d3-e1b802965624 req-83fe0398-f146-4bf5-9be4-ee91184897d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067805 Aug 30 16:22:28.948023 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1755/3830] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:28.954117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-unplugged", "status": "completed", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}, {"server_uuid": "4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3", "name": "network-vif-unplugged", "status": "completed", "tag": "f185d61a-90cf-4f76-baa6-7c750f657e78"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:28.970587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:28.971430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:28.972422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:28.996996 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Creating event network-vif-unplugged:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:22:28.997992 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] Creating event network-vif-unplugged:f185d61a-90cf-4f76-baa6-7c750f657e78 for instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 on n-h1-830883-28 Aug 30 16:22:29.008453 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-172c7ac2-0b65-4477-92d9-584fd5f2a96c req-5010d6cb-b3ba-4d4f-8ed3-656eefb9c76f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.058493 Aug 30 16:22:29.009325 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1756/3831] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:29.014825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8ee8689-5da4-4645-b220-9bc5cba3a081 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360feee50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.079424 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8ee8689-5da4-4645-b220-9bc5cba3a081 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.068509 Aug 30 16:22:29.079940 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1757/3832] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:29.086229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.088045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.096171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.096966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.097574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.098487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.099099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.099933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.168334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.178484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9e20fba-ee29-455a-ab0b-15b4bb11513a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.587725 Aug 30 16:22:29.204787 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2076/3833] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:28 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:29.209841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.225157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.349191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.361464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.363345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.365754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45968092-da35-44e5-9cca-dd388f5b5c9f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1286 microversion: 2.42 time: 0.158636 Aug 30 16:22:29.366542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2077/3834] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:29.379061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.379900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.392991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.395396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.395883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.396803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.407080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.407551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.431135 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 HTTP/1.1 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3'} Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:29.433202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:29.437405 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:29.439316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:29.443488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-481ee28e-37a4-49e0-9404-080a772c3510 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 404 len: 111 microversion: 2.1 time: 0.075166 Aug 30 16:22:29.444296 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2078/3835] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:29.449683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:29.464668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.465175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.465626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.530679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:22:29.608540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9cb1f5e3-7dcb-4b66-ad0a-dadfd5bbbbab tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.162808 Aug 30 16:22:29.609143 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2079/3836] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:29 2022] POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:29.617041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.617762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.624415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.625191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.625793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.626703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.627352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.627940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.639600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.653790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c960f927-16df-424c-abb7-50eb624ee56c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1308 microversion: 2.1 time: 0.572179 Aug 30 16:22:29.655762 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1758/3837] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:29.663995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1728265806", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:29.765448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] validate_networks() for [('e8608350-4e18-447f-b2d0-f6df04a4a834', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:29.941250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:29.953972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cfc08735-cafe-4dc8-9c90-49b21e748735 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.341425 Aug 30 16:22:29.971885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2080/3838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:29.977108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:29.977753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:29.995714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.996213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.996666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:29.997390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:29.997863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:29.999220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.307156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.316386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ffe6642f-b22b-4fb1-9704-b14f86189b4f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1675 microversion: 2.1 time: 0.343079 Aug 30 16:22:30.322766 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2081/3839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:29 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1675 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:30.338443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:30.339420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:30.345882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.348905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.349611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.350416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.350908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.351346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.620962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.634106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98f0b05b-197d-4cfb-bb0e-949c0c9f028e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1313 microversion: 2.1 time: 0.309642 Aug 30 16:22:30.635780 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2082/3840] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:30 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:30.641407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:30.643137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:30.649758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:30.651781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.652782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.653611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.654652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.655499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.657054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.860442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:30.861465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:30.862095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:30.862948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:30.863542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:30.881834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.882366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.882820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.883560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:30.884016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:30.886868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:30.895872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:30.906937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3e51a7c-4ef7-4389-8cfc-53f531eef134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.269443 Aug 30 16:22:30.908768 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2083/3841] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:30 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:30.915068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf544936-46db-4d9a-af29-46d1285dd993 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357d51550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:30.942841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:30.945901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:30.957416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Getting quotas for user e34a71bf74dd4f0aba0a8001d6011f2b and project 69e1b70735654a0280cb66d29f7f7a90. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:30.989123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:30.992300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:31.005969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf544936-46db-4d9a-af29-46d1285dd993 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.095925 Aug 30 16:22:31.009072 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2084/3842] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:30 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:31.028412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.029045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.048688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.049193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.050516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.051541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.059387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.060261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.096238 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4574467-3b3c-41ff-a05c-20021f25141f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.436793 Aug 30 16:22:31.097305 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1759/3843] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:22:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:22:31.102082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.102752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.109205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.110343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.110968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.111667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.112363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.112847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.237528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:31.257120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:31.263102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:31.270522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a92d8574-c164-46bf-b647-655c776a9ab2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1576 microversion: 2.42 time: 0.260070 Aug 30 16:22:31.271392 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2085/3844] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1576 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:31.286235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:31.294755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.347071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.347611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.348063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.349473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.349995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.350469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.604615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f32406f6-d689-4427-ba63-6cf2f2ea0a9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.331423 Aug 30 16:22:31.607215 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2086/3845] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:31 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:31.618712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3", "name": "network-vif-deleted", "tag": "f185d61a-90cf-4f76-baa6-7c750f657e78"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:31.652717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.659205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.659954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.715159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] Creating event network-vif-deleted:f185d61a-90cf-4f76-baa6-7c750f657e78 for instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 on n-h1-830883-28 Aug 30 16:22:31.725382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:31.735859 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d22511d6-d2b8-4488-9748-d292460fab7b req-70ff1631-da38-4cee-b8e6-f29ff2b26021 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125148 Aug 30 16:22:31.737278 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2087/3846] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:31.742172 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a138262a-7498-4667-a5a1-d6aac92b542d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1308 microversion: 2.1 time: 0.638093 Aug 30 16:22:31.745857 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1760/3847] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1308 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:31.754248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960f447e-6153-4f68-8ebc-7056b254507c", "name": "network-vif-plugged", "status": "completed", "tag": "1ae8a6fa-4306-4245-9707-5eda4c496026"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:31.766696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94b3f587-d5a9-4b6e-a3ec-99ff085d28e2 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.768841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94b3f587-d5a9-4b6e-a3ec-99ff085d28e2 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.799214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.801576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.803029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.824348 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] Creating event network-vif-plugged:1ae8a6fa-4306-4245-9707-5eda4c496026 for instance 960f447e-6153-4f68-8ebc-7056b254507c on n-h1-830883-28 Aug 30 16:22:31.831094 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7f9449b1-7a52-4149-a75c-01d145b54b0a req-520d52b8-1ffc-42bd-9d6d-72b7bbfaa83d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091876 Aug 30 16:22:31.832625 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2088/3848] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:31.841601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:31.842877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:31.871892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.873533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.876064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.878812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:31.880927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:31.891142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:31.907588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:32.025298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94b3f587-d5a9-4b6e-a3ec-99ff085d28e2 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.033447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94b3f587-d5a9-4b6e-a3ec-99ff085d28e2 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1225 microversion: 2.1 time: 0.286160 Aug 30 16:22:32.042014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1761/3849] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1225 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:32.054887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:32.055853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:32.075182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.075713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.076158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.076865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.099219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.099601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.470812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.483430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b03b472-acaa-4126-8f3d-ee7874bd5f65 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1675 microversion: 2.1 time: 0.644825 Aug 30 16:22:32.483982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2089/3850] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:31 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1675 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:32.494698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:32.495563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:32.516906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.517133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.517555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.518585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.519325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.519799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.520244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.527641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d61de1d9-e226-4ba9-8e75-dc206a6d2ec8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1669 microversion: 2.1 time: 0.484411 Aug 30 16:22:32.528747 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1762/3851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:32 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:32.534377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a3423e2f-97ba-4bd8-8d9c-eb4b304b3d28 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35ce48b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:32.640624 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a3423e2f-97ba-4bd8-8d9c-eb4b304b3d28 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.110483 Aug 30 16:22:32.642013 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1763/3852] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:32 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:32.653908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:32.654855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:32.670034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.670826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.671475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.672432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.673901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.674946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.817066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.827520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.834074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:32.840345 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bbe6c6e1-34b5-46d3-b40e-9e783151ee5f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1594 microversion: 2.42 time: 0.192628 Aug 30 16:22:32.841348 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1764/3853] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:32 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1594 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:32.862900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:32.863838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:32.873615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.879120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.886131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:32.887157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:32.887842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:32.888472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.029013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.041916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25083228-4531-4d88-bdef-c53d29c3b3e2 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1313 microversion: 2.1 time: 0.556522 Aug 30 16:22:33.044885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2090/3854] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:32 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:33.066640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:33.069546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.103532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.104391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.105081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.106038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.106742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.107404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.267681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.282919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1c8e38c-b534-4dcb-acb8-995e7acf9f51 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1277 microversion: 2.1 time: 0.223072 Aug 30 16:22:33.295892 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2091/3855] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:33 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:33.476223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:33.506294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:33.506963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.523824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.527637 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f42ceb1a-d2de-4e54-9d5d-26df718e5291 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1308 microversion: 2.1 time: 0.684839 Aug 30 16:22:33.529722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1765/3856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:32 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1308 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:33.537017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.550152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.551016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.551496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.551962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.564002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:33.564666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:33.608553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.609092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.611772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:33.613992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:33.616125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:33.617521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.386183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:34.441649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-20d553b4-d1d3-4110-b207-f239948aa249 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1669 microversion: 2.1 time: 0.895372 Aug 30 16:22:34.456703 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1766/3857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:33 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1669 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:34.463658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbc9c764-6381-4273-b436-a13f4ed8ae7d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35d4bddc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:34.544387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:34.551672 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbc9c764-6381-4273-b436-a13f4ed8ae7d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.107823 Aug 30 16:22:34.552283 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1767/3858] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:34 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:34.554581 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77c604d2-c68e-4ff6-8d3a-fb7190952ccf tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1675 microversion: 2.1 time: 1.053288 Aug 30 16:22:34.555682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2092/3859] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:33 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1675 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:34.567464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484c0a4d-443c-4b90-a6b2-959e5defdfa0", "name": "network-vif-plugged", "status": "completed", "tag": "9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:34.577831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:34.583583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:34.588704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.591655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.595109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.610110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.617967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.621118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.622055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.622515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] Creating event network-vif-plugged:9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8 for instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 on n-h2-830883-28 Aug 30 16:22:34.624323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.625075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.635406 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-82328bad-b8a7-4239-a107-062618bfa61d req-3d7952b2-9d5c-441e-8a98-90aa10da51a3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077862 Aug 30 16:22:34.638502 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2093/3860] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:34.645753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:34.655659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:34.670984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.676412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.677078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:34.678687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:34.681231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:34.688318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.048202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.057605 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c4f95ce-8a64-40a3-873b-9c2130cfa85e tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1497 microversion: 2.1 time: 0.417684 Aug 30 16:22:35.062709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2094/3861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:34 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:35.074178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:35.075260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:35.096173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.099539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.100183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.101208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.103327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.106775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.491131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.510987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.512806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.514946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.519538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b068ff47-3104-400f-b454-52af20d92395 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1662 microversion: 2.42 time: 0.960619 Aug 30 16:22:35.527985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87d15de9-97a7-4403-be24-428f38d82e6e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1283 microversion: 2.1 time: 0.462878 Aug 30 16:22:35.530126 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2095/3862] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:35 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1283 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:35.540807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:35.542117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1768/3863] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:34 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1662 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:35.544165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:35.550320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:35.551313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:35.560802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.561532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.562198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.564364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.567705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.570664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.587543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.588134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.588590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.590917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:35.592936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:35.594097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:35.970403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:35.988234 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b14d90fb-75a3-4642-91e1-94c45506c79b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.444335 Aug 30 16:22:35.999068 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1769/3864] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:35 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:35.999068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df682223-a377-4b7e-91db-67b6dc89d5e1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35cdbaee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:36.086815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df682223-a377-4b7e-91db-67b6dc89d5e1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.096270 Aug 30 16:22:36.087751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:36.089105 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1770/3865] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:35 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:36.098858 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24038c53-ea00-45e3-98c1-fe0c62ed15ac tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1308 microversion: 2.1 time: 0.565662 Aug 30 16:22:36.101933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:36.103184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:36.103443 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2096/3866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:35 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:36.119036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:36.120307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.120615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.121120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.121901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.122588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.123072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.125522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:36.155592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.157565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.159058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.160609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.164385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.165124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.266622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e583ff11-ac64-4e45-b916-e4b91a2f75e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 200 len: 322 microversion: 2.1 time: 0.160947 Aug 30 16:22:36.272122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2097/3867] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:36 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:36.278481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:36.290599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:36.307437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.311239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.314086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.326128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.337206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.338208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.692376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:36.710605 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2c193dab-8e03-44c4-a27f-a9c0d89e1b89 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.436800 Aug 30 16:22:36.715387 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2098/3868] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:36 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:36.725901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:36.726840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:36.742132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.742900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.744564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:36.745599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:36.748767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:36.749400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.032965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.046881 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc28dea6-f3a9-4d34-a217-a04e9879830d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1675 microversion: 2.1 time: 0.955602 Aug 30 16:22:37.053653 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1771/3869] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:36 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1675 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:37.059078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:37.064728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:37.078864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.087132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.088077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.089078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.089770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.090507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.440124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.457207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.461249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.463525 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8768b2a4-dc0d-45cd-9ce1-82f8bdaf8e23 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1709 microversion: 2.42 time: 0.746062 Aug 30 16:22:37.464286 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2099/3870] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:36 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1709 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:37.476229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:37.488089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:37.490970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:37.502150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.502965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.505705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.508286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.508962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.509570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.534073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.543501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72a4ec73-53fa-4e3e-b32b-8581e9fe3b2f tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1325 microversion: 2.1 time: 0.488166 Aug 30 16:22:37.560817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1772/3871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:37 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:37.561233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0427c8ce-4ae7-4a5b-8b78-85b1e1f997bf tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360e078b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:37.627471 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0427c8ce-4ae7-4a5b-8b78-85b1e1f997bf tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.076032 Aug 30 16:22:37.628248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1773/3872] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:37 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:37.633609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:37.639603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:37.680965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.681753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.691021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.692131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.693276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.693276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.826427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:37.841031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ec74b74a-1339-4c1d-9c49-99bbd5c363bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.368853 Aug 30 16:22:37.841640 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2100/3873] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:37.870876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:37.872183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:37.893793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.930049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.931361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:37.940176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:37.941630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:37.944044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:38.497362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:38.511104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5035a0a5-5976-4f98-a641-9a5db33d94ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.644537 Aug 30 16:22:38.512785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2101/3874] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:38.524836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:38.525394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:38.538947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:38.540905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:38.541536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:38.542487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:38.543101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:38.543716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:38.663546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:38.675237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-102f0a5f-2190-4de3-b216-779518d271ae tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1489 microversion: 2.1 time: 1.045270 Aug 30 16:22:38.676511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1774/3875] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:37 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1489 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:38.681588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:38.682472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:38.690136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:38.691119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:38.691845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:38.693609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:38.694426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:38.695153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:39.191732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.212987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.219059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.221783 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3f76b66-05db-4a7f-8b41-9eb67388e45f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1756 microversion: 2.42 time: 0.544008 Aug 30 16:22:39.226365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1775/3876] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:38 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1756 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:39.252588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:39.253843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:39.282885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:39.284067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:39.286691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:39.287541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:39.288119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:39.290147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:39.355924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:39.384769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.414235 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9cf37278-e112-4315-a50a-b1d7e60c0984 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1675 microversion: 2.1 time: 0.900246 Aug 30 16:22:39.419121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2102/3877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:38 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1675 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:39.448981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:39.449737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:39.471188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:39.472233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:39.473524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:39.476227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:39.477401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:39.479401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:39.964094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.966196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:39.983899 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9eabc0b-b1d5-491b-8a74-b8d2edc2db0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.754420 Aug 30 16:22:39.997631 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1776/3878] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:39.997740 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84f5663b-3d54-4870-b94e-3f582ba771fe tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1325 microversion: 2.1 time: 0.564588 Aug 30 16:22:39.997740 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2103/3879] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:39 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:39.997904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa7c2038-f479-4ec5-aea5-1f2a37d72c68 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35d4fd040>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:39.997995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1694841962"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:39.997995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:40.010951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.016836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.018707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.019703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.025895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.026699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.095919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa7c2038-f479-4ec5-aea5-1f2a37d72c68 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.108053 Aug 30 16:22:40.109049 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1777/3880] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:39 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:40.202680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c33c362e-66c3-43bd-a274-58daa9b0fb49 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "PUT /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1075 microversion: 2.1 time: 0.211186 Aug 30 16:22:40.205576 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2104/3881] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:22:39 2022] PUT /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1075 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:40.236295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:40.237573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:40.273599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.275156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.278659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.282340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.282998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.285001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.525457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:40.535820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9430be56-fd6a-4d3f-b163-93b1f693eca7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1501 microversion: 2.1 time: 0.314478 Aug 30 16:22:40.540966 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2105/3882] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:40 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1501 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:40.545881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:40.548288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:40.564848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.569169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.572827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.573967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.579344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.580083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:40.593207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:40.905742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:40.940927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63db1de3-7e92-40c4-bc72-2d57bb6a0f86", "tag": "e448fd6a-be9e-48b2-86ea-8e3c08022f4a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:40.985373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:40.986029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:40.986294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.025530 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] Creating event network-changed:e448fd6a-be9e-48b2-86ea-8e3c08022f4a for instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 on n-h1-830883-28 Aug 30 16:22:41.035668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-932b86ae-11a0-4293-90e9-29e1004b81a0 req-f468deb7-43c9-425d-9cee-f8b8c0048786 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.922336 Aug 30 16:22:41.036301 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1778/3883] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:41.041473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1263665281", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "14da368a-1038-4232-aa6a-32d46d4c24f8"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:41.047686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:41.071553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:41.074154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:41.078505 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19a2c822-6285-45b2-8aef-67f0fc3dfb4b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1756 microversion: 2.42 time: 0.535640 Aug 30 16:22:41.082420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2106/3884] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:40 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1756 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:41.097514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:41.101164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:41.119025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.126689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.128983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.131513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.133425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.135134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.252948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] validate_networks() for [('14da368a-1038-4232-aa6a-32d46d4c24f8', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:22:41.421895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:41.431180 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-00f1f2cf-8e75-481a-8764-c85032341335 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1652 microversion: 2.1 time: 0.347614 Aug 30 16:22:41.432878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2107/3885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:41 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1652 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:41.462182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:41.463560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:41.473515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.474491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.475390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.476437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.477343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.477989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.763711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:41.775305 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83f50e0c-13a1-4250-9ac5-a17150924c9b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1501 microversion: 2.1 time: 0.341025 Aug 30 16:22:41.791138 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2108/3886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:41 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:41.805460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:41.806904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:41.824510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.825339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.827371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:41.829702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:41.830195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:41.831071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.030133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:42.070159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:42.102542 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc44fdbc-34b2-4f71-9839-755c10dedb2c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1325 microversion: 2.1 time: 0.308290 Aug 30 16:22:42.103800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2109/3887] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:41 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:42.112060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b9dfe04-c304-4d91-8761-77ab7d3b9169 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c03f1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:42.236712 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b9dfe04-c304-4d91-8761-77ab7d3b9169 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.130741 Aug 30 16:22:42.237866 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2110/3888] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:42 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:42.253662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:42.261505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.263097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.264051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.312964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Going to try to start instance {{(pid=122352) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:22:42.434623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daaa4af4-4347-4327-8ae0-b1ab8a1a1ffb tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action" status: 202 len: 0 microversion: 2.1 time: 0.185805 Aug 30 16:22:42.439457 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2111/3889] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:42 2022] POST /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:42.450676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:42.482065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.489055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.507043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.580716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:22:42.581273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:22:42.581865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:22:42.582621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:22:42.583470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:22:42.588015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:22:42.609992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.611653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.612355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.615897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.616839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.617621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.668047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:22:42.686706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:22:42.708964 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7fc54643-1d18-4c8d-ae06-94ac3792943e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "POST /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0/action" status: 202 len: 0 microversion: 2.1 time: 0.267472 Aug 30 16:22:42.710240 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2112/3890] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:42 2022] POST /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:42.717008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:42.717733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:42.736045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:22:42.740196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.740708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.741241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.741556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:22:42.741946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.742437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.742878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.893072 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ad0763d-a6fa-40f4-b2d1-73dddef353bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854805 Aug 30 16:22:42.896493 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1779/3891] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:22:42.913425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:42.914069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:42.939551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.942982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.943486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:42.944251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:42.947642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:42.948717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:43.684036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:43.698653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-15fd17a2-4c05-476f-95b3-6fc9eb115a3d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1661 microversion: 2.1 time: 0.795820 Aug 30 16:22:43.699827 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1780/3892] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:42 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1661 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:43.708897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:43.715723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:43.729293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:43.735449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:43.736432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:43.737341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:43.737946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:43.742509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:43.762832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:43.784528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:43.790124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:43.795780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-885ca2b5-1fa8-4954-8e4c-275dbef7f647 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1803 microversion: 2.42 time: 1.084755 Aug 30 16:22:43.804271 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2113/3893] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:42 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1803 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:43.821364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c6da65b-4d84-4317-9d47-4e317a867d9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:43.822656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c6da65b-4d84-4317-9d47-4e317a867d9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:43.847912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:44.143236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c6da65b-4d84-4317-9d47-4e317a867d9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:44.155276 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c6da65b-4d84-4317-9d47-4e317a867d9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1215 microversion: 2.1 time: 0.349263 Aug 30 16:22:44.180251 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2114/3894] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:43 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1215 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:44.196065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:44.202525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:44.238343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.241117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.244347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.246956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.247119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.251388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.394132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:44.410611 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80cc3b1e-8730-4979-b9d2-fb7ae47489a9 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.701545 Aug 30 16:22:44.411397 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1781/3895] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:43 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:44.416129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:44.416848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:44.438375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.439249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.439926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.440856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.441514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.442141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.509113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:22:44.722243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-458c8b62-dc25-4ede-872c-11b342bd5d86 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "DELETE /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 204 len: 0 microversion: 2.1 time: 0.309533 Aug 30 16:22:44.727522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1782/3896] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:44 2022] DELETE /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:44.748654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c84f5fe7-678c-4670-8bd9-e5eb38d846d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35d4fd1f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:44.825154 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c84f5fe7-678c-4670-8bd9-e5eb38d846d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1422 microversion: 2.1 time: 0.094888 Aug 30 16:22:44.826011 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1783/3897] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:44 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:44.836694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:44.838586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:44.842614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:44.848942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d31347e1-285a-462e-a63d-95937142ef53 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1325 microversion: 2.1 time: 0.667659 Aug 30 16:22:44.854796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2115/3898] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:44 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:44.862524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:44.873232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:44.891675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.892284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.892991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.893346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.894633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.895803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.897215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.911593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:44.911593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.911593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:44.913265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:44.914022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.233510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.242877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-303e23e3-6930-4b1e-873c-7db580251389 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1503 microversion: 2.1 time: 0.386647 Aug 30 16:22:45.246796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2116/3899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:44 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:45.254042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:45.259090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:45.276181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.276683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.277135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.277879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.279320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.279780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.494993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.508200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa0d1ecd-d5de-42ad-b1f0-470d29dd2375 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1661 microversion: 2.1 time: 0.680967 Aug 30 16:22:45.508786 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1784/3900] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:44 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1661 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:45.513613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63db1de3-7e92-40c4-bc72-2d57bb6a0f86", "name": "network-vif-plugged", "status": "completed", "tag": "e448fd6a-be9e-48b2-86ea-8e3c08022f4a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:45.536182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.538359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.540216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.565757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] Creating event network-vif-plugged:e448fd6a-be9e-48b2-86ea-8e3c08022f4a for instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 on n-h1-830883-28 Aug 30 16:22:45.576001 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bae821c5-1c79-44aa-9fce-7d8c25e1e736 req-14e197fa-6691-47f5-8592-51e2eaf77676 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064182 Aug 30 16:22:45.582495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1785/3901] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:45.589833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:45.592215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:45.611933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.615321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.615947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.618633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.619122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.619647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.622437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.635123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.636787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.638258 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ffe86bb-0a26-471b-b27d-3b681136630a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1803 microversion: 2.42 time: 0.390159 Aug 30 16:22:45.642339 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2117/3902] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:45 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1803 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:45.659229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:45.660115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:45.688273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.694704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.696016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.696408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:45.699141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:45.699725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:45.977399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:45.993771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-494d5945-9bf1-4f9b-9de8-f1f001c33600 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.353384 Aug 30 16:22:46.005844 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2118/3903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:45 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.018764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b340246d-2172-4243-9958-93b46efd026a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35cbec310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.043474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:46.052814 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e67a5f15-54fe-4195-aa5f-99ba39ac29c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1267 microversion: 2.1 time: 0.468837 Aug 30 16:22:46.060078 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1786/3904] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:45 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1267 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.065119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.065747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:46.083863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.084369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.084820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.085655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.085974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.086627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.137470 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b340246d-2172-4243-9958-93b46efd026a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1431 microversion: 2.1 time: 0.119266 Aug 30 16:22:46.139052 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2119/3905] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1431 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.156771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-850f9d2e-92e6-49a7-a7c2-30691a6929b9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35cdb9670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.245530 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-850f9d2e-92e6-49a7-a7c2-30691a6929b9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 200 len: 1431 microversion: 2.1 time: 0.096456 Aug 30 16:22:46.256373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2120/3906] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 1431 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:46.261798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.262702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:46.273039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.287529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.288443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.289780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.290505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.291103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.560065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:46.568594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fecd21a9-b2a5-445d-ac9e-58b22f802636 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1480 microversion: 2.1 time: 0.310703 Aug 30 16:22:46.570413 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2121/3907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1480 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.576146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.577126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:46.584256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.585083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.585691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.586584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.587199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.587785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.793019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:46.803108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f697dc72-25b6-497a-9a05-3d42c8d93672 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1503 microversion: 2.1 time: 0.231209 Aug 30 16:22:46.803921 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2122/3908] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.809640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.810436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:46.831718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.834193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.835299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.836710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.837253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.837810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.929696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:46.951851 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2be427af-2081-49dc-a6ed-1a487fe03aec tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1325 microversion: 2.1 time: 0.885005 Aug 30 16:22:46.954217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1787/3909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1325 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:46.966834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:46.967467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:46.988196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.988715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.989162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:46.990990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:46.993771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:46.994456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.066899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.079254 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6da1215-d041-42a8-b448-7fc83fdd6f9f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1661 microversion: 2.1 time: 0.273940 Aug 30 16:22:47.098329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2123/3910] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1661 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:47.098329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:47.098329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:47.112392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.113023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.113492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.114240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.114754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.115200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.344373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.348847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:47.359819 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f657ea1f-c6d3-44d6-8b17-f03e518788c0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.271175 Aug 30 16:22:47.374555 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2124/3911] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:47 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:47.384389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:47.385042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:47.413740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.414499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.415097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.419344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.419925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.420392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.551768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.561634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.565534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.567741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c174e7d-a3da-49dd-bc37-50c036319651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1850 microversion: 2.42 time: 0.612330 Aug 30 16:22:47.568835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1788/3912] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:46 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1850 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:47.584507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:47.597920 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27cc22d1-f51c-4139-b285-89a7c4373ccd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1273 microversion: 2.1 time: 0.236123 Aug 30 16:22:47.598771 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2125/3913] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:47 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:47.604729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:47.607089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:47.622804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.623808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.624459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.625433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.626038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.626680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.835557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:47.836579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:47.848105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.849397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.850207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:47.852055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:47.852733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:47.853462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.012731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:48.020539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:48.029848 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b9eb96d-729e-4948-a985-82375a914ce8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1467 microversion: 2.1 time: 0.437901 Aug 30 16:22:48.030234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3bf5a979-3d44-4fdf-bd95-962993a1221f tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1503 microversion: 2.1 time: 0.204176 Aug 30 16:22:48.031314 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2126/3914] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:47 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:48.047006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1789/3915] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:47 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1467 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:48.051674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.052592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:48.053312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a95a90c9-878b-45cb-a4c1-acfdd49ede8a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360f98670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.060389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.061158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.061772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.062773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.065122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.065937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.113699 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a95a90c9-878b-45cb-a4c1-acfdd49ede8a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325" status: 200 len: 784 microversion: 2.1 time: 0.064896 Aug 30 16:22:48.114819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1790/3916] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:48 2022] GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325 => generated 784 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:48.120831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.121606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:48.130585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.131420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.132060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.132939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.133769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.134403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.252062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:48.265726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58ca7703-0a8a-4b53-8ea5-6396205889d1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1522 microversion: 2.1 time: 0.232296 Aug 30 16:22:48.267029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2127/3917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:48 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:48.274287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60474dd3-2ed4-477e-9dc7-87863fb7c436 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.288992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60474dd3-2ed4-477e-9dc7-87863fb7c436 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019862 Aug 30 16:22:48.289457 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2128/3918] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:22:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:48.295473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.296294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:48.305965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.306769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.307105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.308968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.308968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.309283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.391344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:22:48.519608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5aaab087-fb44-47e3-a43b-6cbf26087a0e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 204 len: 0 microversion: 2.1 time: 0.228869 Aug 30 16:22:48.524898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2129/3919] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:48 2022] DELETE /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:48.532793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f22190a8-c8e2-4dac-83b2-3f2661d960e8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357e089d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.603426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:48.612627 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e713830-93e5-4cec-aa4e-2869cb8be1c1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1665 microversion: 2.1 time: 0.496260 Aug 30 16:22:48.631043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1791/3920] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:48 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1665 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:48.645771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:48.650011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:48.660868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.663010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.663934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:48.664990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:48.667785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:48.668394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.002685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.025292 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-768a1c95-5c5c-4b54-82f9-48a31c0cef4e tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.383898 Aug 30 16:22:49.026468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1792/3921] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:48 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:49.042398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:49.043114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:49.063172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.064016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.064690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.065649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.066350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.073618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.433342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.445223 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b1f919e-cd46-43d3-b7dd-8242374ccc62 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1528 microversion: 2.1 time: 0.417410 Aug 30 16:22:49.448783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1793/3922] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:49 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1528 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:49.459203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960f447e-6153-4f68-8ebc-7056b254507c", "name": "network-vif-deleted", "tag": "1ae8a6fa-4306-4245-9707-5eda4c496026"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:49.467495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f22190a8-c8e2-4dac-83b2-3f2661d960e8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "DELETE /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 204 len: 0 microversion: 2.1 time: 0.940336 Aug 30 16:22:49.468342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2130/3923] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:48 2022] DELETE /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:22:49.473393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:49.474137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:49.475170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.475812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.476399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.491307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.491809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.492107 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] Creating event network-vif-deleted:1ae8a6fa-4306-4245-9707-5eda4c496026 for instance 960f447e-6153-4f68-8ebc-7056b254507c on n-h1-830883-28 Aug 30 16:22:49.492286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.493127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.493594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.494026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.500998 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-970e4b53-a41e-4e1a-878d-b28180590f91 req-9007e6d0-7ae2-49fc-aa04-e34af3fc7484 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050679 Aug 30 16:22:49.502110 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1794/3924] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:49.507407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:49.508280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:49.516644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.518249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.518880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.519974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.520600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.521038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.854371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.864383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.866413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.867608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3846e665-d9e6-49ce-9fe7-cc869376c7b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1850 microversion: 2.42 time: 0.398312 Aug 30 16:22:49.868328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2131/3925] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:49 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1850 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:49.872757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:49.873380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:49.879982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.880484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.880905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.881600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:49.882059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:49.882518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:49.961359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e441bf510b8441288c28dc6fbc7e8cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec81a72a0c8143d994b45e6d66649113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:49.970289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8539e8fd-145c-40b6-bc7d-337d5d6be6e8 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 200 len: 1298 microversion: 2.1 time: 0.100969 Aug 30 16:22:49.970989 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2132/3926] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:49 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:49.988747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a43d5fc-1247-4084-8439-bfaccf4f157f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357fcbca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:50.012521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8a43d5fc-1247-4084-8439-bfaccf4f157f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] HTTP exception thrown: Image not found. Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a43d5fc-1247-4084-8439-bfaccf4f157f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Request method failure captured: Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 HTTP/1.1 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjkYp8rWIQPyPdbANS9F9YOeOCfhWmdc_NVL2AJqfGJYHt0PYXMyadyr0SNv84bu7-HVFdhNAd3evp6clSY2jf9jwYm-_xcBv-kYztewqCTjyzXhALXGUGNn6wtfHwq4in9ZU5BxHjANa3iOAw0D8zvRJKYsn2vcz4YXti1UuGVAOnU Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}] Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f543ea78c4814a9ab8ad80da0b343de8 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9b6b9f9c-c9c5-4ead-af95-04a98ce24062'} Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9b6b9f9c-c9c5-4ead-af95-04a98ce24062 Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 16:22:50.015301 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b6b9f9c-c9c5-4ead-af95-04a98ce24062 could not be found. Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:22:50.020135 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:50.025731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a43d5fc-1247-4084-8439-bfaccf4f157f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:50.025731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a43d5fc-1247-4084-8439-bfaccf4f157f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 404 len: 62 microversion: 2.1 time: 0.041152 Aug 30 16:22:50.026268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2133/3927] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:49 2022] GET /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:22:50.031858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-unplugged", "status": "completed", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:50.043137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.044150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.044792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.067156 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] Creating event network-vif-unplugged:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:22:50.089103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fee7f1e4-d181-416a-9f68-d67423b1ac10 req-df0659cb-225a-4e48-a7ba-088335da1686 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048919 Aug 30 16:22:50.091558 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2134/3928] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:50.117642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:50.123668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1260426294"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:50.131416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:50.144861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:50.148765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb0edeec-7a36-4602-9c95-9aa2deb16c11 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.645240 Aug 30 16:22:50.150149 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1795/3929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:49 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:50.150409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.151071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.152664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.154598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.154969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:50.155112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.156443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:50.158599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.178530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.180522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.180974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.181701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.184706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.185450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.502276 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c684e775-daeb-4272-bfd0-60873ad3c781 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "POST /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2/action" status: 202 len: 0 microversion: 2.1 time: 0.406183 Aug 30 16:22:50.503909 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2135/3930] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:22:50 2022] POST /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:22:50.509657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:50.510409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:50.517581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.518440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.519224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.520211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.520773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.521264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.748758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:50.761123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-185690f1-40ad-4576-80b6-5def225a03bf tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1528 microversion: 2.1 time: 0.255949 Aug 30 16:22:50.763041 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2136/3931] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:50 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:50.779119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-926b6256-41de-407e-b081-488f644c0db3 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357fcb5e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:50.846391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-926b6256-41de-407e-b081-488f644c0db3 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.080609 Aug 30 16:22:50.854442 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2137/3932] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:50 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:50.893233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:50.894040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:50.904020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.904852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.905878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:50.906907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:50.907494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:50.908027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.017126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:51.026665 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3995ef75-f514-4b6e-88a9-fb378e2de918 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.875391 Aug 30 16:22:51.027796 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1796/3933] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:50 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:51.038158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:51.042318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] [instance: 960f447e-6153-4f68-8ebc-7056b254507c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:51.066730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.067499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.068144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.069074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.069681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.070248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.087368 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] HTTP exception thrown: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Request method failure captured: Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c HTTP/1.1 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjkxXTHkh0oGmwsKZ64GL3tci3ggdILPYFXWogYEftdv9Qn9tgcaH4YI5pJcUofjqtUMxWbU4ozi1UuEaplBQN3FZ9C5eld0FKgVaoSzg8ovfEjWBVYYuRDseytXMUNMOhHGSCDaNnpFkmN2aqmKmuULDYDeMThitSZgnESafEpugDM Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ec81a72a0c8143d994b45e6d66649113 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesActionsTest-1035853174 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ec81a72a0c8143d994b45e6d66649113"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ec81a72a0c8143d994b45e6d66649113"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ec81a72a0c8143d994b45e6d66649113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ec81a72a0c8143d994b45e6d66649113"}]}] Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesActionsTest-1035853174 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ec81a72a0c8143d994b45e6d66649113 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesActionsTest-1035853174 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesActionsTest-1035853174-project Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e441bf510b8441288c28dc6fbc7e8cb8 Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesActionsTest-1035853174-project Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '960f447e-6153-4f68-8ebc-7056b254507c'} Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:51.089352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. Aug 30 16:22:51.094000 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:51.095564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] Returning 404 to user: Instance 960f447e-6153-4f68-8ebc-7056b254507c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:51.096715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-850a5ea1-5c7f-4890-bf2a-86be0b743807 tempest-VolumesActionsTest-1035853174 tempest-VolumesActionsTest-1035853174-project] 10.222.0.47 "GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c" status: 404 len: 111 microversion: 2.1 time: 0.067741 Aug 30 16:22:51.098761 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1797/3934] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:51 2022] GET /compute/v2.1/servers/960f447e-6153-4f68-8ebc-7056b254507c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:51.161197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:51.169276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:51.174808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:51.191639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.193132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:51.194124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.194662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.195576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.196266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.196843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.207807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:51.209081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8585ce9-e5ef-4036-80e7-c944a3e90fc4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1850 microversion: 2.42 time: 0.321723 Aug 30 16:22:51.209671 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2138/3935] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:50 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1850 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:51.549674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "318073c3-10ec-444f-8ce0-6268c151f684"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:51.581387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.582054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.582714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.610789 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] Creating event network-changed:318073c3-10ec-444f-8ce0-6268c151f684 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:22:51.620952 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fa0dedbd-04ee-489c-868f-98895b3ba6e0 req-a77f29a1-358c-4d8e-9868-428232362430 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074790 Aug 30 16:22:51.623354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2139/3936] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:51.767296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:51.788815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d476d4b7-5c07-472d-80fc-1b0b8bccb75e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.622348 Aug 30 16:22:51.791898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:51.792364 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1798/3937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:51 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:51.795295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:51.806133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.807399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.807953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.809342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:51.809919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:51.810511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:51.866381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a43f8713-b085-4ea2-a44c-43c38058308d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c311550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:51.959715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a43f8713-b085-4ea2-a44c-43c38058308d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.097536 Aug 30 16:22:51.962197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1799/3938] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:51 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:52.050491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:52.053017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:52.071797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.073324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.073782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.076460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.076972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.077747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.643120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.675150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e34a71bf74dd4f0aba0a8001d6011f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69e1b70735654a0280cb66d29f7f7a90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:52.705295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0743547e-a885-466f-9df8-9842c43b543e tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 200 len: 1528 microversion: 2.1 time: 0.921417 Aug 30 16:22:52.708581 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2140/3939] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:51 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 1528 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:52.722524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:52.743013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:52.744946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:52.761740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.762252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.762728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.766102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.768906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.769606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.843612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:52.867969 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-40835536-4c57-4491-9206-020ae53bca31 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.823528 Aug 30 16:22:52.868562 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1800/3940] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:52 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:52.879902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:52.880827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:52.900282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.901000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.901606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.903170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:52.904676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:52.905302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:52.913687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.227908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:53.238846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2dd926da-006f-4310-8e7b-e0064b07208d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.368221 Aug 30 16:22:53.256163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1801/3941] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:52 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:53.263680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31f6fd1d-89c9-42ad-ba3d-27d80d4d387c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360f24f70>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.340380 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31f6fd1d-89c9-42ad-ba3d-27d80d4d387c tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.082845 Aug 30 16:22:53.343903 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1802/3942] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:53 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:53.457140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:53.469906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:53.472417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:53.474641 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9a248ce-12ce-47dd-9404-107003de8125 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1871 microversion: 2.42 time: 0.747233 Aug 30 16:22:53.476447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2141/3943] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:52 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1871 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:53.647979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8874af2e-b445-4c3f-b489-51e258351807", "tag": "ca14b877-e929-4757-856e-6c7f3755c822"}, {"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "1bed3514-f847-4fe3-8b2d-599e3a2d21e8"}, {"server_uuid": "63db1de3-7e92-40c4-bc72-2d57bb6a0f86", "name": "network-vif-deleted", "tag": "e448fd6a-be9e-48b2-86ea-8e3c08022f4a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:53.666105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:53.670220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.670978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.672364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.688878 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Creating event network-changed:ca14b877-e929-4757-856e-6c7f3755c822 for instance 8874af2e-b445-4c3f-b489-51e258351807 on n-h2-830883-28 Aug 30 16:22:53.689618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Creating event network-changed:1bed3514-f847-4fe3-8b2d-599e3a2d21e8 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:22:53.690347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] Creating event network-vif-deleted:e448fd6a-be9e-48b2-86ea-8e3c08022f4a for instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 on n-h1-830883-28 Aug 30 16:22:53.705516 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cf208929-83f1-4e99-9bda-e746e0dbf4cd req-68e5ed3c-29a7-49f7-adc9-b32083102c1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.061768 Aug 30 16:22:53.706889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1803/3944] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:53.729292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.729978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 63db1de3-7e92-40c4-bc72-2d57bb6a0f86] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:53.743103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.745831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.746344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.748100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.748591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.749045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.783488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 HTTP/1.1 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '63db1de3-7e92-40c4-bc72-2d57bb6a0f86'} Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.785429 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.788825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 63db1de3-7e92-40c4-bc72-2d57bb6a0f86 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:53.789342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d97e97a5-8d78-4e96-bcc0-b0fe130d8059 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86" status: 404 len: 111 microversion: 2.1 time: 0.063844 Aug 30 16:22:53.795100 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2142/3945] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:53 2022] GET /compute/v2.1/servers/63db1de3-7e92-40c4-bc72-2d57bb6a0f86 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:53.799850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2ac0cae-ebb6-4c98-abd1-a349afeb80a9 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd35c155670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.827305 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-a2ac0cae-ebb6-4c98-abd1-a349afeb80a9 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Image not found. Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2ac0cae-ebb6-4c98-abd1-a349afeb80a9 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49 HTTP/1.1 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8d71e40a-bd7f-439a-aa28-0fc6d029af49'} Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8d71e40a-bd7f-439a-aa28-0fc6d029af49 to delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d71e40a-bd7f-439a-aa28-0fc6d029af49 could not be found. Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.830217 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2ac0cae-ebb6-4c98-abd1-a349afeb80a9 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2ac0cae-ebb6-4c98-abd1-a349afeb80a9 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49" status: 404 len: 62 microversion: 2.1 time: 0.037703 Aug 30 16:22:53.834810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1804/3946] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:53 2022] DELETE /compute/v2.1/images/8d71e40a-bd7f-439a-aa28-0fc6d029af49 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:22:53.841215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.841823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:53.854741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.855263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.855753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.856431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.857970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.858554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.872221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "4330790f-64ef-4c65-8b06-f3d794f22810"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:53.898782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.899274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.907107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.912381 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 HTTP/1.1 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3'} Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:53.914243 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:53.917768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:53.922025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:53.931668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ba1d82c-f942-42c8-b516-5b372ab45e14 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 404 len: 111 microversion: 2.1 time: 0.091937 Aug 30 16:22:53.938382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2143/3947] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:53 2022] DELETE /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:22:53.950731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] Creating event network-changed:4330790f-64ef-4c65-8b06-f3d794f22810 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:22:53.956889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.957747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:53.966262 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-53a313ea-a48b-4089-98de-f0b222a98ef6 req-247a548a-e2c6-49b7-96db-76a9d25cfa53 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097673 Aug 30 16:22:53.973921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1805/3948] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:53.977410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.978041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.978513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.979352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:53.979771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:53.980211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:53.990058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:53.990812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:54.005824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.013358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.014065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.015005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.015684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.016438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.047104 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 HTTP/1.1 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3'} Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:54.049527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. Aug 30 16:22:54.053054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:22:54.055203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:54.057208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb96b466-1033-495c-8796-6f264afbeed1 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3" status: 404 len: 111 microversion: 2.1 time: 0.082030 Aug 30 16:22:54.063292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1806/3949] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:53 2022] GET /compute/v2.1/servers/4db59a6a-a2d7-4eec-bf96-727fc5f5b9c3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:22:54.071448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16b41a63-764d-48da-ad25-ecca4542213c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd360f1a040>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:54.131974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16b41a63-764d-48da-ad25-ecca4542213c tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165820379" status: 202 len: 0 microversion: 2.1 time: 0.065637 Aug 30 16:22:54.133164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1807/3950] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1165820379 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:22:54.153352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:54.262939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:54.263877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:54.277861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.283214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.284823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.287729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.292301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.293618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.657451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:54.679585 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a1fbbaf-0e74-457c-8f61-f1efaff81497 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.739426 Aug 30 16:22:54.691181 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2144/3951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:53 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:54.700360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85f9ce3f-49d6-40f2-8c04-845e686ac397 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c4c7dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:54.778462 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85f9ce3f-49d6-40f2-8c04-845e686ac397 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.085829 Aug 30 16:22:54.782506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:54.784072 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2145/3952] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:54 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:54.795417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:54.796745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:54.801911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29a194cd-634a-4f1c-b0ea-a007196d1a06 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.544250 Aug 30 16:22:54.811095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.817064 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1808/3953] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:54 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:54.818061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.818655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.819515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:54.820087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:54.820610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:54.838720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:22:55.246314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:55.269614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:55.272701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:55.276574 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-221c2c3e-7762-4c09-b692-78301c0a0ba4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1892 microversion: 2.42 time: 0.491133 Aug 30 16:22:55.282180 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2146/3954] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:54 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1892 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:55.705273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:55.706196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:55.731273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.734344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.736972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:55.741668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.742447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.743147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:55.798842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0fac0e7d-f9f4-4a63-ac44-8f7d6fa2359f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c3d03a0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:55.876021 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0fac0e7d-f9f4-4a63-ac44-8f7d6fa2359f tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.081584 Aug 30 16:22:55.883711 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2147/3955] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:55 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:55.889614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:55.891898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:55.899377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.900253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.900859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:55.902751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:55.903383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:55.903969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.138486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:56.153577 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0591529b-74dc-45b9-971f-8fd128a39005 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.452641 Aug 30 16:22:56.157217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1809/3956] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:55 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:56.167428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "d28bb004-9061-4c27-8b2a-bd4d3cc48ede"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:56.186706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:56.189543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:56.190166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.214524 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] Creating event network-changed:d28bb004-9061-4c27-8b2a-bd4d3cc48ede for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:22:56.221078 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-22a8b934-baf7-462b-815c-cb355ee4fc2c req-059aaf75-4660-4f73-ab26-5fef2daa0330 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062356 Aug 30 16:22:56.225568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1810/3957] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:56.308556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:56.315847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:56.324473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:56.337816 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0b242589-12f5-487b-a331-801aa0108983 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.452694 Aug 30 16:22:56.340446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:56.341304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2148/3958] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:55 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:56.341880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:56.342774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.343837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:56.345140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:56.346050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:56.892030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7eac527-4ac3-42b4-a57f-d02e51d6be76 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357e254c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:56.977002 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7eac527-4ac3-42b4-a57f-d02e51d6be76 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.089724 Aug 30 16:22:56.979139 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2149/3959] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:56 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:22:56.990060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68fb01f4-4e0b-424c-8049-a7777ab0050b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '.version_select at 0x7fd35c086310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.028868 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-68fb01f4-4e0b-424c-8049-a7777ab0050b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Image not found. Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68fb01f4-4e0b-424c-8049-a7777ab0050b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/images/85832d2e-ed8f-469e-a254-784b3607a3ab HTTP/1.1 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: exception: Image not found. Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '85832d2e-ed8f-469e-a254-784b3607a3ab'} Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 85832d2e-ed8f-469e-a254-784b3607a3ab to delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85832d2e-ed8f-469e-a254-784b3607a3ab could not be found. Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.031567 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.036690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68fb01f4-4e0b-424c-8049-a7777ab0050b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Image not found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:57.038182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68fb01f4-4e0b-424c-8049-a7777ab0050b tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/images/85832d2e-ed8f-469e-a254-784b3607a3ab" status: 404 len: 62 microversion: 2.1 time: 0.053846 Aug 30 16:22:57.038884 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2150/3960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:56 2022] DELETE /compute/v2.1/images/85832d2e-ed8f-469e-a254-784b3607a3ab => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:22:57.050390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.054014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:57.067876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.074288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.075002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.075876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.076608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.077175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.106669 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 HTTP/1.1 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673'} Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:57.116551 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.119991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.123929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:57.125779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9178e664-7a95-42b6-8672-4e0caec4e940 tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "DELETE /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 404 len: 111 microversion: 2.1 time: 0.082814 Aug 30 16:22:57.127061 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2151/3961] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:22:57 2022] DELETE /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:22:57.136730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.137728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] [instance: 750ddea4-f849-4516-8272-ae410a6b1673] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:57.154509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.155279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.157050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.159271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.160748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.164713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.200237 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] HTTP exception thrown: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Request method failure captured: Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 HTTP/1.1 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjQTjIzpAmm87oGHzOIIKWvjXIh_WhKqfOtTD5EM2Cez3EdzT8CZ35HryiocIPhl58oK4PPl1wUFegQdUapg3KSgKVaf2rsl2nG6iybzbePIhORuqxM-1dOg8KsVWeLgHjQSphZXn4a9ti7ps3b-Si5qd6TJGH9FKtlgb9N8YCbOAU Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/69e1b70735654a0280cb66d29f7f7a90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/69e1b70735654a0280cb66d29f7f7a90"}]}] Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 69e1b70735654a0280cb66d29f7f7a90 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874 Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e34a71bf74dd4f0aba0a8001d6011f2b Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1728019874-project Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '750ddea4-f849-4516-8272-ae410a6b1673'} Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.208531 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. Aug 30 16:22:57.212184 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:22:57.214488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] Returning 404 to user: Instance 750ddea4-f849-4516-8272-ae410a6b1673 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:22:57.215741 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89f75a21-711e-49bc-9a48-1cf1d361d37d tempest-ImagesOneServerNegativeTestJSON-1728019874 tempest-ImagesOneServerNegativeTestJSON-1728019874-project] 10.222.0.47 "GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673" status: 404 len: 111 microversion: 2.1 time: 0.084915 Aug 30 16:22:57.222104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2152/3962] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:57 2022] GET /compute/v2.1/servers/750ddea4-f849-4516-8272-ae410a6b1673 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:22:57.227707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.229365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:57.237953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.238773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.239442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.240484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.241145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.241779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.402018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:57.417011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:57.419360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:57.422647 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bed5563a-9219-4671-ba28-8b137f6dffa6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1892 microversion: 2.42 time: 1.118993 Aug 30 16:22:57.424172 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1811/3963] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:56 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1892 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:57.435514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:57.439689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:57.460047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.460798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.461400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:57.462292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:57.462942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:57.465445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.272107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:58.289536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-100a854c-b7c4-46ce-a21b-ebe2acc866da tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.863464 Aug 30 16:22:58.290355 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1812/3964] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:57 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:58.298436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88d8a4b0-3d95-4ae6-a9cd-149e2feef766 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360e07e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:58.310617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:58.321029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84506039-ddd2-4844-b69f-33e95144f1e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 1.097314 Aug 30 16:22:58.325627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2153/3965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:57 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:58.347154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "55474cec-b9bf-4649-bf10-bfc28a66716a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:58.399641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.401150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.403500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.405308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88d8a4b0-3d95-4ae6-a9cd-149e2feef766 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.113657 Aug 30 16:22:58.413864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1813/3966] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:58 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:58.446765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] Creating event network-changed:55474cec-b9bf-4649-bf10-bfc28a66716a for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:22:58.453380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:58.454176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:58.461579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3d1da39b-7fbb-4833-8c8b-6f98d7f512c3 req-a2ef7454-2767-4819-8b85-355aa01cc79c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134307 Aug 30 16:22:58.464928 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2154/3967] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:58.466577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.467341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.468004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.473449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.474204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.474889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.548064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-plugged", "status": "completed", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:22:58.579187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:58.579681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:58.580127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:58.620868 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] Creating event network-vif-plugged:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:22:58.648697 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6603ff49-f06c-487e-a61d-1a64ec65fe43 req-354845fd-301f-45f7-af06-f087cb5c7dac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105760 Aug 30 16:22:58.653964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2155/3968] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:22:59.208480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.227890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.248429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.250255 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbceef7f-2f3d-46ee-bcda-f25a4eee6920 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1892 microversion: 2.42 time: 0.801440 Aug 30 16:22:59.253131 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1814/3969] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:22:58 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1892 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:22:59.316257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:59.317139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:59.337626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.347301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:59.348301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:22:59.351990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.355405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.356155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.367981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.368813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.369717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.370437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.373935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.375345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:22:59.377446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:22:59.378118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:22:59.749519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:22:59.761793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eafc1483-6bff-49cb-8581-2bf4f77d8f8d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.418510 Aug 30 16:22:59.763103 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1815/3970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:59 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:22:59.773304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7df40bc-9e77-4738-a199-3a4791c421b6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360f1aca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:22:59.844506 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7df40bc-9e77-4738-a199-3a4791c421b6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.079861 Aug 30 16:22:59.845614 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1816/3971] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:22:59 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:00.161428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.213631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e719568-badc-480b-bd1e-212ecca22b4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.899252 Aug 30 16:23:00.216494 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2156/3972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:22:59 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:00.276981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:00.277616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:00.301638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.302315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.303292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.304596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.305293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.308640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.508243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "5bc6f1b1-48e4-40be-85bc-dfeba68ac3df"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:00.530148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.534061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.553792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.615145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] Creating event network-changed:5bc6f1b1-48e4-40be-85bc-dfeba68ac3df for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:00.627985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c28d4886-9da7-4bf0-a888-399f98c5a4f8 req-2f857d2b-c498-41d8-8700-2af6076c704f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124619 Aug 30 16:23:00.630722 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2157/3973] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:00.785425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:00.786151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:00.798329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.806095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.806728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.807509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:00.807980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:00.808421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:00.884722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.912212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.918753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:00.925476 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-785d244c-8f70-4ddd-992e-eaf474168414 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1892 microversion: 2.42 time: 0.650837 Aug 30 16:23:00.929942 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1817/3974] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:00 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1892 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:00.942666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce2029e0-a337-42d6-a525-0b06b0530cfa tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360f244c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:01.027397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce2029e0-a337-42d6-a525-0b06b0530cfa tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.095999 Aug 30 16:23:01.036546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1818/3975] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:00 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:01.239609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:01.240580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:01.256003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.259163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.261116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.264910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.267276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.268669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.353158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:01.368973 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a731b6bd-c7b3-40ba-8bcd-6b98ff865b1c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.587632 Aug 30 16:23:01.382957 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2158/3976] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:00 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:01.511467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8874af2e-b445-4c3f-b489-51e258351807", "name": "network-vif-plugged", "status": "completed", "tag": "ca14b877-e929-4757-856e-6c7f3755c822"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:01.541747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.542289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.542805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.596138 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] Creating event network-vif-plugged:ca14b877-e929-4757-856e-6c7f3755c822 for instance 8874af2e-b445-4c3f-b489-51e258351807 on n-h2-830883-28 Aug 30 16:23:01.614295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ed1c4564-bd8d-43f9-be74-b18e734ea6e5 req-87e3251d-0df1-4811-bf8b-72aec87e783d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106462 Aug 30 16:23:01.626878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2159/3977] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:01.958451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:01.959183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:01.971764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.972273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.979053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:01.979791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:01.980818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:01.981275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.274956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.286283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.288062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.289608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23c079db-4bf9-448c-bab0-af0bd6b311ab tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1892 microversion: 2.42 time: 0.336892 Aug 30 16:23:02.306912 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2160/3978] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:01 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1892 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:02.315304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4a97fc9-ed2e-4221-a41f-5ccd58dfcc91 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c3d0ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:02.399883 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4a97fc9-ed2e-4221-a41f-5ccd58dfcc91 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.091084 Aug 30 16:23:02.401547 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2161/3979] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:02 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:02.408855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:02.411055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:02.421023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.422964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.424435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.425445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.426147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.426795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.659266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.668319 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae7ef415-c349-4ee3-bb8a-49a1ee6e6336 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.265538 Aug 30 16:23:02.669128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2162/3980] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:02 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:02.675535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:02.681835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "52e68554-301a-4a5b-ab8e-a8f37c914c6b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:02.693184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7378211-0206-4752-b89d-90c66c6ff372 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 1.457564 Aug 30 16:23:02.696395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:02.697076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:02.697906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:02.708113 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1819/3981] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:01 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:02.712062 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] Creating event network-changed:52e68554-301a-4a5b-ab8e-a8f37c914c6b for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:02.719126 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-034e2c37-f50c-49e7-afb9-5a68635ee9ec req-23b76e17-b044-4f34-88eb-b8bf50de6273 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041940 Aug 30 16:23:02.726390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2163/3982] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:03.319677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.320626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:03.329030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.329808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.330546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.331471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.332170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.332805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.417774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36f9e9f1-30ce-46ce-977c-2e28a5292140 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c4195e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.493898 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36f9e9f1-30ce-46ce-977c-2e28a5292140 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.081251 Aug 30 16:23:03.501445 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2164/3983] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:03.693948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.694728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:03.732478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.733176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.737736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.740933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.741419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.746029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.806707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:03.855985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:03.863051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:03.869952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-141624e0-d987-4c5b-9844-cb22e3223a54 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.554012 Aug 30 16:23:03.890024 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1820/3984] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:03.899817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:03.903122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:03.911543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.912334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.913008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:03.913885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:03.914677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:03.915868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:04.165879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:04.175309 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0b41bd8-6637-4e2c-8836-ff449d70f689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1315 microversion: 2.1 time: 0.283730 Aug 30 16:23:04.179234 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1821/3985] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:04.263647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:04.274474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8da9d4db-597e-421a-ace6-53bab3f214e3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.584276 Aug 30 16:23:04.289694 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2165/3986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:03 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:04.516070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4646534a-d7a5-4323-ad4c-dce060d394dc tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c168280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:04.610123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4646534a-d7a5-4323-ad4c-dce060d394dc tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.098488 Aug 30 16:23:04.612298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1822/3987] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:04 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:04.899595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:04.901500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:04.918089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.918638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.920315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:04.921115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:04.923623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:04.924724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.208477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:05.209216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:05.224003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:05.224516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:05.224959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.225669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:05.226124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:05.226596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.386271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.397680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.403181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.408790 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b26d3416-2ec2-4b18-84b7-099c07c5a8ff tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.513180 Aug 30 16:23:05.429666 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2166/3988] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:04 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:05.463067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:05.464124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:05.472973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:05.473803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:05.474829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.477197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:05.478193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:05.479345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.703113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.716425 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30eeaf8b-3664-491b-a8cf-8183279580b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1501 microversion: 2.1 time: 0.523744 Aug 30 16:23:05.717049 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1823/3989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:05 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1501 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:05.738028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d09d0e7-9fc4-4b5d-83e9-ae0462e294f0 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c1659d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:05.838076 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d09d0e7-9fc4-4b5d-83e9-ae0462e294f0 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.119766 Aug 30 16:23:05.839835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1824/3990] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:05 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:05.848091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:05.853032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:05.861911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:05.862628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e376893-1e9e-4088-8238-1c02b6a6acbe tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.417210 Aug 30 16:23:05.863227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2167/3991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:05 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:05.865828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:05.866589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:05.915031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Going to try to stop instance {{(pid=122351) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:23:06.032071 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f1873fb-856f-46d2-af80-ac5a61d03f57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807/action" status: 202 len: 0 microversion: 2.1 time: 0.190584 Aug 30 16:23:06.040038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1825/3992] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:05 2022] POST /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:06.049548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:06.050131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:06.074320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.078796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.079587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.080585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.081310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.086438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.443706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:06.445303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:06.480432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.481184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.481917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.483028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:06.484304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:06.485021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:06.884044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:06.907963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17258e7e-9a8d-4605-8a50-ab30c9811849 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.863443 Aug 30 16:23:06.920714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2168/3993] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:06 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:06.944075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb928987-3f02-4830-bafd-bfa1edb30c29 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c419c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:07.079252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb928987-3f02-4830-bafd-bfa1edb30c29 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.147204 Aug 30 16:23:07.082441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2169/3994] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:06 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:07.088358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:07.088993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:07.130030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.130575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.134188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:07.139810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.141447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.150051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:07.217106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:07.233800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:07.239848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:07.241623 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e29f9ebb-767b-4854-a586-37c0828b10b8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.803849 Aug 30 16:23:07.244461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1826/3995] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:06 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:07.898455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:07.910802 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4068a1e-eae0-4870-b8d8-f25bce70a8eb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.826897 Aug 30 16:23:07.916203 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2170/3996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:07 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:07.957348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:07.960732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:07.988329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.990533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.992275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:07.994066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:07.996541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:07.997169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:08.062904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:08.096755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-608bee9b-15c9-4a48-a3b2-4a77dbdb6f27 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357fcbaf0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:08.195271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-608bee9b-15c9-4a48-a3b2-4a77dbdb6f27 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.104590 Aug 30 16:23:08.195913 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2171/3997] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:08 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:08.270598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:08.271503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:08.284715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:08.285976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:08.288079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:08.289028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:08.290167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:08.291422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:08.909488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:08.923771 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ebd3284-b4b8-4ba3-bebf-3c88226d82d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.984735 Aug 30 16:23:08.924365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1827/3998] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:07 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:08.941147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:08.957681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:08.994579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:08.995272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:08.995744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:09.003222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:09.003728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:09.004293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:09.146026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:09.169942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:09.178078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:09.194060 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3e223c0-979c-409c-b9a9-56fec59b26ce tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.915629 Aug 30 16:23:09.194060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2172/3999] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:08 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:09.220943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1fd0a637-e8dd-4fa0-bd6c-f3de2605f4a6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c306ca0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:09.312732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1fd0a637-e8dd-4fa0-bd6c-f3de2605f4a6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.104926 Aug 30 16:23:09.313488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2173/4000] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:09 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:09.731163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:09.747589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c56cfa5-efdb-480a-8328-008a45e4cf73 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.812591 Aug 30 16:23:09.760791 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1828/4001] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:08 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:09.949564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:09.950558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:09.970327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:09.972501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:09.973376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:09.976175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:09.977689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:09.994749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.214166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:10.214816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:10.238336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.241118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.241775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.246555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.247258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.247860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.323997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:10.337224 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2422cf5-ac38-43fa-8ad9-2b7ca1ea71fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.394351 Aug 30 16:23:10.338478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2174/4002] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:09 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:10.344194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4383cc1c-2610-4dc0-862c-79645a1d18a0 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35cbec310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:10.457884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4383cc1c-2610-4dc0-862c-79645a1d18a0 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.118028 Aug 30 16:23:10.463103 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2175/4003] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:10 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:10.636094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:10.659332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:10.663283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:10.669827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e7979e2-e530-4b41-9fbe-21af095e373d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.457869 Aug 30 16:23:10.674012 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1829/4004] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:10 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:10.781953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:10.782580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:10.803260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.803766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.804222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.804944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:10.805407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:10.805839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:10.888370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:11.330551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:11.346508 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7fb8ac9-068c-47ee-aeb2-a7e5a4fb9408 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.568967 Aug 30 16:23:11.347177 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2176/4005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:10 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:11.362603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:11.364083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:11.382696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:11.385763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:11.386467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:11.388975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:11.392744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:11.393461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:11.482079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce4c4be9-1b65-45fa-bb2b-5de673afdb04 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c352c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:11.556115 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce4c4be9-1b65-45fa-bb2b-5de673afdb04 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.082235 Aug 30 16:23:11.557145 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2177/4006] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:11 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:11.719669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:11.730392 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b59a835-340c-4030-93ef-dd2894933c6c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.374103 Aug 30 16:23:11.744521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1830/4007] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:11 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:11.752498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:11.755713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:11.765286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:11.766076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:11.766814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:11.768627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:11.769285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:11.769910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:11.841284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dda975e5-ff31-4dd6-852c-3fe9e3eaaf4c tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] Calling method '.version_select at 0x7fd35c03f310>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:11.918743 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dda975e5-ff31-4dd6-852c-3fe9e3eaaf4c tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] 10.222.0.47 "GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325" status: 200 len: 784 microversion: 2.1 time: 0.360224 Aug 30 16:23:11.934884 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2178/4008] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:11 2022] GET /compute/v2.1/images/fa129e8e-aca8-4a84-86f6-93dc1b487325 => generated 784 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:11.942686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f6bb405-6168-4d69-a132-a8d09532d9b2 tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] Calling method '.version_select at 0x7fd35c03fc10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.032621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f6bb405-6168-4d69-a132-a8d09532d9b2 tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] 10.222.0.47 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.094216 Aug 30 16:23:12.034762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2179/4009] 10.222.0.47 () {58 vars in 1122 bytes} [Tue Aug 30 16:23:11 2022] GET /compute/v2.1/images => generated 445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:12.049119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-832c7dc8-80d4-4e0d-a6cb-4e216820a8c5 tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] Calling method '.version_select at 0x7fd35c352af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.095901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:12.108266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:12.110758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:12.112431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d2786eb-db87-493e-8b9b-a0934c8ad91a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.366930 Aug 30 16:23:12.113600 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1831/4010] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:11 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:12.133814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-832c7dc8-80d4-4e0d-a6cb-4e216820a8c5 tempest-ListImagesTestJSON-452229647 tempest-ListImagesTestJSON-452229647-project] 10.222.0.47 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.091051 Aug 30 16:23:12.148976 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2180/4011] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:23:12 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:12.374992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.375922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:12.389388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.390211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.390990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.392113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.392760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.399509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.572590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c57ab46-467f-43b6-83a7-34e764a9dba1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357e081f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.672704 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c57ab46-467f-43b6-83a7-34e764a9dba1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.105041 Aug 30 16:23:12.673240 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2181/4012] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:12 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:12.696605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:12.712067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebb1ba0a-72ed-4c95-aef8-9fc06ad39845 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1511 microversion: 2.1 time: 0.342347 Aug 30 16:23:12.714145 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1832/4013] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:12 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:12.755233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:12.756872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:12.766986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.768586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.769048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.770290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:12.771026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:12.773946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:12.995066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:13.009044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8391d9e-1d33-454f-b90e-fc3e013de693 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.260472 Aug 30 16:23:13.023494 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2182/4014] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:12 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:13.137389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:13.138153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:13.150173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.150696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.151135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.151837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.156362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.156921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.688732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01e71809-9c27-4b3d-afb5-e17aafd9d3e1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c419dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:13.793285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01e71809-9c27-4b3d-afb5-e17aafd9d3e1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.105524 Aug 30 16:23:13.793915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2183/4015] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:13 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:13.814046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:13.820274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:13.851019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.854176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.854848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.855867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:13.856379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:13.856825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:13.872366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:13.883551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:13.886039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:13.887674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff2c2858-1ad1-45b8-a07e-1a64b4bea458 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.754263 Aug 30 16:23:13.903665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1833/4016] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:13 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:14.033187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:14.033948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:14.047487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.049599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.050503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.052679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.053845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.054913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.240720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:14.252965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c56eaad1-bd91-4a1b-8b66-19460dda83bc tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1488 microversion: 2.1 time: 0.449474 Aug 30 16:23:14.256302 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2184/4017] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:13 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1488 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:14.279640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1675188924"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:14.284818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:14.297198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.300696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.302701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.304986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.308250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.309026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.493426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:14.523535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdb917df-d8e6-411d-8d5e-5a6e2d032722 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.497349 Aug 30 16:23:14.533091 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1834/4018] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:14 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:14.555677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a74fb698-08c4-4b42-ab82-af4788c2611f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "PUT /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1061 microversion: 2.1 time: 0.279903 Aug 30 16:23:14.562778 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2185/4019] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:23:14 2022] PUT /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1061 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:14.585105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:14.587890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:14.601700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.603400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.605903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.608285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.609547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.611048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.809588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3df88e76-62de-4187-a1ea-7b48904747e3 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c419e50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:14.898688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3df88e76-62de-4187-a1ea-7b48904747e3 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.092352 Aug 30 16:23:14.900715 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2186/4020] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:14 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:14.913412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:14.917084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:14.943747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.946838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.948501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:14.952920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:14.953834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:14.954526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.180052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.194884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4f903af-2cec-4cd2-9237-2989bb8329f7 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1488 microversion: 2.1 time: 0.614549 Aug 30 16:23:15.207996 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1835/4021] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:14 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1488 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:15.224987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:15.226411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:15.237330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.239407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.239868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.244556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.245057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.245498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.529636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.545666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.553776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.557185 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5df1ba99-2ac6-4014-ab6c-d0aacc92340e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.648210 Aug 30 16:23:15.559751 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2187/4022] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:14 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:15.569747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:15.573734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:15.590864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.594161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.596790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.597818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.604095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.605025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.667747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:15.682408 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aee5c5ae-26d6-4426-9a32-4af955d59cfb tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1488 microversion: 2.1 time: 0.460897 Aug 30 16:23:15.684881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1836/4023] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:15 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1488 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:15.711889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:15.713155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:15.737292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.738215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.739170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.740149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:15.741928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:15.743924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:15.786785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:23:15.937664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a61aa6b3-8992-4537-9bae-79a7f1019d9d tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 204 len: 0 microversion: 2.1 time: 0.235387 Aug 30 16:23:15.939840 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1837/4024] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:15 2022] DELETE /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:23:15.951140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c3939d3-ca5d-4df0-81aa-621bd44dc9c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c166310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:16.038107 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c3939d3-ca5d-4df0-81aa-621bd44dc9c7 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.097558 Aug 30 16:23:16.039558 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1838/4025] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:15 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:16.044669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:16.045741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:16.054715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.057153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.057153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:16.057153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.057723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.058509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:16.161141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:16.179846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1aa71891-a905-4089-ac00-7843275a7171 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.618655 Aug 30 16:23:16.181208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2188/4026] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:15 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:16.231139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:16.255778 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d627e201-34b7-45a2-8193-0ef09b5cb8e0 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1494 microversion: 2.1 time: 0.214794 Aug 30 16:23:16.256975 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1839/4027] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:16 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:16.584802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:16.586194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:16.599283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.600560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.602195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:16.604714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:16.605593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:16.607197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.056002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3757b5e-1246-4eee-85ff-7fe9bb9c1014 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c166310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:17.153598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3757b5e-1246-4eee-85ff-7fe9bb9c1014 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.102962 Aug 30 16:23:17.162052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1840/4028] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:17 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:17.214712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:17.215675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:17.224429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.225191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.225876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.226846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.227515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.228179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.521479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:17.537120 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25e21910-17de-4347-bd50-eacbd3f131ce tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.326420 Aug 30 16:23:17.539493 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1841/4029] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:17 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:17.552828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:17.555097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:17.570933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.573123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.574648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.576961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:17.578991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:17.582888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:17.635252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:17.649117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:17.653816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:17.658627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a04332d-68f0-472f-84b9-eca76334314d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 1.078566 Aug 30 16:23:17.659567 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2189/4030] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:16 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:18.176248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47c17a93-69a3-418c-9442-102c596cf675 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c48faf0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:18.251390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47c17a93-69a3-418c-9442-102c596cf675 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.078848 Aug 30 16:23:18.252668 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2190/4031] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:18 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:18.479698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:18.492466 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc27bda7-f0c5-4531-b7ed-aab949eecb76 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1494 microversion: 2.1 time: 0.951663 Aug 30 16:23:18.498512 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1842/4032] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:17 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1494 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:18.563386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:18.564412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:18.590434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:18.590957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:18.591416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:18.599476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:18.600242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:18.602271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:18.685811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:18.687643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:18.698623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:18.705515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:18.706172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:18.707111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:18.707856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:18.708776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:18.906797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:18.923910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad622be1-27bf-496f-9518-f1d6b2a7157c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.365194 Aug 30 16:23:18.927247 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2191/4033] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:18 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:19.268839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d20a41f0-9271-45bd-8628-73f75839341d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c419dc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:19.374424 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d20a41f0-9271-45bd-8628-73f75839341d tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.111231 Aug 30 16:23:19.379900 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2192/4034] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:19 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:19.525191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:19.528631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:19.559646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.563935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.568047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:19.571070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.571853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.572822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:19.655937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:19.682017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:19.699720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:19.713390 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0e886b58-1409-4cae-8a8c-ff6f48df4820 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 1.027900 Aug 30 16:23:19.714741 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1843/4035] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:18 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:19.817444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:19.831521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5618c393-4c6f-4bdb-9a56-5806ae875282 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1494 microversion: 2.1 time: 0.311312 Aug 30 16:23:19.846918 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2193/4036] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:19 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1494 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:19.946488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:19.947738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:19.959094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.961345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.962014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:19.964249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:19.965987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:19.969215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:20.019246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:20.392214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8ab891b-939b-4f04-b871-cb2d08c82de4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357fcb940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:20.470754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8ab891b-939b-4f04-b871-cb2d08c82de4 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.085456 Aug 30 16:23:20.477007 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2194/4037] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:20 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:20.742117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:20.743497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:20.801070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=77 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:20.806165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:20.808850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:20.809676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:20.812812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:20.814499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:20.814953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:21.194687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:21.236846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:21.238519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:21.239648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc436b17-d1d1-4a18-9bdf-5745614bd7e7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.502533 Aug 30 16:23:21.254240 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2195/4038] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:20 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:21.263566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:21.273996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:21.286332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:21.286846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:21.287297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:21.288043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:21.288513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:21.288950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:21.493633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:21.514099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-638d4b21-6b6d-4dc9-bcc4-2c4fad9f790f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1452 microversion: 2.1 time: 0.255008 Aug 30 16:23:21.520506 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2196/4039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:21 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1452 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:21.548089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "484c0a4d-443c-4b90-a6b2-959e5defdfa0", "name": "network-vif-deleted", "tag": "9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:21.572648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:21.586956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:21.587826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:21.635895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] Creating event network-vif-deleted:9739a9fc-92bf-4fd4-93f2-0cd8d51e99a8 for instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 on n-h2-830883-28 Aug 30 16:23:21.651779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:21.653117 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1d57774d-e110-4729-9c03-2a78d31eb393 req-00cb6e84-0751-4b32-8484-2c8e42c350cb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117506 Aug 30 16:23:21.656338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2197/4040] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:21.667736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9bbbca01-4ade-4d75-9595-8ff868fa9b43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 1.720974 Aug 30 16:23:21.682916 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1844/4041] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:19 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:21.684138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9aa570e9-1801-458a-b845-25bdaed0989a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd357e08550>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:21.825009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9aa570e9-1801-458a-b845-25bdaed0989a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.165733 Aug 30 16:23:21.825613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2198/4042] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:21 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.288186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.546364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:22.547187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:22.566832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.567361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.569150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.570609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.572463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.574165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.643147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.644111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.653116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.653983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lazy-loading 'fault' on Instance uuid 484c0a4d-443c-4b90-a6b2-959e5defdfa0 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:22.720590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:22.734272 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e89065d-b5a0-41e0-9290-288c69750664 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 200 len: 1310 microversion: 2.1 time: 0.192382 Aug 30 16:23:22.735276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2199/4043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:22 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 1310 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:22.743583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:22.745291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:22.755615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.756380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.757084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:22.758239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:22.758949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:22.759603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:23.051936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:23.077996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:23.079858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:23.081748 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-870fea88-5c77-4b25-a4ad-945d4767a16b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.817770 Aug 30 16:23:23.082948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1845/4044] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:22 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:23.100000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3341f325-f699-4ece-b516-3954fdf38a55 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c165c10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:23.212481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3341f325-f699-4ece-b516-3954fdf38a55 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.128043 Aug 30 16:23:23.217647 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1846/4045] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:23 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:23.228210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:23.252194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5df31ffc-8315-4b4d-9d90-af66e310cb40 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.513980 Aug 30 16:23:23.253153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2200/4046] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:22 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:23.757203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:23.757915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:23.779622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:23.781195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:23.786963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:23.788565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:23.789298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:23.791252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:23.867045 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 HTTP/1.1 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '484c0a4d-443c-4b90-a6b2-959e5defdfa0'} Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:23.869708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:23.873397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7b0ca90-6d8b-4296-8e13-b8f56a3762d5 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 404 len: 111 microversion: 2.1 time: 0.121275 Aug 30 16:23:23.876597 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1847/4047] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:23 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:23.888314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:23.889513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:23.909964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:23.912654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:23.913434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:23.914437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:23.916229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:23.917276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:23.964047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 HTTP/1.1 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '484c0a4d-443c-4b90-a6b2-959e5defdfa0'} Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:23.971755 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:23.975866 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:23.983756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:23.984914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f13ecc9-8ea7-42b9-b0bb-38138b86747f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 404 len: 111 microversion: 2.1 time: 0.100667 Aug 30 16:23:24.007472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.008104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 484c0a4d-443c-4b90-a6b2-959e5defdfa0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.012246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:24.018496 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2201/4048] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:23 2022] DELETE /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:24.035825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.036384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.036906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.038826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.039530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.040554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.098474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 HTTP/1.1 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '484c0a4d-443c-4b90-a6b2-959e5defdfa0'} Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.107758 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 484c0a4d-443c-4b90-a6b2-959e5defdfa0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:24.116921 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-675f2f31-e0dd-4499-931c-3cd968d4a660 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0" status: 404 len: 111 microversion: 2.1 time: 0.112737 Aug 30 16:23:24.117978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.117978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.130518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1848/4049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:23 2022] GET /compute/v2.1/servers/484c0a4d-443c-4b90-a6b2-959e5defdfa0 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:24.135866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.136690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.150023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.150683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.151140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.151887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.152352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.152784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.153361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.159287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.160031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.160967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.161614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.162246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.189229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e HTTP/1.1 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b3dad60-e953-42fb-a348-fa8b19f9254e'} Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:24.195461 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.199214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.205474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:24.206783 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7294e0d5-a479-4570-8ce2-775be9c9b396 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 404 len: 111 microversion: 2.1 time: 0.074867 Aug 30 16:23:24.210633 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1849/4050] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:24 2022] DELETE /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:24.223496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.224530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 9b3dad60-e953-42fb-a348-fa8b19f9254e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.243053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.243591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.243973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.244774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.245110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.245554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.288363 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e HTTP/1.1 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b3dad60-e953-42fb-a348-fa8b19f9254e'} Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.296228 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. Aug 30 16:23:24.300806 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.301420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 9b3dad60-e953-42fb-a348-fa8b19f9254e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:24.302266 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19daabe1-2aa7-4196-b1e0-0e73cd59755f tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e" status: 404 len: 111 microversion: 2.1 time: 0.086854 Aug 30 16:23:24.308753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1850/4051] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:24 2022] GET /compute/v2.1/servers/9b3dad60-e953-42fb-a348-fa8b19f9254e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:24.325910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6af823e3-5b53-4243-b095-a82985ed4132 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd360e078b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.431120 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6af823e3-5b53-4243-b095-a82985ed4132 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.120306 Aug 30 16:23:24.432090 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1851/4052] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:24 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:24.442151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.445740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.463292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.464368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.465024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.469060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.469878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.471887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.821715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:24.844374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:24.845905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:24.851973 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c471f2a1-8d9c-4ad2-ac05-de0ab4bb4232 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.739721 Aug 30 16:23:24.852581 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2202/4053] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:24 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:24.853433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:24.868691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-969661e2-6b52-4f06-8a78-a88a46e441d3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.434660 Aug 30 16:23:24.869836 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1852/4054] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:24 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:24.888568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.892838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.900106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.900630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.902582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.903950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.904519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.904999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.924783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb HTTP/1.1 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd173a4b6-4322-437f-9644-9dd981a26dbb'} Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:24.927709 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:24.932225 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:24.934973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:24.937087 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dffc918c-6bd7-4425-8ede-87741a9f0be4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 404 len: 111 microversion: 2.1 time: 0.078513 Aug 30 16:23:24.938793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2203/4055] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:24 2022] DELETE /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:24.949511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:24.950822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: d173a4b6-4322-437f-9644-9dd981a26dbb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:24.959250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.961431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.962141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:24.963175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:24.963856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:24.964714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.001683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb HTTP/1.1 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'd173a4b6-4322-437f-9644-9dd981a26dbb'} Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.003708 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. Aug 30 16:23:25.007207 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.009252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance d173a4b6-4322-437f-9644-9dd981a26dbb could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:25.011256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1abebd8b-636e-40af-a366-f16e495e8461 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb" status: 404 len: 111 microversion: 2.1 time: 0.068596 Aug 30 16:23:25.012465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1853/4056] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:24 2022] GET /compute/v2.1/servers/d173a4b6-4322-437f-9644-9dd981a26dbb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:25.021791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.022940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.033588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.036909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.041517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.043132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.045931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.046579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.077507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 HTTP/1.1 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fe181eb7-9350-429d-bbed-ea16bf037911'} Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:25.079266 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d15567d-3be0-4a1b-9a90-e16ffbf97fe4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 404 len: 111 microversion: 2.1 time: 0.064109 Aug 30 16:23:25.083388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2204/4057] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:25 2022] DELETE /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:25.089858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.091055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: fe181eb7-9350-429d-bbed-ea16bf037911] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.103110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.104667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.105121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.105833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.106333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.106767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.168405 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 HTTP/1.1 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'fe181eb7-9350-429d-bbed-ea16bf037911'} Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.180952 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance fe181eb7-9350-429d-bbed-ea16bf037911 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:25.184541 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36d55922-f771-49b3-8696-f8eb6e617bd1 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911" status: 404 len: 111 microversion: 2.1 time: 0.098409 Aug 30 16:23:25.207328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.208183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.215883 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1854/4058] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:25 2022] GET /compute/v2.1/servers/fe181eb7-9350-429d-bbed-ea16bf037911 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:25.221007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.224304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.225058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.226053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.227822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.230105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.275977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 HTTP/1.1 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '51e962c8-c6e0-49e1-888c-c40a348283e4'} Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:25.277892 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.281724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.286390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:25.288682 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2813b608-8ad8-4fc0-bda3-dbd312b73a79 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 404 len: 111 microversion: 2.1 time: 0.098397 Aug 30 16:23:25.291574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2205/4059] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:25 2022] DELETE /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:25.300085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.300796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 51e962c8-c6e0-49e1-888c-c40a348283e4] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.316418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.319251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.319962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.323169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.325403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.326100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.388014 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 HTTP/1.1 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '51e962c8-c6e0-49e1-888c-c40a348283e4'} Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:25.390148 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. Aug 30 16:23:25.394100 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:25.410866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 51e962c8-c6e0-49e1-888c-c40a348283e4 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:25.415475 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-66bd013d-8e5e-4d6f-a511-8696ad75f62b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4" status: 404 len: 111 microversion: 2.1 time: 0.119531 Aug 30 16:23:25.421916 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1855/4060] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:25 2022] GET /compute/v2.1/servers/51e962c8-c6e0-49e1-888c-c40a348283e4 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:23:25.453575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef07ceff-a2f4-4931-847d-9988fd66a4db tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35ce48b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.550047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef07ceff-a2f4-4931-847d-9988fd66a4db tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.105503 Aug 30 16:23:25.550675 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1856/4061] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:25 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:25.880638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.881347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.893478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.895915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.897960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.899752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:25.901307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:25.903110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:25.982756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:25.983867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:25.999616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.000117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.000561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.001275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.001733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.002163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.043412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e HTTP/1.1 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64a4d17b-3979-4ecb-8e45-476b1f0c287e'} Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:26.045020 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.049075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:26.056029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ccc7c011-6bb6-4405-b72a-7cbb0c5930f3 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 404 len: 111 microversion: 2.1 time: 0.628524 Aug 30 16:23:26.058856 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2206/4062] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:25 2022] DELETE /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 111 bytes in 633 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:26.067397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.068046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.103899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.104740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.105385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.106281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.106937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.107536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.119014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:26.345637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:26.355042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02315849-3994-4bb3-9482-7676a65c2c46 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.291694 Aug 30 16:23:26.356883 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2207/4063] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:26 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:26.367207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.368129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 64a4d17b-3979-4ecb-8e45-476b1f0c287e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.383757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.384502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.385248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.386058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.386608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.387281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.417605 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e HTTP/1.1 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64a4d17b-3979-4ecb-8e45-476b1f0c287e'} Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.420177 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. Aug 30 16:23:26.424055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.426509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 64a4d17b-3979-4ecb-8e45-476b1f0c287e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:26.427606 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3ad99e1-b3db-4fb1-95eb-7f257bb1584c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e" status: 404 len: 111 microversion: 2.1 time: 0.069382 Aug 30 16:23:26.428634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2208/4064] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:26 2022] GET /compute/v2.1/servers/64a4d17b-3979-4ecb-8e45-476b1f0c287e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:26.440587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.441384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.474327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 HTTP/1.1 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2'} Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.474620 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:26.478033 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f8607db-afb5-408e-901b-9ce9eb93c156 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2" status: 404 len: 111 microversion: 2.1 time: 0.042361 Aug 30 16:23:26.482324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2209/4065] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:26 2022] DELETE /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:26.485382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.486203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.493359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 HTTP/1.1 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2'} Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:26.494944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:26.499927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-806dd299-ccf3-48bb-b1b2-08a0917a741b tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2" status: 404 len: 111 microversion: 2.1 time: 0.015029 Aug 30 16:23:26.505795 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2210/4066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:26 2022] GET /compute/v2.1/servers/bdf2e674-95ec-4df9-ae8d-ac3ffb33f9c2 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:26.521365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.521881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.547569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.548265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.548724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.549469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.549949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.552844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.622247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:23:26.637708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:26.649547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:26.651314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:26.653129 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c34b1158-d8de-4f95-af59-49798ad75970 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.776584 Aug 30 16:23:26.653847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1857/4067] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:25 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:26.659096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-95ed4e2b-7905-48dd-910b-f7be32bdfbdf tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35d096d30>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.745443 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-95ed4e2b-7905-48dd-910b-f7be32bdfbdf tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.090215 Aug 30 16:23:26.746112 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1858/4068] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:26 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:26.819979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09183b20-bd24-4135-8438-ceb66f4afe62 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 204 len: 0 microversion: 2.1 time: 0.305156 Aug 30 16:23:26.820359 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2211/4069] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:26 2022] DELETE /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:23:26.828664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:26.829697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:26.844247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.844744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.845189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:26.845908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:26.865323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:26.866080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.151831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2070195929", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:27.189831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:27.209660 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ccaa7fa-14b2-455b-8575-7799efa0da95 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1480 microversion: 2.1 time: 0.384844 Aug 30 16:23:27.223463 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1859/4070] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:26 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1480 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:27.256868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:23:27.406109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:27.411654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:27.439978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.441055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.442690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.447447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.448281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.449461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.729648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:27.746934 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89a475f5-02b1-4309-9138-7d2981e0d35d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.364059 Aug 30 16:23:27.748162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1860/4071] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:27 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:27.762658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:27.763536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:27.786407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.790010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.790657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:27.791549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:27.793052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:27.793693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.043964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:23:28.044396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:23:28.044877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:23:28.045292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:23:28.045786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:23:28.074105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.074746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.075239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.076534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.079174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.081952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.110853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:28.121337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:28.152212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:23:28.161201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:23:28.251887 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d9672ae-1ab0-4b6d-8467-772a5cf74fd1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186957 Aug 30 16:23:28.259301 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2212/4072] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:23:28.262585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:28.265526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fedc4dd6-3c64-4e04-af2c-a22954bc0016 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c306ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.273297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:28.283177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:28.284552 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebd39800-d21c-43e7-b890-baae0c28a7c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.533802 Aug 30 16:23:28.306568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1861/4073] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:27 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:28.306568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.306568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:28.310781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.311979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.312564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.313284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.313740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.328658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.378116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fedc4dd6-3c64-4e04-af2c-a22954bc0016 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.117548 Aug 30 16:23:28.396714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2213/4074] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:28 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:28.406914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc7d1e8e-3603-437d-bed5-4ad28d4f2a35 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.423269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc7d1e8e-3603-437d-bed5-4ad28d4f2a35 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:28.603996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:28.612547 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8257e631-215a-4d6b-be9f-8ba332720e65 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1480 microversion: 2.1 time: 0.320046 Aug 30 16:23:28.622920 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1862/4075] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:28 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1480 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:28.646422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc7d1e8e-3603-437d-bed5-4ad28d4f2a35 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:28.653986 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc7d1e8e-3603-437d-bed5-4ad28d4f2a35 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1215 microversion: 2.1 time: 0.251370 Aug 30 16:23:28.666985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2214/4076] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:28 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:28.773245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:28.773882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:28.790000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.790605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.791064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:28.791850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:28.792316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:28.792750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.316232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:29.318145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:29.354054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.359652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.361694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:29.362894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.364424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.368558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.371872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.390449 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8df672ff-ab04-48d7-bdf1-960579ff57a0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.618523 Aug 30 16:23:29.392258 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1863/4077] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:28 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:29.412694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1865e7f6-013e-4552-951a-c067d1e551f1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c11b310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:29.516477 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1865e7f6-013e-4552-951a-c067d1e551f1 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.107455 Aug 30 16:23:29.519176 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1864/4078] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:29 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:29.633376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:29.634510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:29.658896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.664432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.665052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.665947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:29.666893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:29.667568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:29.985322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.005668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.011562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.013521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c575270d-2372-49cd-b6ae-6eac35e1c994 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.702905 Aug 30 16:23:30.029684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2215/4079] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:29 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:30.033105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:30.033638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:30.043652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.044173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.044880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.048349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.049296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.049936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.256317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.273639 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d58e5ad-ed44-48f6-a112-79b5c7dec471 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1267 microversion: 2.1 time: 0.249033 Aug 30 16:23:30.276517 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2216/4080] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:30 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:30.330052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.348617 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-397c27e8-6161-433f-8aec-0dabb0322dc4 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1480 microversion: 2.1 time: 0.719235 Aug 30 16:23:30.370623 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1865/4081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:29 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1480 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:30.418332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:30.419478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:30.429411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.437582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.454853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.455867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.456348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.456781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.534286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8244aaaf-458f-445c-9669-56d2e99d957b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c11b0d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:30.701598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8244aaaf-458f-445c-9669-56d2e99d957b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1427 microversion: 2.1 time: 0.172223 Aug 30 16:23:30.705144 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1866/4082] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:30 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:30.711403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50657af5-762a-41eb-adaa-d95ad49b76c6", "name": "network-vif-deleted", "tag": "21b14365-c282-4f22-93ed-e461fc118e36"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:30.734283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:30.734805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:30.735299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:30.748315 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] Creating event network-vif-deleted:21b14365-c282-4f22-93ed-e461fc118e36 for instance 50657af5-762a-41eb-adaa-d95ad49b76c6 on n-h2-830883-28 Aug 30 16:23:30.754481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-570ffb07-4874-4aaf-84ca-68aecce87acf req-18317226-2c96-479d-ade8-574349e0b03d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048084 Aug 30 16:23:30.755500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1867/4083] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:30.943216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:30.956173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3695ae1f-190f-45b4-b3cf-0209b2ce54fd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.544700 Aug 30 16:23:30.963806 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2217/4084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:30 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:31.039963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.040897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:31.086355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.090900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.094177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.100087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.104308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.110043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.297472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.298111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:31.331193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.333371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.338832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.340231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.341291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.342074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.584862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.604899 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18f36d56-6605-466c-ae55-9b22db2664c9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1285 microversion: 2.1 time: 0.307402 Aug 30 16:23:31.605574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2218/4085] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1285 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:31.643865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.644495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:31.669285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.669793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.670280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.671596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.672058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.672490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.809376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:31.809899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:31.810559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:31.811434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lazy-loading 'fault' on Instance uuid 50657af5-762a-41eb-adaa-d95ad49b76c6 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:31.907209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.922853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.924548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.935722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-083e1b06-4e48-4ee3-bcba-f1ccce04b255 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.892140 Aug 30 16:23:31.950953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1868/4086] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:31.959308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47bd5be2-2983-45f9-9da1-bbd5fe6bcc93 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c1659d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.960830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff918cce425e49c19d4726b438e72f43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '207b96798dbb4518a4f768c16a71149d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:31.973513 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ac11ea3-82ec-4127-9cc5-167dc867961c tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 200 len: 1283 microversion: 2.1 time: 0.349618 Aug 30 16:23:31.987141 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2219/4087] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 1283 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:31.996327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:31.997740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.016957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.018179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.033281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.035367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.038574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.041029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.071290 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47bd5be2-2983-45f9-9da1-bbd5fe6bcc93 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1436 microversion: 2.1 time: 0.118529 Aug 30 16:23:32.074364 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1869/4088] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1436 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:32.089872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bbb43c8b-68e1-4743-a07e-9a818c33872b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c192160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.182612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bbb43c8b-68e1-4743-a07e-9a818c33872b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 200 len: 1436 microversion: 2.1 time: 0.097006 Aug 30 16:23:32.185870 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1870/4089] 10.222.0.47 () {58 vars in 1233 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 1436 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:32.200684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.204641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.219915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.221862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.223394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.225165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.225893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.227695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.492467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:32.503479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21b8788b-09ba-49f6-9e0d-bcd22d07b9bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.514574 Aug 30 16:23:32.508245 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2220/4090] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:31 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:32.533060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:32.545657 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-813d3aaf-4ddb-4755-a88b-2b74e093b0d8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1480 microversion: 2.1 time: 0.350628 Aug 30 16:23:32.552839 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1871/4091] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1480 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:32.630169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.630841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.640849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.641594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.642208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.643115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.643767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.644356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:32.802080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:32.816526 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20cfd3f0-1f59-42d7-b93f-807ae27f14c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1273 microversion: 2.1 time: 0.189986 Aug 30 16:23:32.833014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2221/4092] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:32.966992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:32.968226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:32.986910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:32.987764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:32.988391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.000408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:33.001262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] [instance: 50657af5-762a-41eb-adaa-d95ad49b76c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:33.007429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.008108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.009914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.010575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.015929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.016549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.022202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.022912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.025794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.091093 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] HTTP exception thrown: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Request method failure captured: Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 HTTP/1.1 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhSxBwUL2_0Xu8pEi_-0LuZNkDG5iBisF-sJRaqMHvfYYM41l5W4r3jh1yDDhO7ejxLKHgjAy9orfFGCruJggoK7v80ZXT1eRDGA2GUi8SxhJViy7SE1ETnJvvGMgaZ43MhcfqBvkvNvI6zPmyajMNF4hzyU9HKAqfxfk7x8hWZOsM Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_207b96798dbb4518a4f768c16a71149d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/207b96798dbb4518a4f768c16a71149d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/207b96798dbb4518a4f768c16a71149d"}]}] Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersTestJSON-1051878014 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 207b96798dbb4518a4f768c16a71149d Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersTestJSON-1051878014 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ff918cce425e49c19d4726b438e72f43 Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersTestJSON-1051878014-project Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '50657af5-762a-41eb-adaa-d95ad49b76c6'} Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:33.097444 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. Aug 30 16:23:33.101114 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:33.103116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] Returning 404 to user: Instance 50657af5-762a-41eb-adaa-d95ad49b76c6 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:33.104215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a39ded1a-19a9-4ea4-9014-535b03b83483 tempest-ServersTestJSON-1051878014 tempest-ServersTestJSON-1051878014-project] 10.222.0.47 "GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6" status: 404 len: 111 microversion: 2.1 time: 0.108258 Aug 30 16:23:33.113787 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2222/4093] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/50657af5-762a-41eb-adaa-d95ad49b76c6 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:33.529061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:33.529689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:33.550742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.553072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.554968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.555882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.556540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.557665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.898714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:33.918244 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b1c7418-e36c-4dbb-9355-5c03201abf3a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.393015 Aug 30 16:23:33.919987 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2223/4094] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:33 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:33.925791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:33.931631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:33.942677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.946554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.947506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:33.948415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:33.954064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:33.955321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.015269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.025151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.031404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.034320 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-954376be-e698-426b-88c7-b45ace3d7a7a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 1.071495 Aug 30 16:23:34.034910 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1872/4095] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:32 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:34.065086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:34.066033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:34.091089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.092103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.093475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.094855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.095561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.096204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.475170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.485862 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92b9d768-2e47-4e9b-8c78-7643af8aa2a8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.448171 Aug 30 16:23:34.488462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1873/4096] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:34 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:34.628197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:34.647477 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84fa2e03-9096-4e9a-ad8a-2d91553a5f52 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1467 microversion: 2.1 time: 0.717476 Aug 30 16:23:34.648035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2224/4097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:33 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1467 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:34.679737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b41ed86c-bf5f-444f-8877-1f0ffd38ddb8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c192790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:34.942640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:34.944063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:34.950909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.951405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.961646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:34.969369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:34.969969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:34.970454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.582894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:35.598707 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be2e713d-a8ad-47a3-98e6-c8e09365dee4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 0.660707 Aug 30 16:23:35.599646 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2225/4098] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:34 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:35.613201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:35.616552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:35.645258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.645969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.646643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.647732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.648383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.649173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.729476 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b41ed86c-bf5f-444f-8877-1f0ffd38ddb8 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "DELETE /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f" status: 204 len: 0 microversion: 2.1 time: 1.055497 Aug 30 16:23:35.730053 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1874/4099] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:34 2022] DELETE /compute/v2.1/images/8b310bc3-0475-46fc-bebe-cfd8dca1930f => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:23:35.737695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:35.738342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:35.753722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.754963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.756900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.759066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:35.760616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:35.761101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:35.819615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:36.209337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:36.235356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e019c025-d2ed-4965-9948-3b4334a2b3e4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.500676 Aug 30 16:23:36.235919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1875/4100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:35 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:36.256184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68c9b7a0-d1c2-4e29-b9de-261ba0302398 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '.version_select at 0x7fd35c13a160>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.295004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-68c9b7a0-d1c2-4e29-b9de-261ba0302398 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] HTTP exception thrown: Image not found. Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68c9b7a0-d1c2-4e29-b9de-261ba0302398 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Request method failure captured: Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 HTTP/1.1 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjkYp8rWIQPyPdbANS9F9YOeOCfhWmdc_NVL2AJqfGJYHt0PYXMyadyr0SNv84bu7-HVFdhNAd3evp6clSY2jf9jwYm-_xcBv-kYztewqCTjyzXhALXGUGNn6wtfHwq4in9ZU5BxHjANa3iOAw0D8zvRJKYsn2vcz4YXti1UuGVAOnU Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}] Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f543ea78c4814a9ab8ad80da0b343de8 Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: exception: Image not found. Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9b6b9f9c-c9c5-4ead-af95-04a98ce24062'} Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b6b9f9c-c9c5-4ead-af95-04a98ce24062 to delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b6b9f9c-c9c5-4ead-af95-04a98ce24062 could not be found. Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.297451 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68c9b7a0-d1c2-4e29-b9de-261ba0302398 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Returning 404 to user: Image not found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68c9b7a0-d1c2-4e29-b9de-261ba0302398 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "DELETE /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062" status: 404 len: 62 microversion: 2.1 time: 0.053838 Aug 30 16:23:36.301778 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1876/4101] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:36 2022] DELETE /compute/v2.1/images/9b6b9f9c-c9c5-4ead-af95-04a98ce24062 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:23:36.313276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.313782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:36.321647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:36.340384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:36.341841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:36.349023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.349525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.349956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.350690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.351302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.351875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.352286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f73a9b41-8462-40aa-bacb-7cd026033f08 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.751254 Aug 30 16:23:36.352936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2226/4102] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:35 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:36.422640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:23:36.507058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4b2dcf-13e8-4197-a971-069c20a4ab00", "tag": "42a47026-c5cb-49e1-a528-9b8483499a85"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:36.557635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.560678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.562519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.593113 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] Creating event network-changed:42a47026-c5cb-49e1-a528-9b8483499a85 for instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 on n-h2-830883-28 Aug 30 16:23:36.605449 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9b88f404-e99e-413b-8f02-1ed11b0570ec req-3ab67d44-1ca5-4802-9224-929b18db8a3b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110561 Aug 30 16:23:36.607353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2227/4103] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:36.621023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.624682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:36.643742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.644975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.645967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.649031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.650559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.651330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.665549 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a289643b-be98-4bc8-a3ad-5399e3761a61 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "DELETE /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 204 len: 0 microversion: 2.1 time: 0.356070 Aug 30 16:23:36.666333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1877/4104] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:36 2022] DELETE /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:23:36.678669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:36.679493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:36.702460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:36.703757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.707099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.709430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:36.710933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:36.714857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:36.716906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.126759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.138856 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-374856a5-13c3-4b80-8ece-6e48b535ecb9 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1473 microversion: 2.1 time: 0.465286 Aug 30 16:23:37.142885 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1878/4105] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:36 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:37.258328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:37.259141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:37.272867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.273359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.273795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.274535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.274989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.275409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.549626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.563829 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52ff68af-6457-47bb-8802-d70ae7108b56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.311574 Aug 30 16:23:37.565296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1879/4106] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:37 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:37.584642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:37.586529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:37.597174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.598225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.598994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.600870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.601599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.602506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:37.930675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.945030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.947407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:37.948724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35dbca5d-58d1-40d9-b3dd-7c452b1f07b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.382171 Aug 30 16:23:37.969762 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1880/4107] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:37 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:37.975887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-unplugged", "status": "completed", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:37.989669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:37.990448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:37.991287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.009771 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] Creating event network-vif-unplugged:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:23:38.017272 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2baf7986-6024-450f-8bbb-6d9b671a9070 req-ded4b2b0-fe25-443c-bcec-45a5fc40336f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045842 Aug 30 16:23:38.018153 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1881/4108] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:38.097759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:38.159364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:38.162741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:38.163621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:38.178438 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d74e5b5-4398-4b43-b616-0c2dabf6c3cd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1511 microversion: 2.1 time: 1.560990 Aug 30 16:23:38.180420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2228/4109] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:36 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1511 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:38.195220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.206234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.206808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.211593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.212191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.212736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.588941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:38.589639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:38.601644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.602968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.604905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.608549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:38.611081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:38.612758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:38.616232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:38.650751 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb1a2466-4471-4314-873f-ad43cd7a1296 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1473 microversion: 2.1 time: 0.493555 Aug 30 16:23:38.651785 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1882/4110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:38 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:38.665697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:38.977367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:38.978531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:38.987838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:38.997797 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20ebdd3b-530f-4175-b8e6-090cd17267d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.414430 Aug 30 16:23:39.004237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.004552 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2229/4111] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:38 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:39.006519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.007069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.008696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.009261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.009807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.204371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:39.205967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.217095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.222448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.223181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.227426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.229532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.230234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.492805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.519385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.523022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.526787 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c091ca5-a218-4de9-9351-52b6d8766baa tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.557061 Aug 30 16:23:39.528487 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1883/4112] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:38 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:39.639958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:39.655913 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81d11e52-ca88-41c3-b14d-0dba089a912f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1488 microversion: 2.1 time: 0.455515 Aug 30 16:23:39.657790 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2230/4113] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:39 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1488 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:39.678225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:39.679140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.684787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:39.689462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.690145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.690929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.694831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.695655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.696338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.698132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.704499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.707554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.709111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.710979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.712515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.715516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.824805 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-105e2e39-b5ee-45b6-b774-87fa6c20e375 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 200 len: 138 microversion: 2.1 time: 0.149607 Aug 30 16:23:39.825496 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2231/4114] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:39 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 138 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:39.836175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:39.837218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:39.860831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.861333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.861773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:39.862514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:39.862977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:39.863408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.027098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.041584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1322c498-b7be-4bd4-81df-046135fb35c6 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1473 microversion: 2.1 time: 0.367160 Aug 30 16:23:40.042505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1884/4115] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:39 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:40.048102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.052257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.071667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.073561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.074007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.074775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.075232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.075688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.184829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.198050 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-30fb6e6f-7410-4a4a-973a-60d2e7d3f694 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.365001 Aug 30 16:23:40.201018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2232/4116] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:40.235270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.236228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.248083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.251348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.253582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.256114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.257190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.257971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.353490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.363056 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b717d777-d031-4ec2-9181-e74ed6cb53e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.318568 Aug 30 16:23:40.375857 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1885/4117] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:40.380922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e0f898-510e-4315-b9a9-8766ea4b27f2", "name": "network-vif-deleted", "tag": "f334e935-14a6-49df-9144-6256691a645f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:40.392780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.393264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.393692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.406730 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] Creating event network-vif-deleted:f334e935-14a6-49df-9144-6256691a645f for instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 on n-h2-830883-28 Aug 30 16:23:40.413121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-87b1abd2-19a1-48b4-894c-f4b838e215b6 req-24487d65-b1fc-4e5f-9641-bd5eed9add38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Aug 30 16:23:40.413723 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1886/4118] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:40.563240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.566721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.594396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.598050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.600030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.602889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.606635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.607447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.620652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:40.637440 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5c31351-ffe5-48e6-94e3-1d3a1104485c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.409567 Aug 30 16:23:40.643156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2233/4119] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:40.662226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:40.663303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:40.665649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:40.677438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.677940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.678410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:40.679154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:40.679617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:40.680052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.017657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.026861 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d3caeed-6f50-4e24-8332-66890c1c04d4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.368397 Aug 30 16:23:41.031310 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2234/4120] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:41.068736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:41.069565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:41.126328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.131089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.149712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.149712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.149712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.149712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.149712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.156025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.157602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.180437 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe6351c4-c35b-4fe9-bb40-8e6c27abcb1d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.631968 Aug 30 16:23:41.181082 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1887/4121] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:40 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:41.231132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:41.237780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:41.269968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.270514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.271170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.279093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.279574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.280151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.387858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.400836 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d596ddf7-aad5-4240-bc7b-03926507c287 tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1431 microversion: 2.1 time: 0.187970 Aug 30 16:23:41.401670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1888/4122] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:41 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1431 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:41.408297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:41.409406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:41.421459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.421965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.422435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.423146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:41.423598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:41.424195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:41.535861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.549822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e6f063f-4bc4-4cea-96e4-f77c12a3d73f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.497791 Aug 30 16:23:41.551079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2235/4123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:41 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:41.695807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-705979226", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "14da368a-1038-4232-aa6a-32d46d4c24f8"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:41.698031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:41.714066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8109a870-a6d1-45af-b52f-c1d75afbe0bc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.310609 Aug 30 16:23:41.714810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1889/4124] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:41 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:41.787665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] validate_networks() for [('14da368a-1038-4232-aa6a-32d46d4c24f8', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:23:42.215553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:42.216773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:42.226492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.227184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.227930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.228785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.230244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.230879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.284612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:23:42.285222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:23:42.285987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:23:42.286566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:23:42.287596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:23:42.302113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.304018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.305210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.306872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.307996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.308615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.335623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:42.344168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:42.364877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:23:42.368475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:23:42.453488 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8bdfaae-fa31-4b46-be7a-2fd6868ca986 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761837 Aug 30 16:23:42.456135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2236/4125] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:23:42.467562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:42.468209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:42.483512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.485125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.486640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.487694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.490379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.490980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.646292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f543ea78c4814a9ab8ad80da0b343de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e099970d4ee04d27a2af27a426ac98e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.661023 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5b3ebea8-8aec-43c3-8277-7344b78c587a tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 200 len: 1302 microversion: 2.1 time: 0.203564 Aug 30 16:23:42.664516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2237/4126] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:42 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 1302 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:42.679641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2588abd-20fa-4f2f-bf18-2c6ec22c9659 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:42.680500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2588abd-20fa-4f2f-bf18-2c6ec22c9659 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:42.764428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2588abd-20fa-4f2f-bf18-2c6ec22c9659 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.773183 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2588abd-20fa-4f2f-bf18-2c6ec22c9659 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1214 microversion: 2.1 time: 0.107033 Aug 30 16:23:42.783318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2238/4127] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:42 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:42.801848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:42.802517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:42.813101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.813505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.813955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.820093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:42.820972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:42.821654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:42.923172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.940738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.945144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:42.949392 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ddc449bc-d44b-4e96-9d74-be9e20b064f5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.738368 Aug 30 16:23:42.949972 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1890/4128] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:42 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:43.048797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:43.076818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7773f57-9d31-425b-8cdd-f3be060b1ac4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.291946 Aug 30 16:23:43.090975 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2239/4129] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:42 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:43.574415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "318073c3-10ec-444f-8ce0-6268c151f684"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:43.601253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.601751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.607371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.640840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] Creating event network-vif-plugged:318073c3-10ec-444f-8ce0-6268c151f684 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:43.651448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3cfcb385-3090-4a41-97b3-147990824cee req-9a9d2c87-3e7a-4968-b55f-90614b32a003 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081594 Aug 30 16:23:43.657466 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1891/4130] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:43.696009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:43.696808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] [instance: 37e0f898-510e-4315-b9a9-8766ea4b27f2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:43.743403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.746072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.746891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.751161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.753860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.754417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.796636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] HTTP exception thrown: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Request method failure captured: Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 HTTP/1.1 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjkYp8rWIQPyPdbANS9F9YOeOCfhWmdc_NVL2AJqfGJYHt0PYXMyadyr0SNv84bu7-HVFdhNAd3evp6clSY2jf9jwYm-_xcBv-kYztewqCTjyzXhALXGUGNn6wtfHwq4in9ZU5BxHjANa3iOAw0D8zvRJKYsn2vcz4YXti1UuGVAOnU Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e099970d4ee04d27a2af27a426ac98e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e099970d4ee04d27a2af27a426ac98e1"}]}] Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e099970d4ee04d27a2af27a426ac98e1 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-914114453 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f543ea78c4814a9ab8ad80da0b343de8 Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ImagesOneServerTestJSON-914114453-project Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '37e0f898-510e-4315-b9a9-8766ea4b27f2'} Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:23:43.798655 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. Aug 30 16:23:43.802461 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:23:43.805658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] Returning 404 to user: Instance 37e0f898-510e-4315-b9a9-8766ea4b27f2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:23:43.807154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:43.807643 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22d8ad73-0a70-4f62-9618-cf8998172b2b tempest-ImagesOneServerTestJSON-914114453 tempest-ImagesOneServerTestJSON-914114453-project] 10.222.0.47 "GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2" status: 404 len: 111 microversion: 2.1 time: 0.115925 Aug 30 16:23:43.807879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:43.808903 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2240/4131] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:43 2022] GET /compute/v2.1/servers/37e0f898-510e-4315-b9a9-8766ea4b27f2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:23:43.819486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.820218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.820868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.821798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.823291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.823967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.973527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:43.974155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:43.986011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.986881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.987900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:43.988486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:43.989395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:43.990262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:43.991445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.001456 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eda1bc1b-750d-4e28-9be2-c4c83bcf78f0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1266 microversion: 2.1 time: 0.200014 Aug 30 16:23:44.021419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1892/4132] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:43 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:44.113679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:44.114319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:44.127631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:44.128597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:44.131035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.132158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:44.136146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:44.136885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:44.177878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:44.472125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.495069 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecde44f7-013f-465b-9f92-f1fd827d719d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.385758 Aug 30 16:23:44.498213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1893/4133] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:44 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:44.563866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.580131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.585950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:44.587448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f2d4ebe-5b35-4c58-a5fa-fac9b6f2b195 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.618532 Aug 30 16:23:44.588583 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2241/4134] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:43 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:45.048153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41052706-2b78-40d0-b325-3395efdd278e tempest-ExtensionsTest-400526372 tempest-ExtensionsTest-400526372-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.050682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41052706-2b78-40d0-b325-3395efdd278e tempest-ExtensionsTest-400526372 tempest-ExtensionsTest-400526372-project] 10.222.0.47 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.549868 Aug 30 16:23:45.051810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.052625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:45.053630 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1894/4135] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:23:44 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:45.063845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58cb2724-1de3-43c0-979d-5e264a2eafc7 tempest-ExtensionsTest-400526372 tempest-ExtensionsTest-400526372-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.069335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58cb2724-1de3-43c0-979d-5e264a2eafc7 tempest-ExtensionsTest-400526372 tempest-ExtensionsTest-400526372-project] 10.222.0.47 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.010426 Aug 30 16:23:45.072512 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1895/4136] 10.222.0.47 () {58 vars in 1134 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:23:45.079690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.080199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.080845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.081715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.091902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.092556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.374983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:45.386452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34b8509f-a203-4c7e-baa3-784b2a62bc3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1272 microversion: 2.1 time: 0.338694 Aug 30 16:23:45.402339 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2242/4137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:45.525473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.526086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:45.536508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.540929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.543845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.544758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.548023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.550938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.618566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:45.626791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:45.637877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.639755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.640413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.642339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.642828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.645458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.846142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:45.877675 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8160d4c0-ca68-4bf1-b538-3de6e1bfe690 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.356314 Aug 30 16:23:45.879004 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1896/4138] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:45.899415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "1bed3514-f847-4fe3-8b2d-599e3a2d21e8"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "52e68554-301a-4a5b-ab8e-a8f37c914c6b"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "5bc6f1b1-48e4-40be-85bc-dfeba68ac3df"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "d28bb004-9061-4c27-8b2a-bd4d3cc48ede"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:45.930532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:45.936774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:45.937314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:45.960237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Creating event network-vif-plugged:1bed3514-f847-4fe3-8b2d-599e3a2d21e8 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:45.966478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Creating event network-vif-plugged:52e68554-301a-4a5b-ab8e-a8f37c914c6b for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:45.967743 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Creating event network-vif-plugged:5bc6f1b1-48e4-40be-85bc-dfeba68ac3df for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:45.968380 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] Creating event network-vif-plugged:d28bb004-9061-4c27-8b2a-bd4d3cc48ede for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:45.979939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ba9a41c1-d10e-4c56-be85-0fb3c1c1557c req-881006b9-55b8-4ffc-b39f-e01671002660 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.098521 Aug 30 16:23:45.980673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1897/4139] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:46.130251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.141929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.150931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:46.158533 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1acd39f8-663f-4f54-8b89-c84162a3262f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.541039 Aug 30 16:23:46.178984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2243/4140] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:45 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:46.423754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:46.425814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:46.453940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.455274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.455735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.458889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.464784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.465541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.901157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:46.902040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:46.918077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.919901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.922150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.923108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:46.926344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:46.946932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:46.997276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.009678 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5429a39e-dbbf-4f92-be94-62300f79885a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.605129 Aug 30 16:23:47.012599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1898/4141] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:46 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:47.187899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:47.188834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:47.199838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.201352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.202749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.205355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.210344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.210344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.326912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.344842 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e0e377b2-3667-4f0b-8dfb-b594567031e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.449142 Aug 30 16:23:47.362885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2244/4142] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:46 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:47.633649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.683640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.689858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:47.698561 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1332ea92-64b1-4802-be1d-17e3113c4766 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.513702 Aug 30 16:23:47.699381 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1899/4143] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:47 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:47.941643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f87a4d-cb59-42dd-a92a-2f4abc206632", "tag": "197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:47.963192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:47.963932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:47.964378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:47.999106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] Creating event network-changed:197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c for instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 on n-h1-830883-28 Aug 30 16:23:48.014722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f64bf596-a628-416f-aee4-2acdc0a7ddef req-0d71fef3-1ef0-4e02-9d99-849740cdfff5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076367 Aug 30 16:23:48.016268 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1900/4144] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:48.047696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "4330790f-64ef-4c65-8b06-f3d794f22810"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-plugged", "status": "completed", "tag": "55474cec-b9bf-4649-bf10-bfc28a66716a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.080514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.082761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.083543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.087670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f336d04-6052-42db-89c3-f243e34139a5 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35c41f8b0>, body: {"keypair": {"name": "tempest-keypair-1973773494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEVvjAbIW0HU5MjW3AiX1VPSaUbhupZMgNIU5jO8ZTUsi1G0+gB1SGGpu8Az5nxM1IppmqhWd5lZl1Ctj3Cq4cO6lmi2xuqx4ruoTj60K8TvUt12345eH0PNizwuZRFVQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.111233 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Creating event network-vif-plugged:4330790f-64ef-4c65-8b06-f3d794f22810 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:48.112203 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] Creating event network-vif-plugged:55474cec-b9bf-4649-bf10-bfc28a66716a for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:48.133276 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c19226f7-6a1f-48c7-8bec-df5ab4bd24d0 req-7c7659dd-2001-472a-b124-105615fb94ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115274 Aug 30 16:23:48.138241 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1901/4145] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:48.144713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1f336d04-6052-42db-89c3-f243e34139a5 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.151130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.152347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.158579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1f336d04-6052-42db-89c3-f243e34139a5 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.164510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.165171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.165781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.166819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.167432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.168101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.219671 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f336d04-6052-42db-89c3-f243e34139a5 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.457015 Aug 30 16:23:48.221379 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2245/4146] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:48.230765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04b051e0-d82a-4c42-b2e4-b31421f130a7 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c4a1e50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.261746 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04b051e0-d82a-4c42-b2e4-b31421f130a7 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs/tempest-keypair-1973773494" status: 200 len: 498 microversion: 2.1 time: 0.034783 Aug 30 16:23:48.271385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2246/4147] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1973773494 => generated 498 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:48.293855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c929dae8-ced5-4a75-9785-f3aa53ba2d43 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c48fdc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.335157 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c929dae8-ced5-4a75-9785-f3aa53ba2d43 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973773494" status: 202 len: 0 microversion: 2.1 time: 0.062339 Aug 30 16:23:48.336171 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2247/4148] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973773494 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:48.348138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-842e479a-cb39-45c4-b9c8-e9aa9f9a5f14 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35ce47040>, body: {"keypair": {"name": "tempest-keypair-2139103400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTNN/IvFBDDS7tBtfHanrc3owr1AQkH6/5hSEXNzgKge/MCsStiqMDAnxoOTnmrPTbV9/1ILBzqqxlE036mdPAeaKhoPJWIoFPAAoVHgYDEKPHT6HIUjEpfz2o8SXjj8A=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.379295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-842e479a-cb39-45c4-b9c8-e9aa9f9a5f14 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.385088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-842e479a-cb39-45c4-b9c8-e9aa9f9a5f14 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.418676 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-842e479a-cb39-45c4-b9c8-e9aa9f9a5f14 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074622 Aug 30 16:23:48.419293 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2248/4149] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:48.424220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.432935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.449954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.451253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.452144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.454644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.456412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.458616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.538595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:48.547318 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e959981-84dc-47b3-9f75-333cb7c056e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.406732 Aug 30 16:23:48.550993 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1902/4150] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:48.559655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6e5f9ed-9d17-4398-a9b6-1498d85529bf tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd360f0dee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.582094 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6e5f9ed-9d17-4398-a9b6-1498d85529bf tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139103400" status: 202 len: 0 microversion: 2.1 time: 0.029579 Aug 30 16:23:48.583392 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1903/4151] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139103400 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:48.593291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73add31d-7f2e-40b8-a9ec-597e2f4fd78b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35c155e50>, body: {"keypair": {"name": "tempest-keypair-60179537", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.606276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:48.622739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-73add31d-7f2e-40b8-a9ec-597e2f4fd78b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.630838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-73add31d-7f2e-40b8-a9ec-597e2f4fd78b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.664084 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73add31d-7f2e-40b8-a9ec-597e2f4fd78b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.075418 Aug 30 16:23:48.672778 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1904/4152] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:48.679445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28a87d34-9332-4ecb-a50e-211eab535d5b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c13aaf0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.696008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:48.708785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28a87d34-9332-4ecb-a50e-211eab535d5b tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60179537" status: 202 len: 0 microversion: 2.1 time: 0.034329 Aug 30 16:23:48.709804 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1905/4153] 10.222.0.47 () {58 vars in 1215 bytes} [Tue Aug 30 16:23:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60179537 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:48.710703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e41a7966-c68a-4caa-98f8-27dc180ddd47 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.288400 Aug 30 16:23:48.725504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ba3d3a8-ad55-4704-bc2a-a6f42686e0ee tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35c1320d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-397823606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi7Ayb3odwG2faC7zC6O453p2+7JSkxwH/IAhOhKLY1hhIyt2LRYXJgyy9Sn/2OjtBVz9SjLmhgQ4KtfmRj3P9NIKY78pzE0ob/gVckrxDIPGhaKwC91xEqYKHZrQeUxg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.726965 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2249/4154] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:48.732381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:48.733770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:48.744688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.745350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.746043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.747303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:48.748332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:48.749898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:48.758484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6ba3d3a8-ad55-4704-bc2a-a6f42686e0ee tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.764017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6ba3d3a8-ad55-4704-bc2a-a6f42686e0ee tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.810385 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ba3d3a8-ad55-4704-bc2a-a6f42686e0ee tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.090027 Aug 30 16:23:48.811644 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1906/4155] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:48.832771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-569610f2-9216-40ca-88bf-000a0c9dbe6a tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35c0d6700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-455557650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw0GvBTF1hBmL6qHR0bAzx1bDFn4Qsf5I3dtMFdCdwrSJVuCUMkhABIKebUgDVnqiIegL6+NpZvokg+cD4Zg/0ao6JQnJ5FPJHHpiItuNaSqlWICjQlwFw3SFTih3tzGg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.853562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-569610f2-9216-40ca-88bf-000a0c9dbe6a tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.860139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-569610f2-9216-40ca-88bf-000a0c9dbe6a tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.896928 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-569610f2-9216-40ca-88bf-000a0c9dbe6a tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.074608 Aug 30 16:23:48.898580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1907/4156] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:48.913949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ecbb9e8-c796-4e74-952c-9ff27d67b824 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Action: 'create', calling method: .version_select at 0x7fd35c150790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-744441285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5bUlDRhr7BcJPYFcw1lS598Y0deH5AkU3hst9wCwIyTc3x3qlP2YPhl33muRPBhZzMKtL/Q70CZblfr+tZsOGiUrzJijZLoLrFu/CxoD5gW98HoT7ezZ0L3ejNSVRn2A=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:48.933360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4ecbb9e8-c796-4e74-952c-9ff27d67b824 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:23:48.940970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4ecbb9e8-c796-4e74-952c-9ff27d67b824 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Getting quotas for user d097709797ea44ff926d33a7fcb8eb14 and project 6e8ac64634b44c7ea87be5311745c5d8. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:23:48.978226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ecbb9e8-c796-4e74-952c-9ff27d67b824 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.070239 Aug 30 16:23:48.980240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1908/4157] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:23:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:48.994914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e7fc6a4-d7fb-448c-b136-44bd7caf38a9 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd360e07dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.018028 n-d-830883-28 devstack@n-api.service[122351]: WARNING oslo_db.sqlalchemy.utils [None req-3e7fc6a4-d7fb-448c-b136-44bd7caf38a9 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 16:23:49.029211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e7fc6a4-d7fb-448c-b136-44bd7caf38a9 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.041695 Aug 30 16:23:49.032969 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1909/4158] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:49.045132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b33f0232-8b94-4dc8-9eca-ff18dc9248ca tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c155c10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.106874 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b33f0232-8b94-4dc8-9eca-ff18dc9248ca tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-744441285" status: 202 len: 0 microversion: 2.1 time: 0.065136 Aug 30 16:23:49.108291 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1910/4159] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-744441285 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:23:49.120154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9327905-bb2b-453a-b1df-3d69981d5db3 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c13a8b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.121036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:49.133468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:49.141956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:49.143397 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f443c39-c809-42f2-b688-24c3b17689d4 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.415205 Aug 30 16:23:49.144682 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2250/4160] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:48 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:49.179064 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9327905-bb2b-453a-b1df-3d69981d5db3 tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-455557650" status: 202 len: 0 microversion: 2.1 time: 0.064246 Aug 30 16:23:49.181320 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1911/4161] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-455557650 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:49.193028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f43e2566-8969-4d6a-937b-449ec867a61e tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] Calling method '.version_select at 0x7fd35c4f95e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.256165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f43e2566-8969-4d6a-937b-449ec867a61e tempest-KeyPairsV2TestJSON-311866966 tempest-KeyPairsV2TestJSON-311866966-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-397823606" status: 202 len: 0 microversion: 2.1 time: 0.070517 Aug 30 16:23:49.257054 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2251/4162] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-397823606 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:23:49.577737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.577737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:49.587116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.593848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.594510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.597132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.597910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.598860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.734274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:49.734937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:49.753843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.755701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.757399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:49.758451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:49.759445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:49.760353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.023767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.034264 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c4723e4-acc2-4fb6-be8a-34557ee22948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.464786 Aug 30 16:23:50.034934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.035905 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1912/4163] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:49 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:50.038435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:50.047089 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ce2378f-ee98-4048-ae57-3899c1e35bcf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.317706 Aug 30 16:23:50.047714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2252/4164] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:49 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:50.152149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4b2dcf-13e8-4197-a971-069c20a4ab00", "name": "network-vif-plugged", "status": "completed", "tag": "42a47026-c5cb-49e1-a528-9b8483499a85"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:50.170816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:50.171459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:50.177730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:50.179253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:50.179946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.187231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:50.188038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:50.188652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.189551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:50.192461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:50.192895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:50.209513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] Creating event network-vif-plugged:42a47026-c5cb-49e1-a528-9b8483499a85 for instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 on n-h2-830883-28 Aug 30 16:23:50.215014 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f8a98b8d-85f0-4b72-a9aa-f88bebf6b0bb req-ed9e5bd1-34e3-49fe-a835-dd700e74690d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066399 Aug 30 16:23:50.216574 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1913/4165] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:50.912974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.928264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.934380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:50.939737 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-210df795-3e6a-42f4-97b3-e23577905194 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1880 microversion: 2.42 time: 0.770674 Aug 30 16:23:50.963362 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2253/4166] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:50 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1880 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:51.058695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:51.060107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:51.069345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:51.070562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:51.099908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.100489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.100850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.101573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.102032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.110832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.111331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.111797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.113530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.127908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.128452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.128903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:51.444263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:51.454541 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05f1dbdf-42c3-4f12-9d6a-f59df1448a8a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.401938 Aug 30 16:23:51.466356 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1914/4167] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:51 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:51.974891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:51.976490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:51.996969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:51.997838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:51.999128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.002296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:52.004604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:52.006944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.011122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:52.020258 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c1c62f9-7b0b-43e1-8809-bd9f876f841c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1315 microversion: 2.1 time: 0.955285 Aug 30 16:23:52.023513 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2254/4168] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:51 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:52.330517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:52.340064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:52.341515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:52.351084 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-74ed2ba1-f39a-4e35-8713-ea811b2c260b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2837 microversion: 2.42 time: 0.383907 Aug 30 16:23:52.352915 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1915/4169] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:23:51 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2837 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:23:52.384783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:52.386533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:52.396685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:52.398997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:52.400021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:52.400685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.401624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:52.402444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:52.403111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.489289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:52.489909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:52.516960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:52.523570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:52.524235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.526230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:52.527092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:52.531116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:52.787326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-575e11c2-a949-4543-aada-fdcaadd9aff3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.407641 Aug 30 16:23:52.788345 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2255/4170] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:23:52 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78/os-interface => generated 1831 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:23:53.042674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:53.044404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:53.073436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.074452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.076177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.078608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.079534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.080210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.212494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:53.220585 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a01b4aab-7683-42d2-a931-78f5918040b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.735044 Aug 30 16:23:53.226991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1916/4171] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:52 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:53.687680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:53.697520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17d41286-412c-4221-acf7-565d4a2a2d64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1501 microversion: 2.1 time: 0.659501 Aug 30 16:23:53.698119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2256/4172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:53 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1501 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:53.730851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:53.737670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:53.746336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.750627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.751373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.753211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:53.755003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:53.756244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:53.835678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:23:54.004986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-268c893a-442f-42df-a12a-0cf34c69904c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 204 len: 0 microversion: 2.1 time: 0.288939 Aug 30 16:23:54.006030 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1917/4173] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:53 2022] DELETE /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:23:54.015158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:54.016047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:54.029016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:54.030403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:54.033934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:54.034957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:54.038181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:54.038883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:54.250809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:54.251530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:54.260303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:54.261149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:54.261882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:54.263191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:54.263973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:54.264892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:54.454046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:54.470866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93e07860-3db4-4f4b-a458-6f4577a58e33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1507 microversion: 2.1 time: 0.459515 Aug 30 16:23:54.488621 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2257/4174] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:54 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:54.595602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:54.607682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f83c0b86-17eb-4355-977d-502f622c83f9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.363873 Aug 30 16:23:54.621907 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1918/4175] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:54 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:55.499474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:55.501045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:55.515955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:55.521405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:55.522170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:55.523350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:55.524268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:55.525053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:55.629431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:55.630072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:55.649378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:55.650129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:55.650838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:55.651808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:55.652526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:55.653104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:55.895651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:55.915322 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ceb2f06a-b37c-4e8d-952a-2c12cbee5038 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1507 microversion: 2.1 time: 0.421283 Aug 30 16:23:55.930936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2258/4176] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:55 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:55.987881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f87a4d-cb59-42dd-a92a-2f4abc206632", "name": "network-vif-plugged", "status": "completed", "tag": "197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:56.007744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.008560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.008970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.040064 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] Creating event network-vif-plugged:197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c for instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 on n-h1-830883-28 Aug 30 16:23:56.052801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5311ece1-365d-4dc2-bf00-8e8a714b2371 req-ef4a7ab9-40b7-4f66-91b2-b6d775fe1806 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068172 Aug 30 16:23:56.057027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2259/4177] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:23:56.371807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:56.374718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:56.383769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.384549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.385179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.386080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.386786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.387566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.400009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:56.408344 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f410be6-8e7f-493f-bdfc-7bc02918eda1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.783045 Aug 30 16:23:56.424374 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2630a54a-6a0a-4b80-b902-5cfc24b1cacd tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058306 Aug 30 16:23:56.430635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1919/4178] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:55 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:23:56.431324 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2260/4179] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:23:56 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:23:56.444780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "tag": "318073c3-10ec-444f-8ce0-6268c151f684"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:56.480936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.483187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.485206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.555637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:56.556306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:56.561592 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] Creating event network-changed:318073c3-10ec-444f-8ce0-6268c151f684 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:23:56.570054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.576016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.578247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.581389 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-58015ca5-dfbc-4b8a-a632-f7720028e2d5 req-2b48f770-6bdd-4159-83f5-71d6bd3f98f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139678 Aug 30 16:23:56.582437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.584574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.586525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.594719 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1920/4180] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:56.652959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:23:56.904206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:56.927376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36a03428-bf86-4ec1-a017-68fb6e8e8a26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 204 len: 0 microversion: 2.1 time: 0.374706 Aug 30 16:23:56.940203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:56.940959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:56.943439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2261/4181] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:23:56 2022] DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:23:56.960947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:56.961668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:56.967726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.970022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.970725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.974915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:56.976133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:56.979678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:56.999774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:57.000842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:57.004791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:57.005711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:57.006848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:57.007597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:57.689679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:57.702903 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7f36006-7903-48ea-b06e-8f01dba4f7ef tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1671 microversion: 2.1 time: 0.758012 Aug 30 16:23:57.708493 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2262/4182] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:56 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1671 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:57.727987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:57.759586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:57.767236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:57.778262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:57.779739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:57.781358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:57.783140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:57.783601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:57.784539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:57.799825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4bd79bd0-3dc7-4f23-9077-f4f2a8761085 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1465 microversion: 2.1 time: 0.865275 Aug 30 16:23:57.818683 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1921/4183] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:56 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1465 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:58.183951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:58.205339 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f705dc31-178b-4917-8def-4f460b80c3ca tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1314 microversion: 2.1 time: 0.492546 Aug 30 16:23:58.208664 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2263/4184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:57 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:58.707896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4b2dcf-13e8-4197-a971-069c20a4ab00", "name": "network-vif-deleted", "tag": "42a47026-c5cb-49e1-a528-9b8483499a85"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:58.728729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:58.733566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:58.751264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=16 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:58.769320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.771037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.773911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.774437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.775784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.778865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.782596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.785363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.786872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.845237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] Creating event network-vif-deleted:42a47026-c5cb-49e1-a528-9b8483499a85 for instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 on n-h2-830883-28 Aug 30 16:23:58.873588 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b5ba9ef6-9c7e-414b-9c99-75e17782ae77 req-2521dc8a-1c74-4c48-8fff-8526e0266ef3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172408 Aug 30 16:23:58.874672 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1922/4185] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:23:58.893707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:58.895568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:58.914168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.915593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.917650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.921261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.922824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.923507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.949837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:58.961953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=16 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:23:58.986961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:58.987762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:58.988627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:58.989278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'fault' on Instance uuid 7e4b2dcf-13e8-4197-a971-069c20a4ab00 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:23:59.277725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:59.298254 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8d525c4-02d6-4f60-828c-803656a70206 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 200 len: 1305 microversion: 2.1 time: 0.415888 Aug 30 16:23:59.300399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1923/4186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:58 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 1305 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:59.320191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:23:59.322655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:59.342722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.343653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.345547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.346701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.350253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.352045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.491429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:59.518924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4f5f47d-e7f1-4da0-abf2-79ae965a7914 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1671 microversion: 2.1 time: 0.796750 Aug 30 16:23:59.521278 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2264/4187] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:58 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1671 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:59.826230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:23:59.853624 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9a3abd8-4338-4d6f-89b7-10b12f073c7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1500 microversion: 2.1 time: 0.548844 Aug 30 16:23:59.855147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1924/4188] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:23:59 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1500 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:23:59.879454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:23:59.883817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:23:59.904086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.906729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.914674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:23:59.928358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:23:59.936845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:23:59.937677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.037514 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4ebf5f2-957c-45c9-94cf-f8542f9fbb8b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.162264 Aug 30 16:24:00.041198 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2265/4189] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:23:59 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:00.322769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:00.323569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:00.342668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.344587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.348455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.349614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.350362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.351461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.387828 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 HTTP/1.1 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7e4b2dcf-13e8-4197-a971-069c20a4ab00'} Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:00.390854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:24:00.398432 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:00.403770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:00.404516 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c039099-070e-4c79-86cb-07e9e3fa48c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 404 len: 111 microversion: 2.1 time: 0.085896 Aug 30 16:24:00.405237 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1925/4190] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:00 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:00.548916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:00.560003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:00.602552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.603289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.603747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.604565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:00.605032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:00.605455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:00.795725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-810387642", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:00.964515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:01.491036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:01.508981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac42d9a6-658a-4175-99ac-b97ffebc0645 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1671 microversion: 2.1 time: 0.971019 Aug 30 16:24:01.510161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2266/4191] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:00 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1671 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:01.542062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:01.546281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:01.567812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:01.568649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:01.569335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:01.570538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:01.571183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:01.572086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:01.657312 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5825a06f-65bc-484a-8af7-77ca8dc471f2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.132313 Aug 30 16:24:01.659254 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2267/4192] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:01 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:02.077209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ed901ebb-9742-4b5f-aa13-fff958f02a4f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: .version_select at 0x7fd35cba8f70>, body: {"keypair": {"name": "tempest-keypair-1300219849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2wapjH/3Ir2bVDWJRb8vao+p5qhYOuYxaPamR5zlVwD2gvPYBgLyVAwd2NG05VbIAx1GTnEcm1SWQE7GtcFhdfMxIfJl9AtZM39T2p3NwLn03A7P3rRcx0QhkF0l351Q=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:02.112768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ed901ebb-9742-4b5f-aa13-fff958f02a4f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:02.121464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ed901ebb-9742-4b5f-aa13-fff958f02a4f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:02.177073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ed901ebb-9742-4b5f-aa13-fff958f02a4f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.516142 Aug 30 16:24:02.204928 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2268/4193] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:24:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:02.344448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:02.345492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:02.346121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:02.346715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:02.347279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:02.371937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.372683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.374069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.374850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.375496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.376082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.400868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:02.416078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:02.441285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:02.464589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:02.471542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:02.537470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:02.538592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:02.565303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.565817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.572902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.574914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.577800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.578984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.598243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94c66fe9-789d-403f-9e62-3a935623bee1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802891 Aug 30 16:24:02.602554 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1926/4194] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:24:02.621509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2738ce6a-2f77-40e4-b52e-0e953a747f93 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:02.624816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2738ce6a-2f77-40e4-b52e-0e953a747f93 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:02.828331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2738ce6a-2f77-40e4-b52e-0e953a747f93 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:02.838447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2738ce6a-2f77-40e4-b52e-0e953a747f93 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1214 microversion: 2.1 time: 0.227188 Aug 30 16:24:02.840393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1927/4195] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:02 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:02.867714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:02.875944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:02.881608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:02.895199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.896925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.899284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.900316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:02.900943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:02.903926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:02.911922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-953730fb-5b26-468d-aec1-5e7604331fb1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1604 microversion: 2.1 time: 0.379000 Aug 30 16:24:02.912549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2269/4196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:02 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:03.015009 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-efd3e4de-f88f-46b7-80ee-79937954f210 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.170147 Aug 30 16:24:03.016106 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1928/4197] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:02 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:03.545652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cef9d81-c51e-4f33-9295-eb52e722d2aa", "name": "network-vif-deleted", "tag": "a4f9a7e4-672c-4032-add3-8e6b40a72a6a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:03.596779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.597525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.598152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:03.650879 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] Creating event network-vif-deleted:a4f9a7e4-672c-4032-add3-8e6b40a72a6a for instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa on n-h2-830883-28 Aug 30 16:24:03.662978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-10628043-d87d-4a57-8f38-dee71adbd46e req-e5939917-f39b-464d-a8b8-eaf1ac4bd6fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121905 Aug 30 16:24:03.664070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2270/4198] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:03.866893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-227287ed-3dba-431a-87ae-ace8d4d8d190 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:03.868630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-227287ed-3dba-431a-87ae-ace8d4d8d190 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:03.941418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:03.942665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:03.966137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.971238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.972230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:03.973877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:03.975834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:03.976481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.036710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:04.064102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-227287ed-3dba-431a-87ae-ace8d4d8d190 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:04.075276 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-227287ed-3dba-431a-87ae-ace8d4d8d190 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1214 microversion: 2.1 time: 0.212833 Aug 30 16:24:04.082994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.086177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.088435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.104140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lazy-loading 'fault' on Instance uuid 7cef9d81-c51e-4f33-9295-eb52e722d2aa {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:04.110663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1929/4199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:03 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:04.127814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:04.129895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:04.170150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.181218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.184983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.187299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:04.190334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:04.190957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:04.235312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:04.256468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf96356c-086e-4921-b342-47c1999b85d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 200 len: 1326 microversion: 2.1 time: 0.315117 Aug 30 16:24:04.257208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2271/4200] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:03 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 1326 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:04.340801 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a9b3895-dca7-4fef-97d4-1367bfb9cad8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.228349 Aug 30 16:24:04.342211 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1930/4201] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:04 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:05.097021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:05.098263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:05.126084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.127645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.129221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.134149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.137019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.137488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.296959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:05.308212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:05.336650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.338789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.339605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.341665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.344486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.345111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.399916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa HTTP/1.1 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7cef9d81-c51e-4f33-9295-eb52e722d2aa'} Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:05.412513 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:05.418632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12ab5cec-bf93-4092-854f-8708d030066f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 404 len: 111 microversion: 2.1 time: 0.138878 Aug 30 16:24:05.425280 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1931/4202] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:05 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:05.441290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:05.450495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:05.473642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.476085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.479612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.480802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:05.482131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:05.487759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:05.541260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:05.552686 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cbfdbf5-009f-45e4-a96f-f0cf47d40d9a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1266 microversion: 2.1 time: 0.460370 Aug 30 16:24:05.568455 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2272/4203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:05 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:05.579913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d10ed139-1eed-41b9-bed2-c091340f317f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '.version_select at 0x7fd35d28a5e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:05.615092 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d10ed139-1eed-41b9-bed2-c091340f317f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322317343" status: 202 len: 0 microversion: 2.1 time: 0.044511 Aug 30 16:24:05.615996 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2273/4204] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322317343 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:05.666844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c29a698f-986b-401b-a94e-807913cde0d2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.242628 Aug 30 16:24:05.670970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1932/4205] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:05 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:06.574338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:06.576006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:06.591054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1276556662", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76"}], "security_groups": [{"name": "tempest-securitygroup--1046151908"}], "key_name": "tempest-keypair-1300219849", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:06.634775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:06.644079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:06.644850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:06.651046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:06.653586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:06.658532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:06.996014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:07.011343 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bf3c379-dd28-4665-86b2-a1a19ae5b74b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1272 microversion: 2.1 time: 0.442099 Aug 30 16:24:07.012392 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2274/4206] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:06 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:07.017752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:07.027735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:07.043787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:07.046562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:07.048707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:07.054983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:07.057880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:07.058487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:07.156226 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4742deef-e9ea-4318-a335-3bfb26551aad tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.142283 Aug 30 16:24:07.160788 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2275/4207] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:07 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:07.743750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] validate_networks() for [('7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:07.964924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-663231942", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:08.078607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] validate_networks() for [('ebdd2451-5064-4b70-8f72-d3cfcd82b10e', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:09.099705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:09.100687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:09.101777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:09.105503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:09.106261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:09.139361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.143809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.144416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.145377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.148146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.148674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.189223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Getting quotas for project 9c2ecf041edc4894a2154c60c22f0843. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:09.218822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:09.219599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:09.220193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:09.220683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:09.221110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:09.226971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Getting quotas for user 01a97fec04424d428247dbf830884c34 and project 9c2ecf041edc4894a2154c60c22f0843. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:09.244603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.245540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.246154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.250504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.256095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.257565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.290394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:09.303853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:09.362149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:09.385708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:09.441918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:09.445426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:09.495915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91461702-147b-4b4b-8d61-ec5594e43d7c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.630497 Aug 30 16:24:09.495915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2276/4208] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:24:09.518087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:09.522646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:09.550173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.552614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.554618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.567133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.572622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.575195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.606080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b46a1b21-055e-4ab6-8af2-44f491d3a80c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.016252 Aug 30 16:24:09.607716 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1933/4209] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:24:09.633062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:09.643420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:09.674605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.675299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.675935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.677748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:09.678419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:09.679031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:09.790182 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e567af31-780c-40c2-92c5-56cfae4c5cfa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 14 microversion: 2.1 time: 0.181461 Aug 30 16:24:09.791580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1934/4210] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:09 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:24:09.801342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3cc4dff2-ffec-4043-8c25-0d5fdd3ca1c5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: .version_select at 0x7fd35c11b5e0>, body: {"keypair": {"name": "tempest-keypair-711596670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz7Yb4h73oxOin9Pj8/WF7V0booUWbBeTPdWyprUBsyb1D5AHyK26ld0Wv4YZEOPACZVCd9CvPIkuQLuoBZqS2fMzsIW9jJqGMLKQu7U7kEjTzLgrhaOZAetH0T+ryBqQ=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:09.960540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3cc4dff2-ffec-4043-8c25-0d5fdd3ca1c5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for project 8253158502424d52b6415ec18e55be2b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:09.985964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3cc4dff2-ffec-4043-8c25-0d5fdd3ca1c5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for user 8088798e433c4056be1b6ec5d67cbc29 and project 8253158502424d52b6415ec18e55be2b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:10.119815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3cc4dff2-ffec-4043-8c25-0d5fdd3ca1c5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325979 Aug 30 16:24:10.120931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1935/4211] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:24:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:10.132381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e032b4c-d853-447b-b47c-b52b8bbfb234 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:10.136637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e032b4c-d853-447b-b47c-b52b8bbfb234 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:10.248916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.260784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fbc99634-2c66-4c32-8907-4ffab18a04a4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.763686 Aug 30 16:24:10.279860 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2277/4212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:09 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:10.289909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4474dd8-f254-45db-accd-e39347fac73b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:10.295189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4474dd8-f254-45db-accd-e39347fac73b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:10.338208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e032b4c-d853-447b-b47c-b52b8bbfb234 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.346640 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e032b4c-d853-447b-b47c-b52b8bbfb234 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1222 microversion: 2.1 time: 0.224062 Aug 30 16:24:10.348036 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1936/4213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:10 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:10.477853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4474dd8-f254-45db-accd-e39347fac73b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:10.490091 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4474dd8-f254-45db-accd-e39347fac73b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1242 microversion: 2.1 time: 0.206600 Aug 30 16:24:10.493046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2278/4214] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:10 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1242 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:10.803322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:10.806484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:10.855098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.859838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.860897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.861976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:10.862693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:10.863338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:10.959182 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24262ae6-72ea-4064-9389-b99972ea37c7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action" status: 200 len: 8205 microversion: 2.1 time: 0.159637 Aug 30 16:24:10.964778 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1937/4215] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:10 2022] POST /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632/action => generated 8205 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:10.971532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:10.972167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:11.002820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.003341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.003798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.004530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.005183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.005959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.286286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:11.287395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:11.308555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.309181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.309756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.312710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.313604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.314257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.392268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:11.402072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f6c378b-cc74-4041-8476-589fc3ea6734 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.435629 Aug 30 16:24:11.403726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2279/4216] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:10 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:11.441108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:11.441745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:11.473999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.476496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.477073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.483608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.484227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.484683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.652141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:11.666905 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22a8e58b-612f-42ab-ad43-4d3c093c19f6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1274 microversion: 2.1 time: 0.261240 Aug 30 16:24:11.671687 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2280/4217] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:11 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1274 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:11.687806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:11.689055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:11.721252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.723030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.725274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:11.726558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:11.727849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:11.728495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.038503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:12.047870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed045ccc-9cc6-4e36-92fa-860943ac40d6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.766228 Aug 30 16:24:12.070543 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1938/4218] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:11 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:12.070758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:12.084062 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21f87c55-889e-43c5-ad10-57e4d85d9325 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.410725 Aug 30 16:24:12.092756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:12.099586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.105722 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2281/4219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:11 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:12.115638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.117682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.118723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.119425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:12.119896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.120060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.120679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.122151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.144612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.146600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.149200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.152058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.153218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.157919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.276847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:12.305213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0cdc0b8-8663-4087-a5f7-8d2c7237f6be tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1294 microversion: 2.1 time: 0.229819 Aug 30 16:24:12.309914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1939/4220] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:12 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:12.436699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6057db1f-0c33-40bf-8969-215648d84fb7", "tag": "2c364b54-0b0a-4bbe-a170-ca79967028e0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:12.459602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.460421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.461101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.485905 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] Creating event network-changed:2c364b54-0b0a-4bbe-a170-ca79967028e0 for instance 6057db1f-0c33-40bf-8969-215648d84fb7 on n-h2-830883-28 Aug 30 16:24:12.499908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f0803c33-8421-4bf3-afe3-c76e13392d0c req-d0f4f394-7895-4a72-85b4-e79f62d179d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072879 Aug 30 16:24:12.501793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1940/4221] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:12.626818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:12.643870 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91ca855f-e2b7-462b-8567-bbca194bce9c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.535273 Aug 30 16:24:12.661628 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2282/4222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:12 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:12.667540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:12.668354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.692827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.694391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:12.695034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:12.703309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.703881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.710976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.711245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.711902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.712035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.712874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.713462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:12.715248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:12.715672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:12.716111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.024811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.041925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0714c766-0182-4b43-8fdb-d67319897f96 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1282 microversion: 2.1 time: 0.351598 Aug 30 16:24:13.048736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2283/4223] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:12 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:13.080546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:13.081968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:13.105955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.111143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.120112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.121130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.121765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.122381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.490475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.506901 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-01947a4c-a658-455e-8f59-f78070afb85a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.844396 Aug 30 16:24:13.507492 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1941/4224] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:12 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:13.527178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:13.528112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:13.546701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.547674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.548291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.549170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.550872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.553415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.752797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:13.768261 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c384b67-7019-466f-9e8a-387f8d735250 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1300 microversion: 2.1 time: 0.252005 Aug 30 16:24:13.771313 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1942/4225] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:13 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1300 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:13.778198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:13.783203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:13.801779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.802291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.807368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.809603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:13.816725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:13.819617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:13.922687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Locking {{(pid=122351) lock /opt/stack/nova/nova/compute/api.py:4855}} Aug 30 16:24:14.088301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64b14141-91ed-4b12-8107-e0887c9340c4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.314699 Aug 30 16:24:14.089312 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1943/4226] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:13 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:14.096677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:14.097691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:14.104766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.106054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.107183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.108073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.108869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.109496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.864681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.902954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8f171cf-c339-4f4f-a5af-e2f5b78ddead tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 1.827795 Aug 30 16:24:14.925734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2284/4227] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:13 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:14.938576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:14.942886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:14.954199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:14.960537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.962767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.963688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.964608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:14.967878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:14.968529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:14.973928 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-936aa707-57d1-4026-8b3d-d29fd75080ad tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1280 microversion: 2.1 time: 0.883281 Aug 30 16:24:14.979042 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1944/4228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:14 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1280 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:15.007943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:15.009881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:15.039322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.039831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.040281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.041005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.041463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.041889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.269698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.278332 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1555075-6e4c-474f-957b-dce38e3aed6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1300 microversion: 2.1 time: 0.290682 Aug 30 16:24:15.279463 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1945/4229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:14 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:15.928777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:15.929687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:15.949498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.953926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.956548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.959801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:15.963603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:15.964265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:15.983749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:15.992515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b3691b7-4921-44a1-823c-dee54d867f4b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 1.065108 Aug 30 16:24:16.015433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2285/4230] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:14 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:16.024542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:16.028295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:16.038629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:16.050343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.051154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.052335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.053072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.053693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.057049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.454885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.464066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6758ab4-5d31-4eaa-9ad2-1f61873d3acf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.542362 Aug 30 16:24:16.468513 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1946/4231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:15 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:16.488917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:16.504865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.505601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.506212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.567533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action HTTP/1.1 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 15 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: {"os-stop": {}} Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5a8a958d-f47e-466c-9d97-5fa496b1afea', 'body': {'os-stop': {}}} Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1477, in _stop_server Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1479, in _stop_server Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked Aug 30 16:24:16.571458 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:16.582414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 409 to user: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea is locked {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:16.585044 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6e160bc-8ec6-4f31-adc1-69145d1fbeaa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 409 len: 107 microversion: 2.1 time: 0.114558 Aug 30 16:24:16.586852 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1947/4232] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:16 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 107 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:24:16.598915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:16.599928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:16.611899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.612600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.613897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.615841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.616834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.617681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.849237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.860083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-838d06ce-565f-41dc-9894-76829d3f7b61 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1300 microversion: 2.1 time: 0.269470 Aug 30 16:24:16.860966 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1948/4233] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:16 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:16.869256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:16.873815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:16.893001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.894896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.895306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.896370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:16.896841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:16.897289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:16.916118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:16.927182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-581b8c2e-aae0-4341-b081-41ecdcb49240 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.910150 Aug 30 16:24:16.936009 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2286/4234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:16 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:16.986865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Unlocking {{(pid=122351) unlock /opt/stack/nova/nova/compute/api.py:4884}} Aug 30 16:24:17.072258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3cb2320-0396-4873-bde6-30b84676a0b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.209721 Aug 30 16:24:17.073161 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1949/4235] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:16 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:17.084069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:17.102495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.106809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.109774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.143074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:24:17.210521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-581435694", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed0cfc5b-6a05-4f17-a25d-b16f771732b3"}], "security_groups": [{"name": "tempest-securitygroup--241043595"}], "key_name": "tempest-keypair-711596670", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:17.300102 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f9221af-9a66-4190-b456-7e9e60ce6fbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.216989 Aug 30 16:24:17.304020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2287/4236] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:17 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:17.332652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:17.335551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:17.352067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.355317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.356117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.357908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.359126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.360485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.585558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] validate_networks() for [('ed0cfc5b-6a05-4f17-a25d-b16f771732b3', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:17.768480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:17.783485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22f8c17e-efc2-4fdd-8dbc-a1a021b284a7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.472896 Aug 30 16:24:17.784471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2288/4237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:17 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:17.792010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:17.792974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:17.830956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.831861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.833622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.834797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:17.835298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:17.837949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:17.903451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:18.241302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.253579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b5a7c3a-4c0d-4c11-b329-4b76ade0a91b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.467777 Aug 30 16:24:18.254503 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2289/4238] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:17 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:18.276329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:18.277283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:18.291966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.301330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.302032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:18.303150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.303787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.304228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:18.693944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:18.709284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69a4bf49-5802-40db-9618-f399793b6d79 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.453176 Aug 30 16:24:18.710210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2290/4239] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:18 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:18.715560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:18.716159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:18.736857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.737369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.737922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:18.738683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:18.740818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:18.743229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.036107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:19.036703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:19.037266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:19.037898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:19.038387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:19.058686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.060938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.061558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.063148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.066067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.066566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.103570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.118147 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36c8a4d2-9f1b-4b1c-a2e4-930adc382bb5 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.404737 Aug 30 16:24:19.124125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for project 8253158502424d52b6415ec18e55be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:19.147649 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2291/4240] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:18 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:19.147780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Getting quotas for user 8088798e433c4056be1b6ec5d67cbc29 and project 8253158502424d52b6415ec18e55be2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:19.147878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:19.156477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:19.165335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.166497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.167867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.173910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:19.181374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:19.187758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:19.205078 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] Creating event network-changed:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:24:19.208512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bacf6be7-21b7-4cab-8afb-3dfd27e2c8db req-b4c27bb1-504b-488e-b4bc-4e9ae55f4311 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068963 Aug 30 16:24:19.209642 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2292/4241] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:19.216329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.217657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.230067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.231150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.231797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.233356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.234098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.235017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.317484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b127b677-a3c9-49bc-9a21-fa01d2de2ca3 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.122628 Aug 30 16:24:19.324106 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1950/4242] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:24:19.326237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61857f0-1416-4611-9858-4553cd016785", "tag": "dfb7769b-39ee-4527-9137-4d40b18018cb"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:19.353483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.354158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.354881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.382077 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] Creating event network-changed:dfb7769b-39ee-4527-9137-4d40b18018cb for instance e61857f0-1416-4611-9858-4553cd016785 on n-h1-830883-28 Aug 30 16:24:19.387388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5463f158-f3b9-40d9-85b0-8aedbb01dcc4 req-cb7e9195-38d3-4294-9c0f-80b033e25c38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067430 Aug 30 16:24:19.389292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1951/4243] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:19.396608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.397485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.405348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.406227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.407362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.408241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.408941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.409859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.588541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.605889 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1707f76a-a004-4091-a333-94ff1658cdcf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.389206 Aug 30 16:24:19.607444 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2293/4244] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:19.620481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cb31cb04-823e-46a3-899e-e626a006158f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.621233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cb31cb04-823e-46a3-899e-e626a006158f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.725964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cb31cb04-823e-46a3-899e-e626a006158f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.735403 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cb31cb04-823e-46a3-899e-e626a006158f tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1236 microversion: 2.1 time: 0.126307 Aug 30 16:24:19.736485 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2294/4245] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1236 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:19.741537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:19.742361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:19.744484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:19.752036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.759376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.759998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.760553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.761425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:19.762011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:19.762673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:19.765650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dae65308-d1ea-47ef-b4c3-e02024d5b64f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.370568 Aug 30 16:24:19.767935 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1952/4246] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:19.955777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:19.972417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a94b9df-da1c-44a5-a4d3-7ecb306ebe75 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.234548 Aug 30 16:24:19.973136 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2295/4247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:19 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:20.157800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.158816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.173678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.174627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.175548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.176322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.177034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.177727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.482580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.504228 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4e8dd63-d389-44ab-a12d-b54a903a85a3 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.352873 Aug 30 16:24:20.522977 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1953/4248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:20.630195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.630973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.642529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.644082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.644791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.645975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.646731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.647389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.757123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.758109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.768318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.769221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.769843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.770907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.771523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.772107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.879226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.894927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b82acd78-1e2d-41fb-a070-629fa30d9ace tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1288 microversion: 2.1 time: 0.135112 Aug 30 16:24:20.894927 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1954/4249] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:20.894927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:20.895386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:20.904209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.904209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.904209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.904765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:20.905548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:20.906261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:20.980894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:20.998107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c045d5d9-7c63-4259-8d34-289dc6a3ec9e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.371648 Aug 30 16:24:20.998794 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2296/4250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:21.003545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:21.004401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:21.030499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.031340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.031724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.032441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.032909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.033344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.199741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:21.215715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1fcd65f8-609f-4309-9c1d-52cb224174b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.323766 Aug 30 16:24:21.233708 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1955/4251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:21.300018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:21.309962 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73f9ad9b-0031-4d2d-ae72-ce555ea22c20 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.309876 Aug 30 16:24:21.323639 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2297/4252] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:20 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:21.529014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:21.540527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:21.562466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.565546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.568857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.570618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.573407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.577654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.887526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6057db1f-0c33-40bf-8969-215648d84fb7", "name": "network-vif-plugged", "status": "completed", "tag": "2c364b54-0b0a-4bbe-a170-ca79967028e0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:21.930421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:21.937229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:21.939823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:21.970287 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] Creating event network-vif-plugged:2c364b54-0b0a-4bbe-a170-ca79967028e0 for instance 6057db1f-0c33-40bf-8969-215648d84fb7 on n-h2-830883-28 Aug 30 16:24:21.978997 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7ab0ed9a-8026-4ad1-9a8b-ad52bffe4a53 req-a98212d9-1bda-42f1-91ec-2974969fff7e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096087 Aug 30 16:24:21.980438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2298/4253] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:22.023479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:22.027777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:22.049888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.050750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.051564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.052583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.059491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.062788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.095019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:22.108958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-675d075d-e67c-473a-a891-95256d59ee4a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.586301 Aug 30 16:24:22.118711 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1956/4254] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:21 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:22.123499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:22.130747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:22.137412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.138241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.138901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.139781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.141020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.141602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.264456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:22.274698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6506199-413e-4514-a645-3ce9a964b4d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1294 microversion: 2.1 time: 0.292360 Aug 30 16:24:22.275484 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2299/4255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:21 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1294 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:22.281462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:22.282269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:22.288928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.289598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.290096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.290871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.291514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.292078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.559721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:22.568843 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d61071db-4bac-455b-a9f8-ce43e04c3e7a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.291420 Aug 30 16:24:22.573757 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2300/4256] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:22 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:22.579589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:22.585885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:22.602295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.603180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.604353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.612389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:22.613174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:22.613956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:22.889760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:22.901463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9034df19-3e72-4bfa-8692-dee99bb24236 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.326464 Aug 30 16:24:22.906772 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2301/4257] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:22 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:23.084118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:23.096686 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1cede33-daf5-43ff-8804-62f11ab43bfb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.981009 Aug 30 16:24:23.097826 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1957/4258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:22 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:23.130290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:23.133220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:23.154364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.154977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.155457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.156182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.156640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.157077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.319632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:23.321969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:23.349152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.350459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.351954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.354869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.355814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.356740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.458846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:23.468228 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c371b93f-d10a-4d94-a8b0-c8870837cec0 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.342576 Aug 30 16:24:23.468839 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2302/4259] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:23 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:23.599924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:23.600516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:23.610964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.613603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.614158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:23.614991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:23.615442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:23.620222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.022266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.032264 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e513e51e-ee94-4a21-9968-8f12c28e137e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1314 microversion: 2.1 time: 0.437524 Aug 30 16:24:24.046801 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2303/4260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:23 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:24.053524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:24.054658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:24.062924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.063612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.064203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.065305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.066190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.066880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.100665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.116968 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbde35a6-1400-4c87-981c-b834c1d6968a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.808230 Aug 30 16:24:24.117735 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1958/4261] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:23 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:24.123450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "name": "network-vif-plugged", "status": "completed", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:24.148099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.148832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.149788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.163974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] Creating event network-vif-plugged:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:24:24.180096 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-39299a04-2fdd-47bd-a6bf-569dedeec997 req-258e8bef-a32b-4bef-9bf6-b72659c2fe22 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060571 Aug 30 16:24:24.180949 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1959/4262] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:24.188111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:24.188859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:24.208575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.209299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.209794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.210857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.211531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.212173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.293140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.309561 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-108010d8-e75a-4172-949c-7b1692311eec tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.261030 Aug 30 16:24:24.310983 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2304/4263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:24 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:24.493152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:24.493767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:24.506059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.507955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.510460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.512689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:24.515650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:24.519146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:24.651535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.662758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b01b007-069d-40a0-9e9e-4bcfa9e64b15 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.480283 Aug 30 16:24:24.665565 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1960/4264] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:24 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:24.721487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:24.730147 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-308aface-8b40-4a11-b558-6329f141920f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1322 microversion: 2.1 time: 0.240801 Aug 30 16:24:24.731001 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2305/4265] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:24 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:25.053241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.053862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.065900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.066724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.069022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.070404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.071396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.072445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.141784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.143487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.152888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.153543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.154411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.155386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.156053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.156674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.404093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:25.414806 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10a8a94f-ebf6-4e78-bf22-4e3c36889a2b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.279186 Aug 30 16:24:25.421857 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2306/4266] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:25.432009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e7356c-07a4-4e80-8bba-cda2c84d8d92", "tag": "1b1d843f-afaa-49f5-b1f0-48a3901f5073"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:25.471491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.472348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.473074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.494067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] Creating event network-changed:1b1d843f-afaa-49f5-b1f0-48a3901f5073 for instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 on n-h2-830883-28 Aug 30 16:24:25.508575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-77c4e1ac-3099-4a2c-94cb-fa5751a6fed2 req-a0a24a5a-5b33-49dc-81a5-c408cc6f4053 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084974 Aug 30 16:24:25.511384 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2307/4267] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:25.522754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.525070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.541566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.542183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.542786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.548674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.549304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.549935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.799929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:25.809919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05582bcc-a048-456a-90cd-867f26e6f1a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1500 microversion: 2.1 time: 0.760547 Aug 30 16:24:25.814163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1961/4268] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1500 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:25.842764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:25.860457 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-249a2f32-8c40-4d3a-9a71-7a4029ad4be9 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.347231 Aug 30 16:24:25.861714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.862982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2308/4269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:25.866549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.884781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:25.888263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:25.897615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.898483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.899467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.900206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.902858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.903315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.904438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.905229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.906019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.907881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:25.908660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:25.910483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:25.916463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:26.098698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:26.108172 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6ce4ada-6305-4285-b587-09a99e89f36e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1517 microversion: 2.1 time: 0.244008 Aug 30 16:24:26.108766 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2309/4270] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:26.130686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:26.133986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.142108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.143310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.143926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.145378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.146043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.146735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.184450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lazy-loading 'flavor' on Instance uuid 53acca5e-d7a2-4d86-980f-6227b188e970 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:26.297357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:26.299410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47b5d21f-90a0-40ae-b2dc-7c36130daac6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action" status: 200 len: 32 microversion: 2.1 time: 0.173045 Aug 30 16:24:26.300762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2310/4271] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:26 2022] POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:24:26.301614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:26.309840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-587a59a1-7b3d-487c-8228-f2d68755f8f7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.460994 Aug 30 16:24:26.311605 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1962/4272] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:25 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:26.319617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.321339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.329496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.330001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.330699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.334457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.334457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.334457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.447634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.448689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.475819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.477600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.478264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.482354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.484915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.488245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.707321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:26.723016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e06259d2-b59c-4be4-aa5c-ac2558fbaf5e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.413709 Aug 30 16:24:26.725400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2311/4273] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:26 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:26.889665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:26.890418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:26.901248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.901746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.902186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.902918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:26.903383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:26.907218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:26.914055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:26.927531 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-900a25d4-5875-4c24-bb65-beb2365b0dc6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.482921 Aug 30 16:24:26.928235 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1963/4274] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:26 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:27.125916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:27.137842 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-767e9601-b6f5-473e-be36-70672a643487 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.252511 Aug 30 16:24:27.150388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2312/4275] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:26 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:27.337710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:27.338553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:27.351604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.352359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.357865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:27.364710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.365876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.366729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:27.713953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:27.724174 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e50181c9-509b-4423-9665-39eca2fb30be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.389884 Aug 30 16:24:27.725914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1964/4276] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:27 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:27.750384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:27.751054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:27.765600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:27.968054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:27.973782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:27.995741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.000138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.000703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.001558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.003429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.008582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.145019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:28.164820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41ef0315-b08f-4631-9cc0-9af7ab90286c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.423539 Aug 30 16:24:28.171777 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2313/4277] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:27 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:28.191139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:28.192058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:28.212884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.213634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.214798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.218348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.219139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.220071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.255965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:28.268653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b99b1090-57cc-4f6f-83b1-782323c20f99 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.319294 Aug 30 16:24:28.278547 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1965/4278] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:27 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:28.288697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61857f0-1416-4611-9858-4553cd016785", "name": "network-vif-plugged", "status": "completed", "tag": "dfb7769b-39ee-4527-9137-4d40b18018cb"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:28.299402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.299642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.300383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.314777 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] Creating event network-vif-plugged:dfb7769b-39ee-4527-9137-4d40b18018cb for instance e61857f0-1416-4611-9858-4553cd016785 on n-h1-830883-28 Aug 30 16:24:28.324190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7f225d5e-4683-4eb0-bec4-e0500af3bf85 req-39fc5e78-0e57-4e1e-9f04-1f7494faa0d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039472 Aug 30 16:24:28.325526 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1966/4279] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:28.491189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:28.504694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2de6edd3-f006-4f0a-9a28-803cfd46d5e6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.331612 Aug 30 16:24:28.505855 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2314/4280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:28 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:28.766887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:28.769453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:28.782200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.783045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.783680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.784576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.785236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.785856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.859726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d2c715f-6a4c-402f-aee4-b8619e44150c"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:28.862572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:28.876628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.877131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.877578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:28.878286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:28.882740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:28.886274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.093769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:29.146924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.156366 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b0b8767-5f10-46e3-8242-81e7ebb077bb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1654 microversion: 2.1 time: 0.395821 Aug 30 16:24:29.156948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1967/4281] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:28 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1654 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:29.181231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:29.184107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=28 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:29.191386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.191927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.192338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.231503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Going to try to start instance {{(pid=122351) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:24:29.286279 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3b6e2ef-a48c-422d-86ff-558837ccd979 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.110563 Aug 30 16:24:29.287162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1968/4282] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:29 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:24:29.292813 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04413a75-5c86-48bb-9788-7e95f3aef8cf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437490 Aug 30 16:24:29.293291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:29.293633 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2315/4283] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:24:28 2022] POST /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:24:29.299435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:29.299871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:29.301119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:29.306744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.307541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.307681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.308377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.308969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.309398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.310119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.311556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.312564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.313481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.314288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.314814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.546924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.561270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ec7fa26f-c9c2-4d87-9a26-c561e03953e5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.264222 Aug 30 16:24:29.561756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.563072 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2316/4284] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:29 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:29.573024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:29.574352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:29.579209 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5964547-7ad9-4c25-a7f5-4bd5a28b085a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.286143 Aug 30 16:24:29.580102 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1969/4285] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:29 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:29.586016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:29.587092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:29.593889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.594431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.594885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.595596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.598997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.599461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.600387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.601126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.608972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.610038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:29.610696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:29.611215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:29.730804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=14 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:29.790695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.803230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-518f01cd-27e0-4d77-b769-562ca2134e49 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1663 microversion: 2.1 time: 0.238809 Aug 30 16:24:29.804379 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2317/4286] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:29 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1663 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:29.808706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:29.819423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3dde045-b603-42bb-a1d1-81c7a1c978d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1368 microversion: 2.1 time: 0.238013 Aug 30 16:24:29.827850 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1970/4287] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:29 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:30.593151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:30.593910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:30.607766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:30.608583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:30.624958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.627202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.632230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.633015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.634010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.635174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.636238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.637611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.639199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.639937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.641532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.642149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.921592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:30.933035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1320771b-62b5-499e-8ec8-090626edfba8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.349537 Aug 30 16:24:30.934266 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2318/4288] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:30 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:30.940409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:30.941382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:30.952920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.953737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.954565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:30.955677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:30.956700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:30.957383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.073265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:31.116515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4494fa4-4d8c-473d-a3a1-b56fa67d254d tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.504385 Aug 30 16:24:31.124294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1971/4289] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:30 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:31.136173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:31.137723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:31.150881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.151390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.151838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.152556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.153019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.153707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.283701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:31.299757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84f2cd1b-0b7f-4d63-8130-c29861454e5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1663 microversion: 2.1 time: 0.359958 Aug 30 16:24:31.300639 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2319/4290] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:30 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1663 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:31.420144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:31.431796 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db13f1f1-d0cb-4dde-8826-249e02580aeb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1559 microversion: 2.1 time: 0.303733 Aug 30 16:24:31.433068 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1972/4291] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:31 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1559 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:31.454766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:31.456229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:31.465413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.465956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.466439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.467344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.468139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.468746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.613089 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa62b2f0-7150-48e3-8ed9-654a05a46122 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162649 Aug 30 16:24:31.614082 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2320/4292] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:24:31 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:31.961423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:31.963824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:31.979193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.982042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.984674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:31.985620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:31.987369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:31.989242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.146648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:32.149602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:32.161844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.167265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.167996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.168932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.171394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.173134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.402405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:32.413358 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8700617b-ed02-4169-b041-df76d7ac9c26 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.271334 Aug 30 16:24:32.427303 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2321/4293] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:32 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:32.433908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:32.434910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:32.446873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.447737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.448360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.449837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:32.451411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:32.452138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:32.458386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:32.468034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d6f6111-bdfe-4026-83c0-4f67c2f37534 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.510548 Aug 30 16:24:32.486752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1973/4294] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:31 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:33.008953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:33.014533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:33.023520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-556c1b92-6530-4461-97fd-90fe323c897e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.594725 Aug 30 16:24:33.025579 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2322/4295] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:32 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:33.051630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:33.052952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:33.063423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.064406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.065144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.066471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.067205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.067858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.440491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:33.441415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:33.449975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.451705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.452361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.453313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.454119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.454782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.702395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:33.713210 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a2fef10-d1ae-466d-aa80-5c96949d11ac tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.277235 Aug 30 16:24:33.714447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2323/4296] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:33 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:33.723306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:33.725014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:33.733093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.733972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.736597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:33.737868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:33.739348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:33.740004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.065670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:34.083217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40a5bdce-1f6b-4b0f-ba6e-6b5d5695a130 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.367490 Aug 30 16:24:34.083976 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2324/4297] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:33 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:34.087416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:34.101484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-393c73e3-40bb-43c1-8363-352dcb2c082c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 1.054243 Aug 30 16:24:34.105779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e7356c-07a4-4e80-8bba-cda2c84d8d92", "name": "network-vif-plugged", "status": "completed", "tag": "1b1d843f-afaa-49f5-b1f0-48a3901f5073"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:34.127979 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1974/4298] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:33 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:34.151454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.156552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.156986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.160498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:34.163646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:34.177407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.181066 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] Creating event network-vif-plugged:1b1d843f-afaa-49f5-b1f0-48a3901f5073 for instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 on n-h2-830883-28 Aug 30 16:24:34.181928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.182692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.183782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.184410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.190487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.191037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a5be8b7e-4395-425f-be24-a8fc87d1b2ac req-4fcb74dd-e6ab-4d19-9b28-5d9cc1f1100c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090418 Aug 30 16:24:34.191870 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2325/4299] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:34.226047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61857f0-1416-4611-9858-4553cd016785", "tag": "dfb7769b-39ee-4527-9137-4d40b18018cb"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:34.249164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.253077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.255585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.273939 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] Creating event network-changed:dfb7769b-39ee-4527-9137-4d40b18018cb for instance e61857f0-1416-4611-9858-4553cd016785 on n-h1-830883-28 Aug 30 16:24:34.284895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2ada96e1-4661-41e0-a61d-bdb460c95b7c req-c7f6b48c-9fe7-4796-9b28-85433ca0e8e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075232 Aug 30 16:24:34.286264 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2326/4300] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:34.327536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Unlocking {{(pid=122351) unlock /opt/stack/nova/nova/compute/api.py:4884}} Aug 30 16:24:34.406509 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7cc854c8-1528-4d33-8931-f41751111e7c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.251785 Aug 30 16:24:34.419820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:34.420481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:34.423070 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1975/4301] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:34 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:34.428459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.429328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.429999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.431309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.432015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.432641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.703283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:34.719735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49ff28f5-c6ce-4cae-9b74-6e08a4ed4a95 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.303947 Aug 30 16:24:34.722672 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2327/4302] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:34 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:34.747033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:34.748582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:34.761128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.761128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.761128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.761583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.762011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.762475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.775395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:34.779326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:34.807305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.809233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.809962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:34.812104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:34.813112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:34.815627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.113478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:35.124988 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9f504af-8c47-4c55-abe8-3206d3bbff9e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.371391 Aug 30 16:24:35.126269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2328/4303] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:34 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:35.147860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:35.149733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:35.158400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.159939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.160401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.161523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.161610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.161984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.190365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:35.197241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:35.205610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e32b6e34-fd3a-4aa1-ab31-bad17d905948 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.464164 Aug 30 16:24:35.211067 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1976/4304] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:34 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:35.231962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:35.233002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:35.250211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.250748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.251192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.251904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.264819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.265360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.391822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:35.404865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8eadd806-3ede-4aab-9496-1164ced174a8 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1361 microversion: 2.1 time: 0.263142 Aug 30 16:24:35.417727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2329/4305] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:35 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:35.748583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:35.765197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e35b2db7-77bf-452f-9f74-fd4d8a1e27b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.536949 Aug 30 16:24:35.765916 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1977/4306] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:35 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:35.791850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:35.792713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:35.802727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.803409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.803846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.804556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:35.805015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:35.805442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:35.985073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27ffc29f-5dc1-47db-9005-56e9b7c8b542 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.197913 Aug 30 16:24:35.992182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2330/4307] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:35 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:35.995989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:35.996611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:36.026491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.027454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.031383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.032334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.034570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.034939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.157466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:36.158197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:36.167662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.167662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.167662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.168346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.170259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.172270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.481257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:36.495270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2a22568a-0392-4e30-8d19-45be364722e9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1672 microversion: 2.1 time: 0.504480 Aug 30 16:24:36.515162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1978/4308] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:35 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1672 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:36.527115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:36.539253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:36.546717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.547309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.547879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.548799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.549376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.550014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.661061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:36.684089 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-625dbd98-3fd9-4929-a43e-3d62e01d4546 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.532217 Aug 30 16:24:36.686059 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2331/4309] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:36 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:36.859462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:36.882783 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-404a2a04-609d-4bcc-a5f8-5140b747490d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1547 microversion: 2.1 time: 0.348732 Aug 30 16:24:36.884976 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1979/4310] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:36 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1547 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:36.913345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:36.914290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:36.922278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.923101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.923962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:36.928887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:36.929835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:36.930498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.068868 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8215f4d-8c5f-4565-a679-28fe289faf88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159441 Aug 30 16:24:37.079348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2332/4311] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:24:36 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:37.530101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:37.531081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:37.541472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.542221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.542686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.543711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.545826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.546673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.714540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:37.715158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:37.723388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.724050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.724702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.725558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.726218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.727009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.729450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:37.743905 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-abba8d26-d06c-4790-94b7-efe7924078cb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1652 microversion: 2.1 time: 0.221041 Aug 30 16:24:37.758328 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1980/4312] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1652 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:37.772510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:37.773383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:37.783538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.785065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.785509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.786216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.786705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.787128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.893551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-720a04c2-7644-48cb-8555-6ef7d0dfba5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.123625 Aug 30 16:24:37.894255 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1981/4313] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:24:37 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:24:37.904019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:37.905407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:37.913007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.913669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.914264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:37.915205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:37.933441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:37.934030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:38.156243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:38.172150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-26caef41-d294-4615-a911-b9384a6304c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1659 microversion: 2.1 time: 0.272832 Aug 30 16:24:38.183503 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1982/4314] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1659 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:38.371256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:38.383688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73c1509c-5c8e-473f-98e5-7ebc1e6bfe23 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.673168 Aug 30 16:24:38.397983 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2333/4315] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:37 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:38.818339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e7356c-07a4-4e80-8bba-cda2c84d8d92", "tag": "1b1d843f-afaa-49f5-b1f0-48a3901f5073"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:38.848331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:38.848819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:38.849450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:38.868866 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] Creating event network-changed:1b1d843f-afaa-49f5-b1f0-48a3901f5073 for instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 on n-h2-830883-28 Aug 30 16:24:38.884135 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7d91124f-f0b2-4254-86ea-2e6bedfdab48 req-71b74edd-7ffb-4d98-bda5-24285273cf90 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069833 Aug 30 16:24:38.886248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1983/4316] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:39.193206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:39.193957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:39.211729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.212471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.213251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.214135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.214794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.215403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.407096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:39.409545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:39.423395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.426336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.427185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.428600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.437468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.438826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.488910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:39.500309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b4d11efd-3cba-41c1-80b1-d99183ec1f75 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.311064 Aug 30 16:24:39.516464 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2334/4317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:39.530103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:39.530757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:39.543074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.545936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.546615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.547877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.548347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.548783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.801090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:39.813044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0bfaa2c-a429-4869-afd5-3a028263a9b1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.287866 Aug 30 16:24:39.819664 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2335/4318] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:39.823285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:39.839303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:39.839937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:39.843852 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe826d4f-652d-400e-a35a-393f8dcda690 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.442154 Aug 30 16:24:39.844454 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1984/4319] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:39 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:39.848090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.848591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.849169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:39.850217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:39.850880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:39.851816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.025617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:40.036779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aee903f0-282e-4f96-9d46-426f04532424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.200939 Aug 30 16:24:40.039006 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2336/4320] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:39 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.058591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:40.059259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:40.066954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.068090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.068683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.070012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.070501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.071077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.226320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:40.256026 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-edc7168a-1239-490c-b0ca-41e23036d96a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.201584 Aug 30 16:24:40.258499 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1985/4321] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.279927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:40.281187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:40.289058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.289885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.290585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.291495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.292111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.292699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.515496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:40.524074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-57ed1f73-3afe-4371-955c-da2d2681cafb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.248724 Aug 30 16:24:40.526449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2337/4322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.548999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:40.549815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.566574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.741754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:40.751826 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7a3264a-b346-435f-a03c-bdcc6b14354f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.209101 Aug 30 16:24:40.752622 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1986/4323] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:40.869486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:40.870156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:40.878131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.879149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.879860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:40.880644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:40.881179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:40.881677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:41.042067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:41.054282 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-189f0d4a-ce12-4b05-8d80-6f594cdd4ec2 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.189429 Aug 30 16:24:41.055040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2338/4324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:40 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:42.080014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:42.081449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:42.089773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:42.090623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:42.091614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:42.092681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:42.093869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:42.094540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:42.256407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:42.265477 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-667baa69-0ee2-42df-b929-b94130efb10f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.191524 Aug 30 16:24:42.266160 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1987/4325] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:42 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:43.287099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:43.288379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:43.297783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:43.298691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:43.299310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:43.300344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:43.301002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:43.301502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:43.522847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:43.536445 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7c5c355-784f-4d7e-ba4f-b7e2d4784991 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.253463 Aug 30 16:24:43.537343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2339/4326] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:43 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:43.860037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:43.861153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:43.868486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:43.868989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:43.869431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:43.870444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:43.870987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:43.871806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:43.905607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:24:44.010739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-accea415-c08a-4a20-8371-f5b66630eef5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 204 len: 0 microversion: 2.1 time: 0.154672 Aug 30 16:24:44.011583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1988/4327] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:24:43 2022] DELETE /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:24:44.021964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:44.023143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:44.030844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:44.031335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:44.031960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:44.032656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:44.033113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:44.033541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:44.037935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:44.202420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:44.218657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d17b9481-e23d-4916-ae23-a43c909f8478 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1552 microversion: 2.1 time: 0.200611 Aug 30 16:24:44.222230 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2340/4328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:44 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:44.561152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:44.562205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:44.568756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:44.569344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:44.569931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:44.571009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:44.571928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:44.572447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:44.729423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:44.739211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-282a7a0c-ab90-4581-9980-6b91d3ee6644 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.184171 Aug 30 16:24:44.740018 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1989/4329] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:44 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:45.287001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:45.288076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:45.297818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:45.298474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:45.298926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:45.299900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:45.300861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:45.301515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:45.492599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:45.503579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1117d45f-736c-4b9f-a17c-4b9e802e24e9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1552 microversion: 2.1 time: 0.222058 Aug 30 16:24:45.504246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2341/4330] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:45 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1552 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:45.760219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:45.761526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:45.770866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:45.771628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:45.772076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:45.772785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:45.773615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:45.774059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:45.928642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:45.938402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-353d5f81-8e24-4f0e-b690-b8dadfa27433 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.181779 Aug 30 16:24:45.939221 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1990/4331] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:45 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:46.530023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:46.531139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:46.549687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:46.550190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:46.550761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:46.555017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:46.556016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:46.558989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:46.619818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6057db1f-0c33-40bf-8969-215648d84fb7", "name": "network-vif-deleted", "tag": "2c364b54-0b0a-4bbe-a170-ca79967028e0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:46.639976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:46.640847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:46.641534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:46.666808 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] Creating event network-vif-deleted:2c364b54-0b0a-4bbe-a170-ca79967028e0 for instance 6057db1f-0c33-40bf-8969-215648d84fb7 on n-h2-830883-28 Aug 30 16:24:46.677200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-50e63458-43a0-4696-869a-e6fee53c6d0d req-09d58d8f-e8a6-4755-b1f4-6b0ebeeca180 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062621 Aug 30 16:24:46.677765 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1991/4332] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:24:46.699315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:46.724680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6c227ec-e1d6-4324-8c71-643818d269ca tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1510 microversion: 2.1 time: 0.202735 Aug 30 16:24:46.726527 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2342/4333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:46 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:46.966521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:46.967191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:46.976592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:46.977140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:46.977933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:46.979156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:46.979720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:46.980532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:46.985899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:47.214945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:47.229311 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2a65eb0-5854-4b57-837b-f9834229eafc tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.268432 Aug 30 16:24:47.230220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1992/4334] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:46 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:47.411068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:47.412545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:47.423333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.424175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.424802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.425861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.426800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.427497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.650791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:47.662180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:47.664078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:47.665540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8121f9e1-857a-4513-a252-465713a181b6 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2955 microversion: 2.42 time: 0.260820 Aug 30 16:24:47.666775 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2343/4335] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:24:47 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2955 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:47.693398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:47.694376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:47.702448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.703263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.704085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.705070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.705813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.706617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.750481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:47.751020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:47.762153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.762951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.763866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.764668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:47.765139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:47.765579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:47.839915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:47.850475 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c2b4278-a98c-43f3-a76c-8c4808fa9e70 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1345 microversion: 2.1 time: 0.105043 Aug 30 16:24:47.864467 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2344/4336] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:47 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:47.864853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b74d5e7-6f16-4ecb-94f0-c9c9be6cdce2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.175997 Aug 30 16:24:47.865664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1993/4337] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:24:47 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78/os-interface => generated 1831 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:24:48.253981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:48.255033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:48.263766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:48.267001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:48.268009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:48.268787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:48.269700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:48.270375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:48.271082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:48.491435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:48.501683 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bd8567b-c8cf-43e6-9e54-bcde562606af tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.252474 Aug 30 16:24:48.515339 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2345/4338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:48 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:48.875858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:48.878285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:48.882804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:24:48.890084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:48.890507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:48.891132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:48.891990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:48.892595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:48.893502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:48.984564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:49.001854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d4d2b8c-1c5f-43ce-a619-747ae2b7c40b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1345 microversion: 2.1 time: 0.133214 Aug 30 16:24:49.002741 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1994/4339] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:48 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:49.525520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:49.526512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:49.540535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:49.540899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:49.541573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:49.542389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:49.542857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:49.559089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:49.787213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:49.805042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daf8b16b-1ef4-45b4-b4f8-44915ad9b504 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.283795 Aug 30 16:24:49.815618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2346/4340] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:49 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:50.024733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:50.026108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:50.034750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:50.035515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:50.036251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:50.037139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:50.037813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:50.038450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:50.132922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:50.158952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0ce68f8-9d07-4913-ac3b-c37c80b14405 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1345 microversion: 2.1 time: 0.138237 Aug 30 16:24:50.160073 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1995/4341] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:50 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:50.828923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:50.829465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:50.837108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:50.837870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:50.838539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:50.839468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:50.840126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:50.842064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:51.006177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:51.017010 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f8a4b5e-f593-4ec6-97d4-7598d8c7b71c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.192662 Aug 30 16:24:51.031660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2347/4342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:50 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:51.186036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:51.187244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:51.210955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:51.211814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:51.217096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:51.218238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:51.219106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:51.219707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:51.288585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:51.302911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d949eadd-01a0-410f-a479-59bdbb22a158 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1345 microversion: 2.1 time: 0.122366 Aug 30 16:24:51.303904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1996/4343] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:51 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:52.040115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:52.040761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:52.048278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.048784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.049238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.049951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.050661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.051077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.191584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:52.199914 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c8fc2e2-943a-4a6b-9292-18c3653b93d6 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.163566 Aug 30 16:24:52.200486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2348/4344] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:52 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:52.323901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:52.325861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:52.334593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.335683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.336789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.337511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.338280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.338714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.395340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:52.396188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:52.396853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:52.397529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'fault' on Instance uuid 6057db1f-0c33-40bf-8969-215648d84fb7 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:24:52.449613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:52.458634 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7c6e16b-4dc3-4d0a-bfa0-29680b8ea310 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 200 len: 1304 microversion: 2.1 time: 0.138993 Aug 30 16:24:52.459541 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1997/4345] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:52 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:53.221433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:53.223010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:53.230323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.230836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.231861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.232587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.233216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.233700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.370844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:53.379378 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8195caa3-1394-4311-ade7-777c39145866 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.163172 Aug 30 16:24:53.379960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2349/4346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:53 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:53.480366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:53.481020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:53.488767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.489479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.489989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.490743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.491213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.491651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.507721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 HTTP/1.1 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6057db1f-0c33-40bf-8969-215648d84fb7'} Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:53.509788 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.515401 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.517329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:53.518384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b943c923-fd2e-4f94-b240-e5cb9af66b33 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 404 len: 111 microversion: 2.1 time: 0.041800 Aug 30 16:24:53.518960 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1998/4347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:53 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:53.638290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:53.640735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:53.647385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.648137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.649022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.649762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:53.650276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:53.650904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:53.666516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7/os-volume_attachments HTTP/1.1 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': '6057db1f-0c33-40bf-8969-215648d84fb7'} Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:53.668213 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5439ac3f-52d9-42f2-bceb-0d6607a10490 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036239 Aug 30 16:24:53.675562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2350/4348] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:24:53 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:53.877037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-685692283", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:53.935777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:54.383625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:54.384053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:54.384532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:54.384938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:54.385385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:54.398004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.398981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.399695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.400468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.400917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.403325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:54.404159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:54.406164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.414603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.418412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.419222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.420552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:54.421403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:54.422071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:54.441619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:54.447748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:54.461341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:54.463716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:54.523055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4d14b43-c9f6-4424-ba59-da88dc60b39d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649887 Aug 30 16:24:54.524629 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 1999/4349] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:24:54.535966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-74192295-18aa-4593-94ab-a980d0c5e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:54.536803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-74192295-18aa-4593-94ab-a980d0c5e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:54.603798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74192295-18aa-4593-94ab-a980d0c5e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:54.612687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-74192295-18aa-4593-94ab-a980d0c5e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451" status: 200 len: 1214 microversion: 2.1 time: 0.080616 Aug 30 16:24:54.614875 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2000/4350] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:54 2022] GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:54.630513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:54.637022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:54.638103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:54.641134 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8824e45f-3cb2-4744-a075-713c09597a6f tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.243792 Aug 30 16:24:54.642140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2351/4351] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:54 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:24:54.661102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:24:54.957000 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.scheduler.client.report [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Deleted allocations for instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 Aug 30 16:24:54.964696 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Instance Mapping does not exist while attempting local delete cleanup. Aug 30 16:24:54.966662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d12614f-c458-4f98-836a-7b50a4a3128b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451" status: 204 len: 0 microversion: 2.1 time: 0.332919 Aug 30 16:24:54.970289 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2001/4352] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:24:54 2022] DELETE /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:24:54.976668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:54.977517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:54.984915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 HTTP/1.1 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '94ffa957-fd91-4cbd-8f1e-06d833b5a451'} Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:24:54.986885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bad79bee-b17f-4076-b35f-f954de3c9dab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451" status: 404 len: 111 microversion: 2.1 time: 0.016220 Aug 30 16:24:54.991735 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2352/4353] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:54 2022] GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:24:55.049729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-609189841", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:55.108365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:24:55.597476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:24:55.598117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:24:55.598288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:24:55.598928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:24:55.599505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:24:55.612324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.613070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.614036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.614986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.615643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.616078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.634785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:24:55.640527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:24:55.654520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:24:55.662478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:55.663827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:55.670888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:24:55.685557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.686067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.686732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.687622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:55.688250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:55.688851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:55.760468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db81afb8-77e3-4d19-80a8-261a1866f660 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709738 Aug 30 16:24:55.761178 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2002/4354] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:24:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:24:55.787897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-089c4b5b-f3cb-4b03-812d-8a881fba8153 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:55.790898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-089c4b5b-f3cb-4b03-812d-8a881fba8153 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:55.866590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:55.880496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6981616-e191-46a8-9708-1e421a3e6484 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.219193 Aug 30 16:24:55.896208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2353/4355] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:55 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:55.909497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-089c4b5b-f3cb-4b03-812d-8a881fba8153 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:55.918054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-089c4b5b-f3cb-4b03-812d-8a881fba8153 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1214 microversion: 2.1 time: 0.148182 Aug 30 16:24:55.931731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2003/4356] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:55 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:56.901214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:56.901994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:56.921455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.922148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.922721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:56.923547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.924118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.924754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:56.940362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:56.941133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:56.955707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.956303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.957163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:56.957966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:56.959838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:56.960378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:57.089651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:57.111895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f598eda6-ddf2-46f2-87ed-51467de22792 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1266 microversion: 2.1 time: 0.174437 Aug 30 16:24:57.126517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2004/4357] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:56 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:57.209462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:57.244187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae503bc9-6159-414a-bc37-6b85c8109697 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.346818 Aug 30 16:24:57.246173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2354/4358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:56 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:58.138345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:58.139092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:58.154568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:58.155231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:58.155750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:58.162621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:58.163198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:58.163720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:58.345875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:58.347558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:58.358522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:58.359393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:58.359908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:58.360824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:58.361497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:58.362118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:58.569097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:58.581527 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea868a31-06b2-4a75-b767-f8d209294019 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.448471 Aug 30 16:24:58.583016 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2005/4359] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:58 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:58.649587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:58.661885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8eed350b-24dd-4a1d-999b-e204184caf0a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.324427 Aug 30 16:24:58.676320 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2355/4360] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:58 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:24:59.364319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e60a046-857f-4633-90ce-737f6921e0d7", "tag": "04d681f7-5219-4771-8553-3ba5a45920b0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:24:59.376782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.377903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.378562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.405731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] Creating event network-changed:04d681f7-5219-4771-8553-3ba5a45920b0 for instance 7e60a046-857f-4633-90ce-737f6921e0d7 on n-h2-830883-28 Aug 30 16:24:59.418287 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-663f751a-427b-4157-929b-d33d3249c39c req-e8c6bc8f-3f56-4a30-befc-649605e02da0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374252 Aug 30 16:24:59.420293 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2006/4361] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:24:59.620168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:59.623346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:59.635692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.636542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.637273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.638268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.639233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.639233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.694288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:24:59.695610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:24:59.709024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.709875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.710440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.711448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:24:59.711893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:24:59.712510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:24:59.930063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:24:59.938991 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4272a153-7afc-4fdb-8491-1126a25d6d27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.334618 Aug 30 16:24:59.953497 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2356/4362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:59 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:00.276828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:00.302172 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab0b6471-23a8-404c-b109-7c20bfe0032a tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1523 microversion: 2.1 time: 0.620919 Aug 30 16:25:00.305728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2007/4363] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:24:59 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1523 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:00.965632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:00.967082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:00.979174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:00.979849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:00.980452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:00.981884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:00.982548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:00.983133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.203334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:01.212251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ffe68a8-ee4d-4a9f-8025-fb503cc6d644 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.254339 Aug 30 16:25:01.228497 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2357/4364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:00 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:01.333409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:01.334039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:01.349990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.352232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.352856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.355409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.357016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.359442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.579544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:01.589283 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-375bcee1-718f-4029-bc8c-91c31ddb0737 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1503 microversion: 2.1 time: 0.259793 Aug 30 16:25:01.591225 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2008/4365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:01 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:01.612656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-369ee3fb-f7ad-4e58-8798-31c5a319a42b tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'create', calling method: .version_select at 0x7fd360f08af0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-481254715", "description": "tempest-description-3434327"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:01.807519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-369ee3fb-f7ad-4e58-8798-31c5a319a42b tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.199044 Aug 30 16:25:01.808135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2358/4366] 10.222.0.47 () {60 vars in 1180 bytes} [Tue Aug 30 16:25:01 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:01.822012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-481254715"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:01.822584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:01.831115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.831953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.832399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.833503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:01.833732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:01.834216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:01.983569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.network.security_group_api [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Adding security group 5556df10-b0b7-4988-a6a1-16caa89205b9 to port 7a76b908-905b-4ca1-92ce-d14227092bdd Aug 30 16:25:02.239975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:02.241312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.248381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.249379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.250043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.250879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.251828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.252589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.275249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:02.436423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:02.446983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1aa1d8d8-7b7f-4634-a11e-70b173f87409 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.214298 Aug 30 16:25:02.477759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2359/4367] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:02 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:02.701922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc676b24-9bb3-4fdb-84aa-d5b9e54d0154 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action" status: 202 len: 0 microversion: 2.1 time: 0.884049 Aug 30 16:25:02.705653 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2009/4368] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:01 2022] POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:02.712337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-481254715"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:02.712874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:02.720974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.721651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.722250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.733145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:02.739693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.740464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.741120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.752668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:02.753163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:02.757277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:02.785536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] Creating event network-changed:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:25:02.800054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-777bb322-49d0-4665-a0fd-97430f7967a2 req-7ae81c4d-de38-454f-bb25-1f5dd45acca0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072106 Aug 30 16:25:02.801382 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2010/4369] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:03.162392 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Removing security group 5556df10-b0b7-4988-a6a1-16caa89205b9 from port 7a76b908-905b-4ca1-92ce-d14227092bdd Aug 30 16:25:03.470752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:03.471952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:03.483866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.484707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.488067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.489173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:03.489856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:03.490553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:03.785917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2a06e02f-a8ce-4585-8dec-e835f28f8530 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action" status: 202 len: 0 microversion: 2.1 time: 1.078511 Aug 30 16:25:03.787438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2360/4370] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:02 2022] POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:03.796700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08489e5f-5e5e-4dc4-ae53-87d3c0fed739 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'create', calling method: .version_select at 0x7fd360f82670>, body: {"pool": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:04.024662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:04.039447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e6d6c6c-40b3-4018-a0dc-56c72521525a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.574153 Aug 30 16:25:04.048006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2011/4371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:03 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:04.053420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:04.077245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:04.078143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:04.079279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:04.103428 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] Creating event network-changed:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:25:04.110673 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-265a2bfa-daec-4117-a17d-09c36c3637f6 req-49cc4437-08b1-4f8e-938a-bd7c52b3555e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060975 Aug 30 16:25:04.112114 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2012/4372] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:05.074707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:05.077133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:05.100100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.101013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.102005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.102784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.103407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.104088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.286595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:05.298224 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36261745-2a34-4eaa-a6a5-f94568def59e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.232377 Aug 30 16:25:05.299001 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2013/4373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:05 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:05.587812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08489e5f-5e5e-4dc4-ae53-87d3c0fed739 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.795065 Aug 30 16:25:05.588539 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2361/4374] 10.222.0.47 () {60 vars in 1170 bytes} [Tue Aug 30 16:25:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:05.601252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.171"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:05.603757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:05.610771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.611269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.611711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.612418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:05.612878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:05.613313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:05.628069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:05.639441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:25:05.639855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquired lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:25:05.914429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=18 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:06.218437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e60a046-857f-4633-90ce-737f6921e0d7", "name": "network-vif-plugged", "status": "completed", "tag": "04d681f7-5219-4771-8553-3ba5a45920b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:06.238189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.239183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.240601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.253176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] Creating event network-vif-plugged:04d681f7-5219-4771-8553-3ba5a45920b0 for instance 7e60a046-857f-4633-90ce-737f6921e0d7 on n-h2-830883-28 Aug 30 16:25:06.258628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fc4351f6-6be5-4d48-bcdf-9bb563f10ea0 req-ad0460c8-104b-4ce5-90ac-d4f33f965e2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274030 Aug 30 16:25:06.259237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2362/4375] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:06.320374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:06.322157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:06.330092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.330835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.331641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.332788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:06.335308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:06.335823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:06.514522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:06.523028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5bb000a-cf82-4ad0-9972-6581c2c66221 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.207157 Aug 30 16:25:06.523618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2363/4376] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:06 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:07.390845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Building network info cache for instance {{(pid=122351) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:25:07.398855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:07.410555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.411049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.411490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.437452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] Creating event network-changed:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:25:07.456897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5514fb23-4a3b-4ea0-b10c-39d2d52d472d req-ae2cf795-045e-4aca-b5a6-b8723899a415 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060784 Aug 30 16:25:07.457822 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2364/4377] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:07.547823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:07.548739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:07.558399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.559206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.560175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.562467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:07.563884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:07.564493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:07.829677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:07.843675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0cc33229-7101-4f0e-8326-e161e77e5b82 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1314 microversion: 2.1 time: 0.302623 Aug 30 16:25:07.859671 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2365/4378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:07 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:08.371164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Updating instance_info_cache with network_info: [{"id": "7a76b908-905b-4ca1-92ce-d14227092bdd", "address": "fa:16:3e:d0:77:d9", "network": {"id": "ebdd2451-5064-4b70-8f72-d3cfcd82b10e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-810924287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9c2ecf041edc4894a2154c60c22f0843", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a76b908-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:25:08.396694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Releasing lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:25:08.399121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7adcc875-9bd3-4813-b7a2-6c60a6899019 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action" status: 202 len: 0 microversion: 2.1 time: 2.802044 Aug 30 16:25:08.399801 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2014/4379] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:05 2022] POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action => generated 0 bytes in 2803 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:25:08.408809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.171"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:08.630821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:08.638110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.638741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.639264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.640075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.640650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.641086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.864428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 16:25:08.865076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquired lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 16:25:08.865490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:08.866452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:08.874167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.874920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.875604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.876380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:08.876943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:08.877476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:08.894577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:09.041266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:09.050495 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d3dc8e7-572e-42d5-b804-5b7206f389db tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1501 microversion: 2.1 time: 0.189157 Aug 30 16:25:09.051077 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2015/4380] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:08 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:09.055906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:09.056398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:09.062849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.063656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.064383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.065235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.065839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.066781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.105202 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7934df25-701f-46f4-b7bc-cb85624271b5 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/ips" status: 200 len: 150 microversion: 2.1 time: 0.052888 Aug 30 16:25:09.105933 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2016/4381] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:25:09 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:09.110858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:09.111405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:09.117438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.117943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.118533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.119220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.119839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.120419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.210080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ced2ba5b-eea0-486d-8228-0229289298b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7/action" status: 202 len: 0 microversion: 2.1 time: 0.102690 Aug 30 16:25:09.211396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2017/4382] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:09 2022] POST /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:09.224568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:09.226237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:09.234918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.235990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.236827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.237756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:09.238759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:09.239351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:09.413270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:09.423815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84d48947-cd44-482d-bdf6-25a8cfe4e2bf tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1506 microversion: 2.1 time: 0.206082 Aug 30 16:25:09.424919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2018/4383] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:09 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:10.115233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Building network info cache for instance {{(pid=122352) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 30 16:25:10.124357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:10.136101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.136996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.137828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.151042 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] Creating event network-changed:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:25:10.157757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-66e2a533-0fd5-45fa-a658-2b2af83a8b5f req-469177e3-afc3-428f-80e5-d8b92b455477 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037504 Aug 30 16:25:10.159581 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2019/4384] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:10.458268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:10.460246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:10.488289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.491084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.491493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:10.492225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:10.492690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:10.497457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.059185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:11.072384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3741061f-2b6e-4bb2-ab40-acfca628e4c7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1486 microversion: 2.1 time: 0.627277 Aug 30 16:25:11.074685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2020/4385] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:10 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1486 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:11.086237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:11.107786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:11.127372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.127372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.135841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.136738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.138356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.138636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.305657 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b9cb32a-5924-4075-a0f4-75d1c25518e6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.229686 Aug 30 16:25:11.308884 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2021/4386] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:11 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:11.319270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:11.325842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:11.337332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:11.343685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.344466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.345818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.347889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.352305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.352946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.391647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Updating instance_info_cache with network_info: [{"id": "7a76b908-905b-4ca1-92ce-d14227092bdd", "address": "fa:16:3e:d0:77:d9", "network": {"id": "ebdd2451-5064-4b70-8f72-d3cfcd82b10e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-810924287-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9c2ecf041edc4894a2154c60c22f0843", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7a76b908-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122352) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:25:11.409210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Releasing lock "refresh_cache-53acca5e-d7a2-4d86-980f-6227b188e970" {{(pid=122352) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 16:25:11.410404 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8591c50-edc3-4223-8232-37cfd5716c98 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action" status: 202 len: 0 microversion: 2.1 time: 3.005770 Aug 30 16:25:11.418511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2366/4387] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:08 2022] POST /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970/action => generated 0 bytes in 3014 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 16:25:11.427948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:11.439581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:11.449799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:11.456147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.461820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.462679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.467225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:11.467966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:11.469890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:11.597168 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebb4eb37-58d3-4017-8be3-b555a1572d4a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 204 len: 0 microversion: 2.1 time: 0.285793 Aug 30 16:25:11.600550 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2022/4388] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:25:11 2022] DELETE /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:25:11.611115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ff290cf-e18b-482a-ad38-e71e5c490502 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '.version_select at 0x7fd35c311a60>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:12.004329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:12.017598 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81a0c916-aa9b-41c7-982d-2cdb226e7b3d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1669 microversion: 2.1 time: 0.597904 Aug 30 16:25:12.026701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2367/4389] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:11 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1669 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:12.041069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:12.041950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:12.056782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:12.057528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:12.058157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:12.061417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:12.062287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:12.063248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:12.501940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:12.517385 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a56e3a0f-7848-44ac-bcf1-20c0c87e9fad tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1492 microversion: 2.1 time: 0.488783 Aug 30 16:25:12.518156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2368/4390] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:12 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1492 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:12.539860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5b972c8-93e1-4a30-87cc-ee876a417713"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:12.542627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:12.550890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:12.560805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:12.561267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:12.563209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:12.563836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:12.564275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:13.105467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aeea61e0-4daa-4093-b86d-67af50922664 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585296 Aug 30 16:25:13.116815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2369/4391] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:25:12 2022] POST /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 194 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:13.129368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:13.131086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:13.145889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:13.147295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:13.148927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:13.150602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:13.152243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:13.153998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:13.623364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:13.640721 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0be8c389-3dc1-44ad-a7d7-9683f5d90cbd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1669 microversion: 2.1 time: 0.521098 Aug 30 16:25:13.646133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2370/4392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:13 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:13.659426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:13.662597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:13.680128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:13.681548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:13.682350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:13.685135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:13.685823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:13.686259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:13.771894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ff290cf-e18b-482a-ad38-e71e5c490502 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "DELETE /compute/v2.1/os-floating-ips/1b90e4aa-303a-42ea-a611-551847c8cb8f" status: 202 len: 0 microversion: 2.1 time: 2.169931 Aug 30 16:25:13.772478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2023/4393] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:25:11 2022] DELETE /compute/v2.1/os-floating-ips/1b90e4aa-303a-42ea-a611-551847c8cb8f => generated 0 bytes in 2171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:13.783381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ab44c24-26d3-4c59-b6be-85a09384f84e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '.version_select at 0x7fd35c1000d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:14.184183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:14.194787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-beb4b846-d4e3-414c-a0da-a5a3eb03826c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1492 microversion: 2.1 time: 0.545502 Aug 30 16:25:14.207732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2371/4394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:13 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1492 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:14.299850 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ab44c24-26d3-4c59-b6be-85a09384f84e tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "DELETE /compute/v2.1/os-security-groups/5556df10-b0b7-4988-a6a1-16caa89205b9" status: 202 len: 0 microversion: 2.1 time: 0.522425 Aug 30 16:25:14.300450 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2024/4395] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 16:25:13 2022] DELETE /compute/v2.1/os-security-groups/5556df10-b0b7-4988-a6a1-16caa89205b9 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:14.308714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:14.309227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:14.316216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.316712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.317157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.317863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.331119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.334895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.389625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:14.574396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b0fd45d-35fb-4eae-9a09-baa0ac02a69c tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "DELETE /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 204 len: 0 microversion: 2.1 time: 0.268590 Aug 30 16:25:14.580597 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2372/4396] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:25:14 2022] DELETE /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:25:14.583442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:14.584462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:14.599427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.602924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.611034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.619343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.620307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.620915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.672630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:14.673521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:14.684724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.691050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.692985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.699956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:14.700620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:14.701181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:14.997846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:15.007156 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe2971b4-12ce-4006-ae5a-bf39a4d90670 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.338781 Aug 30 16:25:15.018370 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2373/4397] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:14 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:15.235427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e60a046-857f-4633-90ce-737f6921e0d7", "name": "network-vif-deleted", "tag": "04d681f7-5219-4771-8553-3ba5a45920b0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:15.253743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.256646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.257296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.288140 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] Creating event network-vif-deleted:04d681f7-5219-4771-8553-3ba5a45920b0 for instance 7e60a046-857f-4633-90ce-737f6921e0d7 on n-h2-830883-28 Aug 30 16:25:15.296010 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3850fdef-34ed-4182-8496-023bc54514ef req-0bbb7eeb-38ff-461e-a634-86d42fd62542 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065435 Aug 30 16:25:15.300566 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2374/4398] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:15.313657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:15.314640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:15.330482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.331151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.331712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.332561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.335398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.335992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.376828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:15.386329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-79b8da36-353d-4f6e-a137-942b5a7d5826 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1509 microversion: 2.1 time: 0.807002 Aug 30 16:25:15.395085 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2025/4399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:14 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1509 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:15.404682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:15.405412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:15.406030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:15.406688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'fault' on Instance uuid 7e60a046-857f-4633-90ce-737f6921e0d7 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:15.409828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:15.471191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:15.480394 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48a1c0c5-c93a-477b-a779-12c0220f1a56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 200 len: 1304 microversion: 2.1 time: 0.178468 Aug 30 16:25:15.481981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2375/4400] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:15 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:16.421520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:16.423026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:16.435376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.436226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.438460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.439616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.440624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.441356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.505268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:16.506651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:16.521329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.538883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.539618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.545135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:16.547940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:16.551161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:16.625879 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 HTTP/1.1 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e60a046-857f-4633-90ce-737f6921e0d7'} Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:16.633697 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:25:16.640300 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:16.648428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:25:16.650479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3222e3b5-eb2d-4d6b-915b-daec94d90285 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 404 len: 111 microversion: 2.1 time: 0.149678 Aug 30 16:25:16.658667 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2376/4401] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:16 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:25:16.876151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-976969645", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:16.977539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:25:17.131918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:17.140780 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-006d9719-2087-4223-9eaa-ceaeaa20a128 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1509 microversion: 2.1 time: 0.725459 Aug 30 16:25:17.145122 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2026/4402] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:16 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1509 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:18.012032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53acca5e-d7a2-4d86-980f-6227b188e970", "name": "network-vif-deleted", "tag": "7a76b908-905b-4ca1-92ce-d14227092bdd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:18.058580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.075679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.077528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.116772 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] Creating event network-vif-deleted:7a76b908-905b-4ca1-92ce-d14227092bdd for instance 53acca5e-d7a2-4d86-980f-6227b188e970 on n-h1-830883-28 Aug 30 16:25:18.125846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5db6e32e-5242-4583-bad4-808c5e0bc3ad req-56f8fc1a-a3ea-4f82-a780-555ae1038e9f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123447 Aug 30 16:25:18.130707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2027/4403] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:18.166421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:18.169488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:18.193555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.216667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:25:18.217670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.218018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:25:18.218368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.218964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:25:18.219724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:25:18.221503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.223658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:25:18.224328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.224895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.269027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.269546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.270735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.271539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.274604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.275114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.295540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:18.298806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:18.306648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:18.307382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lazy-loading 'fault' on Instance uuid 53acca5e-d7a2-4d86-980f-6227b188e970 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:18.312074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:18.339633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:18.454243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:18.549577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:25:18.558431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a97fec04424d428247dbf830884c34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2ecf041edc4894a2154c60c22f0843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:18.568036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:25:18.625304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ad4e98e-0554-4c9d-ae94-06a38ab24a55 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 200 len: 1312 microversion: 2.1 time: 0.463481 Aug 30 16:25:18.631100 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2028/4404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:18 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 1312 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:18.682464 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ee4a246-6910-41a7-94e0-dcdbb99ad718 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.810702 Aug 30 16:25:18.687709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2377/4405] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:25:18.700246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b931d0d0-6774-421d-857c-bb6fa20120f8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:18.704652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b931d0d0-6774-421d-857c-bb6fa20120f8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:18.950114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b931d0d0-6774-421d-857c-bb6fa20120f8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:18.971130 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b931d0d0-6774-421d-857c-bb6fa20120f8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1214 microversion: 2.1 time: 0.266928 Aug 30 16:25:18.990788 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2029/4406] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:18 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:19.659563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:19.660262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] [instance: 53acca5e-d7a2-4d86-980f-6227b188e970] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:19.683155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:19.683637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:19.694714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:19.703997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:19.710689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:19.712168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:19.755623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] HTTP exception thrown: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Request method failure captured: Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 HTTP/1.1 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjmnahPOwD_yZmPd1FQJYYMwPuVOclvSWfoFQDCrQiMRjgvfTLaCC5n6GUd4QJ4SBoNsU2wTAPt-mDqLjPD7BfI_dECzvml4FdvfCFMZrV9L4Z1CPyFh0BIGSpY9rzb7AJulmWBuZQrKlh_KxeJA0W9TmhJEdU2N6n75aOQn6zKHLXk Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 9c2ecf041edc4894a2154c60c22f0843 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2052950202 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9c2ecf041edc4894a2154c60c22f0843"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9c2ecf041edc4894a2154c60c22f0843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9c2ecf041edc4894a2154c60c22f0843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9c2ecf041edc4894a2154c60c22f0843"}]}] Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2052950202 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 9c2ecf041edc4894a2154c60c22f0843 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2052950202 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerRescueTestJSONUnderV235-2052950202-project Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 01a97fec04424d428247dbf830884c34 Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2052950202-project Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '53acca5e-d7a2-4d86-980f-6227b188e970'} Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:19.757196 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] Returning 404 to user: Instance 53acca5e-d7a2-4d86-980f-6227b188e970 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:25:19.761513 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3066b33-34ce-4098-b05c-d757b6823684 tempest-ServerRescueTestJSONUnderV235-2052950202 tempest-ServerRescueTestJSONUnderV235-2052950202-project] 10.222.0.47 "GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970" status: 404 len: 111 microversion: 2.1 time: 0.106369 Aug 30 16:25:19.763396 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2378/4407] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:19 2022] GET /compute/v2.1/servers/53acca5e-d7a2-4d86-980f-6227b188e970 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:25:20.001208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:20.002736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:20.016262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:20.018445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:20.020195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:20.021100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:20.025230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:20.025866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:20.261038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:20.271377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bbe3f4d1-b4cc-476b-b942-9799d9ebaa64 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1210 microversion: 2.1 time: 0.275604 Aug 30 16:25:20.275382 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2030/4408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:19 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1210 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:21.297552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:21.298951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:21.306224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:21.307010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:21.307608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:21.308519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:21.309175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:21.309875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:21.416617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:21.425851 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-78edc125-3492-4c64-a9ce-962635258185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1272 microversion: 2.1 time: 0.132715 Aug 30 16:25:21.442815 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2379/4409] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:21 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:22.451467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:22.452092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:22.459812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:22.460779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:22.461412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:22.462127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:22.462637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:22.463234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:22.974945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:22.983575 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8cf6db11-054c-4d99-8bc8-00e93d4ea0e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.537328 Aug 30 16:25:23.000841 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2031/4410] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:22 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:24.061872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:24.062541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:24.081394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:24.081946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:24.085915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:24.086953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:24.087808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:24.088466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:24.396940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:24.406111 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73ce08f4-196d-4127-82e7-373cdb9bfeb3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.392050 Aug 30 16:25:24.418578 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2380/4411] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:24 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:24.804742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383ca713-66ab-4951-9a59-144f78c95392", "tag": "8f6f3540-1861-4a64-ae56-f28731d4ba71"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:24.817116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:24.818133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:24.818831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:24.836382 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] Creating event network-changed:8f6f3540-1861-4a64-ae56-f28731d4ba71 for instance 383ca713-66ab-4951-9a59-144f78c95392 on n-h2-830883-28 Aug 30 16:25:24.847559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d05461f0-3336-48ee-9f69-6447e5095cac req-6da0ce05-4947-46a4-96e6-5fa27c4f91be service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046979 Aug 30 16:25:24.848409 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2032/4412] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:25.428953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:25.429704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:25.443248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:25.443901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:25.444621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:25.448267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:25.448858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:25.449945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:25.704766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:25.715732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f19ec4f-cac1-4544-856a-a8d81ecd63d9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.290735 Aug 30 16:25:25.728936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2381/4413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:25 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:26.738874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:26.740573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:26.749105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:26.749784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:26.750405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:26.751337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:26.751736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:26.752308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:26.756994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:26.920286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:26.928452 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e06dab64-b1e2-4aed-8000-27ee2a053617 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.194511 Aug 30 16:25:26.929269 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2033/4414] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:26 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:27.981105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:27.991085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:28.001942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:28.002645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:28.003194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:28.004046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:28.004736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:28.005330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:28.297675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:28.305922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9432a31-69fc-43f9-acd0-0c7b430c02e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.358563 Aug 30 16:25:28.309892 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2382/4415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:27 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:28.350564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6518d664-69b2-4660-bdaf-de48fbcae196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: .version_select at 0x7fd360f13b80>, body: {"keypair": {"name": "tempest-keypair-502785112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkSsipem4vKfdqR+ZKwKISNRIydQBUdfyPhE/evR+ko5PiDavdnEPY44DdEXi+406jX1IhwtLhjVIHColwU1BAkBM0qgLpQaO9l0GJ9b4vUmeEK7XMaIJy3oMOIUpvLzg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:28.381800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6518d664-69b2-4660-bdaf-de48fbcae196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:28.389424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6518d664-69b2-4660-bdaf-de48fbcae196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:28.472747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6518d664-69b2-4660-bdaf-de48fbcae196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126102 Aug 30 16:25:28.474137 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2034/4416] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:25:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:29.355164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:29.355946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:29.357979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:29.358928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:29.375252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:29.375754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:29.376204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:29.381162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:29.381657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:29.382101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:30.007627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:30.022758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d106ef34-7136-45e3-9886-dfc91ea2b881 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.673662 Aug 30 16:25:30.037824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2383/4417] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:29 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:31.048308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:31.048940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:31.063132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:31.063132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:31.063524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:31.066544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:31.067070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:31.067905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:31.487929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:31.506183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5903e2d-6917-484c-9151-0cff03539808 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.462864 Aug 30 16:25:31.519755 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2035/4418] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:31 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:32.566672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:32.567974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:32.575434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1060281172", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76"}], "security_groups": [{"name": "tempest-securitygroup--657660397"}], "key_name": "tempest-keypair-502785112", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:32.578826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:32.582802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:32.583523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:32.590482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:32.591717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:32.592561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:32.902655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] validate_networks() for [('7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:25:32.981200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:32.993872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc86274d-e743-4b6c-8e81-5e5c603f91ee tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.428262 Aug 30 16:25:32.994641 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2384/4419] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:32 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:33.171907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383ca713-66ab-4951-9a59-144f78c95392", "name": "network-vif-plugged", "status": "completed", "tag": "8f6f3540-1861-4a64-ae56-f28731d4ba71"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:33.190578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:33.202124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:33.208729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:33.247736 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] Creating event network-vif-plugged:8f6f3540-1861-4a64-ae56-f28731d4ba71 for instance 383ca713-66ab-4951-9a59-144f78c95392 on n-h2-830883-28 Aug 30 16:25:33.253889 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-68a042dc-4159-4ba8-8550-9dacab8a2c6c req-a0a9b578-6378-4c71-a6f0-57c4ce53c5cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086074 Aug 30 16:25:33.258474 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2385/4420] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:33.659806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:25:33.660968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:25:33.661613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:25:33.662519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:25:33.663313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:25:33.676614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:33.684822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:33.685289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:33.686107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:33.686586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:33.687004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:33.730574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:33.740865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:33.778225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:25:33.788240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:25:33.910773 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0fa49933-1990-4cf0-866c-d585594c6ce0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.349825 Aug 30 16:25:33.922913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2036/4421] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:25:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:25:33.924464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7b532d3-97b3-4a6f-b1a7-10a713e580b0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:33.925286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7b532d3-97b3-4a6f-b1a7-10a713e580b0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:34.019066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:34.019701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:34.031341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:34.031845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:34.033667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:34.038051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:34.039917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:34.040548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:34.102204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7b532d3-97b3-4a6f-b1a7-10a713e580b0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:34.147747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7b532d3-97b3-4a6f-b1a7-10a713e580b0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1241 microversion: 2.1 time: 0.228563 Aug 30 16:25:34.176227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2386/4422] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:33 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1241 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:34.331440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:34.344872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12107c6e-406c-462b-b68c-f61c0920b8d8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1314 microversion: 2.1 time: 0.329892 Aug 30 16:25:34.354895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2037/4423] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:34 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:35.178659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:35.180130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:35.199477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.200664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.203385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.215221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.216403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.219405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.372341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:35.373890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:35.386021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.387537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.388470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.389573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.392196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.392923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.419303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:35.443673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e0346d7-3f7f-42e4-a012-79610c9d5a1d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1237 microversion: 2.1 time: 0.271852 Aug 30 16:25:35.444658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2387/4424] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:35 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1237 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:35.638075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:35.650362 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee649ebe-0556-4c35-9bc9-09ea30533ade tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1500 microversion: 2.1 time: 0.283360 Aug 30 16:25:35.667108 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2038/4425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:35 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:35.673974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:35.674596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:35.681796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.682323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.682856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.683797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:35.684503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:35.684952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:35.713358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'flavor' on Instance uuid 383ca713-66ab-4951-9a59-144f78c95392 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:36.012575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f499728d-0a89-4e6f-b9ba-2a7f9545ada5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392/action" status: 202 len: 0 microversion: 2.1 time: 0.341136 Aug 30 16:25:36.013964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2388/4426] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:25:35 2022] POST /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:25:36.022122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:36.022921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:36.033264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.036270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.037303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.040449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.041460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.043577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.332278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:36.341148 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4780c6a3-1947-4b7c-9732-35134c9244b7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.323154 Aug 30 16:25:36.358227 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2039/4427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:36 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:36.472039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:36.473301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:36.484230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.484734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.485177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.494178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:36.494713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:36.495166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:36.607565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:36.616934 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85ddf5d9-c254-4071-b52f-7f2fea206e1c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1311 microversion: 2.1 time: 0.154641 Aug 30 16:25:36.621899 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2389/4428] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:36 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:37.365502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:37.366177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:37.379674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.381178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.382478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.385507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.390757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.391440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.483424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1806505552", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "27db2a62-c09a-457b-896a-63af0cabde72"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:37.585444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] validate_networks() for [('27db2a62-c09a-457b-896a-63af0cabde72', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:25:37.842713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:37.853650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0cf9cc3d-adb8-4e72-b40b-f9cc07513cf0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.492621 Aug 30 16:25:37.854246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2390/4429] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:37 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:37.875961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:37.883150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:37.907568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.908086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.910901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:37.914595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:37.916189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:37.916662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.400508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:25:38.400508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:25:38.400508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:25:38.400508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:25:38.400508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:25:38.408329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.408829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.409273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.410106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.410612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.411047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.431191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Getting quotas for project fdd6ac2d5cf346a4bdc3e566d7c98a39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:38.436926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Getting quotas for user f1bf9a7563a048628cc56c104734bafd and project fdd6ac2d5cf346a4bdc3e566d7c98a39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:38.451062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:25:38.453517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:25:38.523177 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1599b68-e303-4b5c-9b57-fbaf551f109d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.290517 Aug 30 16:25:38.523879 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2040/4430] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:25:38.531633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:38.535515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:38.536139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:38.552855 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d424ef6d-5abc-4281-a547-bc51a10e528c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.693395 Aug 30 16:25:38.554987 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2391/4431] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:37 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:38.663221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:38.677888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:38.679410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:38.681508 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11f8105b-56cb-4341-a2aa-b756f135b48b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1262 microversion: 2.26 time: 0.149297 Aug 30 16:25:38.681508 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2041/4432] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:38 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:38.882207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:38.883382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:38.897539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.898883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.899547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:38.901173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:38.902008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:38.902891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.163544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc6da81-90c9-4762-9c74-3d87b734a2b3", "tag": "7265fdf1-57f4-4595-8a47-a26fcf623cd6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:39.179118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.180166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.180768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.198906 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] Creating event network-changed:7265fdf1-57f4-4595-8a47-a26fcf623cd6 for instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 on n-h1-830883-28 Aug 30 16:25:39.206274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-817b6a3e-2eec-4f34-aba0-996d11367767 req-b4bcf9b8-7e13-4d0f-b423-bcb1f97c1be4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046133 Aug 30 16:25:39.207522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2042/4433] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:39.216895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.231709 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-00d12257-e834-45fc-a3e4-e32d2d526e4e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.353821 Aug 30 16:25:39.244762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2392/4434] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:38 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:39.576645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:39.577359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:39.593404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.595258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.597389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.600133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.600919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.602856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.706488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:39.707113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:39.728205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.728715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.738136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.741215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:39.741741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:39.742183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:39.894526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.897119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:39.909563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.911082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.912364 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21d20981-55d4-4521-99e2-0b22ac568c86 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1314 microversion: 2.26 time: 0.210150 Aug 30 16:25:39.913482 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2393/4435] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:39 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:39.932399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:39.949279 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cece9eb1-4b4a-434b-a231-a2237df10179 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.376570 Aug 30 16:25:39.951029 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2043/4436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:39 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:40.254711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:40.255609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.269922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.272023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.274191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.275457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.278405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.279689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.492187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:40.505204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7db5d7ed-8d57-4766-915e-789353a5880a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.255932 Aug 30 16:25:40.523797 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2394/4437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:40 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:40.939230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:40.939857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.956016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.956801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.957132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.957912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.958439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.958963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.972662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:40.974656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:40.985492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.986413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.987386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:40.988345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:40.989030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:40.989687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.534576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.546828 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a39c833d-87d3-4e75-9dbf-3289672d6973 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.578021 Aug 30 16:25:41.565852 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2395/4438] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:40 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:41.565852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:41.565852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:41.584469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:41.597135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:41.597868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.598771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:41.598897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.603074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:41.607118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:41.617257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.618285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:41.619524 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72e366c4-ef09-4915-b3af-84ba5e6d65b1 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.684388 Aug 30 16:25:41.620088 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2044/4439] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:40 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:42.247636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.261131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a284082-ac6c-4aea-9bf1-18b603b2a1e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.706404 Aug 30 16:25:42.264264 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2396/4440] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:41 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:42.573768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:42.575593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:42.579360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:42.591270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.598778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.599528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.600470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.601117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.601718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.649970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:42.650898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:42.658412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.662941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.663616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.664524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:42.665143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:42.674527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:42.892545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.901613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.903552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:42.905108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26c0520d-3ef7-48f5-bbb6-e570b1ed9711 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.259885 Aug 30 16:25:42.905863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2397/4441] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:42 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:43.093114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:43.101289 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f56d7d58-8df7-46ec-a6ed-4120c4fc44bc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.531677 Aug 30 16:25:43.102549 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2045/4442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:42 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:43.285696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:43.286399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:43.299320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.300788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.302919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.303849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.305176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.305800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.483374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e019b495-e587-4e82-8ba5-620b47f2aded", "tag": "f416347b-bc8c-4a78-8533-bdf3e6cf3414"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:43.508580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.510126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.510828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.528884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] Creating event network-changed:f416347b-bc8c-4a78-8533-bdf3e6cf3414 for instance e019b495-e587-4e82-8ba5-620b47f2aded on n-h2-830883-28 Aug 30 16:25:43.533608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:43.534512 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f10a44a4-a7f7-48c6-b232-c8af7db01d9c req-7b83c503-85b1-4403-8568-ec1475223dd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061287 Aug 30 16:25:43.536808 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2046/4443] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:43.547263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f25b04ec-21be-4565-b8ad-ed33cc38da40 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.265830 Aug 30 16:25:43.547727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2398/4444] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:43 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:43.930813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:43.932425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:43.949319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.950976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.952377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:43.955013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:43.956324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:43.957615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.125214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:44.125947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:44.128066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:44.137686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:44.141708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:44.142476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.143519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:44.144160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:44.144817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.163817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:44.174063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:44.176636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:44.178152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3efb5507-323d-44e2-b5f0-a4b847c814aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.252707 Aug 30 16:25:44.193542 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2047/4445] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:43 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:44.377375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:44.390594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5146d408-2055-4c5c-9921-bb700184cefc tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.270128 Aug 30 16:25:44.392140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2399/4446] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:44 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:44.510005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc6da81-90c9-4762-9c74-3d87b734a2b3", "name": "network-vif-plugged", "status": "completed", "tag": "7265fdf1-57f4-4595-8a47-a26fcf623cd6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:44.521262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:44.522025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:44.522818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.543349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] Creating event network-vif-plugged:7265fdf1-57f4-4595-8a47-a26fcf623cd6 for instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 on n-h1-830883-28 Aug 30 16:25:44.564898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5b1c0d86-7ded-4ddb-bb51-b5330c6bed62 req-3f7f03c8-6ae6-4ad3-ace8-148827f7b75a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059276 Aug 30 16:25:44.568243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:44.568647 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2048/4447] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:44.568927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:44.578046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:44.580856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:44.581328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.582048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:44.582540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:44.582966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:44.935628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:44.945937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-13403957-1ada-4e84-8508-a300ec8cf7fa tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.381714 Aug 30 16:25:44.961910 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2400/4448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:44 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:45.204435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:45.205942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:45.213969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.216171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.216988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.217937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.218568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.219339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.411785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:45.412328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:45.421734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.422236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.422750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.423680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.424144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.424572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.441741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.452950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.455030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.456634 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4cdd69bc-7610-437c-9ed2-15937d07480d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.258750 Aug 30 16:25:45.471701 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2049/4449] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:45 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:45.614270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:45.624818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-326aea5d-9698-4601-8a31-4d18558e05fe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1366 microversion: 2.1 time: 0.217092 Aug 30 16:25:45.631337 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2401/4450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:45 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:45.969083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:45.969812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:45.976297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.976876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.977386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:45.978159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:45.978790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:45.979237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.163293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.176894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbb4c446-946c-43ff-88cb-620d75550a97 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.212389 Aug 30 16:25:46.177666 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2050/4451] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:45 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:46.483021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:46.484464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:46.491487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.491988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.492439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.493149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.493811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.494253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.647173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:46.648932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:46.661529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.662649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.662947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.663476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.664271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:46.664752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:46.665238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:46.676877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.680060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:46.681599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c03ff51-289b-4485-981b-9e443885f869 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.203256 Aug 30 16:25:46.682911 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2402/4452] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:46 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:47.017000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.027100 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-510af218-c622-4890-82e4-485b8c88ba5d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1556 microversion: 2.1 time: 0.384013 Aug 30 16:25:47.028390 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2051/4453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:46 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1556 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:47.048763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:47.049278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:47.057602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.062752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.063785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.064560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.065044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.065481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.189142 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54945ceb-4ff9-4aac-a6fe-ec37380707ca tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144162 Aug 30 16:25:47.195018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2403/4454] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:25:47 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:47.202445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:47.203214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:47.214799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.215842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.216518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.223412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.226988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.227828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.437613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.469955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6491966c-d84f-4659-bbb8-ab24552e8a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.275287 Aug 30 16:25:47.471743 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2052/4455] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:47 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:47.507320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:47.507953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:47.517738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.518251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.518747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.519465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.519934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.520370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.711765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:47.716136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:47.731146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.731734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.732419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.733770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:47.736656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:47.737629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:47.915964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.926655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.929834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:47.931827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa3907b6-ab65-40da-9de3-159f474a2d0b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.227493 Aug 30 16:25:47.933449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2053/4456] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:47 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:48.213210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.224618 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9fa10e67-8fb6-4e39-974c-30922a5c5e70 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.722293 Aug 30 16:25:48.225206 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2404/4457] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:47 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:48.259230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.260297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.278688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.280723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.282199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.285719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.286413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.288396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.421265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:48.491754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.492456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.504600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:48.507038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.518224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.519603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.520367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.520847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.521284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.578770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.591991 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf4f88a3-e7a8-42db-930a-fa701fe02554 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.344059 Aug 30 16:25:48.592840 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2054/4458] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:48.616897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.618075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.627529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.628799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.629761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.631162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.632273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.633761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.659690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:48.670707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=20 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:48.829251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.833525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:48.838739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-50459094-81da-49c6-8d8c-1933ba77d3cf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.229177 Aug 30 16:25:48.841120 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2055/4459] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:48.843802 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f89bc0f-128f-494b-8ef8-ff58b6c4b5ed tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.355970 Aug 30 16:25:48.854723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2405/4460] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:48.866000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.867055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.877740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.878535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.879211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.880581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.881933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.882734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.957251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:48.958247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:48.967437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.969417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.971015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:48.972819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:48.974511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:48.976431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:49.112428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.129816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3dfaa9a4-d989-4b5f-8ace-f4b147c72efc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.269281 Aug 30 16:25:49.145599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2056/4461] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:49.312755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.344717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.352972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:49.358196 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c683983c-e2c8-4857-9232-83f34d8ca90b tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.404777 Aug 30 16:25:49.377620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1366514603", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "14da368a-1038-4232-aa6a-32d46d4c24f8"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:49.383410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2406/4462] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:48 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:49.388807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc6da81-90c9-4762-9c74-3d87b734a2b3", "tag": "7265fdf1-57f4-4595-8a47-a26fcf623cd6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:49.410951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:49.411914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:49.412928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:49.431165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] Creating event network-changed:7265fdf1-57f4-4595-8a47-a26fcf623cd6 for instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 on n-h1-830883-28 Aug 30 16:25:49.437245 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e5c70270-ff98-44ab-8481-524cbe0db27e req-4f2f5c60-9b0c-424e-ad6b-19fa87ff334c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052665 Aug 30 16:25:49.441800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2407/4463] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:49.473068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] validate_networks() for [('14da368a-1038-4232-aa6a-32d46d4c24f8', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:25:49.866887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:49.867533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:49.880044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:49.882453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:49.883125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:49.884085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:49.887428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:49.892459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.079190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:25:50.080298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:25:50.082525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:25:50.083199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:25:50.083923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:25:50.095853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.096444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.097106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.098040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.098764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.099746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.121183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:25:50.129051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:25:50.145012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:25:50.147832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:25:50.221293 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c80f0afb-b9cc-452f-a073-e483b2dbc9fb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855611 Aug 30 16:25:50.230260 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2057/4464] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:25:50.242401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c092d596-cf92-49e7-aa34-23dfbca9e433 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:50.243512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c092d596-cf92-49e7-aa34-23dfbca9e433 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:50.260751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:50.271117 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-558f1feb-c726-40b8-9160-716aab78fbc9 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.409994 Aug 30 16:25:50.287908 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2408/4465] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:49 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:50.359577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c092d596-cf92-49e7-aa34-23dfbca9e433 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:50.367398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c092d596-cf92-49e7-aa34-23dfbca9e433 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1215 microversion: 2.1 time: 0.135575 Aug 30 16:25:50.369305 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2058/4466] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:50 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:50.390135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:50.390800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:50.400091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.400600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.401308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.403122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.405450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.406067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.590438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e019b495-e587-4e82-8ba5-620b47f2aded", "name": "network-vif-plugged", "status": "completed", "tag": "f416347b-bc8c-4a78-8533-bdf3e6cf3414"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:50.611357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:50.612182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:50.612974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:50.631780 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] Creating event network-vif-plugged:f416347b-bc8c-4a78-8533-bdf3e6cf3414 for instance e019b495-e587-4e82-8ba5-620b47f2aded on n-h2-830883-28 Aug 30 16:25:50.648167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-894a4214-723e-40d7-b3a0-abf1ad2bfca2 req-cbcd0d87-b8b6-40eb-870a-5f751e72454a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064248 Aug 30 16:25:50.649519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2059/4467] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:50.722856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:50.737061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:50.739025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:50.740611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1dc85c6-4342-4115-8af2-453dd4354562 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.355360 Aug 30 16:25:50.741876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2409/4468] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:50 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:51.296513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:51.297894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:51.306558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.307324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.308585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.309710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.310401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.311137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.395778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:51.396417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:51.410478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.410987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.412273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.413116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.413730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.414181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.516391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:51.527595 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db6a2196-cda8-46eb-8c7e-da21ff9dfb84 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1267 microversion: 2.1 time: 0.139744 Aug 30 16:25:51.538381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2410/4469] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:51 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:51.549495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:51.560784 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c61252e1-a308-46de-a9d7-13205da84f8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.269500 Aug 30 16:25:51.562055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2060/4470] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:51 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:51.765980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:51.766986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:51.773903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.774717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.775388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.776115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:51.776632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:51.777274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:51.795237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:51.994586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.014794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.021735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.031769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9e83f45-7ac1-4ea1-baff-d324cca3e8a6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1362 microversion: 2.26 time: 0.269753 Aug 30 16:25:52.034797 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2411/4471] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:51 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:25:52.551727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:52.553236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:52.600626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:52.601930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:52.611474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.613947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.614631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.615607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.616277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.616720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.622666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.624082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.627800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.629080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:52.630230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:52.631297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:52.726915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.737162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-15b3d0c4-44c7-451a-a6dd-765b68701b44 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1273 microversion: 2.1 time: 0.191912 Aug 30 16:25:52.738567 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2061/4472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:52 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:52.916640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:52.926374 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82c9f1a8-bd4a-4480-b163-8b327bdb4e56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.342211 Aug 30 16:25:52.927047 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2412/4473] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:52 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:53.058295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.059109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.065690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.066335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.067418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.068129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.068570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.069004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.315395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.330280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.332390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.336091 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-924e7b0f-19f7-4736-9372-535e8d58a1d6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1547 microversion: 2.26 time: 0.281957 Aug 30 16:25:53.337735 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2062/4474] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:53 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1547 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:53.369027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0cf8b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.391471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.392168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.392737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.393317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.399703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.400204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.400647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.402293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.402800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.403585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.440388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.440968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.441478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.462645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.463295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.465288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.539701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:53.598489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a08a7543-4cf3-4cc3-a35e-1758955121f2 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1297714343" status: 201 len: 0 microversion: 2.26 time: 0.237413 Aug 30 16:25:53.604660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2413/4475] 10.222.0.47 () {62 vars in 1380 bytes} [Tue Aug 30 16:25:53 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1297714343 => generated 0 bytes in 244 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 16:25:53.614194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f627f98-69c1-4f62-93db-ef78a48cc600 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360fad790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.629008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f627f98-69c1-4f62-93db-ef78a48cc600 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.634215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f627f98-69c1-4f62-93db-ef78a48cc600 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.634778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f627f98-69c1-4f62-93db-ef78a48cc600 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.682113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f627f98-69c1-4f62-93db-ef78a48cc600 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1297714343" status: 204 len: 0 microversion: 2.26 time: 0.073300 Aug 30 16:25:53.683695 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2063/4476] 10.222.0.47 () {60 vars in 1361 bytes} [Tue Aug 30 16:25:53 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1297714343 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:53.692810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0a0820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.703933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.704631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.706217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.706979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.716372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.716971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.717806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.720934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.731993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.733490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.759794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.760614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.768454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.770536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.771722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.773313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.774720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.776031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.784696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.785187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.785632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.822591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:53.849549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c5eaafd-ddc8-4ee4-aca7-31193aafe090 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 204 len: 0 microversion: 2.26 time: 0.161062 Aug 30 16:25:53.854723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2414/4477] 10.222.0.47 () {60 vars in 1295 bytes} [Tue Aug 30 16:25:53 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:53.866714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1cd11c3e-fd4b-4e17-bfcd-51bc4ea91f2d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd357f865e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.881107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cd11c3e-fd4b-4e17-bfcd-51bc4ea91f2d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.887303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cd11c3e-fd4b-4e17-bfcd-51bc4ea91f2d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.887773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1cd11c3e-fd4b-4e17-bfcd-51bc4ea91f2d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.907599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1cd11c3e-fd4b-4e17-bfcd-51bc4ea91f2d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 12 microversion: 2.26 time: 0.047087 Aug 30 16:25:53.909441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2415/4478] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 16:25:53 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:53.927957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0a0940>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:53.940260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.944004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.944463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.944968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:53.952292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.953002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.953751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.954654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.955275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.955863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:53.991878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:53.996733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:53.997479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:53.998169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.003620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac1c1aa6-71ce-4d6c-9ebe-fee8af04e658 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.247316 Aug 30 16:25:54.017792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2064/4479] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:53 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:54.017792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.017792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.018296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.018529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.019059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.019871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.020333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.020655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.020768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.021155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.021620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.053860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:54.079733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb1cc9b5-3b0d-4362-84fd-de5625172932 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1251213597" status: 201 len: 0 microversion: 2.26 time: 0.162720 Aug 30 16:25:54.081162 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2416/4480] 10.222.0.47 () {62 vars in 1380 bytes} [Tue Aug 30 16:25:53 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1251213597 => generated 0 bytes in 167 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 16:25:54.091612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfd0ca9a-c6e1-4c81-acf5-c06c36b6ecc3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0a0700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.101872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfd0ca9a-c6e1-4c81-acf5-c06c36b6ecc3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.102527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfd0ca9a-c6e1-4c81-acf5-c06c36b6ecc3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.103273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfd0ca9a-c6e1-4c81-acf5-c06c36b6ecc3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.117775 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfd0ca9a-c6e1-4c81-acf5-c06c36b6ecc3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 36 microversion: 2.26 time: 0.031086 Aug 30 16:25:54.119382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2417/4481] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 16:25:54 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 36 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:54.132497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd357f3a160>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.143361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.144300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.144886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.145514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.157296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.157960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.159202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.160023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.160582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.161171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.195105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.195830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.196598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.247154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:54.268788 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70ddda3b-90dc-4f37-a32e-9dd2fa3c07d7 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1251213597" status: 204 len: 0 microversion: 2.26 time: 0.142414 Aug 30 16:25:54.270684 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2418/4482] 10.222.0.47 () {60 vars in 1364 bytes} [Tue Aug 30 16:25:54 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1251213597 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:25:54.276887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:54.278989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d7367-1a6a-418a-8322-0b2fa968a425", "tag": "5bf8dcfe-3a94-42fe-84be-dd31496eeba3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:54.291305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.292001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.292625 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21fd7533-d525-4cb6-b69e-7afe43ba47c4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.285795 Aug 30 16:25:54.293336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.294581 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2065/4483] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:54 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:54.299634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-894126c0-57ad-4c9c-8613-9bdbcf8623d4 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360f988b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.319083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-894126c0-57ad-4c9c-8613-9bdbcf8623d4 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.319526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-894126c0-57ad-4c9c-8613-9bdbcf8623d4 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.320043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-894126c0-57ad-4c9c-8613-9bdbcf8623d4 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.328582 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] Creating event network-changed:5bf8dcfe-3a94-42fe-84be-dd31496eeba3 for instance 901d7367-1a6a-418a-8322-0b2fa968a425 on n-h1-830883-28 Aug 30 16:25:54.342451 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7b624884-232a-4ab5-b9c2-616f09e7e97d req-1ca7632d-47ad-4e78-be00-d6352e4528e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069496 Aug 30 16:25:54.342985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2419/4484] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:54.349346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.349943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.359833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.360334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.360727 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-894126c0-57ad-4c9c-8613-9bdbcf8623d4 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 12 microversion: 2.26 time: 0.063411 Aug 30 16:25:54.360848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.361762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.362229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.362702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.363052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2066/4485] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 16:25:54 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 12 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:54.374677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360ee7700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.395522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.397024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.397488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.397985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.401576 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d07de19-18f1-44c7-87d0-35555647675d tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/ips" status: 200 len: 146 microversion: 2.1 time: 0.057346 Aug 30 16:25:54.402482 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2420/4486] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:25:54 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:54.411858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.412346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.412790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.413757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.414222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.414832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.446606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.447108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.447550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.461296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:54.478870 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c81167b8-0543-42d5-ab29-44d6a21ab78d tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 204 len: 0 microversion: 2.26 time: 0.109713 Aug 30 16:25:54.484824 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2067/4487] 10.222.0.47 () {60 vars in 1295 bytes} [Tue Aug 30 16:25:54 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:25:54.492120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd357f86430>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.502501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.503239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.503682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.504934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.511785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.512384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.512837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.513591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.514106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.514609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.555142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.555632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.556078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.566877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.567376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.567868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.612738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:54.639468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df183c41-4c70-4648-b5b6-eadab4830f64 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1798103936" status: 201 len: 0 microversion: 2.26 time: 0.152711 Aug 30 16:25:54.640702 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2421/4488] 10.222.0.47 () {62 vars in 1380 bytes} [Tue Aug 30 16:25:54 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1798103936 => generated 0 bytes in 154 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 16:25:54.651278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360fad1f0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.669667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.670614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.682445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.686546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.697513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.698017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.698526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.699583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.700059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.700923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.734746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.735258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.735961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.748488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.748981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.749425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.794343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:54.865047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-456f12fe-f29f-4c2b-ab9d-71c8dd35a214 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-582611265" status: 201 len: 0 microversion: 2.26 time: 0.218289 Aug 30 16:25:54.868070 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2068/4489] 10.222.0.47 () {62 vars in 1377 bytes} [Tue Aug 30 16:25:54 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-582611265 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 30 16:25:54.883153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0ca0d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:54.902536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.903849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.904926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.907603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:54.919197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.919855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.920494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.921628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.922166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.922701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.953887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:54.954516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:54.955032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:54.964720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:54.977504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.009227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-938608b0-0f75-4184-a7cd-98b0c1208d39 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 204 len: 0 microversion: 2.26 time: 0.131717 Aug 30 16:25:55.010348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2422/4490] 10.222.0.47 () {60 vars in 1295 bytes} [Tue Aug 30 16:25:54 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:55.020652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-227a363b-ea57-4bd3-a4b6-5c7e07f4e9d3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c3113a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.037206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-227a363b-ea57-4bd3-a4b6-5c7e07f4e9d3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.037587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.038452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.039212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-227a363b-ea57-4bd3-a4b6-5c7e07f4e9d3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.039870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-227a363b-ea57-4bd3-a4b6-5c7e07f4e9d3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.054424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.055194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.055845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.057012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.057732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.057915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-227a363b-ea57-4bd3-a4b6-5c7e07f4e9d3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 12 microversion: 2.26 time: 0.043088 Aug 30 16:25:55.058639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.064533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2069/4491] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 16:25:55 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:55.070020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c1323a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.080918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.081528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.081988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.082529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.093128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.093696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.094263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.095590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.096177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.096564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.127208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.128226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.128873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.142392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.158853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c218f84e-a9f4-43e0-acfd-05a1c65405f3 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 204 len: 0 microversion: 2.26 time: 0.093157 Aug 30 16:25:55.159785 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2070/4492] 10.222.0.47 () {60 vars in 1295 bytes} [Tue Aug 30 16:25:55 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:55.172272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c4b4820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.183795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.184283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.184725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.185209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.201711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.202205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.202691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.203401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.203855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.204282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.261865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.264850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.266664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:55.267943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.280366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.281161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.282228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.282372 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-caf136d4-672e-4f21-b324-e0838d0474e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.256002 Aug 30 16:25:55.296894 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2423/4493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:55 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:55.300496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:55.315937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.316567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.328269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.328782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.329237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.329955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.330452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.332661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.336624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.366817 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a036fd8-0497-40dc-8ea2-dc580a3b7417 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-15052270" status: 201 len: 0 microversion: 2.26 time: 0.199381 Aug 30 16:25:55.368465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2071/4494] 10.222.0.47 () {62 vars in 1374 bytes} [Tue Aug 30 16:25:55 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-15052270 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Aug 30 16:25:55.389304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360f24c10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.409374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.409894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.410371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.410881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.430647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.430647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.430647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.431205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.431642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.431946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.494967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.495539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.495992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.514658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.515156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.515601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.531324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:55.540707 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c35621bc-c16f-4ca7-9f17-b01c9a34190e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.229012 Aug 30 16:25:55.542354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2424/4495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:55 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:55.555291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.575017 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e137480-84b2-431b-afed-a0158531e550 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1072466033" status: 201 len: 0 microversion: 2.26 time: 0.200758 Aug 30 16:25:55.575927 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2072/4496] 10.222.0.47 () {62 vars in 1380 bytes} [Tue Aug 30 16:25:55 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags/tempest-tag-1072466033 => generated 0 bytes in 202 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 30 16:25:55.585429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Action: 'update_all', calling method: .version_select at 0x7fd357cdb700>, body: {"tags": ["tempest-tag-942940326", "tempest-tag-1936704391"]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:55.596442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.596935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.597374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.597859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.604023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.605035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.605525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.606474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.606938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.607382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.634557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.636488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.637142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.663978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.683631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0994457f-e261-4251-bbe9-522258028bd6 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 61 microversion: 2.26 time: 0.101626 Aug 30 16:25:55.689589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2425/4497] 10.222.0.47 () {62 vars in 1312 bytes} [Tue Aug 30 16:25:55 2022] PUT /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 61 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:55.694913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5321ee94-f0dc-4eb3-a89a-397b9195d280 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd360f98670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.714499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5321ee94-f0dc-4eb3-a89a-397b9195d280 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.715028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5321ee94-f0dc-4eb3-a89a-397b9195d280 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.715472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5321ee94-f0dc-4eb3-a89a-397b9195d280 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.740162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5321ee94-f0dc-4eb3-a89a-397b9195d280 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 200 len: 61 microversion: 2.26 time: 0.039266 Aug 30 16:25:55.741208 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2073/4498] 10.222.0.47 () {60 vars in 1292 bytes} [Tue Aug 30 16:25:55 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 61 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:55.752169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '.version_select at 0x7fd35c0ec040>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.807190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.811504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.812396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.814152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.830830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.835135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.835771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.837465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.838672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.840430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.898524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.899246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.900296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.932031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'flavor' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:55.952226 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d5a3753-8cfc-4915-b212-4776ae2229aa tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags" status: 204 len: 0 microversion: 2.26 time: 0.204122 Aug 30 16:25:55.959868 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2426/4499] 10.222.0.47 () {60 vars in 1295 bytes} [Tue Aug 30 16:25:55 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:55.967395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:55.968363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:55.989840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:55.990676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:55.995657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:55.999620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.000344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.001033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.056762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:25:56.203054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2395a777-cd8e-483a-a5e2-2b146409eb44 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 204 len: 0 microversion: 2.26 time: 0.233536 Aug 30 16:25:56.204354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2074/4500] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:25:55 2022] DELETE /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:25:56.213878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:56.215334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:56.234449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.234955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.235394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.236131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.236786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.236968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.310150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:56.311367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:56.328008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.328522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.328993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.329711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.330171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.331461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.515794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.524270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72fffed5-d3a9-4cd2-80e4-0df672c5d63d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.220948 Aug 30 16:25:56.525333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2075/4501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:56 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:56.540028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.553288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.555475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.561716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:56.562355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:56.563930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c940fca4-a4c4-4ddf-8922-b84696dfb915 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1553 microversion: 2.26 time: 0.355678 Aug 30 16:25:56.564556 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2427/4502] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:56 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1553 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:56.587257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.587755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.588190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.589666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:56.590196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:56.590812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:56.762542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:56.773993 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee1ec43f-4aee-48a7-88a8-f1bdbd77fa66 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.216741 Aug 30 16:25:56.787383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2076/4503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:56 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:57.064614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ffbecc-201b-4a89-980c-c06c05f92ef3"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:57.067100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:57.074394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.074905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.075349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.076136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.076524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.077008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.549115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:57.549748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:57.559896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.563410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.564302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.566733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.567760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.568143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.721291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c0dd245-d5a9-4592-909b-1f3b3c55710b tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660177 Aug 30 16:25:57.727936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2428/4504] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:25:57 2022] POST /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:25:57.734186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:57.735012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:57.742139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.742683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.743515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.744299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.744830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.745935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.751270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:57.761331 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2457471a-0d0d-4d28-a925-62d694d67c64 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.215672 Aug 30 16:25:57.762409 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2077/4505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:57 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:57.799100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:57.800428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:57.811914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.813602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.815676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.816635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:57.817892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:57.818547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:57.980385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.010582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.013210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.015924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-55ec67d1-32d9-4d5f-b4d5-b3fc147e449f tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1553 microversion: 2.26 time: 0.286757 Aug 30 16:25:58.016672 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2429/4506] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:57 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1553 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:58.074193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:58.084875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9f480ba-9418-4ae9-a794-42c109fa912f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.289680 Aug 30 16:25:58.099243 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2078/4507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:57 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:25:58.785465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:58.786131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:58.797480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e019b495-e587-4e82-8ba5-620b47f2aded", "name": "network-vif-deleted", "tag": "f416347b-bc8c-4a78-8533-bdf3e6cf3414"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:25:58.804913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:25:58.810918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:58.811400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:58.811713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:58.811834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:58.812158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:58.812596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:58.812710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:58.813070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:58.813507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:58.829280 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] Creating event network-vif-deleted:f416347b-bc8c-4a78-8533-bdf3e6cf3414 for instance e019b495-e587-4e82-8ba5-620b47f2aded on n-h2-830883-28 Aug 30 16:25:58.866081 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e019bc14-ea5d-44b0-88a9-cc7678661b97 req-61586600-d74f-41e4-926c-2f36c9558eeb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072583 Aug 30 16:25:58.867782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2079/4508] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:25:59.049350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:59.050082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:59.106024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.107162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.107162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.107737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.108126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.124130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.218596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.220306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.224381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.225052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lazy-loading 'fault' on Instance uuid e019b495-e587-4e82-8ba5-620b47f2aded {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:25:59.242921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.260330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2c478120-fc44-49ed-bfe9-0f7f0d3d8202 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.478693 Aug 30 16:25:59.278138 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2430/4509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:58 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:25:59.285095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:25:59.286134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:25:59.293581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.296196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.296196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.296196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:25:59.296196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:25:59.296196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:25:59.357366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.369166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.371876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1bf9a7563a048628cc56c104734bafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6ac2d5cf346a4bdc3e566d7c98a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.373054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ea30f97-b9c0-4187-9e2c-ceea13cdaf79 tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 200 len: 1352 microversion: 2.26 time: 0.335794 Aug 30 16:25:59.397013 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2080/4510] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:25:59 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 1352 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:25:59.516520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:25:59.532761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f351f82e-45fb-49b7-9d9d-0ec88db8d51f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.252138 Aug 30 16:25:59.535147 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2431/4511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:25:59 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:00.285093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:00.286507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:00.291042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:00.302240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.306679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.308081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.309000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.313113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.313799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.380745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:00.404479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:00.409576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] [instance: e019b495-e587-4e82-8ba5-620b47f2aded] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:00.428972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.430017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.430665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.431619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.432240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.437766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.486547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] HTTP exception thrown: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Request method failure captured: Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded HTTP/1.1 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjoAqHKuu5GRBvzDJtY9vh5teHFEDszxjgfgPP2ssGJi57S-1-SkpOAfEIUBsqSnUctPwqt_RRtpQgmZGaL83SYOIQKJRjWuPU76snPONFY8fd9Gc_BCQ0mQzv1jUlpzpVqJzNtwo-2_vQRyehKJBGBX6ynaKqkb6NiG49u3_Q4eDps Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.26 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: fdd6ac2d5cf346a4bdc3e566d7c98a39 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerTagsTestJSON-1795970315 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fdd6ac2d5cf346a4bdc3e566d7c98a39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fdd6ac2d5cf346a4bdc3e566d7c98a39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fdd6ac2d5cf346a4bdc3e566d7c98a39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fdd6ac2d5cf346a4bdc3e566d7c98a39"}]}] Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerTagsTestJSON-1795970315 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: fdd6ac2d5cf346a4bdc3e566d7c98a39 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerTagsTestJSON-1795970315 Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerTagsTestJSON-1795970315-project Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f1bf9a7563a048628cc56c104734bafd Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerTagsTestJSON-1795970315-project Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'e019b495-e587-4e82-8ba5-620b47f2aded'} Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:00.488658 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. Aug 30 16:26:00.492826 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:26:00.494835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] Returning 404 to user: Instance e019b495-e587-4e82-8ba5-620b47f2aded could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:00.499726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-964dd66c-8bef-4675-9a39-3c4dc2f13e8e tempest-ServerTagsTestJSON-1795970315 tempest-ServerTagsTestJSON-1795970315-project] 10.222.0.47 "GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded" status: 404 len: 111 microversion: 2.26 time: 0.103427 Aug 30 16:26:00.500878 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2432/4512] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:00 2022] GET /compute/v2.1/servers/e019b495-e587-4e82-8ba5-620b47f2aded => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:26:00.576107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:00.580935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:00.623080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.624905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.625650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.626615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:00.627468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:00.628258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:00.756734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:00.765458 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e47c73a3-717c-498d-b0e6-6e1b74f40c88 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.484227 Aug 30 16:26:00.771439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2081/4513] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:00 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:00.905071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:00.919462 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2da0ce4-9bd7-4cb6-8ed1-f87e6edde8fe tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.363660 Aug 30 16:26:00.924194 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2433/4514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:00 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:01.168639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901d7367-1a6a-418a-8322-0b2fa968a425", "name": "network-vif-plugged", "status": "completed", "tag": "5bf8dcfe-3a94-42fe-84be-dd31496eeba3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:01.191328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.191809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.192229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.227317 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] Creating event network-vif-plugged:5bf8dcfe-3a94-42fe-84be-dd31496eeba3 for instance 901d7367-1a6a-418a-8322-0b2fa968a425 on n-h1-830883-28 Aug 30 16:26:01.252173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5319ffed-4f8e-449f-95e2-f1030722a104 req-0dde4bf4-e2f5-4178-a00a-803a339303df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088005 Aug 30 16:26:01.252786 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2082/4515] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:01.793372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:01.794216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:01.805320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.808901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.809557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.810500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.814780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.815413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.954583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:01.955815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:01.976094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.981920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.982870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:01.989516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:01.990983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:01.992345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:02.119139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:02.133371 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24487b9b-afe2-46ae-bfc2-52ddcd66d3ab tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1315 microversion: 2.1 time: 0.344690 Aug 30 16:26:02.137030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2434/4516] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:01 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:02.332844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:02.348423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-982a6a03-0c89-4bb2-aeea-3153db0afb77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.397325 Aug 30 16:26:02.358354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2083/4517] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:01 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:03.164686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:03.167422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:03.183071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.185775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.186841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.188175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.190881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.192848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.369368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:03.371684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:03.388267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.389062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.389792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.390721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.391490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.392091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.598759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:03.611496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e180c21-75e2-45eb-bdb5-72ca7bdb6075 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1501 microversion: 2.1 time: 0.452466 Aug 30 16:26:03.616474 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2435/4518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:03 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1501 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:03.653491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:03.655037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:03.682176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.683968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.684680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.685645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:03.687255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:03.689617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:03.862519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:03.885029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94b8ef8f-86be-4739-b6ae-8cde19e295e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1506 microversion: 2.1 time: 0.513314 Aug 30 16:26:03.887905 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2084/4519] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:03 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:04.167072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Removing security group b1bfb34c-165b-446c-bfa1-99380ffdf8df from port 5bf8dcfe-3a94-42fe-84be-dd31496eeba3 Aug 30 16:26:04.904046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:04.905568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:04.921430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:04.923292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:04.924818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:04.929381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:04.930065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:04.930784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.067391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-efd0c820-fdc4-4acc-b256-5f495576e2e7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425/action" status: 202 len: 0 microversion: 2.1 time: 1.425600 Aug 30 16:26:05.068525 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2436/4520] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:26:03 2022] POST /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425/action => generated 0 bytes in 1427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:05.084867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:05.085827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:05.094151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.095225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.095888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.097085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.097762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.098444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.132648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:05.317849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.333072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-acd428fd-76c9-457b-a1f1-b883bac41cf7 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1459 microversion: 2.1 time: 0.256298 Aug 30 16:26:05.346833 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2437/4521] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:05 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1459 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:05.357808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d7367-1a6a-418a-8322-0b2fa968a425", "tag": "5bf8dcfe-3a94-42fe-84be-dd31496eeba3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:05.376679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.377749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.378645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.405897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.409020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:05.411918 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] Creating event network-changed:5bf8dcfe-3a94-42fe-84be-dd31496eeba3 for instance 901d7367-1a6a-418a-8322-0b2fa968a425 on n-h1-830883-28 Aug 30 16:26:05.417438 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4eeec32e-bd77-4e9a-991a-71d89bf56c69 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1527 microversion: 2.1 time: 0.518904 Aug 30 16:26:05.419204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2085/4522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:04 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1527 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:05.424104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:05.425006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:05.434706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.435433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.436316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.438180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.439266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.439940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.440609 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-032a93b5-0934-4664-b724-2e4b96f2c94e req-3c4e599b-af66-480b-8c79-a2987c249109 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087945 Aug 30 16:26:05.445514 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2438/4523] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:05.734555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:05.752582 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-563fe225-0a7a-4e69-825f-1fb8eefae7e3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.331754 Aug 30 16:26:05.753194 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2086/4524] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:05 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:05.786719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:05.787449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:05.801316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.801813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.802260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:05.802998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:05.803472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:05.803895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.445222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:06.447151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:06.456831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.457601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.458456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.460124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.460754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.461348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.497540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.508311 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-036e14eb-de94-4057-a653-cf60fdbbf018 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.732740 Aug 30 16:26:06.510070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2439/4525] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:05 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:06.531399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:06.532057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:06.539366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.540313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.540922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.542016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.543359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.543996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.696803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.709437 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6049ed52-4e8e-497c-84d4-725b1cb93a63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1527 microversion: 2.1 time: 0.268242 Aug 30 16:26:06.710595 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2087/4526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:06 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:06.867986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:06.881741 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b156385-05d4-4524-9531-045b347e3cd9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.355127 Aug 30 16:26:06.882367 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2440/4527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:06 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:06.906894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:06.907848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:06.925501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.937418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.938206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:06.941543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:06.943094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:06.943984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:07.211878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:07.228242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6f665f5-6e3f-471b-b75a-75f4e1c4e4b2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.326348 Aug 30 16:26:07.252200 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2088/4528] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:06 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:07.325609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1772916387", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "14da368a-1038-4232-aa6a-32d46d4c24f8"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:07.414757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] validate_networks() for [('14da368a-1038-4232-aa6a-32d46d4c24f8', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:26:07.735011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:07.736491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:07.744381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:07.745853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:07.746542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:07.747419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:07.748401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:07.749219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:08.028184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:08.037405 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3777c862-6619-4817-a8ef-df4236b2f477 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1527 microversion: 2.1 time: 0.305453 Aug 30 16:26:08.050334 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2089/4529] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:07 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1527 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:08.289313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:26:08.289784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:26:08.290124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:26:08.290577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:26:08.291001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:26:08.317039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:08.317552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:08.317989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:08.318983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:08.319217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:08.319652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:08.356185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:26:08.367876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Getting quotas for user 02c865c4a5e7463b9f55de166009b343 and project ab2c70537f9f48c89243905d8bd74e15. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:26:08.397296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:26:08.403835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:26:08.436996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:08.511877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a2aa02d-7b7e-4093-888a-6057dd220ca8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190980 Aug 30 16:26:08.513379 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2441/4530] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:26:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:26:08.524061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf91fb10-b58d-4dad-a5f4-10535ee36746 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:08.524696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf91fb10-b58d-4dad-a5f4-10535ee36746 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:08.615166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf91fb10-b58d-4dad-a5f4-10535ee36746 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:08.623840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf91fb10-b58d-4dad-a5f4-10535ee36746 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1215 microversion: 2.1 time: 0.103687 Aug 30 16:26:08.628913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2090/4531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:08 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:08.690537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383ca713-66ab-4951-9a59-144f78c95392", "name": "network-vif-plugged", "status": "completed", "tag": "8f6f3540-1861-4a64-ae56-f28731d4ba71"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:08.711172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:08.711676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:08.712119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:08.741540 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] Creating event network-vif-plugged:8f6f3540-1861-4a64-ae56-f28731d4ba71 for instance 383ca713-66ab-4951-9a59-144f78c95392 on n-h2-830883-28 Aug 30 16:26:08.768571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9261b765-a98e-4323-aa0d-7b568ced64b6 req-d8833ba6-999b-4469-ab4f-5f3bad6536fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079777 Aug 30 16:26:08.769894 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2442/4532] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:09.064082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:09.065768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:09.078049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:09.078793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:09.079481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:09.080590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:09.081317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:09.082207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:09.273504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:09.283797 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4c84ba2d-5807-4baf-be22-d3e32502cc8b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1527 microversion: 2.1 time: 0.226409 Aug 30 16:26:09.294945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2091/4533] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:09 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1527 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:09.646242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:09.647722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:09.665840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:09.666369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:09.667627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:09.668562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:09.669240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:09.669888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:09.746855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:09.755990 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6dea71cf-8ffe-4712-89eb-e205520e8952 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1267 microversion: 2.1 time: 0.114594 Aug 30 16:26:09.757235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2443/4534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:09 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:09.937427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1489980271", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:09.997759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:26:09.998191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:26:09.998695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:26:09.999303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:26:09.999721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:26:10.008873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.009366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.009808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.010583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.011406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.011903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.030655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Getting quotas for project 8542f6143177438daac3358a60bb760b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:26:10.036095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Getting quotas for user e92ecb6d2c8144978eda6d14fd36afaa and project 8542f6143177438daac3358a60bb760b. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:26:10.049611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:26:10.051965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:26:10.102143 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a0bdd40-bd56-4289-9375-bc3d9cd64ef2 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.322541 Aug 30 16:26:10.105429 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2092/4535] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:26:10.116167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:10.117158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:10.210384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.225989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.236467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.239742 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6c38721-9d8a-45b2-8230-58c560943b28 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1278 microversion: 2.57 time: 0.127873 Aug 30 16:26:10.240551 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2444/4536] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:10 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:10.325651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:10.329204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:10.345430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.346226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.346870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.347851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.348469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.349073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.759680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.779659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:10.780698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:10.789457 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee4770ef-02be-446d-826f-154b026846e7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.483869 Aug 30 16:26:10.790101 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2093/4537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:10 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:10.791055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.791918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.793073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.794071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:10.794697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:10.795140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:10.908689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:10.921526 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3e7cbe6-7c2d-461e-ad43-5d196ccde086 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1273 microversion: 2.1 time: 0.147060 Aug 30 16:26:10.922611 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2445/4538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:10 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:11.270088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:11.270868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:11.285923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.287315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.288108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:11.289596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.291416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.292864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:11.813879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:11.814727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:11.829897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.835365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.844030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:11.844992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:11.845606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:11.847590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.117653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.133798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.135971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.138745 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed7d3400-a3a3-4bd2-8ddf-e265df622640 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1282 microversion: 2.57 time: 0.873623 Aug 30 16:26:12.145874 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2094/4539] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:11 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1282 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:12.159909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:12.161059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:12.178466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.179446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.183822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.185524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:12.187192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:12.187803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:12.326167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.328965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:12.344055 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2c12f600-84d0-42f0-b128-43bdbbc67481 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.534052 Aug 30 16:26:12.345604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dc9374bf-dc35-4b18-8132-6a6e6eb242c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1273 microversion: 2.1 time: 0.190181 Aug 30 16:26:12.346504 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2095/4540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:12 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:12.367041 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2446/4541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:11 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:13.038553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.043350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.059573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.061042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.062951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.064573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.069116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.069826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.144940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7bc7b19-21a1-4909-b5e6-9c3852d3d6da tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110797 Aug 30 16:26:13.150538 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2096/4542] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:13.168975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.169585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.178722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.179432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.197655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.198290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.200586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.201279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.202711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.203615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.204671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.205560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.206702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.207850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.208531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.210939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.304090 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf1a370f-cbdf-45c8-b48f-566fc97205b1 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3" status: 200 len: 194 microversion: 2.1 time: 0.146070 Aug 30 16:26:13.309430 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2447/4543] 10.222.0.47 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:13.370758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.371873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.380734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.387450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.389661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.394097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.398168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.398876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.432874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.469263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.480236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.485150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0430aaaf-c506-434e-b715-3b34cd326f09 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1336 microversion: 2.57 time: 0.320115 Aug 30 16:26:13.486011 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2097/4544] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1336 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:13.498241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:13.503190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:13.528612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.530713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.531179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.532136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:13.534987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:13.535670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:13.724532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:13.751258 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d0f8533-f9bd-4747-bc8b-77aece4d58d9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.387453 Aug 30 16:26:13.766832 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2448/4545] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:14.196627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.215860 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c112de4-c895-4755-9c5a-e3b39cd464b0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.727734 Aug 30 16:26:14.219491 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2098/4546] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:13 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:14.512879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:14.514696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:14.533361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.534086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.534716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.537824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.541033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.548630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.549805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a9d4a5-659c-4c3b-9e93-9bead59bebc0", "tag": "5198bb7a-b599-4680-90be-963f3690eef0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:14.578639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.580387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.581010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.612518 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] Creating event network-changed:5198bb7a-b599-4680-90be-963f3690eef0 for instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 on n-h2-830883-28 Aug 30 16:26:14.623823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-439c0d8e-d4cb-4892-a652-bbc63fdb90eb req-b219a3c0-51b3-4367-81e2-bace65d44f07 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083344 Aug 30 16:26:14.631639 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2099/4547] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:14.683763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.692998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.705519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:14.706886 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33aa418c-6835-4d5a-bbf8-c91779c88a2c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1336 microversion: 2.57 time: 0.201745 Aug 30 16:26:14.707511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2449/4548] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:14 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:14.784221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:14.790130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:14.815299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.816908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.817772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:14.821487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:14.823853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:14.824490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.249082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:15.253823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:15.265190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.266157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.266826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.267791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.268422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.269017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.401721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:15.430169 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8513a57c-e41e-43b0-8303-746232f2693e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.653938 Aug 30 16:26:15.438025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2100/4549] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:14 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:15.728113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:15.732935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:15.734266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:15.742531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f14672a6-f133-4c0e-a3b0-a05b4c1759b2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.502767 Aug 30 16:26:15.743797 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2450/4550] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:15 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:15.748157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.750522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.751646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.753639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:15.755969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:15.756625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:15.908709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:15.926559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:15.931468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:15.938793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12bf90df-239f-4ea0-a996-a25104e31f6c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1336 microversion: 2.57 time: 0.211937 Aug 30 16:26:15.946273 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2101/4551] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:15 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:16.154357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21cc8d2b-6b0c-409b-b294-d4ec9466801e"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:16.156674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:16.179712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.180305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.180828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.181853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.183073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.183757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.459279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:16.459898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:16.470216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.470984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.471340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.471905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.474726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.475933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.722693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:16.731606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6be8fc5c-546c-4bab-be58-4aa6b1d34bb1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.276182 Aug 30 16:26:16.735162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2102/4552] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:16 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:16.766421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:16.767361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:16.778127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.781157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.781806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:16.782801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:16.783500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:16.784149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.000220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.009034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c26ab38a-13dc-4d87-b5dd-8dc52a98ddf7 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.246470 Aug 30 16:26:17.009613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2103/4553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:16 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:17.024962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:17.029747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.039257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.039763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.040199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.040901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.042327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.042761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.123772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.128576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:17.134833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.137622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.139012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d00b2fd-877f-4416-804a-75a024fd2fda tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1357 microversion: 2.57 time: 0.126301 Aug 30 16:26:17.139740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2104/4554] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:17 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1357 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:17.166378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:17.169880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.180941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.182650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.183669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.184432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.184932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.185358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.348101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:26:17.348570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:26:17.349237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:26:17.349753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:26:17.350268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:26:17.442466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.449818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.450704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.451499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.452425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.453097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.453755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.486995 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-790909d0-08f0-41c3-8a13-f876c56f4520 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "POST /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6/action" status: 202 len: 1138 microversion: 2.57 time: 0.324794 Aug 30 16:26:17.488286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2105/4555] 10.222.0.47 () {62 vars in 1320 bytes} [Tue Aug 30 16:26:17 2022] POST /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6/action => generated 1138 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 16:26:17.508441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:17.509443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.517491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.518437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.519192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.520162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.520846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.521491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.645311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.665127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.667498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.668778 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe994c8d-8aca-40e4-b1fa-1f2589880b13 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.164558 Aug 30 16:26:17.669694 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2106/4556] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:17 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:17.762221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:17.767326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:17.769609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.770183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.773757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.774547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:17.775028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:17.775473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:17.963088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:17.972593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e45ec2e-7aba-437d-9336-67b1e4ab5dd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.214554 Aug 30 16:26:17.978000 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2107/4557] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:17 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:18.030514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:18.031139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:18.059978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.060495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.060943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.061699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.062321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.062816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.285832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9aceefea-60ea-4361-b3f6-a163a584b7d5 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "POST /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.135789 Aug 30 16:26:18.293512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2451/4558] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:26:16 2022] POST /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 194 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:18.490204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.500208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3aa02d8-8c21-462a-9fae-beb833013516 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.473717 Aug 30 16:26:18.504283 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2108/4559] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:18 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:18.702282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:18.703669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:18.711152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:18.716862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.717854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.718524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.719703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:18.721811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:18.722491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:18.860670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.871573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.878450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:18.879858 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a918bf1b-7a94-48f4-a93e-e57799956350 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.186968 Aug 30 16:26:18.880449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2452/4560] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:18 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:18.999576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:19.000192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:19.013446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.014275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.014750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.016802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.017425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.020259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.523986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:19.527019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:19.539688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.542568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.544040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.546260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.553980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.555093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.638867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:19.662945 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9150d769-cac7-4719-8b2c-70775188cd5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.665337 Aug 30 16:26:19.683052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2109/4561] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:18 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:19.824262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:19.833390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7e53aae-04fa-4af5-860d-a9bea6d6fd68 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.315577 Aug 30 16:26:19.838731 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2453/4562] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:19 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:19.908153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:19.909039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:19.919237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.920135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.921016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:19.922071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:19.923185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:19.923803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.021694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.025439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:20.039869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.042353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.044396 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2cc71c9d-c0b5-43e1-b20c-9d3b8d81ea68 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.139828 Aug 30 16:26:20.045746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2110/4563] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:19 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:20.693539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:20.697675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:20.708344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:20.721652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.722595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.723237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.724271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.724905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.725523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.856978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:20.857991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:20.873652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:20.875750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.878669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.880010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.881255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:20.884206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:20.884913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:20.955241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:20.990322 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49beb6f2-bb12-44c4-a05b-3536f8194134 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.300951 Aug 30 16:26:20.992147 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2454/4564] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:20 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:21.083380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:21.084073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:21.109180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.109601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.110090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:21.116429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:21.117658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:21.119849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:21.200654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:21.215304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f511bce2-fc2f-4244-a284-abb5a1d95db3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.362261 Aug 30 16:26:21.230661 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2111/4565] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:20 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:21.316531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:21.325478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:21.331093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:21.332977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:21.334792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5622b3cf-c94a-42e4-b10f-3ebeca38b577 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.267369 Aug 30 16:26:21.335677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2455/4566] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:21 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:22.013877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:22.014686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:22.035018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.035689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.036237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.037087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.037643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.038167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.236303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:22.236950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:22.257733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.258608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.259288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.261625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.262437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.263126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.356589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.371848 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-71cf2a42-65e8-435b-aa5c-e48cecd88117 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.362551 Aug 30 16:26:22.372639 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2112/4567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:22 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:22.377767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:22.378451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:22.401083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.401766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.402207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.402974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.403443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.403883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.544445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.559790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.561549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.563736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0e9f8ec-e5d2-47fa-9781-d6a0e18a899d tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.189667 Aug 30 16:26:22.581778 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2113/4568] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:22 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:22.629642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:22.645803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-175fc87c-65ee-4b1a-a8bf-69a22e68f309 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.413557 Aug 30 16:26:22.646956 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2456/4569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:22 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:22.767037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a9d4a5-659c-4c3b-9e93-9bead59bebc0", "name": "network-vif-plugged", "status": "completed", "tag": "5198bb7a-b599-4680-90be-963f3690eef0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:22.795355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:22.798244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:22.799066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:22.860085 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] Creating event network-vif-plugged:5198bb7a-b599-4680-90be-963f3690eef0 for instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 on n-h2-830883-28 Aug 30 16:26:22.906524 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e3c74ba6-a3ca-4024-a2f8-30262425b38f req-d56f961d-efb7-47d7-aeea-8a6fd55e78b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118628 Aug 30 16:26:22.906524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2114/4570] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:23.392958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.393682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.413123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.413965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.414692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.415628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.416431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.417304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.591187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.591992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.614693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.617759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.621217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.622141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.625421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.627066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.684075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.693505 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5470ea27-ac2d-4ec9-aa89-908facd2d3d0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1315 microversion: 2.1 time: 0.304394 Aug 30 16:26:23.694486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2457/4571] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:23.703827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.709032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.719351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.720196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.720987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.721926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.722645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.723318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.772372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.782681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.784698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:23.792284 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84b08bc0-4b41-43be-ac85-227f9b1a8b84 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.207047 Aug 30 16:26:23.793489 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2115/4572] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:23.828754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:23.829604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.843878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.845245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.845849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.849006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.849828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.850870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.909926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8e04ca57-13ab-4308-ab41-53345b189571 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/ips" status: 200 len: 150 microversion: 2.1 time: 0.085737 Aug 30 16:26:23.919274 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2116/4573] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:23.931112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5b972c8-93e1-4a30-87cc-ee876a417713"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:23.934122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:23.950578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.951373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.956677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:23.964958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:23.965540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:23.965996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.030098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.043857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41a7dc96-23c9-4ce1-bc73-0ee84f3a8b9e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.347962 Aug 30 16:26:24.045175 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2458/4574] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:23 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:24.179741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/os-volume_attachments HTTP/1.1 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 74 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: {"volumeAttachment": {"volumeId": "c5b972c8-93e1-4a30-87cc-ee876a417713"}} Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': 'bbc6da81-90c9-4762-9c74-3d87b734a2b3', 'body': {'volumeAttachment': {'volumeId': 'c5b972c8-93e1-4a30-87cc-ee876a417713'}}} Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5140, in attach_volume Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4980, in _check_volume_already_attached Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:26:24.181623 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 Aug 30 16:26:24.186373 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:24.188434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 400 to user: Invalid volume: volume c5b972c8-93e1-4a30-87cc-ee876a417713 is already attached to instances: e61857f0-1416-4611-9858-4553cd016785 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:24.190956 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38b76afb-5b5d-470c-b600-6495227c69de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.263857 Aug 30 16:26:24.194840 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2117/4575] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:26:23 2022] POST /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3/os-volume_attachments => generated 174 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:26:24.211624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.212141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.224264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.224770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.225213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.225925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.231081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.231915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.291299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:24.452201 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-52286ea9-68ad-427f-89a9-8259aac96dd6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 204 len: 0 microversion: 2.1 time: 0.245958 Aug 30 16:26:24.452910 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2459/4576] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:26:24 2022] DELETE /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:26:24.460853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.461470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.477245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:24.491287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.491794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.492235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.493374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.493517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.493833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.719371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.720593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.732741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.736716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.737636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.738577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.741149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.742234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.829472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:24.842027 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57170817-2fb2-40a9-b0c7-720c99d5c2aa tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1681 microversion: 2.1 time: 0.384931 Aug 30 16:26:24.858889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2118/4577] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:24 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:24.875757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:24.887447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:24.894075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.894621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.895039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:24.895753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:24.896213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:24.896655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.007567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.020145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.023508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.029971 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0d9a3bc-7820-4bb7-b28c-e1c409a1c017 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.165263 Aug 30 16:26:25.046969 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2119/4578] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:24 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:25.068546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:25.069434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.089404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.093284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.093940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.094872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.095495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.101492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.140637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.152455 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1f2bf5c-35df-4dbc-a8e6-73a88123d8dd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1502 microversion: 2.1 time: 0.438486 Aug 30 16:26:25.153825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:25.157739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2460/4579] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:24 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:25.188502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:25.189099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.202657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.209447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.212000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.214966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.217042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.217681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.335354 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ed597f1-02d1-42c7-8ebd-174992331651 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0/action" status: 202 len: 0 microversion: 2.1 time: 0.163051 Aug 30 16:26:25.337222 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2461/4580] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:26:25 2022] POST /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:26:25.355031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:25.357033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.368123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.372896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.373726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.375249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.376093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.376999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.542146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.550956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:25.553180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a7153e7-69dd-455f-b011-8511109be30c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.488369 Aug 30 16:26:25.562981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2120/4581] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:25 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:25.571633 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7dee724-6e6e-4b04-ad11-970632a64624 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1507 microversion: 2.1 time: 0.227748 Aug 30 16:26:25.575031 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2462/4582] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:25 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:25.873162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:25.874486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:25.887233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.887975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.888604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:25.889525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:25.891670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:25.892290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.060157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:26.061090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:26.070491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.071263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.074676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.074676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.079341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.079687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.111244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.136840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f2b7cea5-473f-4786-b431-91e6e9776da6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1681 microversion: 2.1 time: 0.269487 Aug 30 16:26:26.140938 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2121/4583] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:25 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:26.281733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.290617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.299365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:26.300633 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3085234f-d71e-46ef-a714-12533b2a164b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.249271 Aug 30 16:26:26.309276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2463/4584] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:26 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:26.576404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:26.577456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:26.594705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:26.595502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:26.601219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.605764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.606394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.607164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.610493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.610950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.613906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.625837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.627324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:26.631235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:26.633262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:26.637831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.033292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.042447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d978cc34-27b8-4c58-bff4-46e988d1bb63 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.470729 Aug 30 16:26:27.042979 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2122/4585] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:26 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:27.167323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:27.168201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:27.178139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.183808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.185946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.190095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.193696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.205118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.248970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.260212 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc940c14-6efd-44d2-82b2-bc0f24e406c3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1487 microversion: 2.1 time: 0.669625 Aug 30 16:26:27.269713 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2464/4586] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:26 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1487 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:27.292843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:27.293651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:27.314141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.320111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.323775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.325625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.329583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.332140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.437427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lazy-loading 'flavor' on Instance uuid c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:27.606085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.616583 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-06edebc5-b737-4046-a12a-adcf8219f09b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1681 microversion: 2.1 time: 0.453122 Aug 30 16:26:27.617764 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2123/4587] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:27 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1681 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:27.625248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:27.626100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:27.637429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.638203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.639121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.640217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.642333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.642962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.799499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.821750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.830828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:27.832947 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3ff020c-5db7-4e8d-b2d6-82c9956b7097 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.213198 Aug 30 16:26:27.834757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2124/4588] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:27 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:27.922522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6b802b7-1f38-42e9-8b3e-5ab27e5c0cc0 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0/action" status: 202 len: 0 microversion: 2.1 time: 0.638615 Aug 30 16:26:27.923185 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2465/4589] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:26:27 2022] POST /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:27.934205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:27.935287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:27.954639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.961016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.961728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:27.964429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:27.965076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:27.965582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.069375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:28.070814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:28.082147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.083848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.084455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.087121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.087877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.089676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.313204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.331902 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36af6444-19cf-427f-b416-61430fc82a53 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1493 microversion: 2.1 time: 0.398997 Aug 30 16:26:28.332817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2125/4590] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:27 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1493 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:28.599708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.615378 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bbf98c5b-25a6-4593-afc4-83e8c5a7a46c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.551285 Aug 30 16:26:28.617464 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2466/4591] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:28 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:28.672259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:28.673013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:28.679621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.680536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.681180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.682131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.682918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.683430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.796617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:28.818229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6420bd2-b14e-49c1-b0ea-d95323b485dd tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1614 microversion: 2.1 time: 0.169151 Aug 30 16:26:28.819296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2126/4592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:28 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1614 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:28.858050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:28.859410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:28.873388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.873899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.874384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.878408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.881123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.881869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:28.954540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc6da81-90c9-4762-9c74-3d87b734a2b3", "name": "network-vif-deleted", "tag": "7265fdf1-57f4-4595-8a47-a26fcf623cd6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:28.974620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:28.986801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:28.987622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.023466 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] Creating event network-vif-deleted:7265fdf1-57f4-4595-8a47-a26fcf623cd6 for instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 on n-h1-830883-28 Aug 30 16:26:29.058361 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9d88ec93-226d-449d-b8eb-27f74abb2677 req-91263a1c-d952-43a3-9455-1825bcee5d4e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104536 Aug 30 16:26:29.059138 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2127/4593] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:29.089636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.092724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:29.113674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.118674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.124071 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a116545c-d7cd-4dbf-b8fa-155240441e50 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.269730 Aug 30 16:26:29.126374 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2467/4594] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:28 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:29.362533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:29.363572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:29.378631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.383136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.383605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.384475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.385494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.385943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.639488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:29.640432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:29.656614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.668954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.669416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.670194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.670697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.671528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.724531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:29.748178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89ed1967-d104-44fe-8274-fa5b026a33b5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1514 microversion: 2.1 time: 0.391921 Aug 30 16:26:29.748798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2128/4595] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:29 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:29.841214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:29.841758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:29.855906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.856694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.861173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.862112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.862871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.863494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.949779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:29.954012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:29.954724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:29.955358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lazy-loading 'fault' on Instance uuid bbc6da81-90c9-4762-9c74-3d87b734a2b3 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:30.059228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.074680 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0d1f332-e27c-4c2c-86e4-165090f299c8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 200 len: 1331 microversion: 2.1 time: 0.238374 Aug 30 16:26:30.078376 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2129/4596] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:29 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 1331 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:30.097533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.113730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b0882061-8c36-4405-8e68-d5b638242002 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.477488 Aug 30 16:26:30.118388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2468/4597] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:29 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:30.149710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:30.151804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:30.166762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.167563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.172522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.173329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.173817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.174268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.349955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.376300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.387750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:30.392248 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1aa888a-c0c7-43b1-ac64-8419d41d412b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.246948 Aug 30 16:26:30.395048 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2130/4598] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:30 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:30.772692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:30.773659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:30.786427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.787463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.789468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:30.794054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:30.794883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:30.800911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.034613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.046048 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53617c6e-7042-4368-a400-e72b507ddf26 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1514 microversion: 2.1 time: 0.277800 Aug 30 16:26:31.047488 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2469/4599] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:30 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:31.099074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.099707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:31.142037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.151882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:31.164244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.164985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.167216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.168101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.169005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.169411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.169830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.169956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.170562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.170685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.171089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.176368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.208236 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 HTTP/1.1 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bbc6da81-90c9-4762-9c74-3d87b734a2b3'} Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:31.210723 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:26:31.216345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:31.219614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:31.220954 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31d388eb-5dd8-47b3-8e5c-65a96fab78cb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 404 len: 111 microversion: 2.1 time: 0.126408 Aug 30 16:26:31.223288 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2131/4600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:31 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:26:31.236029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a947057-0894-4a2e-9bcd-7ae9f042cec6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '.version_select at 0x7fd35d547040>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.308163 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a947057-0894-4a2e-9bcd-7ae9f042cec6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502785112" status: 202 len: 0 microversion: 2.1 time: 0.080139 Aug 30 16:26:31.309137 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2132/4601] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:26:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502785112 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:31.417735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:31.418398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:31.431088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.442624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.443238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.444072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:31.444612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:31.445191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:31.496349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.512699 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01f80a2b-ee81-4ae3-a70f-192ba94c0472 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.377015 Aug 30 16:26:31.513917 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2470/4602] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:31 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:31.580981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.593183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.594971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:31.596430 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e66d5e81-4b18-498e-a1a6-bbbb30ecf217 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.183260 Aug 30 16:26:31.605416 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2133/4603] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:31 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:32.085971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.089138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.105597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.107002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.114281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.115775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.121149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.121611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.533194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.533996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.546766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.547350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.547721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.548452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.548910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.549338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.767557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.787299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e008c4d-b945-4a57-a27a-5a7455999371 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1522 microversion: 2.1 time: 0.257965 Aug 30 16:26:32.794890 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2134/4604] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:32 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:32.804795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.805435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.822991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.823500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.823948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.824665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.825129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.825565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.837568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:32.847766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-39c362a2-4835-40bf-a26a-dce4432e86bd tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1514 microversion: 2.1 time: 0.776888 Aug 30 16:26:32.863955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2471/4605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:32 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1514 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:32.934287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:32.935181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:32.943753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.944502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.945355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:32.946953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:32.948198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:32.948840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.045791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.060099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.068777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:33.068777 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-670e3f25-f922-4865-9003-8d70dcb73e37 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.267952 Aug 30 16:26:33.068777 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2135/4606] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:32 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:33.096302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lazy-loading 'services' on Instance uuid e61857f0-1416-4611-9858-4553cd016785 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:33.200444 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7819268c-9802-4cf3-8760-5ca1175d3c1f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments/c5b972c8-93e1-4a30-87cc-ee876a417713" status: 202 len: 0 microversion: 2.1 time: 0.270027 Aug 30 16:26:33.201912 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2472/4607] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:26:32 2022] DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments/c5b972c8-93e1-4a30-87cc-ee876a417713 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:26:33.209676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:33.212772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:33.219471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.220244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.220664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.221577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.222026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.222484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.258940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f860a1f4-2e6c-45b9-b74c-7c22079b34c1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052907 Aug 30 16:26:33.260255 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2136/4608] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:33 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:33.812936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:33.813749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:33.830166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.831045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.831503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.835471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.836151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.836796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.871741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:33.872983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:33.894436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.898830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.899675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:33.902930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:33.905037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:33.905754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.190577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:34.207260 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0674ca3d-b846-41ab-b455-ef1eccf28a8e tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1504 microversion: 2.1 time: 0.401566 Aug 30 16:26:34.209030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2473/4609] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:33 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:34.216786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.218142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.229055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.231007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.231590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.232434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.233024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.234717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.355707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:34.371285 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6efe299-0164-40e8-8aeb-c116d3f3a14c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1514 microversion: 2.1 time: 0.506159 Aug 30 16:26:34.371882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2137/4610] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:33 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1514 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:34.391894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.396283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.417522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.428223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.428963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.429899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.430567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.431189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.451019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:34.486596 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6537a3f5-8827-444d-a109-81e8d9c00a99 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098477 Aug 30 16:26:34.487901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2138/4611] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:34 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:34.493032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.494179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:34.495953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:34.496279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.498988 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ced17040-69a2-488e-bd25-d55759c6d789 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.289263 Aug 30 16:26:34.499587 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2474/4612] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:34 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:34.504522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.505242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.505836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.506760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.507382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.507971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.512846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:34.549636 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-110c5a31-49aa-48c1-9a8c-e94c5e360f07 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060369 Aug 30 16:26:34.551056 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2139/4613] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:34 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:34.696800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.698367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.714715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.715456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.716096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.717173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.717832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.718542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.759666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a9d4a5-659c-4c3b-9e93-9bead59bebc0", "name": "network-vif-plugged", "status": "completed", "tag": "5198bb7a-b599-4680-90be-963f3690eef0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:34.773817 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-307af593-8904-4313-bdb0-9b6def7e4010 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3" status: 200 len: 194 microversion: 2.1 time: 0.084092 Aug 30 16:26:34.779964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2475/4614] 10.222.0.47 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:34 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:34.788241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.788729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.789168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.816817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:34.817736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:34.820760 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] Creating event network-vif-plugged:5198bb7a-b599-4680-90be-963f3690eef0 for instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 on n-h2-830883-28 Aug 30 16:26:34.832736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bd88744c-558f-41b3-ba3c-d75a4116f037 req-39a50257-669e-48e2-ab21-3fc17025d57c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077470 Aug 30 16:26:34.839552 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2140/4615] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:34.843474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.843984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.844425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.845136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:34.845593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:34.846021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:34.978092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lazy-loading 'services' on Instance uuid b0e7356c-07a4-4e80-8bba-cda2c84d8d92 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:35.128782 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-150f90de-d7a5-4433-8317-a2cd34e21554 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3" status: 202 len: 0 microversion: 2.1 time: 0.344279 Aug 30 16:26:35.129796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2476/4616] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:26:34 2022] DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/49ffbecc-201b-4a89-980c-c06c05f92ef3 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:35.232120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:35.233588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:35.247852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.251608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.252140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.252878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.253345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.253821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.401691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:35.407234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:35.414819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.415562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.416791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.428845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.429647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.430288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.501110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.515792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6178fea-f13e-40b8-a8d8-ceb90622fc77 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1504 microversion: 2.1 time: 0.288628 Aug 30 16:26:35.535801 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2141/4617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:35 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:35.541820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:35.544630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:35.552631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.553315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.553920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.554864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.555651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.556248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.597688 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7004882-c6d3-4689-991d-3deae908c4ee tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060471 Aug 30 16:26:35.603131 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2142/4618] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:35 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:35.609180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:35.610437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:35.617984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.618815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.620129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.621373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:35.622087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:35.622773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:35.653496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.673550 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5932fa54-0f42-4186-af36-a7885c67efe1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.282854 Aug 30 16:26:35.686327 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2477/4619] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:35 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:35.700753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.721121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.722661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:35.725152 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0729a4f8-635c-45d2-b795-6f0c09757234 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.120085 Aug 30 16:26:35.730467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2143/4620] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:35 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:36.539548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:36.540183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:36.551415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.551896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.552340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.553151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.553607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.554039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.611084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:36.613631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:36.638390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.638918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.639394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.640185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.662526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.664543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.735480 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2971520b-9a67-42fd-a6ad-d59803d5200b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129440 Aug 30 16:26:36.740412 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2144/4621] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:36 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:36.747317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:36.748049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:36.818069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:36.828508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.828508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.829236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.830327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.830949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.832138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.845246 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4eefe212-3ef0-4b61-a285-75bb4fe0c2c2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1504 microversion: 2.1 time: 0.310394 Aug 30 16:26:36.845872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2478/4622] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:36 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:36.868973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:36.871408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:36.879078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.879859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.880865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:36.881860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:36.882616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:36.883218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:37.012231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:37.028123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:37.032354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:37.033916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e6f8aa0-86bb-477f-8f0f-ed4f51aa1eed tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.174159 Aug 30 16:26:37.035191 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2479/4623] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:36 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:37.040220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383ca713-66ab-4951-9a59-144f78c95392", "name": "network-vif-unplugged", "status": "completed", "tag": "8f6f3540-1861-4a64-ae56-f28731d4ba71"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:37.065542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:37.080204 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d4d4663-2290-4048-bab5-f163d2e06d7d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.337750 Aug 30 16:26:37.081235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:37.082127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:37.083982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:37.089494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2145/4624] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:36 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:37.106718 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] Creating event network-vif-unplugged:8f6f3540-1861-4a64-ae56-f28731d4ba71 for instance 383ca713-66ab-4951-9a59-144f78c95392 on n-h2-830883-28 Aug 30 16:26:37.111622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c9a3188f-af92-45e0-ad3f-e3dd3798bf37 req-a76f4656-1c16-49cc-b82e-be8444b0038c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075100 Aug 30 16:26:37.117339 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2480/4625] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:37.748821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:37.751753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:37.773964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:37.774762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:37.775957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:37.776856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:37.777476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:37.778068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:37.846862 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18a7f4f0-fdc1-4c02-bfe4-82e00e3a27e1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102758 Aug 30 16:26:37.851431 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2146/4626] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:37 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:37.878529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:37.879855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:37.904049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:37.905797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:37.906335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:37.907184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:37.909288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:37.910045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.065297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:38.075880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:38.087066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.088489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.089378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.090326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.091091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.091738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.156676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:38.165336 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff9ecf90-72c0-4ce6-83c2-cd6024dc57d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 200 len: 1447 microversion: 2.1 time: 0.297961 Aug 30 16:26:38.187701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2481/4627] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:37 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 1447 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:38.195998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:38.212186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:38.231556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.232312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.233063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.234291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.235256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.235853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.249243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:38.262143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:38.264789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:38.267650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-361a2f6c-9f90-44c2-ac33-2dd4dff12a18 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.205281 Aug 30 16:26:38.268740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2147/4628] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:38 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:38.285157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:38.288892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:38.302021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.307487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.307943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.308734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.309353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.309830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.338661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:38.346240 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Working on deleting snapshot 114e5fe9-54b4-4eaa-854f-b5a4fe408da8 from shelved instance... Aug 30 16:26:38.516738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:38.524789 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6899090a-a7ad-496a-91cf-aaf76487f7c5 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.334986 Aug 30 16:26:38.534957 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2482/4629] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:38 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:38.859861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:38.862639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:38.865023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:38.874186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.895487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.898836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.899752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:38.900983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:38.911059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:38.983941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:38.988085 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f26f15c8-3311-40f1-9e30-eddcdffbc680 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132067 Aug 30 16:26:38.990618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2483/4630] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:38 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:39.301622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:39.303747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:39.318127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:39.321222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:39.321913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:39.324519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:39.325689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:39.325689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:39.428295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:39.446168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:39.458197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:39.460813 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9540d0e-f57c-41ff-ace2-df5f938caad0 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.170707 Aug 30 16:26:39.461930 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2484/4631] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:39 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:39.489932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Doing local delete in cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122351) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 16:26:39.490763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:39.491244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:39.491873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:39.492299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 16:26:39.498011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] deallocate_for_instance() {{(pid=122351) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 30 16:26:39.559245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:39.560181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:39.568525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:39.569454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:39.570120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:39.571814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:39.573206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:39.573853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:39.768903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:39.778785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6485755-65eb-437b-ac68-e85af0dc19cc tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.226696 Aug 30 16:26:39.779734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2485/4632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:39 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:40.002867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:40.005177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:40.030533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.031353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.032324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.034672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.036277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.039682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.119538 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e719d757-8260-44c3-9e83-521129a0408d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120308 Aug 30 16:26:40.120403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2486/4633] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:39 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:40.316681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383ca713-66ab-4951-9a59-144f78c95392", "name": "network-vif-deleted", "tag": "8f6f3540-1861-4a64-ae56-f28731d4ba71"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:40.318629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Updating instance_info_cache with network_info: [] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:26:40.333208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.333926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.334585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.401198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_external_events [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] Unable to find a host for instance 383ca713-66ab-4951-9a59-144f78c95392. Dropping event network-vif-deleted {{(pid=122352) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Aug 30 16:26:40.403165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-defc9509-6272-4657-9209-60d2605be5dc req-b46d89b5-4ce5-48e9-9302-a83d40be5678 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090455 Aug 30 16:26:40.405677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2487/4634] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 16:26:40.486552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:40.487495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:40.501228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.503556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.504002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.504712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.505171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.505598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.637030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:40.653729 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff910e51-2c77-470f-9d47-fa6806c8e4e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 204 len: 0 microversion: 2.1 time: 2.383791 Aug 30 16:26:40.658226 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2148/4635] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:26:38 2022] DELETE /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 0 bytes in 2386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:26:40.664884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:40.665938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:40.668573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:40.670398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:40.673507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.674215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.674855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.675745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.676366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.676959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.684556 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1424785-d02b-45b4-be7c-cd068f704c8a tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.200928 Aug 30 16:26:40.695761 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 HTTP/1.1 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '383ca713-66ab-4951-9a59-144f78c95392'} Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:40.698352 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:26:40.702966 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:40.704558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:40.705602 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2488/4636] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:40 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:40.706579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7eceecba-c02b-483b-ae0b-95946a2d0e87 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 404 len: 111 microversion: 2.1 time: 0.046148 Aug 30 16:26:40.707356 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2149/4637] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:40 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:26:40.801677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:40.803550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:40.824682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.828551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.831476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.846887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:40.861471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:40.862594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:40.908098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-263546818", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:41.048734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:26:41.180869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:41.195736 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99d2323e-4c4e-4639-b60c-c0cf05364c3f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.395509 Aug 30 16:26:41.198035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2489/4638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:40 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:41.218615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:41.221566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:41.273871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:41.280872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:41.281852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:41.282914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:41.285530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:41.286069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:41.355797 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69b5994e-5492-4862-af17-d05cd139dccf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153398 Aug 30 16:26:41.358744 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2490/4639] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:26:41 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:26:41.714998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:41.715858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:41.724614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:41.726030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:41.726621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:41.736415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:41.736958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:41.737415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:41.920141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:41.928849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:41.930351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:41.932432 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd433c0f-8d55-4e5e-88c5-86976cfc142f tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.222825 Aug 30 16:26:41.947075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2491/4640] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:41 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:41.972147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:41.972667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:41.997084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:41.999525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.001172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.002446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.007670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.009248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.143806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:42.342274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dbc1253b-84bf-498e-9f29-feeffcba061b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 204 len: 0 microversion: 2.1 time: 0.373007 Aug 30 16:26:42.345038 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2492/4641] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:26:41 2022] DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:26:42.364225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:42.365031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:42.379622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.380216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.381336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.383436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.384282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.386990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.621882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:42.647237 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84bb0ece-f9bb-4bb9-8d02-1521dc72d24a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.300808 Aug 30 16:26:42.648211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2493/4642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:42 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:42.659219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:42.660086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:42.664520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:26:42.665534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:26:42.666927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:26:42.667553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:26:42.668174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:26:42.674905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.676628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.679562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.680011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.680498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.683798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.695947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.696739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.697935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.699514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:42.700915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:42.701522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:42.722295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:26:42.728963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:26:42.747174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:26:42.749890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:26:42.842614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b93f1cb8-0163-4d52-a9c8-23be66a7f4d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938576 Aug 30 16:26:42.847222 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2150/4643] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:26:42.858582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-baf1842a-4092-46d0-9fcc-d99f36690266 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:42.859465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-baf1842a-4092-46d0-9fcc-d99f36690266 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:42.998032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-baf1842a-4092-46d0-9fcc-d99f36690266 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:43.006369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-baf1842a-4092-46d0-9fcc-d99f36690266 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1214 microversion: 2.1 time: 0.152101 Aug 30 16:26:43.018780 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2151/4644] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:42 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:43.023428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:43.023428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:43.036921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:43.037424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:43.041889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:43.043052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:43.043530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:43.043970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:43.047489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:43.055803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74d7d7d3-2fa8-4eab-83b9-829c05dbf09f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1683 microversion: 2.1 time: 0.406283 Aug 30 16:26:43.062962 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2494/4645] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:42 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1683 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:43.149048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:43.255201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:43.269322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:43.271308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:43.279061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14bf133a-21d7-4bcf-a3a6-39bfe9d21422 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.261676 Aug 30 16:26:43.280773 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2152/4646] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:43 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:43.668867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:43.669714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:43.692166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:43.692679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:43.693131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:43.693867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:43.703895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:43.704784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.000405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.010279 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de81e824-9080-419a-b68e-c73bc4353c5f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.345607 Aug 30 16:26:44.019894 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2495/4647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:43 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:44.034250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:44.035128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:44.045548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.046253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.047016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.047973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.048665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.049367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.090955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:44.092339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:44.118902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.122076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.122802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.124273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.126704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.127386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.165098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.183729 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92d8ef1b-d66d-48ea-b29d-6bbc8f004906 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1210 microversion: 2.1 time: 0.151237 Aug 30 16:26:44.185113 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2153/4648] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:44 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:44.307549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:44.309096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:44.320037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:44.331286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.334265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.334761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.338499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:44.339413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:44.346475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:44.475972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.490315 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2970577-917d-49e3-a7a8-661aa934cce2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1683 microversion: 2.1 time: 0.406222 Aug 30 16:26:44.490919 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2496/4649] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:44 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1683 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:44.516270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-599794099", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:44.560891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.570918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.573568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:44.575434 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa425377-166f-480f-9f0d-6af487c52276 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1366 microversion: 2.57 time: 0.271933 Aug 30 16:26:44.576924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2154/4650] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:44 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:26:44.641787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] validate_networks() for None {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:26:45.044175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:45.045545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:45.076305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.080986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.085549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.100199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.102043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.102878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.131289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:26:45.132665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:26:45.133589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:26:45.135399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:26:45.136345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:26:45.162740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.164900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.166719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.170814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.171653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.172311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.213603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Getting quotas for project 536291f197474cc0b48341bd6b9faf39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:26:45.223648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Getting quotas for user 429c39f1a4e84536b79a0a473ae313de and project 536291f197474cc0b48341bd6b9faf39. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:26:45.246374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:26:45.250685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:26:45.344233 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ca6eaba-784e-4084-a34a-3dc2420ef73a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843915 Aug 30 16:26:45.350445 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2497/4651] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:26:45.353960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:45.354629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:45.373007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.377042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.377042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.377294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:45.377791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:45.378126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:45.719078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:45.729713 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5fb3bfdd-bf46-43f3-8aba-9891f9ea1049 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.691541 Aug 30 16:26:45.739206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2155/4652] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:45 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:45.756440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ced8efbe-868c-4c07-b2e4-6e80bedf6269 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:45.768567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ced8efbe-868c-4c07-b2e4-6e80bedf6269 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:46.386202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.398613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-872d92a0-9fed-47c2-9123-73fbebe79ab6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1272 microversion: 2.1 time: 1.052147 Aug 30 16:26:46.408560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2498/4653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:45 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1272 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:46.428757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:46.433797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:46.467904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.470968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.472511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.477635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.481541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.482356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.574881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ced8efbe-868c-4c07-b2e4-6e80bedf6269 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.585070 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ced8efbe-868c-4c07-b2e4-6e80bedf6269 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1214 microversion: 2.1 time: 0.837926 Aug 30 16:26:46.607597 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2156/4654] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:45 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1214 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:46.614016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:46.619793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:46.636344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.647781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.648486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.649405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.650114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.651080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.685050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.698131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3721eafe-c66a-4792-af77-9947852e1376 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1615 microversion: 2.1 time: 0.272045 Aug 30 16:26:46.698863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2499/4655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:46 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1615 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:46.764108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:46.764987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:46.782638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.783160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.783613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.784346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:46.791673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:46.792229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:46.836945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.848021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.862485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:46.865952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d090ae18-98fe-4c1e-937a-3f6c53805842 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1372 microversion: 2.57 time: 0.255204 Aug 30 16:26:46.882995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:46.883102 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2157/4656] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:46 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:47.233446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:47.246735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-01b4b893-c368-4dfc-b49f-bd44b3248a3e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.487042 Aug 30 16:26:47.249271 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2500/4657] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:46 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:47.429107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:47.429730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:47.454050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.454714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.455186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.455941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.456557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.457060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.607449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61857f0-1416-4611-9858-4553cd016785", "name": "network-vif-deleted", "tag": "dfb7769b-39ee-4527-9137-4d40b18018cb"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:47.631672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.634773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.635426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.667010 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] Creating event network-vif-deleted:dfb7769b-39ee-4527-9137-4d40b18018cb for instance e61857f0-1416-4611-9858-4553cd016785 on n-h1-830883-28 Aug 30 16:26:47.676673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3832ff63-e6cc-44ea-b850-a8d440c98e45 req-d04a4675-83e1-4185-8874-0c4da717f07a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076950 Aug 30 16:26:47.679129 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2501/4658] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:47.691407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:47.696524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:47.715874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.719121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.719121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.720275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.721837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.722456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.904812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:47.912787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-efff61ca-b797-4cbe-bff1-f273c5f07d7a tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1266 microversion: 2.1 time: 0.231383 Aug 30 16:26:47.913384 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2502/4659] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:47 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:47.963651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:47.964818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:47.976576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.977289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.978241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.979287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:47.980410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:47.981020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:47.997308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.014445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05fbc5b1-9e1e-44ee-91b2-65277ebcd128 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.589188 Aug 30 16:26:48.036206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2158/4660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:47 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:48.062085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.063035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.092024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.092551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.096616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.099227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.099718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.102208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.152135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.152469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.152928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.153394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lazy-loading 'fault' on Instance uuid e61857f0-1416-4611-9858-4553cd016785 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:48.232189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.241991 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ded61eb5-ecc2-4566-96d5-e62d283b03ef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 200 len: 1332 microversion: 2.1 time: 0.327581 Aug 30 16:26:48.242822 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2503/4661] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:47 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 1332 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:48.270938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.271579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.292244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.292244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.292576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.293905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.294902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.303006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.432921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.452242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.453804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.468468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8974e58-8382-4ecd-8736-795a3cc2d30c tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1357 microversion: 2.57 time: 0.428572 Aug 30 16:26:48.479054 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2159/4662] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1357 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:48.499779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.504753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.526617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.535057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.535789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.536721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.537350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.537960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.608089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:48.692905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:48.711961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab9df4ea-61a8-4cbc-beb3-348596fefc43 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.443609 Aug 30 16:26:48.713405 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2504/4663] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:48.839587 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5e85446-9cb9-40d2-8a51-386cbadf64e3 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 204 len: 0 microversion: 2.57 time: 0.343365 Aug 30 16:26:48.841466 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2160/4664] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:26:48 2022] DELETE /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:26:48.874392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.875728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.887917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.888419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.888866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.903461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.904261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.904879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.941331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:48.946208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:48.971391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.972285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.972972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:48.975225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:48.976448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:48.977131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.126680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:49.135342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:49.147805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:49.149081 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e77ee29-209f-4309-9ea4-e771ebcbb523 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1363 microversion: 2.57 time: 0.303422 Aug 30 16:26:49.170333 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2505/4665] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:49.170333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:49.170333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:49.219788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.227097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.227764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.229410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.231690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.232213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.350627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:49.360817 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d60cb15-c4e1-4ae1-a14d-363ce745b4bf tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1274 microversion: 2.1 time: 0.424500 Aug 30 16:26:49.377958 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2161/4666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:48 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1274 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:49.416041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:49.419138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:49.450450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.451440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.471525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.473292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.475593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.478752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.554474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 HTTP/1.1 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e61857f0-1416-4611-9858-4553cd016785'} Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:49.564290 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:26:49.569574 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:49.571470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:49.573290 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fbd1399f-60ef-4ddd-83ac-f2653fc10f59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 404 len: 111 microversion: 2.1 time: 0.193272 Aug 30 16:26:49.574408 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2162/4667] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:49 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:26:49.589834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1d97b09-0a82-45a7-ac3c-f7963e970ed0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '.version_select at 0x7fd360fee790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:49.646807 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1d97b09-0a82-45a7-ac3c-f7963e970ed0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300219849" status: 202 len: 0 microversion: 2.1 time: 0.066172 Aug 30 16:26:49.647817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2163/4668] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:26:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300219849 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:26:49.736241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:49.737258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:49.755341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.758829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.759799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.760925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:49.763976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:49.765451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:49.843970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:49.864699 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fee9c040-885b-4af9-8037-8c696b2053cc tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.703880 Aug 30 16:26:49.867858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2506/4669] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:49 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:50.187421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:50.188224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:50.204485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.205365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.206580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.208886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.209611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.210264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.463687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:50.480859 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-76d3e30d-40e0-4eee-a37e-895975311339 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.750582 Aug 30 16:26:50.492898 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2164/4670] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:49 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:50.508170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:50.509034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:50.523764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.532561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.534570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.534570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.537025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.539137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.560892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:50.574552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:50.576014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:50.579663 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fde7766a-6d96-4180-8756-e6742324404b tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1363 microversion: 2.57 time: 0.397322 Aug 30 16:26:50.583313 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2507/4671] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:50 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:50.589175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:50.589677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:50.611403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.611916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.612371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.613091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.613578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.613997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.683787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fdfd955c-0bf2-41f0-bc36-28a51f4ba793 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/21cc8d2b-6b0c-409b-b294-d4ec9466801e" status: 200 len: 194 microversion: 2.1 time: 0.098746 Aug 30 16:26:50.690785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2508/4672] 10.222.0.47 () {58 vars in 1413 bytes} [Tue Aug 30 16:26:50 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/21cc8d2b-6b0c-409b-b294-d4ec9466801e => generated 194 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:50.700196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:50.710540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:50.718121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.718936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.719546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.720437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.731157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.732303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.771953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:50.784837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6e354f1-226d-47e9-bc23-cc0a8c2d75b4 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1272 microversion: 2.1 time: 0.289720 Aug 30 16:26:50.786553 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2165/4673] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:50 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:50.874294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc5cf91-32c2-495d-b8aa-8774bbd3af36", "tag": "9dfc2a28-9caf-475b-baf2-3334c58d8b2e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:50.905248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:50.906846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:50.908633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:50.959199 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] Creating event network-changed:9dfc2a28-9caf-475b-baf2-3334c58d8b2e for instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 on n-h2-830883-28 Aug 30 16:26:50.965378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lazy-loading 'services' on Instance uuid b0e7356c-07a4-4e80-8bba-cda2c84d8d92 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:26:50.987142 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5620ee91-684b-4e04-9430-c6015cb232ec req-b905791a-ef22-46ce-bd6e-72c6e7f7b880 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116920 Aug 30 16:26:50.991980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2166/4674] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:26:51.007883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:51.019879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:51.042241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.044725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.045179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.047814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.048957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.049557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.116743 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfa46e02-cc13-482c-a8e2-3657052e0160 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/21cc8d2b-6b0c-409b-b294-d4ec9466801e" status: 202 len: 0 microversion: 2.1 time: 0.420025 Aug 30 16:26:51.117745 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2509/4675] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:26:50 2022] DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments/21cc8d2b-6b0c-409b-b294-d4ec9466801e => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:26:51.390093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:51.399285 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bdd7597b-ebf0-455d-8167-a872adf1c35c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.405763 Aug 30 16:26:51.400725 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2167/4676] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:50 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:51.515067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:51.516118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:51.534269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.535196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.536620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.543109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.543608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.544055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.614659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:51.615291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:51.623451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.636549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.637292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.638221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.643288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.644074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:51.923182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:51.938267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:51.941846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e92ecb6d2c8144978eda6d14fd36afaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8542f6143177438daac3358a60bb760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:51.946908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a321b982-7f08-44ec-ae59-8f18ef285ac7 tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 200 len: 1363 microversion: 2.57 time: 0.341151 Aug 30 16:26:51.951826 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2168/4677] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:51 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:51.960963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:51.966096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:51.995771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:51.996298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:51.999684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:52.002950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:52.004113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:52.004113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:52.220397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:52.235683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb225a40-266c-4054-ac31-9ff91fa0c3b3 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1272 microversion: 2.1 time: 0.282624 Aug 30 16:26:52.250709 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2169/4678] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:51 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:52.395837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:52.406878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8d9eb79-c666-4355-8fa2-2e5aaa40c087 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.897057 Aug 30 16:26:52.415077 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2510/4679] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:51 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:52.422560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:52.423887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:52.446160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:52.449666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:52.454089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:52.471771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bf70f4d2-2e74-47ab-8f7b-d94a367ef54c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: .version_select at 0x7fd357d07280>, body: {"keypair": {"name": "tempest-keypair-452914495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi+mRh0CJH96c+yL+rxfKmRSvXEbIcQi6U3DY4hNfjlnLz5uWN+VUN3St9KefB32gE3+QKFwq5nvn3uW5S6jaiJziZ21sTr3itTBnaR/ZHNnhhfzMwjkpj1eXcGHZUvHA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:52.480726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:52.482391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:52.482970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:52.527770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-bf70f4d2-2e74-47ab-8f7b-d94a367ef54c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:26:52.559981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-bf70f4d2-2e74-47ab-8f7b-d94a367ef54c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:26:52.639971 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bf70f4d2-2e74-47ab-8f7b-d94a367ef54c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.175955 Aug 30 16:26:52.641314 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2511/4680] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:26:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:52.714575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:52.851509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:52.854520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:52.867102 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-019eb99a-ec3b-40a6-99e2-de756974a185 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.449952 Aug 30 16:26:52.869520 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2170/4681] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:52 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:52.970561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:52.971061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] [instance: bcbcf8d2-b364-496b-9270-9c761764b0c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:52.981876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:52.982409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:52.982865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:52.983590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:52.984056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:52.984493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.034354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] HTTP exception thrown: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Request method failure captured: Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 HTTP/1.1 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjohl6q4taaK_BYUVLaAo1v0HewcLUyurVADNpov9-MXs0Mkk9RAR-Qg7g_kBnK-1h6mzg3Rpl9LiTHTRKu2fkTuqEyfC6Bd1S0292H_lCeyBEDkNdYFdzRZRPXkpABzCtiw0waYJVoyvspllN_-VJrOO--MBdjhRKAiNWXYcJGywOQ Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.57 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8542f6143177438daac3358a60bb760b Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerShowV257Test-1877484644 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8542f6143177438daac3358a60bb760b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8542f6143177438daac3358a60bb760b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8542f6143177438daac3358a60bb760b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8542f6143177438daac3358a60bb760b"}]}] Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerShowV257Test-1877484644 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8542f6143177438daac3358a60bb760b Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerShowV257Test-1877484644 Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerShowV257Test-1877484644-project Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e92ecb6d2c8144978eda6d14fd36afaa Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerShowV257Test-1877484644-project Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bcbcf8d2-b364-496b-9270-9c761764b0c6'} Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:26:53.041706 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. Aug 30 16:26:53.045885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:26:53.049651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] Returning 404 to user: Instance bcbcf8d2-b364-496b-9270-9c761764b0c6 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:26:53.051255 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5fbdedd5-5e3f-4460-8ef3-10dcd40a0bcd tempest-ServerShowV257Test-1877484644 tempest-ServerShowV257Test-1877484644-project] 10.222.0.47 "GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6" status: 404 len: 111 microversion: 2.57 time: 0.085287 Aug 30 16:26:53.056792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2171/4682] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:52 2022] GET /compute/v2.1/servers/bcbcf8d2-b364-496b-9270-9c761764b0c6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:26:53.132747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:53.133267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:53.160336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.160845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.161443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.162023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.162522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.162960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.253316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:26:53.257325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:53.258711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:53.272916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.274335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.276652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.278479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.279042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.280751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.624874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8d3cc5c-d5bf-4673-9db3-d49b18f1fbe2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 204 len: 0 microversion: 2.42 time: 0.982002 Aug 30 16:26:53.625538 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2512/4683] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:26:52 2022] DELETE /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:26:53.631387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:53.632124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:53.652952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.653637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.654091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.654854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.655313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.655746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.715981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:53.748854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-728c8371-666d-4797-8c9e-cc1f7a76443b tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.496016 Aug 30 16:26:53.750600 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2172/4684] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:53 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:53.759824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:53.760445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:53.791680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.792264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.792701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:53.793410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:53.793867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:53.794294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:54.090003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:54.107463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e28a34da-85af-47b5-b5ff-6e58e8a05f27 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.476253 Aug 30 16:26:54.110254 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2513/4685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:53 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:54.130901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:54.131992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:54.135044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:54.142623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:54.143881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:54.144579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:54.145489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:54.146136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:54.146794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:54.578782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:54.596784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3657e4da-be77-4afe-b994-d05d31ce02d0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.472453 Aug 30 16:26:54.598176 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2514/4686] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:54 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:54.662475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:54.666553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16becea-fdcc-4639-b9fd-161f08276282", "tag": "52028b2b-78f2-43a5-bf31-57e738d40114"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:54.679577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:54.694959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:54.702604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21582f06-d79d-4177-bdca-172dfa328ee3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2961 microversion: 2.42 time: 0.945082 Aug 30 16:26:54.704837 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2173/4687] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:53 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2961 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:54.705611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:54.710111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:54.710111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:54.763356 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] Creating event network-changed:52028b2b-78f2-43a5-bf31-57e738d40114 for instance b16becea-fdcc-4639-b9fd-161f08276282 on n-h1-830883-28 Aug 30 16:26:54.768986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:54.769601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:54.777567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:54.778055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:54.778526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:54.779213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:54.779671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:54.783430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1076babd-9c81-4c40-be3d-f31e8c503534 req-465a21d3-7fe1-4ac7-ab67-65bf6eef9f92 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124337 Aug 30 16:26:54.784163 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2515/4688] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:54.787791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.136699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:55.137402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:55.153399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.153898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.154360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.155072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.155529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.155956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.201539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:55.202714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:55.385425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:55.410512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ba19da4-7886-4d16-95f9-144825c4ec0c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.278543 Aug 30 16:26:55.411108 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2516/4689] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:55 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:55.623046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:55.623734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:55.636331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:55.640560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.641422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.643083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.646702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.647425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.648295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.651630 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bec333ef-ac49-4548-8887-1e46cc72d26f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.886419 Aug 30 16:26:55.652231 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2174/4690] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:54 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:55.732362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:55.732974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:55.746460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.746961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.747407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:55.748113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:55.748570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:55.749003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:56.114021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:56.129259 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd850c74-1db3-4a8f-9ead-a366692cef9f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.513857 Aug 30 16:26:56.131119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2517/4691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:55 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:56.291405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:56.309910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:56.314419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:56.318895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a552f67-1c7d-4a9d-8836-3b4957cea23e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2961 microversion: 2.42 time: 0.588422 Aug 30 16:26:56.324189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2175/4692] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:55 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2961 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:56.434964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:56.435937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:56.459012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:56.460780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:56.465002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:56.466038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:56.466736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:56.468581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:56.690315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:56.726217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:56.770351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:26:56.773745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:56.774517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:56.775176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:56.776296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:56.776915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:56.778545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.459053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:57.470717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-905fee4c-fe22-468e-9ca6-9c043739e328 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 1.041020 Aug 30 16:26:57.471328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2518/4693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:56 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:57.500428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:57.501054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:57.511624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.514371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.515113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:57.516591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:57.518959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:57.519652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.125484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.136192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3f229d6-e5a4-4ca6-8535-21af3788b080 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.639518 Aug 30 16:26:58.139850 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2519/4694] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:57 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:58.148620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:58.151174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:58.165326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.166093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.167946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.169075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.170038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.170690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.557767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.588467 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-305a6bf5-c90a-4e1c-aaa6-6b5af9f124a6 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 1.917654 Aug 30 16:26:58.596389 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2176/4695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:56 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:58.606655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:58.611020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:58.617494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.624177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.626885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.627502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.628950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:58.630594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:58.632228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.632868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:58.633684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.635589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12e21dc9-25a2-43db-9533-2018f7f3affb tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2961 microversion: 2.42 time: 0.494578 Aug 30 16:26:58.636158 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2520/4696] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:26:58 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2961 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:26:58.845846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-480695896", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76"}], "security_groups": [{"name": "tempest-securitygroup--1869860513"}], "key_name": "tempest-keypair-452914495", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:58.886041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:58.923316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84812f70-cf84-448e-849d-7a85d6d4fb55 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1509 microversion: 2.1 time: 0.324959 Aug 30 16:26:58.924966 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2177/4697] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:58 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:26:59.161877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:59.162557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:59.187254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:59.187770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:59.188219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:59.189146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:59.189812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:59.190493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:59.229774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] validate_networks() for [('7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:26:59.672929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:26:59.693765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7265ea3-97c1-41d8-8e4f-5de84455644d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.535153 Aug 30 16:26:59.711109 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2178/4698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:59 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:26:59.729485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc5cf91-32c2-495d-b8aa-8774bbd3af36", "name": "network-vif-plugged", "status": "completed", "tag": "9dfc2a28-9caf-475b-baf2-3334c58d8b2e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:26:59.779547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:59.780028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:59.780459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:59.814327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] Creating event network-vif-plugged:9dfc2a28-9caf-475b-baf2-3334c58d8b2e for instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 on n-h2-830883-28 Aug 30 16:26:59.835791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6ab059b6-bdfc-432c-ab33-b128dd68d6a8 req-909fffd7-eee0-4c84-9684-d61eea527d77 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122880 Aug 30 16:26:59.836441 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2179/4699] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:26:59.843441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:26:59.844149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:26:59.857727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:59.858230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:59.863639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:26:59.865466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:26:59.865994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:26:59.866469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.386809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:00.387297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:00.387909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:00.388192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:00.388700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:00.413558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.413927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.414406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.415182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.427228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.433535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.485562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:00.494404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:00.515088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:00.517467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:00.581129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:00.594510 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd109a90-e89a-4bb4-bb35-2b9e18fbf643 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.754545 Aug 30 16:27:00.595344 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2180/4700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:26:59 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:00.609556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.611066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.621585 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f12dfa13-ad7c-4e11-b2bd-42524faf2009 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.780037 Aug 30 16:27:00.627397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.628263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.629068 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2521/4701] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:26:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:27:00.630828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.632845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.633693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.634896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.646019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:00.646993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:00.662382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.663126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.664229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.676004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:00.677083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:00.677083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:00.994271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.038995 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f08150d4-4ab4-494a-b288-f5972c9b1088 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1506 microversion: 2.1 time: 0.408238 Aug 30 16:27:01.042850 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2522/4702] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:00 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:01.058152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8306a20c-fe4f-470c-8867-f5be5c82f5c0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:01.058152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8306a20c-fe4f-470c-8867-f5be5c82f5c0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:01.133338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8306a20c-fe4f-470c-8867-f5be5c82f5c0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.144957 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8306a20c-fe4f-470c-8867-f5be5c82f5c0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1240 microversion: 2.1 time: 0.100973 Aug 30 16:27:01.146881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2523/4703] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:01 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:01.152708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:01.153683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:01.188131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.189838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.191340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.193370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.194130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.195073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.538691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.551463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.554533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.556445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:01.558211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2b6ad04-4204-49de-8ac5-75bde949e168 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2940 microversion: 2.42 time: 0.958324 Aug 30 16:27:01.573129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2181/4704] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:00 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2940 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:01.590748 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89c54254-f7c5-44eb-a2d9-8c0e6b292f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1314 microversion: 2.1 time: 0.442146 Aug 30 16:27:01.591360 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2524/4705] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:01 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:01.621571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:01.622721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:01.630657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.631598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.632381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.633654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.634859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.635675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.701273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:01.705197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:01.717108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.717943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.718704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.719871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:01.720580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:01.721313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:01.807761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c12c2024-eb47-48dd-924c-c1a95a6f3b47 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112479 Aug 30 16:27:01.811063 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2525/4706] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:27:01 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:27:01.967483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-unplugged", "status": "completed", "tag": "318073c3-10ec-444f-8ce0-6268c151f684"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:01.997059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.005066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.005662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.032607 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] Creating event network-vif-unplugged:318073c3-10ec-444f-8ce0-6268c151f684 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:02.048347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-db6f5f06-6271-4248-b0ce-6564b0a90b42 req-76828f53-942a-4238-aee4-35234c808602 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085007 Aug 30 16:27:02.050652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2526/4707] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:02.061340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.063632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.076865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.077359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.077810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.078537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.078995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.085406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.120765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68337e7b-59c8-404b-8b01-940fcaa3b809 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068865 Aug 30 16:27:02.126914 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2527/4708] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:27:02 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:27:02.126914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.127317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.133494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.134646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.135053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.135794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.136259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.136688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.316327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:02.329563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a985b86-6415-42cb-b8ed-0720941e8915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1506 microversion: 2.1 time: 0.206605 Aug 30 16:27:02.343306 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2528/4709] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:02 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:02.360841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.361860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.387067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.389320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.390127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.391103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.393855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.395197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.500693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:02.515519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c916000-71af-4612-9437-ad6d1dc6daba tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1292 microversion: 2.1 time: 0.170272 Aug 30 16:27:02.517232 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2529/4710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:02 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1292 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:02.523416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.524504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.538869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.539375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.540117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.549912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.550482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.551846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.604631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:02.763051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79365929-b148-4877-a0eb-44071f8ef6d4 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 204 len: 0 microversion: 2.1 time: 0.243980 Aug 30 16:27:02.767449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2530/4711] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:02 2022] DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:02.776214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.776986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.795285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.795803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.796256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.798569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.799001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:02.799803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.800435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.821154 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-07ae19a1-802e-4856-8944-e4838f823d53 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 1.204558 Aug 30 16:27:02.822820 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2182/4712] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:01 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:02.840965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:02.842221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:02.863034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.863872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.867217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:02.868141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:02.869681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:02.871316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.108583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.126337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.131533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.140761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7c01097-bc6f-416b-bd6e-851ffcf3f81e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2919 microversion: 2.42 time: 0.371888 Aug 30 16:27:03.159615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2531/4713] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:02 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2919 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:03.170359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:03.171262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:03.185490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.187909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.189133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.190614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.191333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.196291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.499329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.502084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:03.513578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8e225f9-b43a-4a10-b341-3734959bad18 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1672 microversion: 2.1 time: 0.351187 Aug 30 16:27:03.514184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0a4843f2-0350-473f-a552-f490449bd9b8 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1500 microversion: 2.1 time: 0.686614 Aug 30 16:27:03.516093 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2183/4714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:02 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1500 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:03.521071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:03.529493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:03.542435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2532/4715] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:03 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:03.542930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:03.543672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:03.544964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.545589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.546266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.547338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.549452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.553639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.554423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.554744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.554942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:03.556268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:03.557318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:03.558021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.082863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:04.091193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:04.099485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c3cf024-f358-48bb-a6d5-1dba8a1089ac tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1298 microversion: 2.1 time: 0.563490 Aug 30 16:27:04.126150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2533/4716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:03 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1298 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:04.142790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:04.171490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.172529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.173084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.262656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:27:04.395450 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77a67356-63e4-4981-8e76-27040694808d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36/action" status: 202 len: 0 microversion: 2.1 time: 0.266968 Aug 30 16:27:04.396291 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2534/4717] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:27:04 2022] POST /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:04.410854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:04.411922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:04.431737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.432406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.433088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.433875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.434486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.435073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.731838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:04.744983 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34d715f5-102e-42b6-9ac9-57f4709c1fd3 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1506 microversion: 2.1 time: 1.227499 Aug 30 16:27:04.749168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2184/4718] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:03 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1506 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:04.780188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:04.781446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:04.797724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.798234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.801380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.802165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.802668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:04.803108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:04.929852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:04.940395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62a81311-fb13-4f4f-8179-f1ecd931fb6d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.542649 Aug 30 16:27:04.946213 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2535/4719] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:04 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:04.964478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-unplugged", "status": "completed", "tag": "52e68554-301a-4a5b-ab8e-a8f37c914c6b"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-unplugged", "status": "completed", "tag": "5bc6f1b1-48e4-40be-85bc-dfeba68ac3df"}, {"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-unplugged", "status": "completed", "tag": "d28bb004-9061-4c27-8b2a-bd4d3cc48ede"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:04.998109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:04.998975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.003037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.037417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Creating event network-vif-unplugged:52e68554-301a-4a5b-ab8e-a8f37c914c6b for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:05.045584 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Creating event network-vif-unplugged:5bc6f1b1-48e4-40be-85bc-dfeba68ac3df for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:05.046747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] Creating event network-vif-unplugged:d28bb004-9061-4c27-8b2a-bd4d3cc48ede for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:05.065679 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e4dcf2ca-f162-41cb-985b-2ee4a1807ba8 req-ffa6ff66-cd47-4d18-8ecf-f392d1611566 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117789 Aug 30 16:27:05.069152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2536/4720] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:05.082542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.084951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.102277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.102891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.103444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.106742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.112109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.112749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.198753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.215068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.233380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.234887 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94bac24f-2743-41ae-8a56-3d23787cfd49 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2919 microversion: 2.42 time: 0.484234 Aug 30 16:27:05.235802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2185/4721] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:04 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2919 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:05.240543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.241388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.262533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.263415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.264017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.265009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.265633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.266220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.436531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.450551 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3adbc6bc-e330-476d-aee7-7d56c6fd98b3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.379344 Aug 30 16:27:05.467514 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2537/4722] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:05.472476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.473106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.494096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.494735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.495089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.504706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.505248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.505704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.815446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.826006 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a5ed356-b71d-42f1-8791-eb89c30f5f5a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1672 microversion: 2.1 time: 0.589146 Aug 30 16:27:05.842720 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2186/4723] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1672 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:05.854954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.856039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.872093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.877240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.877704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.878483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.879121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.879729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.888308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:05.911530 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f198b3ca-e1df-4196-82ae-76fbe950b386 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.441039 Aug 30 16:27:05.912813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2538/4724] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:05.977024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:05.979334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:05.988679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.989111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.989923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:05.992682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:05.994262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:05.995146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.363852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:06.387275 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-604e62f6-ff44-43da-972e-f31b503f4a1c tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.415154 Aug 30 16:27:06.406128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2539/4725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:06.411725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:06.415581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:06.423579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.424077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.424509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.425415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.426046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.426677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.594630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:06.606601 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f082c846-cc11-486f-883b-888fa62ffca4 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1506 microversion: 2.1 time: 0.762182 Aug 30 16:27:06.607775 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2187/4726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:05 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:06.613035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5281e689-fa01-447f-a37e-e51da7e0b8be", "tag": "ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:06.625222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.626172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.627769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.647953 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] Creating event network-changed:ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc for instance 5281e689-fa01-447f-a37e-e51da7e0b8be on n-h1-830883-28 Aug 30 16:27:06.653937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-64982aa1-71d0-4798-9d9c-72e97e2fb128 req-304410c5-a7a2-4f47-992a-ab49688c6965 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044501 Aug 30 16:27:06.655233 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2188/4727] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:06.662458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:06.663465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:06.673031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.673675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.675164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.676152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.676743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.677289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.695611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:06.701374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:06.712698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:06.715461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:06.737876 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-182c6951-0bd4-411f-9d68-eefb80b274e0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2872 microversion: 2.42 time: 0.329896 Aug 30 16:27:06.755224 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2540/4728] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:06 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2872 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:06.755224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-deleted", "tag": "55474cec-b9bf-4649-bf10-bfc28a66716a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:06.770115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.770566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.775321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.790725 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] Creating event network-vif-deleted:55474cec-b9bf-4649-bf10-bfc28a66716a for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:06.799474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b3e3d900-a0b4-4844-b0d7-d94b17977bbc req-33cf74aa-fde9-4005-a0df-b3d6ffc6e7d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051857 Aug 30 16:27:06.802780 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2541/4729] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:06.872535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:06.880306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:06.913426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.914195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.914888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:06.916496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:06.917143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:06.917756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.131427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:07.143703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d330603-cc04-4271-85e8-80b051de43ed tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1672 microversion: 2.1 time: 0.291984 Aug 30 16:27:07.144609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2542/4730] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:06 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1672 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:07.150811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:07.151661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:07.158865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.158865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.159206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.160031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.160798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.161243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.164457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:07.176252 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ca20586-cf97-42e5-a7a4-420a5ca92e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.519318 Aug 30 16:27:07.177189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2189/4731] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:06 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:07.185031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-unplugged", "status": "completed", "tag": "55474cec-b9bf-4649-bf10-bfc28a66716a"}, {"server_uuid": "b16becea-fdcc-4639-b9fd-161f08276282", "name": "network-vif-plugged", "status": "completed", "tag": "52028b2b-78f2-43a5-bf31-57e738d40114"}, {"server_uuid": "c7a9d4a5-659c-4c3b-9e93-9bead59bebc0", "name": "network-vif-unplugged", "status": "completed", "tag": "5198bb7a-b599-4680-90be-963f3690eef0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:07.220977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.222578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.227128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.244485 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Creating event network-vif-unplugged:55474cec-b9bf-4649-bf10-bfc28a66716a for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:07.245259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Creating event network-vif-plugged:52028b2b-78f2-43a5-bf31-57e738d40114 for instance b16becea-fdcc-4639-b9fd-161f08276282 on n-h1-830883-28 Aug 30 16:27:07.245907 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] Creating event network-vif-unplugged:5198bb7a-b599-4680-90be-963f3690eef0 for instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 on n-h2-830883-28 Aug 30 16:27:07.257443 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cc4476f1-89e4-4d60-abf0-2126b2e7f5ff req-3c778928-e5b8-4503-9861-c5c12edd3cf4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.078665 Aug 30 16:27:07.258803 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2190/4732] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:07.340427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:07.348498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a208845-80cb-4aed-aa7b-524053fb8fa3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.202646 Aug 30 16:27:07.349095 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2543/4733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:07 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:07.413577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:07.414295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:07.422652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.423159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.423601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.424316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.424777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.425210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.629564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:07.630278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:07.645708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.646506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.646945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.647647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.648108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.648519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.839566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:07.854126 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-420098b7-59f2-427c-9b9c-2793ea6df37c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1506 microversion: 2.1 time: 0.228305 Aug 30 16:27:07.855081 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2544/4734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:07 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:07.883364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:07.884268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:07.897910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:07.912404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7eabdbbf-f4f6-49f9-b6fd-2098510b82d2 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.502966 Aug 30 16:27:07.912871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.913314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2191/4735] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:07 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:07.913481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.913887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:07.914633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:07.917135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:07.918783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.166030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.166696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.177676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.178653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.187993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.189046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.189922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.190598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.254944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:08.266638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:08.270605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:08.272305 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62cd16f6-7367-44cd-9030-dfde788d7468 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2758 microversion: 2.42 time: 0.415992 Aug 30 16:27:08.283091 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2545/4736] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:07 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2758 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:08.302752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.314335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:08.315113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.321846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-060227ef-17ef-49d0-b010-4a93899e3f2a tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1605 microversion: 2.1 time: 0.160068 Aug 30 16:27:08.323449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2192/4737] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:08 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:08.339337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.341970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.342538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.343420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.344093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.344778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.372600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.373212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.385577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.386469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.388254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.389225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.390843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.393073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.675531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:08.688780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bfff08a9-18a3-4ca3-9dbd-5e77762fca16 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.404228 Aug 30 16:27:08.689521 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2546/4738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:08 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:08.844220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-deleted", "tag": "52e68554-301a-4a5b-ab8e-a8f37c914c6b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:08.865276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.865939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.866433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.891344 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] Creating event network-vif-deleted:52e68554-301a-4a5b-ab8e-a8f37c914c6b for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:08.897542 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ae07f5dc-191b-4187-8150-ea7fe2f3fbb3 req-35b47ca4-7bac-45c1-b375-444086587aed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056928 Aug 30 16:27:08.898565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2547/4739] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:08.906169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:08.906987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:08.917938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.918709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.919232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:08.919998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:08.920666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:08.921263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.036339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.050796 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11093cba-9c25-48d5-862a-acf393c89023 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.682306 Aug 30 16:27:09.068713 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2193/4740] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:08 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:09.074983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.075838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.086762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.089147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.090043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.092902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.094452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.096401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.373760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.386153 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fcab203b-8248-48c3-ae5d-7350d1052ca6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 200 len: 1449 microversion: 2.1 time: 0.486010 Aug 30 16:27:09.386914 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2548/4741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:08 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 1449 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:09.393916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.395222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.403527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.404121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.404572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.405602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.406064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.406580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.520880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.554288 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c4d3aa34-9cb7-457d-a555-8a8693dcba0d tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1314 microversion: 2.1 time: 0.473957 Aug 30 16:27:09.575590 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2194/4742] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:09.591437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.594995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.613270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.617800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.622714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.625178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.626614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.628798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.733519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.734279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.734961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.735570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lazy-loading 'fault' on Instance uuid b0e7356c-07a4-4e80-8bba-cda2c84d8d92 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:09.875174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8088798e433c4056be1b6ec5d67cbc29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8253158502424d52b6415ec18e55be2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.903333 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7926bc8-6c65-49f3-9742-1d5387ffcbae tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 200 len: 1326 microversion: 2.1 time: 0.324279 Aug 30 16:27:09.910016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.911150 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2195/4743] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 1326 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:09.927677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.929156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:09.930440 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cbbeee7-677e-4695-bcd2-7aab861ac9d2 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2597 microversion: 2.42 time: 0.542219 Aug 30 16:27:09.931907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.932517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.940271 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2549/4744] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2597 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:09.945923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:09.952689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:09.957594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.958126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.958686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.959470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.959931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.960736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.973498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.974013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.974493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:09.975739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:09.976382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:09.976986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.459030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:10.493916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:10.502869 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93413b77-c0b9-4dbe-b09b-13399a7c442c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.561027 Aug 30 16:27:10.504159 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2550/4745] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:10.511193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:10.513729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:10.523478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.524986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.526058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.527064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.527891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.528573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.572186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:10.578994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:10.591958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fee9f5d4-0164-4b37-a558-62551858fa0d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.667504 Aug 30 16:27:10.592559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2196/4746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:09 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:10.613194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:10.620648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:10.645941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.647980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.648630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.650121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.651165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.651775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.874623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:10.891925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ee8483f-d25c-411c-8a4d-109c93ede701 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.386396 Aug 30 16:27:10.893937 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2551/4747] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:10 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:10.912447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:10.914948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:10.933495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:10.936978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.938552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.939089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.941476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:10.942692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:10.945697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:10.990436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:11.005217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0140a7e1-494d-42b0-a558-03bbbc134480 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1464 microversion: 2.1 time: 0.411602 Aug 30 16:27:11.006006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2197/4748] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:10 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:11.027147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e7356c-07a4-4e80-8bba-cda2c84d8d92", "name": "network-vif-deleted", "tag": "1b1d843f-afaa-49f5-b1f0-48a3901f5073"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:11.053672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:11.057206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.064062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.064884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.106478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] Creating event network-vif-deleted:1b1d843f-afaa-49f5-b1f0-48a3901f5073 for instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 on n-h2-830883-28 Aug 30 16:27:11.124413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-07605510-8701-45de-861f-797b5f099870 req-cc397878-8dcb-4240-9115-5fec13fbaf08 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109665 Aug 30 16:27:11.125724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2198/4749] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:11.135569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:11.136626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:11.143561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.145272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:11.154623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.160530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.161593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.162255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.162937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.239994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 HTTP/1.1 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b0e7356c-07a4-4e80-8bba-cda2c84d8d92'} Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:11.242109 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:11.247020 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:11.248944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:11.250039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04db9eaf-511d-4d6c-b60b-e7dcb8597c88 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 404 len: 111 microversion: 2.1 time: 0.123007 Aug 30 16:27:11.251521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2199/4750] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:11 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:11.268091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:11.268961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:11.280142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.282054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.283411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.286487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.288688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.289161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.732282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:11.750913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:11.755026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:11.760015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0a573f62-e889-4157-82ee-2d459e64be07 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2550 microversion: 2.42 time: 0.507142 Aug 30 16:27:11.762470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2200/4751] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:11 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2550 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:11.806048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:11.807820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:11.826618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.827645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.828339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.831258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:11.833397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:11.834181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:11.863355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:11.916856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:11.963958 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d5cbfc2-9316-474e-96fc-b3e8ab261f58 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 1.064941 Aug 30 16:27:11.969842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2552/4752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:10 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:11.987472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ed218c5-0f32-40e4-85c5-db539e4bff26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '.version_select at 0x7fd357c78b80>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:12.049190 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ed218c5-0f32-40e4-85c5-db539e4bff26 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-711596670" status: 202 len: 0 microversion: 2.1 time: 0.077748 Aug 30 16:27:12.052106 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2553/4753] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-711596670 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:12.073134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:12.074091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:12.075260 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8133ffa-42fa-40cc-8aba-865534bd0b5f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 204 len: 0 microversion: 2.1 time: 0.310643 Aug 30 16:27:12.079453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2201/4754] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:11 2022] DELETE /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:12.083670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.085328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:12.086479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:12.087058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.087985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.089665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.090593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.092105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.095363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.096250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.096706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.097801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.098865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.099497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.504453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:12.515289 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09ce41d5-27c7-4345-a248-3cb44c47e8b4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.434480 Aug 30 16:27:12.518638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2202/4755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:12 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:12.534874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:12.535510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:12.549209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.549712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.550162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.559301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.559815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.560268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.637078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:12.663740 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c45124a7-93db-4c43-ac1b-8ff039a52e67 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.593581 Aug 30 16:27:12.677888 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2554/4756] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:12 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:12.696530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:12.698179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:12.713305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.716084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.718718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:12.720218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:12.721230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:12.723628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:13.029072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:13.051276 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d94db3ed-6f97-4da1-a62e-4e71b2bee08e tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.531218 Aug 30 16:27:13.051958 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2203/4757] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:12 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:13.074070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:13.075063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:13.086561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:13.091036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:13.093141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:13.101639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:13.102688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:13.103484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:13.677592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:13.693419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ff51114-3811-47bd-8ebf-623eca779372 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1470 microversion: 2.1 time: 1.013733 Aug 30 16:27:13.707256 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2555/4758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:12 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1470 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:13.718534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:13.719441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:13.731109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:13.749368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:13.750233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:13.751213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:13.751873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:13.752471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.168484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.189552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.191041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.192523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b8fb3d6-0720-47f8-b616-0327e8f8553a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2503 microversion: 2.42 time: 1.138739 Aug 30 16:27:14.194342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2204/4759] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:13 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2503 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:14.217789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-deleted", "tag": "318073c3-10ec-444f-8ce0-6268c151f684"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:14.240009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.247586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.248383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.269770 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] Creating event network-vif-deleted:318073c3-10ec-444f-8ce0-6268c151f684 for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:14.286106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b7792ca2-a64d-4103-ad86-1207608c9640 req-d9268615-5629-43eb-9ecc-8ae6d9cc1b35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089949 Aug 30 16:27:14.287659 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2205/4760] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:14.302748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:14.306668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.306978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:14.315716 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86312874-d286-469d-ab50-0e957aa66e47 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.606802 Aug 30 16:27:14.321591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2556/4761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:13 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:14.326333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:14.332364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:14.336234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.336988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.337631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.338620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.339312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.339986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.344052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.344551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.345008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.345701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.346162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.346643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.701912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.725458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50bd620f-cc4e-45f6-8a2d-5eb16f5f5d38 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.402091 Aug 30 16:27:14.728367 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2557/4762] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:14 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:14.743975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5281e689-fa01-447f-a37e-e51da7e0b8be", "name": "network-vif-plugged", "status": "completed", "tag": "ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:14.766068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.768822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.770293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.799767 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] Creating event network-vif-plugged:ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc for instance 5281e689-fa01-447f-a37e-e51da7e0b8be on n-h1-830883-28 Aug 30 16:27:14.814067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5e63dab2-a4e3-4605-974a-7e155c1f0469 req-852e11ac-c4e2-4b5c-b8a2-fd7f566746a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078932 Aug 30 16:27:14.814734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2558/4763] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:14.827829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:14.847167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:14.847951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:14.848563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:14.905881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:27:14.991721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:14.995115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:15.011787 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe9f0c4e-213e-4984-be37-6e2141bcebfe tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.719797 Aug 30 16:27:15.015314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2206/4764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:14 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:15.022840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:15.025482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:15.028841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a9312dd-4dbb-4264-9fe2-3fac8f6923e2 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.205780 Aug 30 16:27:15.033015 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2559/4765] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:27:14 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:15.054241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.054917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:15.055312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.056612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.059326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:15.059851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.060978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.061676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.076127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.076897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.077508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.078457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.079092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.079687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.511026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:15.527157 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c415eaa-c6ae-433d-8cdf-fec069a870fa tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.492500 Aug 30 16:27:15.539733 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2560/4766] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:15 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:15.552685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:15.553526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:15.561674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.562331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.564345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.568122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.568777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:15.573810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:15.584098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:15.592929 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe02a9b7-2455-43ac-b875-883965e99def tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1470 microversion: 2.1 time: 0.575078 Aug 30 16:27:15.594899 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2207/4767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:15 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:15.877615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:15.903997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:15.912128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:15.917172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2097580394", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:15.923366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5019fa3-851f-4a53-91fa-cea1cac80b00 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 2213 microversion: 2.42 time: 0.373683 Aug 30 16:27:15.944118 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2561/4768] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:15 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 2213 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:15.960774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:15.964843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:15.997168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:15.998737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.001454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.003155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.003681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.008384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.022730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] validate_networks() for [('41f78965-9e06-49c9-99ac-2886a39ad4ca', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:27:16.259054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:16.286624 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b036e196-62a3-40c4-8528-50a85f33f19b tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.340192 Aug 30 16:27:16.291483 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2562/4769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:15 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:16.299735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.317661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:16.340768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.341839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.342685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.343913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.344689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.345346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.755786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:16.765818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10e5e5f1-e9f2-469d-b630-b4975aa72c5f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1366 microversion: 2.1 time: 0.472916 Aug 30 16:27:16.769365 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2563/4770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:16.776096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-deleted", "tag": "5bc6f1b1-48e4-40be-85bc-dfeba68ac3df"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:16.811842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.812353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.814996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.841178 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] Creating event network-vif-deleted:5bc6f1b1-48e4-40be-85bc-dfeba68ac3df for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:16.851692 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-59b31ced-e8be-4fbf-9d8e-ed15a20e2645 req-8c289406-1132-48a1-900c-ba494b428957 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079051 Aug 30 16:27:16.853137 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2564/4771] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:16.865701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:16.866521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:16.874267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.875742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.876394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.879387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:16.881137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:16.881793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:16.974716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:16.975309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:16.977385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:16.985509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:16.986198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:17.015886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.018250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.018872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.022813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.023454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.024066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.088919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Getting quotas for project 1e61195c24fb4000a372e7fbab7b9fb2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:17.101364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.109359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Getting quotas for user d227c38d5aaf416b806556a431d0cdb0 and project 1e61195c24fb4000a372e7fbab7b9fb2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:17.112791 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79fae1fe-e528-40a9-b911-ba610e81fc08 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.256058 Aug 30 16:27:17.123200 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2565/4772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:16 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:17.129481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.130486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.138575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.139204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.140486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.141058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:17.142654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.143163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.143610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.148079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:17.184960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.185597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.187305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.188256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lazy-loading 'fault' on Instance uuid b16becea-fdcc-4639-b9fd-161f08276282 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:17.255128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '429c39f1a4e84536b79a0a473ae313de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536291f197474cc0b48341bd6b9faf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.264020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11958309-22ca-48aa-ac9b-d54123fbe60f tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 200 len: 1304 microversion: 2.1 time: 0.138096 Aug 30 16:27:17.265512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2566/4773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:17.267816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e89ac47-c740-4d09-9017-8014aaca42ff tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667074 Aug 30 16:27:17.268472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2208/4774] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:27:17.277945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.278592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.284815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.285297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-307db415-ee3c-4ef4-b8d5-99f5406868b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.286410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.287208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.287919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.288554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.289159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.299910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-307db415-ee3c-4ef4-b8d5-99f5406868b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.388903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-307db415-ee3c-4ef4-b8d5-99f5406868b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.399295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.404039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-307db415-ee3c-4ef4-b8d5-99f5406868b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1217 microversion: 2.1 time: 0.127995 Aug 30 16:27:17.411845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2209/4775] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:17.423072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.423732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.425842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.427342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.428545 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7bdba8c-fbab-4ba7-be69-b8bea33918c7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.161928 Aug 30 16:27:17.435845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.436758 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2567/4776] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:17.437005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.437719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.438686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.439864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.440880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.633050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:17.645964 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7ddffba-d9a4-42a2-b6f7-72dee2eba127 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.232724 Aug 30 16:27:17.646606 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2210/4777] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:17.789609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:17.792101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:17.810706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.817691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.819514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:17.822537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:17.823832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:17.824677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.048843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.061571 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d6ad63d-55f7-44a6-baff-0c63182046ab tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1557 microversion: 2.1 time: 0.275885 Aug 30 16:27:18.062882 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2568/4778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:17 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:18.085656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.087516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.107937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.108469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.110714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.112164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.115417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.126962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.137101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.138025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.155922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.156746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.157365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.158371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.159411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.160140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.206086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:18.285258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43166d6d-508f-4729-bff9-789945c6fed1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205966 Aug 30 16:27:18.295081 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2211/4779] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:18.301923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.303269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] [instance: b16becea-fdcc-4639-b9fd-161f08276282] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.313135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.313910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.314552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.316300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.317163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.320590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.342898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] HTTP exception thrown: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Request method failure captured: Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 HTTP/1.1 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjo9T8X9CLZ8xu9xa-FqLq3HqbDERU4AAlzGSFVmSwmxxT6LdCC1GwOHCwu8czTLTLnLgr3E0NETRqSFjU_4Tzx4LHSUDxd7SPfWcMD99cSsphhhKihNrt2N9i3i2xkatI1nBVxsPC0-9Lccv3AsmaYm6dQLHMFeLSKBsni_ytgHAe0 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 536291f197474cc0b48341bd6b9faf39 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesNegativeTest-1660232996 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/536291f197474cc0b48341bd6b9faf39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_536291f197474cc0b48341bd6b9faf39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/536291f197474cc0b48341bd6b9faf39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/536291f197474cc0b48341bd6b9faf39"}]}] Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesNegativeTest-1660232996 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 536291f197474cc0b48341bd6b9faf39 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesNegativeTest-1660232996 Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesNegativeTest-1660232996-project Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 429c39f1a4e84536b79a0a473ae313de Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesNegativeTest-1660232996-project Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b16becea-fdcc-4639-b9fd-161f08276282'} Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:18.344988 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. Aug 30 16:27:18.349883 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:18.351768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] Returning 404 to user: Instance b16becea-fdcc-4639-b9fd-161f08276282 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:18.353916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de1b524d-98e8-4a63-8432-9e43f09bcf54 tempest-VolumesNegativeTest-1660232996 tempest-VolumesNegativeTest-1660232996-project] 10.222.0.47 "GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282" status: 404 len: 111 microversion: 2.1 time: 0.065753 Aug 30 16:27:18.354998 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2212/4780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/b16becea-fdcc-4639-b9fd-161f08276282 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:18.425719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.426701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.442282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.443169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.443779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.446708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.447637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.454239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.557134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.575733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2c8df67-66a0-4472-9f2c-a343ee53e83f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.443702 Aug 30 16:27:18.584210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2569/4781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:18.598470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.599399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.612949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.613798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.614483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.615147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.617516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.618536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.619080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.631948 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-321f1d03-5c0f-4797-8aa4-4c44d5c9d0bf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1269 microversion: 2.1 time: 0.210017 Aug 30 16:27:18.633022 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2213/4782] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1269 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:18.670118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:18.671165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:18.688539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.691572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.692325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.693404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.696789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.698029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.771829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.788103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.793033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.798574 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ced0945-7b8a-4942-ab30-3a10a3b3f572 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.212977 Aug 30 16:27:18.799269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2570/4783] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:18.912536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8d8ab8-f1e1-442b-97a4-077bf55d0c78", "name": "network-vif-deleted", "tag": "d28bb004-9061-4c27-8b2a-bd4d3cc48ede"}, {"server_uuid": "b16becea-fdcc-4639-b9fd-161f08276282", "name": "network-vif-deleted", "tag": "52028b2b-78f2-43a5-bf31-57e738d40114"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:18.928486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:18.936074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:18.937141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:18.937816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:18.947782 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43b8acb9-8986-42ea-9516-ccff064562a2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.283966 Aug 30 16:27:18.948802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2214/4784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:18 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:18.973998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Creating event network-vif-deleted:d28bb004-9061-4c27-8b2a-bd4d3cc48ede for instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 on n-h1-830883-28 Aug 30 16:27:18.975080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] Creating event network-vif-deleted:52028b2b-78f2-43a5-bf31-57e738d40114 for instance b16becea-fdcc-4639-b9fd-161f08276282 on n-h1-830883-28 Aug 30 16:27:18.984633 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e19c876a-8000-4fa7-ac72-c21fafb0e142 req-21494e37-8c22-4b4f-8366-13a21411c90f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076725 Aug 30 16:27:18.993751 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2571/4785] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:19.609645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:19.611768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:19.640233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:19.643971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:19.648248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.649400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:19.650172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:19.651762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.654211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:19.654947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:19.674733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:19.675525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:19.676140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.677019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:19.677639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:19.678217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:19.918626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:19.944342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-990cb319-7ae3-4676-a1b8-769398ec0d13 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1275 microversion: 2.1 time: 0.294376 Aug 30 16:27:19.959089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2572/4786] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:19 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1275 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:19.992524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:20.009382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:20.027652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.028166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.028621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.029373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.044372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.044853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.199118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.215951 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14f64954-89d5-48cc-b33b-e90ade25b490 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.603540 Aug 30 16:27:20.242670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2215/4787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:19 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:20.253857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:20.254528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:20.291009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.291523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.291972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.292685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.298761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.299308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.755241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.777404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e04ee826-33b0-4a57-b09b-f05c7a85c217 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.533416 Aug 30 16:27:20.778358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2216/4788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:20 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:20.800099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5281e689-fa01-447f-a37e-e51da7e0b8be", "tag": "ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:20.810582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.828086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.830524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:20.833055 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45cd413d-6538-4cf7-8de3-5d9839690486 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.868383 Aug 30 16:27:20.847182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2573/4789] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:19 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:20.851888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:20.853736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:20.855041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:20.931555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] Creating event network-changed:ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc for instance 5281e689-fa01-447f-a37e-e51da7e0b8be on n-h1-830883-28 Aug 30 16:27:20.956916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cb60f6f4-6edc-4bbb-bd86-de9d41c33a2a req-c2d27775-9692-4f06-9b6f-08b09d784e93 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175805 Aug 30 16:27:20.959240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2217/4790] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:20.990549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:20.994071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:21.010717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.012312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.014472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.015279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.017163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.018184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.248176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:21.249108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:21.283394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.284871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.285321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.288262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.288897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.289283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.402919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:21.421877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b68a1a8-bba4-4243-9b0f-8f0827ad4fd7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.449969 Aug 30 16:27:21.437321 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2574/4791] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:20 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:21.799319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:21.800111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:21.817915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.818524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.818891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:21.820652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:21.824068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:21.824703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.159794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.173259 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4ff7884-9793-41f6-bac5-b3126d1a6d49 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.378108 Aug 30 16:27:22.174436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2575/4792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:21 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:22.179803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:22.181325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:22.188805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.189640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.190374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.191480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.192216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.192889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.272854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.285271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.287419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.288961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41523aed-8a35-4923-b077-229a894d4c6d tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.113073 Aug 30 16:27:22.290801 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2576/4793] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:22 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:22.400852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.420034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c37e4fc8-bca9-452b-9bd6-f4cf3c4a7b13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 1.178339 Aug 30 16:27:22.420664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2218/4794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:21 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:22.444429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:22.445374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:22.460964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.462895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.463762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.465323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:22.465971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:22.466754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:22.829707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:22.845118 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7ccb14d-4bdf-4d6b-99fe-641cea94ed10 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.404899 Aug 30 16:27:22.847625 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2577/4795] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:22 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:23.169509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:23.189799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.191502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.226986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.230526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:23.237069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.250133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.256378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.257243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.258033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.264978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.266965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.300308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] Creating event network-changed:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:27:23.362537 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ec6d5ba3-442b-4cbf-be89-15750a5df9d0 req-ac6cb678-9849-482a-bf4b-fd95f692bea5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191907 Aug 30 16:27:23.363428 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2219/4796] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:23.392959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.394116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:23.417096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.417682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.418203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.420296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.422265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.422810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.576635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:23.585190 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab64dd72-7760-4550-a6be-d6500283bab4 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.390151 Aug 30 16:27:23.606472 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2578/4797] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:23.619446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.620085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:23.638079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.638613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.639063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.644151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.644822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.645283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.708516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:23.726207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:23.749317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:23.753091 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1917a2e8-376f-429f-bcec-0b833a534a2f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.382462 Aug 30 16:27:23.768611 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2220/4798] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:23.871302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:23.872246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:23.885759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.887876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.888496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.889401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:23.891625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:23.892248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:23.911044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:23.925984 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11d296f8-b770-45aa-a730-2567c5b3e689 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.317981 Aug 30 16:27:23.927354 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2579/4799] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:24.404938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.422151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-42f25a4f-f9c7-4dd7-a361-98f1a64beefa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.555024 Aug 30 16:27:24.424590 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2221/4800] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:24.610275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:24.610954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:24.622862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.623373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.623821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.624551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.625020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.625505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.785088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:24.785738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:24.795630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.796132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.796574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.797280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.797734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.798160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.876749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.888685 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d632cc5-c2a9-4256-85f4-f362d849d0f3 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.282517 Aug 30 16:27:24.890239 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2580/4801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:24 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:24.910395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.922285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.924662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:24.926295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38d94d7b-da9c-484f-b7a0-e25be75c562f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.146938 Aug 30 16:27:24.927358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2222/4802] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:24 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:24.953578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:24.954386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:24.963803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.964615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.965708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:24.966994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:24.968016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:24.968671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.197682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:25.239016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1413c543-e3c6-48a4-b7cd-1e9c6d54b73a tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1677 microversion: 2.1 time: 0.289752 Aug 30 16:27:25.239977 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2581/4803] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:24 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:25.448688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:25.449472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:25.474427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.476161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.479218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.483060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.484279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.487078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.755662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:25.767441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-266524d4-4b22-4473-8e44-12398d9b0cf8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.324300 Aug 30 16:27:25.768645 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2223/4804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:25 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:25.917815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:25.918695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:25.931196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.931944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.932850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.934136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.935148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.935750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.953645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:25.954528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:25.963757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.964639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.966038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:25.967051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:25.967705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:25.968292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.097555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.111460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.113291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.114886 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b01c6fd-ac05-41a8-bf2a-6f8608f510e3 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.165953 Aug 30 16:27:26.116006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2224/4805] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:25 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:26.189977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.213401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a8660f9-332f-46f5-b973-236d72912e65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.302362 Aug 30 16:27:26.230900 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2582/4806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:25 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:26.265235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:26.265870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:26.277567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.280544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.281952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.283797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.285538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.288751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.464767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:26.476418 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8c05ad7-a314-463c-84cd-b2526d50dfa9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1654 microversion: 2.1 time: 0.215289 Aug 30 16:27:26.477828 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2225/4807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:26 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1654 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:26.498117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:26.507419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.508310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.509009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.537843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Going to try to start instance {{(pid=122352) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:27:26.593108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8784f56c-f661-455b-ae76-0a279a81df4f tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.098770 Aug 30 16:27:26.602805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:26.603927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:26.607180 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2583/4808] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:27:26 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:26.610697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.611801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.612601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.614193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.615010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.615656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.790482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:26.791311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:26.812206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.812991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.813656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:26.818157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:26.819116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:26.819772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.030259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.039128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6ae10b8-1850-4261-ab0f-aa1258e1b572 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.253755 Aug 30 16:27:27.052931 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2584/4809] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:26 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:27.052931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1330949340", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "9b2b75c7-b60d-4048-8e2c-d196ebe5fb69"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:27.053301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.116149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] validate_networks() for [('9b2b75c7-b60d-4048-8e2c-d196ebe5fb69', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:27:27.393349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.412109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.437483 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df061f9b-3ea7-456d-939b-a69f8da72ada tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1663 microversion: 2.1 time: 0.839191 Aug 30 16:27:27.452938 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2226/4810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:26 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1663 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:27.458143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:27.460337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:27.467804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.469065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.469840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.470832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.471500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.472132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.493917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:27.625798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:27.626763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:27.628368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:27.629036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:27.629512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:27.644198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.644616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.645286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.646109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.646823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.647694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.657302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.668229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.669679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.670921 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb527bf6-4a0e-4b38-a9c7-305014b5238e tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.216589 Aug 30 16:27:27.671277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Getting quotas for project 1993a73e328b444a9a148871f46328b2. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:27.671490 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2227/4811] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:27 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:27.677714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Getting quotas for user c3743d3266554386b5f9531ca284945b and project 1993a73e328b444a9a148871f46328b2. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:27.692995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:27.696309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:27.702292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:27.702934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:27.718778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.719279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.719739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.720438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:27.720899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:27.721332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:27.751376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-976fc2b8-8c1c-4199-ae0c-22d37481c680 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709857 Aug 30 16:27:27.752294 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2585/4812] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:27:27.770181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d890d7a-769c-4d04-86f7-ade08a8c1421 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:27.770713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d890d7a-769c-4d04-86f7-ade08a8c1421 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:27.840178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6d890d7a-769c-4d04-86f7-ade08a8c1421 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:27.853768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d890d7a-769c-4d04-86f7-ade08a8c1421 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1219 microversion: 2.1 time: 0.087394 Aug 30 16:27:27.854615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2586/4813] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:27 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:28.062591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:28.063896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:28.078463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.080157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.081531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.083206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.084072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.084734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.089974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:28.283419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:28.296197 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-593d2fb4-7f5d-48f4-9868-be1dcfef409e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.238947 Aug 30 16:27:28.325372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2587/4814] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:28 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:28.410385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:28.427916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89d07eea-9f76-4918-b350-9079606b61e0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.727507 Aug 30 16:27:28.431518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2228/4815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:27 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:28.462769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:28.463755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:28.473535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.474426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.475065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.476224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.478469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.479272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.699248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:28.699945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:28.723381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.731779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.732272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.733813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.737509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.738421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.895404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:28.904632 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e17ecd6d-bfb2-488b-986f-c17ffb38bb57 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1663 microversion: 2.1 time: 0.448326 Aug 30 16:27:28.909186 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2588/4816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:28 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1663 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:28.925153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:28.925976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:28.941667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.942494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.943088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.946799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:28.947530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:28.948256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:28.985372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.009757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.014370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.015998 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e5fc446-e190-48e5-8968-309dfc76d35b tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.323973 Aug 30 16:27:29.018272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2229/4817] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:28 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:29.094609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.106160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c89a3f10-7ba5-4c36-97ef-e925ff431443 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1223 microversion: 2.1 time: 0.191462 Aug 30 16:27:29.115455 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2589/4818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:28 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:29.318583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:29.319205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:29.338532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.339106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.339530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.340229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.340688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.341108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.455185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:29.456130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:29.465715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.466559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.467207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.476524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.478874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.479943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.583288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.593214 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2215a30e-7bac-40f0-82af-cfb19fcc8ed4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.278534 Aug 30 16:27:29.607230 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2230/4819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:29 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:29.764104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:29.772298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f9246b8-999f-4b26-8e0b-0f11e8bb4f1f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 0.324360 Aug 30 16:27:29.779082 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2590/4820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:29 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:29.937659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:29.938494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:29.955719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.958869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.959617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:29.960585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:29.961407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:29.961997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.045928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.046763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.053800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.054558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.055982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.056836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.057369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.058094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.162919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.182646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.185403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.190106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4420c169-510b-43e5-8d0e-80d88eca3651 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.150162 Aug 30 16:27:30.192449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2591/4821] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:30.214193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.219459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.232221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:30.234856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.236868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.237627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.239592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.240312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.241716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.351080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.364452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9c2cca1-b8dc-411d-a816-babc03a0ab98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1277 microversion: 2.1 time: 0.169186 Aug 30 16:27:30.374667 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2592/4822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:30.484727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.499722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0a14a5c-a4a9-49d1-a33a-305df1cea3a6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.566858 Aug 30 16:27:30.501142 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2231/4823] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:29 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:30.522811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.523924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.532313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.533208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.533885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.534917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.536067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.537030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.619497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.623562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.640703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.641715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.642498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.643474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.644764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.648633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.880181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.893614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dcb183fa-77b6-43ce-af4a-737d3f568b96 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.373009 Aug 30 16:27:30.909100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:30.911813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2593/4824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:30.924912 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a8abde82-d3f8-4330-8ac0-6dcbcd0367c4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.313965 Aug 30 16:27:30.928147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2232/4825] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:30.945200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.945956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:30.947113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.949632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:30.963701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.964482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.965153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.966162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.967173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.967772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.971496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.973518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.974000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:30.982168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:30.986130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:30.986683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:31.428148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:31.440308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d782c20d-f9ae-46cc-b8f8-5cd8e527f78c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.508075 Aug 30 16:27:31.443788 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2233/4826] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:31.459546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "name": "network-vif-plugged", "status": "completed", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:31.482132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:31.482997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:31.485240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:31.515636 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] Creating event network-vif-plugged:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:27:31.531873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d206608d-6bcf-4aae-a17d-f890e2d46d4a req-758ffc98-2632-4103-bfeb-f4499a6c5612 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083530 Aug 30 16:27:31.533807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2234/4827] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:31.545991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:31.552010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:31.568987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:31.569737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:31.570693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:31.571863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:31.572480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:31.573058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:31.774205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:31.788014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:31.790171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:31.791468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c1391a0-1f67-482f-b6e4-93e731d8a099 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.255880 Aug 30 16:27:31.803361 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2235/4828] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:31 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:31.814088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:31.815015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:31.821934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:31.822726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:31.823339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:31.824217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:31.824827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:31.825405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.142477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.164129 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3ddb815-c4ff-4a50-8958-a1383f3ad92d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1510 microversion: 2.1 time: 1.249603 Aug 30 16:27:32.178835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2594/4829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:30 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1510 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:32.190962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:32.191988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:32.212027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.222246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.224354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.237487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.237997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.243965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.527204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.540918 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0643a52-eef9-4c40-a0eb-1951ca6ab131 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.360818 Aug 30 16:27:32.541876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2595/4830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:32 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:32.552137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:32.552763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:32.568589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.569086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.569525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.573897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.574405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.574850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.655722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.670052 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2c677222-b0ba-4e82-858a-a8c11b18f3f6 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.865113 Aug 30 16:27:32.684941 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2236/4831] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:31 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:32.697902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:32.699924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:32.703460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:32.713281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.714520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.715215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.717660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.718851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.719466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.830119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.842263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee175c45-9253-418b-ba5e-707c775a7af3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1317 microversion: 2.1 time: 0.297524 Aug 30 16:27:32.843594 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2596/4832] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:32 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:32.849251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:32.850550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:32.858804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.859620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.861113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.862080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:32.862929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:32.863575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:32.948290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.961564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.963245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:32.964508 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-271373f5-2645-4c17-8688-ca672b8c3e0a tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.119672 Aug 30 16:27:32.970867 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2597/4833] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:32 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:33.112186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:33.121726 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c65c6f1-dcda-401d-8a12-1a18687c045d tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.434776 Aug 30 16:27:33.127554 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2237/4834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:32 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:33.151594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:33.153686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:33.161431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.162161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.162883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.163829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.165059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.165870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.188799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:33.189511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:33.204717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lazy-loading 'flavor' on Instance uuid 5a8a958d-f47e-466c-9d97-5fa496b1afea {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:33.204930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.204930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.204930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.204930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.205514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.206183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.371418 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e09fb0ff-9c58-4d5b-88d8-4fae714b12ed tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.226677 Aug 30 16:27:33.372393 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2598/4835] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:27:33 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:33.383722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:33.384439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:33.410664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.411182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.411700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.412615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.413239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.419576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.715463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:33.736937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7dff9ac7-f204-49a4-b5ff-8b574e2110c0 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1487 microversion: 2.1 time: 0.551956 Aug 30 16:27:33.743147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2238/4836] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:33 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1487 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:33.763122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:33.764805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:33.786049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.788950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.789565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:33.792510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:33.795062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:33.798724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.129071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.172101 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7fb6f700-32dc-4ef1-a196-c38f58f01ccb tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1675 microversion: 2.1 time: 0.792778 Aug 30 16:27:34.176043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2599/4837] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:33 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1675 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:34.189419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.190395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.210321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.213955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.214995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.217004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.219885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.220491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.302987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:34.424813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:34.456585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.471531 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-926d0c7b-cad7-478c-bb27-594364829a2d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.726960 Aug 30 16:27:34.472126 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2239/4838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:33 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:34.481473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.488113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.508887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.509656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.510260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.511204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.511830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.513018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.552864 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-adfd4b5e-ef18-4584-b061-8f17285c8865 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 204 len: 0 microversion: 2.1 time: 0.375017 Aug 30 16:27:34.553584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2600/4839] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:34 2022] DELETE /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:34.573730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dcf3b0b-569f-4927-8cbf-b6f78554b73f", "tag": "f13a607d-ceda-4d38-8e5a-85b40ab82948"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:34.594068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.595403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.596023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.617172 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] Creating event network-changed:f13a607d-ceda-4d38-8e5a-85b40ab82948 for instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f on n-h2-830883-28 Aug 30 16:27:34.627029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-14042630-8eab-46b1-bd1a-72549b6acb6c req-1e429cc3-203e-4cdf-a096-88bb79c12a82 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070320 Aug 30 16:27:34.627926 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2601/4840] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:34.646672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.648348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.658156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.658932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.660533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.661768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.662431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.663051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.787744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.808655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.811638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.816628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ca5c602-a579-4a66-9596-8bb8a4b236c9 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.186938 Aug 30 16:27:34.819003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2602/4841] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:34 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:34.834502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.835022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.857781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.860260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.860794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.862949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.863466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.863921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.895414 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 HTTP/1.1 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b0e7356c-07a4-4e80-8bba-cda2c84d8d92'} Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:34.897707 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:34.903143 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:34.905254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:34.906442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1078a6e4-2086-476c-9389-ca616f6c0e85 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 404 len: 111 microversion: 2.1 time: 0.086286 Aug 30 16:27:34.907618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2603/4842] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:34 2022] DELETE /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:34.916501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.917261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.926739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.927406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.927837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:34.928302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.928825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.929384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:34.930198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:34.940479 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7bcca071-1085-4070-ab35-cb227bf78a15 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.463480 Aug 30 16:27:34.949583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2240/4843] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:34 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:34.960130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:34.960745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: b0e7356c-07a4-4e80-8bba-cda2c84d8d92] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:34.981210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:34.981704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:35.007524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:35.009726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:35.017417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:35.018051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:35.084648 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 HTTP/1.1 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b0e7356c-07a4-4e80-8bba-cda2c84d8d92'} Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:35.093167 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance b0e7356c-07a4-4e80-8bba-cda2c84d8d92 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-63226baf-8a32-43f9-8e28-400afb015fa0 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92" status: 404 len: 111 microversion: 2.1 time: 0.144502 Aug 30 16:27:35.098559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2241/4844] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:34 2022] GET /compute/v2.1/servers/b0e7356c-07a4-4e80-8bba-cda2c84d8d92 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:35.182796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-554323093", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:35.318896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] validate_networks() for [('41f78965-9e06-49c9-99ac-2886a39ad4ca', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:27:35.449502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:35.460127 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68e924ee-8eea-4bd0-ac5c-699ce8c1ec6c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1493 microversion: 2.1 time: 0.548214 Aug 30 16:27:35.461207 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2604/4845] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:34 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1493 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:35.469728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:35.470591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:35.483193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:35.484448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:35.484929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:35.486951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:35.486951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:35.490199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.158882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:36.168677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a7ca15b-07bb-449e-ba78-fab04ae23dc1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1658 microversion: 2.1 time: 0.706352 Aug 30 16:27:36.169272 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2605/4846] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:35 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1658 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:36.184952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:36.186181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:36.212723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.213242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.213702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.214518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.214991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.215434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.531105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:36.559389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65bddc03-b523-42b9-bcff-bdeba7697413 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.388656 Aug 30 16:27:36.563467 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2606/4847] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:36 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:36.576005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:36.577061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:36.594718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.597653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.598538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.601994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.603212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.604279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.738577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:36.753042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:36.755443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:36.756952 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-92ec9d30-482a-47a6-80fb-957f56ebbc58 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.192299 Aug 30 16:27:36.757821 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2607/4848] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:36 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:36.763925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:36.764721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:36.781542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:36.782644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:36.782789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.783363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.783681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:36.783842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.784451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:36.784830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.785282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:36.786783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.790524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.797283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.798059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.798841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.799789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.800475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.801100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.824191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Getting quotas for project 1e61195c24fb4000a372e7fbab7b9fb2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:36.831334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Getting quotas for user d227c38d5aaf416b806556a431d0cdb0 and project 1e61195c24fb4000a372e7fbab7b9fb2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:36.849042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:36.852824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:36.935754 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f8a263f-dacc-41c8-82e6-9ab762e26232 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759797 Aug 30 16:27:36.936688 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2242/4849] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:27:36.945776 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff44c370-3bf2-4bd4-8c53-9aa45f9f30ee tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action" status: 202 len: 0 microversion: 2.1 time: 0.185584 Aug 30 16:27:36.947345 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2608/4850] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:27:36 2022] POST /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:27:36.950594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:36.951322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:36.958050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-547f3e53-3dcf-42ac-8198-6ca291c36506 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:36.959773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-547f3e53-3dcf-42ac-8198-6ca291c36506 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:36.965943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.966514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.966933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:36.978277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:36.978807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:36.979425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.121776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-547f3e53-3dcf-42ac-8198-6ca291c36506 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.132910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-547f3e53-3dcf-42ac-8198-6ca291c36506 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1216 microversion: 2.1 time: 0.183568 Aug 30 16:27:37.137295 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2609/4851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:36 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:37.142984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:37.143704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:37.174004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.177947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.177947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.178503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.178976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.179405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.447697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.466986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f8cf7a6-e852-414c-8171-ab48e6204e71 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1493 microversion: 2.1 time: 0.528162 Aug 30 16:27:37.473004 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2243/4852] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:36 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1493 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:37.586647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:37.587265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:37.597902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.599294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.600143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.603530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.605278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.605933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.622976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.640436 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-557c8528-e809-452e-b4d4-7abea51f86c1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1664 microversion: 2.1 time: 0.500945 Aug 30 16:27:37.673966 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2610/4853] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:37 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1664 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:37.782408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:37.783271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:37.791943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:37.797192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.800048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.801442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.806569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:37.807279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:37.808120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:37.971996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.988611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.990141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:37.991399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07d798ea-f8a9-4b22-b160-2f769ccce5a8 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.214096 Aug 30 16:27:37.995681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2611/4854] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:37 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:38.153841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:38.154768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:38.182187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.183237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.183915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:38.185135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.185810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.186815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:38.202168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:38.218265 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18438593-3d2a-4c00-b566-8052a3ee9c86 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.634616 Aug 30 16:27:38.251014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2244/4855] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:37 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:38.324944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:38.336171 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-824460f2-e5a1-4657-920d-cba23a13f123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1220 microversion: 2.1 time: 0.186298 Aug 30 16:27:38.337603 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2612/4856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:38 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:38.503007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:38.505153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:38.529410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.533128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.534931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:38.540150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.542335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.545017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:38.667529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:38.668170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:38.689785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.691885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.692359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:38.698665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:38.699258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:38.699710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:39.206143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:39.223911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2ebe481b-2d2f-4431-9077-09a55dea22d2 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1451 microversion: 2.1 time: 0.728081 Aug 30 16:27:39.224834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2245/4857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:38 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1451 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:39.241113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:39.245602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:39.259519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:39.262660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:39.263243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:39.264077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:39.267438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:39.268143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:39.320937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:39.769202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:39.776924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0099ff06-1e4d-4c62-a972-6aa56468bdde tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1664 microversion: 2.1 time: 1.116647 Aug 30 16:27:39.790343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2613/4858] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:38 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1664 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:39.790343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:39.790343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:39.800794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:39.805460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:39.814631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:39.816013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:39.816720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:39.819166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:39.964615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:39.974865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:39.986637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:39.988804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c64616b-cb8a-4a6a-b5cd-80631ce7f7af tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.760442 Aug 30 16:27:40.001745 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2246/4859] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:39 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:40.014448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:40.019718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:40.041503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.042442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.043323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.044270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.045193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.045998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.363734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:40.379180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-795bef3f-0eaf-428c-a4b3-4dcd06291601 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1274 microversion: 2.1 time: 0.375220 Aug 30 16:27:40.380071 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2247/4860] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:40 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:40.386990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc5cf91-32c2-495d-b8aa-8774bbd3af36", "name": "network-vif-deleted", "tag": "9dfc2a28-9caf-475b-baf2-3334c58d8b2e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:40.400738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:40.408781 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b034c957-911c-405f-a6b8-40086cbbdabb tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.629787 Aug 30 16:27:40.427252 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2614/4861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:39 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:40.430844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.432198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.432670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.445275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:40.445941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:40.463959 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] Creating event network-vif-deleted:9dfc2a28-9caf-475b-baf2-3334c58d8b2e for instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 on n-h2-830883-28 Aug 30 16:27:40.464635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.465140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.465583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.466291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.466773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.467205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.475258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a39e798c-429d-493b-8d35-e4c48288bc5a req-9fca29d0-02e7-441b-a6d0-ece1565a7498 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093159 Aug 30 16:27:40.475894 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2248/4862] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:40.519749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.520243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.520687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.521140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'fault' on Instance uuid 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:40.622632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:40.630946 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5e299c0-6cbe-453e-992b-15b2206766b5 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 200 len: 1304 microversion: 2.1 time: 0.202493 Aug 30 16:27:40.643958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2615/4863] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:40 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:40.805138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:40.811954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:40.844933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.848708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.850537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:40.856732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:40.857621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:40.861832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.018539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:41.020401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:41.043886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.044537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.045194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.048114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.049381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.051732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.371465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:41.385065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:41.395316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:41.396904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20ae6309-96ec-417f-a79d-2eb3d43b056c tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.383049 Aug 30 16:27:41.397936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2616/4864] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:41 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:41.406285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:41.411225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:41.423570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.430750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.431494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.432598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.433839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.434926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.548537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:41.561306 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54068d09-1d14-47ef-9af9-1cd9baa50c38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1274 microversion: 2.1 time: 0.160707 Aug 30 16:27:41.578579 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2617/4865] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:41 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:41.587024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:41.588077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:41.616000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.616529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.617676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.618486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.623064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.624383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.660362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:41.672382 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b40ede5-7f54-43ae-b760-b4e148169967 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1664 microversion: 2.1 time: 0.872223 Aug 30 16:27:41.679157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:41.683030 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2249/4866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:40 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1664 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:41.713540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:41.719146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:41.738027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.738891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.739486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.740362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:41.745630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:41.746289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:41.779301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 HTTP/1.1 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '1cc5cf91-32c2-495d-b8aa-8774bbd3af36'} Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:41.781927 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:27:41.786998 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:41.792470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:41.793550 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-addf93e1-8943-453c-8873-b3bbcca53467 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 404 len: 111 microversion: 2.1 time: 0.109401 Aug 30 16:27:41.812679 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2250/4867] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:41 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:42.016404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:42.034027 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba089a28-b961-4430-8943-43eb8be2a9e9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.444831 Aug 30 16:27:42.046724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2618/4868] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:41 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:42.057489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-332422464", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "2afeccbd-1520-425b-a059-3bc56aff13d0"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:42.190534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] validate_networks() for [('2afeccbd-1520-425b-a059-3bc56aff13d0', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:27:42.423481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:42.424497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:42.439545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:42.440523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:42.442832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:42.444498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:42.445612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:42.451043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:42.597398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:42.609838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:42.612665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:42.614080 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce2e129b-f7e6-43eb-ac1a-8d43dc78b9d5 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.196142 Aug 30 16:27:42.627115 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2619/4869] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:42 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:27:42.638286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:42.647923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:42.658986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:42.660046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:42.660906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:42.662047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:42.662715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:42.663496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:42.997064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:43.006521 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd3ed3a9-7683-4854-834a-49d935821562 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 0.376880 Aug 30 16:27:43.007799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2620/4870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:42 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:43.013725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.014777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.022456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.024116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.024865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.026607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.028277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.029161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.327241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:43.342221 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8367828c-d1ad-46be-934e-6bcb1ae1f247 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.332985 Aug 30 16:27:43.343922 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2621/4871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:43.348880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.358925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.368298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.379107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.379880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.380830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.381489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.382153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.486212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:27:43.486700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:27:43.487547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:27:43.487965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:27:43.488382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:27:43.507887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.508513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.509162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.509977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.510478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.523615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.570931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:27:43.586805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Getting quotas for user 512a5e5b9ce048ce8a48dae5253b247f and project 8cdb2ae22edb4d87989fb377f5598e39. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:27:43.624302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:27:43.632512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:27:43.636785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:43.651430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e5861ac-1176-40b7-a1c6-9106bd443768 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.305964 Aug 30 16:27:43.652944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2622/4872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:43.658119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.661692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.670107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.671100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.671760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.672932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.673607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.674251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.715446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa HTTP/1.1 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7cef9d81-c51e-4f33-9295-eb52e722d2aa'} Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:43.718788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:43.722689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:43.727838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:43.728978 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d33e4016-e6f3-40d9-9a96-bdd444136a24 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 404 len: 111 microversion: 2.1 time: 0.074815 Aug 30 16:27:43.732470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2623/4873] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:43 2022] DELETE /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:43.744254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.744601 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31f0a915-7461-43d6-9d46-eb878c464ed6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694698 Aug 30 16:27:43.746046 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2251/4874] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:27:43.746587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.752624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dcf3b0b-569f-4927-8cbf-b6f78554b73f", "name": "network-vif-plugged", "status": "completed", "tag": "f13a607d-ceda-4d38-8e5a-85b40ab82948"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:43.761026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.764431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.765159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.765423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.766085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.766773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.767022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.767592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.771150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.843016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] Creating event network-vif-plugged:f13a607d-ceda-4d38-8e5a-85b40ab82948 for instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f on n-h2-830883-28 Aug 30 16:27:43.858875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-75b23d8b-f596-4a11-bcc6-9a10ec38a263 req-aaa836ee-77c0-44af-bb7b-f1917f57ca3b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110473 Aug 30 16:27:43.860583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2252/4875] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:43.867675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:43.877687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:43.897178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.901672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.904013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:43.905998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:43.907812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:43.909890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.082222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.098697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.109862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.111296 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5671d067-cf6f-4b72-9eb3-bff42382ba3f tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.249563 Aug 30 16:27:44.115008 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2253/4876] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:44.128290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:44.128290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] [instance: 7cef9d81-c51e-4f33-9295-eb52e722d2aa] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:44.138194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.138763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.139139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.139858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.140322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.140758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.182844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] HTTP exception thrown: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Request method failure captured: Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa HTTP/1.1 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjhg51_RZ5pJ9VjIpeFotHnX8DSZ3_knKmeswaOQHEA4gA-t2OAguZTKS00GnjQyUl0owgRCny5yNERGm4WaCRCualJQ4X-whecg8owpcoujC2nQVn_JKpa8WHCBU8UM9zJ97Cb8zB3Swp811qkzK-2KPIBShwIFGfh6OjLCVEXpwnI Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8253158502424d52b6415ec18e55be2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8253158502424d52b6415ec18e55be2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8253158502424d52b6415ec18e55be2b"}]}] Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 8253158502424d52b6415ec18e55be2b Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-590009043 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 8088798e433c4056be1b6ec5d67cbc29 Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeTestJSON-590009043-project Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7cef9d81-c51e-4f33-9295-eb52e722d2aa'} Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:44.184418 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] Returning 404 to user: Instance 7cef9d81-c51e-4f33-9295-eb52e722d2aa could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:44.191396 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-905ea793-3703-4a05-91a9-151292b607a6 tempest-AttachVolumeTestJSON-590009043 tempest-AttachVolumeTestJSON-590009043-project] 10.222.0.47 "GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa" status: 404 len: 111 microversion: 2.1 time: 0.069877 Aug 30 16:27:44.204772 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2254/4877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:44 2022] GET /compute/v2.1/servers/7cef9d81-c51e-4f33-9295-eb52e722d2aa => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:44.225430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e90230a-185a-4711-b6aa-9694a8cfab7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:44.226061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e90230a-185a-4711-b6aa-9694a8cfab7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:44.397370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.412785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5ade3b0-7605-41aa-98e3-88806a3b0999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1667 microversion: 2.1 time: 0.678985 Aug 30 16:27:44.414743 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2624/4878] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:43 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1667 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:44.421432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:44.433649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:44.448972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.449752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.450545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.451289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.451750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.452178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.492942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e90230a-185a-4711-b6aa-9694a8cfab7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:44.502422 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e90230a-185a-4711-b6aa-9694a8cfab7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1214 microversion: 2.1 time: 0.296445 Aug 30 16:27:44.524396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2255/4879] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:44 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1214 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:44.537431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:44.537953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:44.549932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.550470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.551093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.552552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:44.553187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:44.553783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:44.627504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:44.646652 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Working on deleting snapshot 7621d4d7-0f5e-4324-8e6b-e0975bad7d6e from shelved instance... Aug 30 16:27:45.087653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:45.128937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef7a2864-4d36-4e16-a091-5faed6027a79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 0.708121 Aug 30 16:27:45.137628 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2625/4880] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:44 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:45.151923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:45.152547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:45.171704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.172212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.172657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.174594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.175069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.175507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.556215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:45.572269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff3897be-752b-4666-a75d-65ab666887e5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1319 microversion: 2.1 time: 0.424440 Aug 30 16:27:45.577373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2626/4881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:45 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:45.590136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64709681-735f-4bd4-9fa9-609a19ceefcf", "tag": "91ecd3ff-f10e-4c24-8f54-11201498a7aa"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:45.633688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.636038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.638170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.668239 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] Creating event network-changed:91ecd3ff-f10e-4c24-8f54-11201498a7aa for instance 64709681-735f-4bd4-9fa9-609a19ceefcf on n-h1-830883-28 Aug 30 16:27:45.695708 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f93d872a-af9f-4f3b-a414-6d341a169567 req-cd50bbee-834b-4d96-aec4-bc5e269bfc6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113762 Aug 30 16:27:45.696936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2627/4882] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:45.712008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:45.713002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:45.729043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.731003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.734247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.735366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.736702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.737389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.749648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Doing local delete in cell 5f94f90b-c483-4336-9a70-6afa481bc2ae(cell1) {{(pid=122351) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 16:27:45.750566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:45.751060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:45.751603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:45.752681 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 16:27:45.763342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] deallocate_for_instance() {{(pid=122351) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 30 16:27:45.985268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.009423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.013409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.021242 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-946d964a-e20d-40d3-9567-c2816a58f4c0 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1605 microversion: 2.42 time: 0.321601 Aug 30 16:27:46.023370 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2628/4883] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:45 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1605 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:46.039057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:46.040035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:46.047321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.047840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.048293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.049014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.049480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.049915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.229076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.237142 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aaa18faa-8503-4696-b40c-e0ad9c8ef9e1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1210 microversion: 2.1 time: 0.212500 Aug 30 16:27:46.237747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2629/4884] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:46 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1210 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:46.250897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:46.251626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:46.271534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.272048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.272494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.273222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.274521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.274979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.694147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:46.706947 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e0ecf36-d847-45cf-b18c-7f88c11d144f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 0.468122 Aug 30 16:27:46.707573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2630/4885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:46 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:46.724715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:46.725351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:46.732955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.733474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.733928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:46.743994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:46.744542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:46.745008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.128725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:47.509971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Updating instance_info_cache with network_info: [] {{(pid=122351) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 30 16:27:47.533798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:47.550543 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8f76f14-5b5c-4255-875d-dfc5341d3fed tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1509 microversion: 2.1 time: 0.841763 Aug 30 16:27:47.552902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2631/4886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:46 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1509 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:47.608218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:47.610558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:47.644087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.644905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.645511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.646430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.647060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.647676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.688427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.689184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.689967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.708802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lazy-loading 'fault' on Instance uuid ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:47.797525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:47.811184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:47.812830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25918ea9699d41048d84386475ab6592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10923d93d36d491ab095e4c5360fa072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:47.815074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93805470-88c6-4751-a10b-91ed8df33800 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 200 len: 1610 microversion: 2.42 time: 0.226168 Aug 30 16:27:47.815513 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2632/4887] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:47 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 1610 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:27:47.838214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:47.848891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:47.903224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.907480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.910491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.916789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:47.921493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:47.922237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:47.971352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09e84baa-69a1-4089-8a1b-5a8fb70daf61 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 204 len: 0 microversion: 2.1 time: 3.446853 Aug 30 16:27:47.972822 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2256/4888] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:44 2022] DELETE /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 0 bytes in 3450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:47.986437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:47.987067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:48.006120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.009951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.011817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.014253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.015567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.017018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.156868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:48.165788 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bfdf96c-5da8-487c-8b3f-04f5b6f9eb56 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1272 microversion: 2.1 time: 0.349128 Aug 30 16:27:48.174690 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2633/4889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:47 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:48.194489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a9d4a5-659c-4c3b-9e93-9bead59bebc0", "name": "network-vif-deleted", "tag": "5198bb7a-b599-4680-90be-963f3690eef0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:48.240706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.243207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.243791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.273162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_external_events [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] Unable to find a host for instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0. Dropping event network-vif-deleted {{(pid=122352) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Aug 30 16:27:48.281103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-308a1c63-fe47-40df-b353-13be0bb2eec2 req-c1ada8c5-f541-4dea-a030-e51006e182e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104172 Aug 30 16:27:48.290758 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2634/4890] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 114 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 16:27:48.296400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:48.299652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: c7a9d4a5-659c-4c3b-9e93-9bead59bebc0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:48.317349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.322093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.323625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.329533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.336998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.340346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.375289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 HTTP/1.1 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c7a9d4a5-659c-4c3b-9e93-9bead59bebc0'} Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:48.380219 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.386347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 404 to user: Instance c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:48.388999 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d571271-ae14-42a8-9f9a-979d59b77892 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0" status: 404 len: 111 microversion: 2.1 time: 0.096786 Aug 30 16:27:48.396970 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2635/4891] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:48 2022] GET /compute/v2.1/servers/c7a9d4a5-659c-4c3b-9e93-9bead59bebc0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:48.402612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:48.413718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:48.425995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:48.430692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.433945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.436750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.437849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.438866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.443818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.506412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:48.538488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:48.728650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e23fe941-f5b3-42c9-a791-587cbcaf25be tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 204 len: 0 microversion: 2.1 time: 0.325740 Aug 30 16:27:48.730785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2636/4892] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:48 2022] DELETE /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:27:48.748659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:48.750475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:48.763796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.766000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.768020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.770212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.770857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.771944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.853103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:48.870746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-786f5a5b-07b3-4313-9a8e-1d2243e0f912 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 0.893438 Aug 30 16:27:48.874228 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2257/4893] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:47 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:48.901749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:48.902404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:48.916867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.917639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.918806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.920393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:48.921034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:48.923632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:48.950517 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] HTTP exception thrown: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Request method failure captured: Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 HTTP/1.1 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjjvl6I0m4TOh91K4UNO7jtWTQdxN2fisXNgVAGg4RJDi-5-HlkDUZclGeuyQB-07w0Or_ffg050FAo8ssA-oihC-FFf8zAV80x6ykmnxQVolE2pjfCitclSFM8CnvNCxE7lsPTB5FLgrrx9VsfquI8qhYTYZfQEq4ptKig1nGCr88o Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}] Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 25918ea9699d41048d84386475ab6592 Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'ba8d8ab8-f1e1-442b-97a4-077bf55d0c78'} Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.952937 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:48.958147 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:48.961084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Returning 404 to user: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:48.963739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:48.967002 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51e0dcf4-00ce-492c-9622-48f3dc62bff7 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 404 len: 111 microversion: 2.42 time: 0.072571 Aug 30 16:27:48.967698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2258/4894] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:48 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:48.978993 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7d0ce58-6975-4007-bf05-e0b559b4edd6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1465 microversion: 2.1 time: 0.241530 Aug 30 16:27:48.979863 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2637/4895] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:48 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:48.992753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a4fe66c6-ee49-4a84-a776-b35e01039e02 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '.version_select at 0x7fd35cb60670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:49.020917 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a4fe66c6-ee49-4a84-a776-b35e01039e02 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905243212" status: 204 len: 0 microversion: 2.42 time: 0.046904 Aug 30 16:27:49.021760 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2259/4896] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905243212 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:27:49.200294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:49.200931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:49.208733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.208733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.208733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.209558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.210372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.211329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.343389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:49.363884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91451462-88f9-4a4e-a595-610115c6084c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1272 microversion: 2.1 time: 0.167502 Aug 30 16:27:49.365220 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2638/4897] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:49 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:49.895925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:49.896814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:49.918687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.927829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.928787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:49.929849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:49.930640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:49.931307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.007469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:50.010164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:50.020018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.021466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.022129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.024060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.024752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.025567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.278245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:50.293051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7f106c3-231b-42fa-8c17-5fa3d3726142 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1465 microversion: 2.1 time: 0.292205 Aug 30 16:27:50.306976 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2639/4898] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:49 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1465 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:50.387505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:50.388723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:50.402009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.402976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.403373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:50.404199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:50.404668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:50.405286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:51.147674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:51.156848 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-907aee95-ebb0-4539-a542-32fb82a71f85 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.774508 Aug 30 16:27:51.157856 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2640/4899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:50 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:51.163214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64709681-735f-4bd4-9fa9-609a19ceefcf", "name": "network-vif-plugged", "status": "completed", "tag": "91ecd3ff-f10e-4c24-8f54-11201498a7aa"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:51.171042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:51.180501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ee5826b-0ff6-4a3e-857b-198e157651e0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 1.289234 Aug 30 16:27:51.186821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:51.187502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:51.188107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:51.191214 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2260/4900] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:49 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:51.225144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] Creating event network-vif-plugged:91ecd3ff-f10e-4c24-8f54-11201498a7aa for instance 64709681-735f-4bd4-9fa9-609a19ceefcf on n-h1-830883-28 Aug 30 16:27:51.246796 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7f2e3ab7-bceb-4e32-8959-4684465e41d4 req-36b9a65c-6d61-46b4-a01c-e34dfca6ed44 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076169 Aug 30 16:27:51.248078 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2641/4901] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:51.315740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:51.316355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:51.327999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:51.328754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:51.329385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:51.330261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:51.334854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:51.335483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.007582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:52.035431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d7f9547-9868-4a72-b34e-bc511621a47b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1465 microversion: 2.1 time: 0.722188 Aug 30 16:27:52.073964 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2261/4902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:51 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1465 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:52.184997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:52.186246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:52.203808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.204890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.206271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.207634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:52.208756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:52.210358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.213061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.214359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.223315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.224397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.225338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.227638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.228432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.230600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.249167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:52.750484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:52.762052 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9961038b-6eed-4877-b2e1-3e46f3275f7d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.582578 Aug 30 16:27:52.765075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2642/4903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:52 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:52.775736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901d7367-1a6a-418a-8322-0b2fa968a425", "name": "network-vif-deleted", "tag": "5bf8dcfe-3a94-42fe-84be-dd31496eeba3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:52.806836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.807956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.808936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.822421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:52.840987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebb2339e-9e4c-444d-90d9-e14af281d9ba tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1316 microversion: 2.1 time: 0.635494 Aug 30 16:27:52.844007 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2262/4904] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:52 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:52.847902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] Creating event network-vif-deleted:5bf8dcfe-3a94-42fe-84be-dd31496eeba3 for instance 901d7367-1a6a-418a-8322-0b2fa968a425 on n-h1-830883-28 Aug 30 16:27:52.855057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f520f287-f4f0-4a3c-911b-60be72fc7a67 req-23d81c6e-5d70-4347-99b0-7fa8661c0fce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088406 Aug 30 16:27:52.856523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2643/4905] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:52.929224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:52.930076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:52.937461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.938102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.938822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.939744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:52.940413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:52.941050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:52.974800 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f8e3e9f-30c1-4e29-b72a-5bf86050309b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/ips" status: 200 len: 151 microversion: 2.1 time: 0.049568 Aug 30 16:27:52.975721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2263/4906] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:27:52 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:53.090827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:53.091869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:53.104248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.105704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.106597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.109174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.110438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.111245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.222462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.228982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.231306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.231975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lazy-loading 'fault' on Instance uuid 901d7367-1a6a-418a-8322-0b2fa968a425 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:27:53.382114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:53.416163 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4af331e7-6b74-4947-8f98-2caf9227f3b8 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 200 len: 1305 microversion: 2.1 time: 0.330398 Aug 30 16:27:53.418895 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2644/4907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:53 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 1305 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:53.787902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:53.788519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:53.791203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:53.804946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.805720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.806332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.808296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.809579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.811083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.867666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:53.868302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:53.881486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.883153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.884777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:53.885774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:53.886268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:53.887777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.292035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:54.307669 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-383dd53c-f55f-4ec4-ae27-688eaf2ba865 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1505 microversion: 2.1 time: 0.447426 Aug 30 16:27:54.311426 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2645/4908] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:53 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:54.336937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:54.348120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:54.371104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.371694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.372258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.373052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.373579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.374085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.464715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:54.468172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:54.478104 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ed33409-37c5-42e2-811c-4c5bc102ee0c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.694031 Aug 30 16:27:54.481294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2264/4909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:53 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:54.510090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:54.511211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 901d7367-1a6a-418a-8322-0b2fa968a425] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:54.513299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:54.527041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.531157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.531867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.532776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.533399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.533994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.577344 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 HTTP/1.1 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '901d7367-1a6a-418a-8322-0b2fa968a425'} Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:54.582693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 404 to user: Instance 901d7367-1a6a-418a-8322-0b2fa968a425 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:54.588419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-892bff62-2579-4ff7-9f5d-671734108cbf tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425" status: 404 len: 111 microversion: 2.1 time: 0.086245 Aug 30 16:27:54.590493 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2265/4910] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:54 2022] GET /compute/v2.1/servers/901d7367-1a6a-418a-8322-0b2fa968a425 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:27:54.599867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:54.607072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:54.613820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.615357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.615837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.616560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.617562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.622953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.689908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f03b9e6-2a77-408f-a14b-c211d3488f06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 204 len: 0 microversion: 2.1 time: 0.357316 Aug 30 16:27:54.690829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2646/4911] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:54 2022] DELETE /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:27:54.700129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:54.700840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:54.709640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.710138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.716072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.716980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:54.719337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:54.719854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:54.775379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:27:54.969627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:55.007350 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b50a7b9d-c71b-44bd-b394-6c8bbfef9fb9 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 204 len: 0 microversion: 2.1 time: 0.412405 Aug 30 16:27:55.012445 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2266/4912] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:27:54 2022] DELETE /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:27:55.020957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa7380c1-2da1-47de-814c-5d9c5e38c9d3", "tag": "8fa49f32-4fcf-45dc-8e55-171198a9fd41"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:55.038539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:55.040339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:55.042549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:55.078936 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] Creating event network-changed:8fa49f32-4fcf-45dc-8e55-171198a9fd41 for instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 on n-h2-830883-28 Aug 30 16:27:55.091496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d1743943-5f92-4598-ba68-37973841b6b0 req-bad347e2-ed74-4f45-99ea-12376f055e6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075004 Aug 30 16:27:55.092881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2267/4913] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:27:55.111481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:55.112938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:55.125800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:55.127589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:55.128232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:55.129281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:55.131307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:55.131916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:55.318189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:55.328673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4f96a0e8-7be3-44d3-9781-c9941af435d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1511 microversion: 2.1 time: 0.633603 Aug 30 16:27:55.329210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2647/4914] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:54 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1511 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:55.480738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:55.515105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:55.516917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:55.528070 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64a60088-a3bf-427a-947a-f41963556c92 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1506 microversion: 2.1 time: 0.430205 Aug 30 16:27:55.530048 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2268/4915] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:55 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:55.577576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:55.578345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:55.579159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:55.580134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:55.582792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:55.584455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.011499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1101d956-087b-4fc8-9877-ee8072d1e0da"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:27:56.013889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:56.048670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.051443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.052868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.055835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.056501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.057706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.151678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:56.165952 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8b6a11c-edb4-4a3e-bf52-433678d41f78 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.665673 Aug 30 16:27:56.167493 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2648/4916] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:55 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:56.356512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:56.357249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:56.371650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.372604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.374021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.375102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.376443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.377561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.765896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:56.775902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2fe41348-6b4d-47ee-93d1-a384d9fa355a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1511 microversion: 2.1 time: 0.429684 Aug 30 16:27:56.783015 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2649/4917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:56 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:27:56.792568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:56.793213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:56.802698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.803210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.803657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:56.809428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:56.809928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:56.810414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:57.313293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:57.331368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1ab5ca5-6f4a-4d87-ac30-5f21246bf424 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1506 microversion: 2.1 time: 0.546828 Aug 30 16:27:57.331974 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2650/4918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:56 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1506 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:57.350192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:57.351865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:57.369704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:57.370286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:57.370528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:57.371260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:57.372658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:57.375056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:57.416598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:27:57.639317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:57.653644 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8287680a-6884-4023-a195-303c960dfb19 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.314270 Aug 30 16:27:57.654618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2651/4919] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:57 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:57.778579 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd65bab8-e667-412f-b6a3-88936a4e813c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.772542 Aug 30 16:27:57.787927 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2269/4920] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:27:56 2022] POST /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 194 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:27:57.820496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:57.822481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:57.835203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:57.836919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:57.837683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:57.840049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:57.841217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:57.842100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.281790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:58.298761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f16b677-7f9e-43b3-ba53-3a5c0e52391e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1511 microversion: 2.1 time: 0.483981 Aug 30 16:27:58.307076 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2652/4921] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:57 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:58.362518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:58.363887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:58.376478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.377404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.378136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.383814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.385229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.386484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.529381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:58.530591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:58.547514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.548226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.548747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.549759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.550379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.551447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.574337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] HTTP exception thrown: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Request method failure captured: Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 HTTP/1.1 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjvl6I0m4TOh91K4UNO7jtWTQdxN2fisXNgVAGg4RJDi-5-HlkDUZclGeuyQB-07w0Or_ffg050FAo8ssA-oihC-FFf8zAV80x6ykmnxQVolE2pjfCitclSFM8CnvNCxE7lsPTB5FLgrrx9VsfquI8qhYTYZfQEq4ptKig1nGCr88o Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}] Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 25918ea9699d41048d84386475ab6592 Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'ba8d8ab8-f1e1-442b-97a4-077bf55d0c78'} Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:58.587689 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Returning 404 to user: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cfb349c8-bfe2-4572-8372-545d36ba5f57 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 404 len: 111 microversion: 2.42 time: 0.063802 Aug 30 16:27:58.596303 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2653/4922] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:27:58 2022] DELETE /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:58.597857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:58.598518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] [instance: ba8d8ab8-f1e1-442b-97a4-077bf55d0c78] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:58.607754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.609295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.610282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.615311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.616336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.617809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.645633 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] HTTP exception thrown: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Request method failure captured: Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 HTTP/1.1 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjjvl6I0m4TOh91K4UNO7jtWTQdxN2fisXNgVAGg4RJDi-5-HlkDUZclGeuyQB-07w0Or_ffg050FAo8ssA-oihC-FFf8zAV80x6ykmnxQVolE2pjfCitclSFM8CnvNCxE7lsPTB5FLgrrx9VsfquI8qhYTYZfQEq4ptKig1nGCr88o Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_10923d93d36d491ab095e4c5360fa072"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/10923d93d36d491ab095e4c5360fa072"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/10923d93d36d491ab095e4c5360fa072"}]}] Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 10923d93d36d491ab095e4c5360fa072 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-524445932 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 25918ea9699d41048d84386475ab6592 Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TaggedBootDevicesTest_v242-524445932-project Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'ba8d8ab8-f1e1-442b-97a4-077bf55d0c78'} Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.647599 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. Aug 30 16:27:58.652805 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:27:58.659031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] Returning 404 to user: Instance ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:27:58.660492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6df796c0-8d92-4404-98c4-462b88fbcb48 tempest-TaggedBootDevicesTest_v242-524445932 tempest-TaggedBootDevicesTest_v242-524445932-project] 10.222.0.47 "GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78" status: 404 len: 111 microversion: 2.42 time: 0.066159 Aug 30 16:27:58.661848 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2654/4923] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:27:58 2022] GET /compute/v2.1/servers/ba8d8ab8-f1e1-442b-97a4-077bf55d0c78 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:27:58.688358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:58.689312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:58.724091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.724606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.729457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:58.730369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:58.730836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:58.731507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:59.040074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:59.057384 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-895ada88-dc54-4aea-aeba-1648b89f4469 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.378221 Aug 30 16:27:59.059391 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2655/4924] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:58 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:59.326218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:27:59.327454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:27:59.342186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:59.343589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:59.345429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:59.346276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:27:59.348133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:27:59.350005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:27:59.475323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:59.491499 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0654385c-9cf3-4b26-a902-476cc54ab23b tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1506 microversion: 2.1 time: 1.141511 Aug 30 16:27:59.495844 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2270/4925] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:58 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1506 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:27:59.613686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:27:59.627189 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7be89af-7146-4015-b186-791cc0c5541d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1511 microversion: 2.1 time: 0.307547 Aug 30 16:27:59.629739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2656/4926] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:27:59 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:00.085268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:00.088226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:00.112030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.115575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.118032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.120161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.121292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.131722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.516238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:00.516879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:00.545048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.545598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.546064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.546980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.555536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.556310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.741001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:00.750698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8371b644-76d2-4e50-989d-c76df0772b03 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1464 microversion: 2.1 time: 0.238444 Aug 30 16:28:00.761940 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2657/4927] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:00 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:00.774055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64709681-735f-4bd4-9fa9-609a19ceefcf", "name": "network-vif-deleted", "tag": "91ecd3ff-f10e-4c24-8f54-11201498a7aa"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:00.806717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.807611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.811907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.839499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] Creating event network-vif-deleted:91ecd3ff-f10e-4c24-8f54-11201498a7aa for instance 64709681-735f-4bd4-9fa9-609a19ceefcf on n-h1-830883-28 Aug 30 16:28:00.856606 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-39cb3b6a-8616-46f8-b3b3-3a792d282979 req-4ec7aaf4-161d-486e-83d4-f864bb066f29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087458 Aug 30 16:28:00.857578 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2658/4928] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:00.870466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:00.871477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:00.890730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.891517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.892191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.893160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.893851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.894548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.978009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:00.979164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:00.979878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:00.980596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lazy-loading 'fault' on Instance uuid 64709681-735f-4bd4-9fa9-609a19ceefcf {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:01.097795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:01.112758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87dff7df-b667-49c0-8d69-f2b5d4ef8ecf tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 200 len: 1306 microversion: 2.1 time: 0.248084 Aug 30 16:28:01.113799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2659/4929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:00 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:01.240437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:01.253976 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da005e97-6c3a-487d-acc8-994ac329dfbb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 1.174160 Aug 30 16:28:01.266327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2271/4930] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:00 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:01.783871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:01.784724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:01.795900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:01.799381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:01.801012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:01.802665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:01.805082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:01.805967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:01.876768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:01.877422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:01.877973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:01.878827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lazy-loading 'fault' on Instance uuid b9f87a4d-cb59-42dd-a92a-2f4abc206632 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:01.928086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:01.940578 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-981e96b8-b9e6-424e-87d2-e52e58a0b751 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 200 len: 1304 microversion: 2.1 time: 0.161374 Aug 30 16:28:01.941763 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2660/4931] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:01 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:02.144666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:02.144666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:02.177864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.199330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.202520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.203678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.205061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.205679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.251269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf HTTP/1.1 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '64709681-735f-4bd4-9fa9-609a19ceefcf'} Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:02.261989 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:02.268094 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:02.270284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:02.280719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:02.281763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:02.293055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7f964df-f243-4626-a26b-c1625b21b2c8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 404 len: 111 microversion: 2.1 time: 0.155475 Aug 30 16:28:02.296437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.298523 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2272/4932] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:02 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:02.307813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.317273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:02.318103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.320183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.333959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.343094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.344586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:02.369935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.372627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.373798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.374560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.379538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.379973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.757310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:02.766042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba4c7e65-c66b-4269-9ad6-db83a95ae090 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.490698 Aug 30 16:28:02.775322 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2661/4933] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:02 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:02.787226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7380c1-2da1-47de-814c-5d9c5e38c9d3", "name": "network-vif-plugged", "status": "completed", "tag": "8fa49f32-4fcf-45dc-8e55-171198a9fd41"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:02.817189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.818905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.819193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.834411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] Creating event network-vif-plugged:8fa49f32-4fcf-45dc-8e55-171198a9fd41 for instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 on n-h2-830883-28 Aug 30 16:28:02.846039 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b901dc64-27df-4790-8604-7b27bb085f1e req-95e0af87-51ab-46de-bbf4-e10e6091c3df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068264 Aug 30 16:28:02.847449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2662/4934] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:02.865494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:02.875096 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d5403378-fc22-4f0a-89d5-caf495ae2239 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.569138 Aug 30 16:28:02.879238 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2273/4935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:02 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:02.917622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f87a4d-cb59-42dd-a92a-2f4abc206632", "name": "network-vif-deleted", "tag": "197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:02.952333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.952755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.953202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.971142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:02.973059 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] Creating event network-vif-deleted:197c6d1d-8ec1-4687-a6bc-2082d1d5ed4c for instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 on n-h1-830883-28 Aug 30 16:28:02.978278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: b9f87a4d-cb59-42dd-a92a-2f4abc206632] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:02.985848 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-94596938-0c31-4cba-9825-bea262690929 req-2e2dcfda-144d-45fc-96d8-47e238ef8c95 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071374 Aug 30 16:28:02.993033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2663/4936] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:02.993791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.994583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.995208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:02.996145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:02.996770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:02.997378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.035328 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 HTTP/1.1 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b9f87a4d-cb59-42dd-a92a-2f4abc206632'} Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:03.044061 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. Aug 30 16:28:03.049105 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.051839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 404 to user: Instance b9f87a4d-cb59-42dd-a92a-2f4abc206632 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:03.053550 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-396f01b4-9eff-4fba-a71d-bcbc7f5cd741 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632" status: 404 len: 111 microversion: 2.1 time: 0.090837 Aug 30 16:28:03.054204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2274/4937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:02 2022] GET /compute/v2.1/servers/b9f87a4d-cb59-42dd-a92a-2f4abc206632 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:03.063987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:03.064597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:03.072497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.073009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.073480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.074185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.079675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.083250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.093956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0e15fdf-db0a-4a3d-88de-8ef7e233d892 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0e15fdf-db0a-4a3d-88de-8ef7e233d892 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 163 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": 12345, "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 12345 Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:03.097721 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 16:28:03.103520 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:03.111922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0e15fdf-db0a-4a3d-88de-8ef7e233d892 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:03.116274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b0e15fdf-db0a-4a3d-88de-8ef7e233d892 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026412 Aug 30 16:28:03.119284 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2275/4938] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:03 2022] POST /compute/v2.1/servers => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:03.129565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:03.134918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:03.167141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.168758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.169712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.172934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.173088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:28:03.174683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.175653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.339960 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-842d9d89-510c-4e76-99c5-a16d03c53878 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 204 len: 0 microversion: 2.1 time: 0.280330 Aug 30 16:28:03.340831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2664/4939] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:03 2022] DELETE /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:28:03.349930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:03.350881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:03.367749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.368492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.369112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.370260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.370754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.371183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.556035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:03.566845 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-daf752cb-dd02-4012-9a63-3a5048a7ac90 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.440662 Aug 30 16:28:03.568145 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2276/4940] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:03 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:03.592416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:03.593387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:03.602553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.603334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.603987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.605259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.606278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.606947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.695945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:03.704194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ea525f6-bdef-4813-9a13-6b4b92e1ed12 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1494 microversion: 2.1 time: 0.358982 Aug 30 16:28:03.705035 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2665/4941] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:03 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1494 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:03.798656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:03.799408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:03.806692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.809498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.810481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.811456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:03.812233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:03.812985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:03.874244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:03.885865 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0f7df59-90ee-4590-af96-a0ef1bceb299 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.298515 Aug 30 16:28:03.886977 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2277/4942] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:03 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:04.072546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:04.081672 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43bda065-501b-4933-b004-ac384342f0c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.296758 Aug 30 16:28:04.084452 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2666/4943] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:03 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:04.725450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:04.727138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:04.743331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:04.744061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:04.745218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:04.746852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:04.747672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:04.749800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:05.105759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:05.107047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:05.136867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:05.137396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:05.137846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:05.142215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:05.145333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:05.146149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:05.462078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:05.485727 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8f2b6b0-2bfd-46f8-8d9d-ca2805501590 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1314 microversion: 2.1 time: 0.383137 Aug 30 16:28:05.488125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2667/4944] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:05 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:05.635685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:05.645763 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5bd27020-c504-45f9-9b71-f217f4051915 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1494 microversion: 2.1 time: 0.924306 Aug 30 16:28:05.649117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2278/4945] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:04 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1494 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:06.250032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8874af2e-b445-4c3f-b489-51e258351807", "name": "network-vif-deleted", "tag": "ca14b877-e929-4757-856e-6c7f3755c822"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:06.298961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.301323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.305061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.353798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] Creating event network-vif-deleted:ca14b877-e929-4757-856e-6c7f3755c822 for instance 8874af2e-b445-4c3f-b489-51e258351807 on n-h2-830883-28 Aug 30 16:28:06.372468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-66ff8d8f-eb6e-4c79-b5fd-4e2f3d1ab3a7 req-6cfe3f71-f526-4621-8f68-3a49f782b4ef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131900 Aug 30 16:28:06.373340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2668/4946] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:06.508444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:06.509082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:06.522170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.523831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.526146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.526979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.528475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.531507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.672257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:06.673761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:06.708251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.709611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.711805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.714437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.717692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.719014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.782967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.783666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.784300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.784935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lazy-loading 'fault' on Instance uuid 8874af2e-b445-4c3f-b489-51e258351807 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:06.787122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:06.825522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:06.839710 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9de2924-591b-4ca8-b37d-678db53d4f3a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1500 microversion: 2.1 time: 0.336906 Aug 30 16:28:06.840296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2279/4947] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:06 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1500 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:06.869631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:06.873092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:06.881705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.882239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.892327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.893873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:06.894400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:06.894842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:06.928727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:06.942040 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d0a1cbf-9704-4d3f-ab7d-592c86f0d8b6 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 200 len: 1305 microversion: 2.1 time: 0.275434 Aug 30 16:28:06.948510 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2669/4948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:06 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 1305 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:06.962255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:06.970076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'flavor' on Instance uuid fa7380c1-2da1-47de-814c-5d9c5e38c9d3 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:07.137106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f2099c68-4530-4f48-b5f5-1055e76c4bfd tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "POST /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3/action" status: 202 len: 0 microversion: 2.1 time: 0.275856 Aug 30 16:28:07.150469 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2280/4949] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:06 2022] POST /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:28:07.160335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:07.160976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:07.183490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.184417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.186892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.192711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.201155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.202708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.265746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c4f46de-246f-4df5-9c81-15a483cf5414 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-670506745", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "77ad9b20-444f-4574-aae9-48cddb3804e8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:07.416824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8c4f46de-246f-4df5-9c81-15a483cf5414 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c4f46de-246f-4df5-9c81-15a483cf5414 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 357 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-670506745", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "77ad9b20-444f-4574-aae9-48cddb3804e8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: exception: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-670506745', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '77ad9b20-444f-4574-aae9-48cddb3804e8'}], 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:07.423613 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. Aug 30 16:28:07.427790 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:07.431738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c4f46de-246f-4df5-9c81-15a483cf5414 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Block Device 77ad9b20-444f-4574-aae9-48cddb3804e8 is not bootable. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:07.432883 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c4f46de-246f-4df5-9c81-15a483cf5414 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.171559 Aug 30 16:28:07.433947 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2281/4950] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:07 2022] POST /compute/v2.1/servers => generated 110 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:07.446740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:07.453720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:07.466054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.483845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.490225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.492148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.494519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.498949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.696116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:07.711740 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-889c195e-bfb2-4e66-a1bb-9be13a40c1b6 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1508 microversion: 2.1 time: 0.559791 Aug 30 16:28:07.713183 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2670/4951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:07 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:07.860577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:07.873607 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21cb501b-4952-406d-b8b6-30dfef58ff5e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.433184 Aug 30 16:28:07.886536 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2282/4952] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:07 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:07.902378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:07.903275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:07.914625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.915299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.915825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.917069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.918494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.919090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.971090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:07.971711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 8874af2e-b445-4c3f-b489-51e258351807] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:07.985650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.986143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.986611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:07.987319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:07.987772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:07.988197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.036739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 HTTP/1.1 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8874af2e-b445-4c3f-b489-51e258351807'} Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:08.045438 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. Aug 30 16:28:08.049972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:08.054898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 404 to user: Instance 8874af2e-b445-4c3f-b489-51e258351807 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:08.055791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4c0f1c5-733f-4d16-a07d-24ac8591a446 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807" status: 404 len: 111 microversion: 2.1 time: 0.088679 Aug 30 16:28:08.062663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2283/4953] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:07 2022] GET /compute/v2.1/servers/8874af2e-b445-4c3f-b489-51e258351807 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:08.089394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:08.089902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:08.111648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:08.122113 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f2cda98-75ff-4e85-8af0-6fb9230af95a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.226678 Aug 30 16:28:08.122346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.129709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.130178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.130961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.131431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.131865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.139197 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2671/4954] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:07 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:08.227863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:28:08.366037 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa14a760-1ab5-45e1-be27-fbc99e79be99 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 204 len: 0 microversion: 2.1 time: 0.283322 Aug 30 16:28:08.369844 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2284/4955] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:08 2022] DELETE /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:28:08.375351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:08.375981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:08.390273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.390812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.391269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.391991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.392783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.393716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.717556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:08.734663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:08.735820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:08.736313 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b00df46-9350-4377-a62d-57a4aed8579c tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1673 microversion: 2.1 time: 0.364854 Aug 30 16:28:08.737094 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2672/4956] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:08 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1673 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:08.777610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.781331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.781914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:08.785278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:08.786532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:08.787072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.002884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:09.012756 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce22fa05-7329-4af5-acb1-687c65a6ad88 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1491 microversion: 2.1 time: 0.283148 Aug 30 16:28:09.015117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2285/4957] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:08 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:09.044210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:09.045024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:09.052998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:09.055217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.059254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.059890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.060801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.062958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.063611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.118017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:28:09.338343 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ada4bcc-281c-4297-85a9-8ce17086ef9d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 204 len: 0 microversion: 2.1 time: 0.297352 Aug 30 16:28:09.339964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2673/4958] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:09 2022] DELETE /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:28:09.348160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:09.348696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:09.355941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.356689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.357307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.358174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.358802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.359386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.609694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:09.621072 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-23c173b5-cb94-42ec-960d-0b916d7590ab tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1497 microversion: 2.1 time: 0.276613 Aug 30 16:28:09.626621 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2286/4959] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:09 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:09.765694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:09.767152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:09.778569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.780896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.783890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:09.786031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:09.791288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:09.792722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:10.020925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:10.037203 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0436862-cc2b-4564-9810-4090b0e08f28 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1673 microversion: 2.1 time: 0.275574 Aug 30 16:28:10.040047 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2674/4960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:09 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1673 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:10.643035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:10.643751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:10.656837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:10.657444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:10.660723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:10.661579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:10.662106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:10.663849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:10.885117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:10.897442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fae1a0e3-bc0e-495e-bef0-c7f29546cb27 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1497 microversion: 2.1 time: 0.259040 Aug 30 16:28:10.900200 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2287/4961] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:10 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:11.069264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:11.070211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:11.097859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.098216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.100277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:11.102824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.105988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.107507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:11.241787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:11.264527 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ae27841-293d-4ece-be91-72a140c1d999 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1606 microversion: 2.1 time: 0.199800 Aug 30 16:28:11.265133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2675/4962] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:11 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1606 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:11.453979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92ec72c9-7c93-49a8-b755-c030ea033d6b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1577093980", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "destination_type": "local"}, {"source_type": "volume", "uuid": "8546112d-78d6-435c-9823-8a700a077f04", "destination_type": "invalid"}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92ec72c9-7c93-49a8-b755-c030ea033d6b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 495 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1577093980", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "destination_type": "local"}, {"source_type": "volume", "uuid": "8546112d-78d6-435c-9823-8a700a077f04", "destination_type": "invalid"}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1577093980', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8546112d-78d6-435c-9823-8a700a077f04', 'destination_type': 'invalid'}], 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:11.460476 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 16:28:11.464463 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:11.468719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92ec72c9-7c93-49a8-b755-c030ea033d6b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:11.482642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92ec72c9-7c93-49a8-b755-c030ea033d6b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031583 Aug 30 16:28:11.484982 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2288/4963] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:11 2022] POST /compute/v2.1/servers => generated 155 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:28:11.494112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:11.495142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:11.510411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.513928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.514857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:11.516101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.516817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.518780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:11.923596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:11.924348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:11.945289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.946096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.946805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:11.947794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:11.948365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:11.948904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:12.698487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:12.712103 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6dad53c-0587-4f75-8664-394962bf2028 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1497 microversion: 2.1 time: 0.793732 Aug 30 16:28:12.717076 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2289/4964] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:11 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1497 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:12.728248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:12.732557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:12.746174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:12.746953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:12.747552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:12.748468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:12.749095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:12.750864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:12.789750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:12.802391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f63be11e-dc60-46bf-9488-18d3d8c8cad3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.312985 Aug 30 16:28:12.832735 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2676/4965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:11 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:12.844791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8a958d-f47e-466c-9d97-5fa496b1afea", "name": "network-vif-deleted", "tag": "a0b82679-a9d1-4896-92bf-bd8d5b51c5a5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:12.868995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:12.869763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:12.872942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:12.914346 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] Creating event network-vif-deleted:a0b82679-a9d1-4896-92bf-bd8d5b51c5a5 for instance 5a8a958d-f47e-466c-9d97-5fa496b1afea on n-h1-830883-28 Aug 30 16:28:12.934793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3c2e15ae-b9d3-4a94-b5ac-126d758b9b3e req-738e53da-3e4a-4ff0-906f-d6cda72f9fc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099097 Aug 30 16:28:12.940956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c865c4a5e7463b9f55de166009b343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2c70537f9f48c89243905d8bd74e15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:12.952999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2677/4966] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:12.965260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:12.967564 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-451c0604-80dc-4836-90be-22d4c70ff615 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 200 len: 1322 microversion: 2.1 time: 0.249065 Aug 30 16:28:12.968569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:12.969461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2290/4967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:12 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:13.005287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.005822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.006353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.009914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.011182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.013627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.334636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:13.344895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9dedd2a3-d202-4cde-906b-c4b80e1b31b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.389438 Aug 30 16:28:13.352643 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2678/4968] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:12 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:13.451634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-987bbbbf-b7a5-4589-8efc-7af5c1cd8ef2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1752350752", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-987bbbbf-b7a5-4589-8efc-7af5c1cd8ef2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 492 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1752350752", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1752350752', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.458402 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:13.461793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-987bbbbf-b7a5-4589-8efc-7af5c1cd8ef2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:13.463836 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-987bbbbf-b7a5-4589-8efc-7af5c1cd8ef2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014803 Aug 30 16:28:13.470479 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2291/4969] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:13 2022] POST /compute/v2.1/servers => generated 624 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:13.474984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:13.476152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:13.486643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.490950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.492316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.493302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.493957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.494412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.735998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:13.736719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:13.749664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:13.757609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.758099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6e8e7b6-0215-429e-92b5-61c0b3aff6b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.287134 Aug 30 16:28:13.760311 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2679/4970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:13 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:13.770681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.773644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.773644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.773644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.774230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.785121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:13.786927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:13.799744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.806917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.807815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.808484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.809162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.809552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.865504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:13.866010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:13.867043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:13.867518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lazy-loading 'fault' on Instance uuid fa7380c1-2da1-47de-814c-5d9c5e38c9d3 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:13.937511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512a5e5b9ce048ce8a48dae5253b247f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdb2ae22edb4d87989fb377f5598e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:13.947728 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9485a2d5-12c8-41ff-8ced-6355f8f6ba86 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 200 len: 1304 microversion: 2.1 time: 0.213711 Aug 30 16:28:13.948971 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2292/4971] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:13 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:13.995615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:13.996347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] [instance: 5a8a958d-f47e-466c-9d97-5fa496b1afea] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:14.006153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.011126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.011689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.012521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.013074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.013584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.038062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] HTTP exception thrown: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Request method failure captured: Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea HTTP/1.1 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjiULHV-HCJ1zGYvebWXdN46o5_uEp8vrkJlOxTAkohwlaYaN_hL-Lv_YE6cLLfaF6Nmx4qHv6uljU5ZnZrDOWNbMtPXBaox0jTFAEJp5PQLObX_JJqSsWm8ACkV-coTzWelxn_aJcfy6GHtiBZ-H3Ifri6VOtGdjQNoPcc9PgGhI9c Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ab2c70537f9f48c89243905d8bd74e15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ab2c70537f9f48c89243905d8bd74e15"}]}] Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ab2c70537f9f48c89243905d8bd74e15 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2065441136 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 02c865c4a5e7463b9f55de166009b343 Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2065441136-project Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5a8a958d-f47e-466c-9d97-5fa496b1afea'} Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:14.040362 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Returning 404 to user: Instance 5a8a958d-f47e-466c-9d97-5fa496b1afea could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:14.044980 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5693865d-1ca4-4660-a48d-05bb35f908a1 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea" status: 404 len: 111 microversion: 2.1 time: 0.052991 Aug 30 16:28:14.048353 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2293/4972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:13 2022] GET /compute/v2.1/servers/5a8a958d-f47e-466c-9d97-5fa496b1afea => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:14.053235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9fd66ad-681c-492c-89d3-88c965208e13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] Calling method '.version_select at 0x7fd35c2a1ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:14.081845 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9fd66ad-681c-492c-89d3-88c965208e13 tempest-ServerActionsTestJSON-2065441136 tempest-ServerActionsTestJSON-2065441136-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755286941" status: 202 len: 0 microversion: 2.1 time: 0.032299 Aug 30 16:28:14.095118 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2294/4973] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:28:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755286941 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:28:14.120217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:14.133690 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d844bc54-5e17-4ee1-8201-bb175c894dd3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.350080 Aug 30 16:28:14.134895 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2680/4974] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:13 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:14.222521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acf404cc-e4f5-46d5-b698-d6d3d0a08d24 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acf404cc-e4f5-46d5-b698-d6d3d0a08d24 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 416 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.229864 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acf404cc-e4f5-46d5-b698-d6d3d0a08d24 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acf404cc-e4f5-46d5-b698-d6d3d0a08d24 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013185 Aug 30 16:28:14.242441 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2295/4975] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:14 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:14.250208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:14.250658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:14.265303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.266388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.269868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.271695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.272384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.273839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.525665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:14.538089 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0127e934-05c0-45b6-8838-b41f0d377d87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.294935 Aug 30 16:28:14.540824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2681/4976] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:14 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:14.568015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:14.568813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:14.580725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.582687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.586120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.587162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.587852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.588531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.968886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:14.970651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:14.971356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:14.982646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca9ead63-fdec-40a9-83d7-f8c4fc4c8f81 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.414455 Aug 30 16:28:14.982868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.983327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2296/4977] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:14 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:14.985293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.985792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:14.988671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:14.990054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:14.990577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.033559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa7380c1-2da1-47de-814c-5d9c5e38c9d3", "name": "network-vif-deleted", "tag": "8fa49f32-4fcf-45dc-8e55-171198a9fd41"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:15.048168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.050022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.050480 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.050632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 HTTP/1.1 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fa7380c1-2da1-47de-814c-5d9c5e38c9d3'} Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.052497 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.058047 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.060110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.061161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9a1d61dc-c710-4f9d-bd61-7cc619d3d8de tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 404 len: 111 microversion: 2.1 time: 0.095211 Aug 30 16:28:15.063775 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2682/4978] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:14 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.080888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.084444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.092387 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] Creating event network-vif-deleted:8fa49f32-4fcf-45dc-8e55-171198a9fd41 for instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 on n-h2-830883-28 Aug 30 16:28:15.108825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.109642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.110262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.111406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.112625 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ccc2a224-564d-47ca-b151-22dd1d35aab5 req-e94b0667-4f16-4cdf-a860-4c022adedd9e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080400 Aug 30 16:28:15.113320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.114636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.114817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2297/4979] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:15.128021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db5d50f3-3075-4a15-bc9b-a41d951ffd1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1855055105", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": -1, "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:15.151390 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 HTTP/1.1 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fa7380c1-2da1-47de-814c-5d9c5e38c9d3'} Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.158607 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.163820 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-db5d50f3-3075-4a15-bc9b-a41d951ffd1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Flavor -1 could not be found. Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db5d50f3-3075-4a15-bc9b-a41d951ffd1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 206 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1855055105", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": -1, "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: exception: Flavor -1 could not be found. Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1855055105', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': -1, 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.164543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db5d50f3-3075-4a15-bc9b-a41d951ffd1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db5d50f3-3075-4a15-bc9b-a41d951ffd1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.051040 Aug 30 16:28:15.168437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2298/4980] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:15 2022] POST /compute/v2.1/servers => generated 73 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:28:15.175894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.175894 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1c84ae9-57da-402e-a801-41dc02c6e307 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 404 len: 111 microversion: 2.1 time: 0.101524 Aug 30 16:28:15.177219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.177959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.188618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2683/4981] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:15 2022] DELETE /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.195847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.196853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: fa7380c1-2da1-47de-814c-5d9c5e38c9d3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.204798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.205769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.206080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.207343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.208313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.209109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.209241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.209938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.210246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.218843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.219393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.219790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.229473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 HTTP/1.1 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fa7380c1-2da1-47de-814c-5d9c5e38c9d3'} Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.231816 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. Aug 30 16:28:15.236555 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.242926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance fa7380c1-2da1-47de-814c-5d9c5e38c9d3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.244211 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fad13647-4a74-4c53-8f9a-b462a1b75677 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3" status: 404 len: 111 microversion: 2.1 time: 0.054546 Aug 30 16:28:15.249827 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2684/4982] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/fa7380c1-2da1-47de-814c-5d9c5e38c9d3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.255648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.256465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.266830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.270994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.271780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.273695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.274408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.275079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.318334 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 HTTP/1.1 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1cc5cf91-32c2-495d-b8aa-8774bbd3af36'} Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.330221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.334703 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.338599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.339830 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-740d37bd-ef81-4cb1-8b93-fa87f98041c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 404 len: 111 microversion: 2.1 time: 0.088584 Aug 30 16:28:15.340872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2685/4983] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:15 2022] DELETE /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.351730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.352742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 1cc5cf91-32c2-495d-b8aa-8774bbd3af36] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.361760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.362721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.363465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.364422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.365114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.365841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.394869 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 HTTP/1.1 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '1cc5cf91-32c2-495d-b8aa-8774bbd3af36'} Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.399796 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 1cc5cf91-32c2-495d-b8aa-8774bbd3af36 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a590754a-b284-490f-b7bf-92a8ac0b1c65 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36" status: 404 len: 111 microversion: 2.1 time: 0.056625 Aug 30 16:28:15.405688 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2686/4984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/1cc5cf91-32c2-495d-b8aa-8774bbd3af36 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:15.410167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.410715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.422254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.423442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.424115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.425656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.426505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.427231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.472082 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 HTTP/1.1 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '383ca713-66ab-4951-9a59-144f78c95392'} Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.473736 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.480717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-30d8a008-1df0-4b29-a4c2-a397c9362d8c tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 404 len: 111 microversion: 2.1 time: 0.068909 Aug 30 16:28:15.484794 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2687/4985] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:15 2022] DELETE /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:15.496015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.496691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 383ca713-66ab-4951-9a59-144f78c95392] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.526460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.527018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.535323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.538900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.539599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.540767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.578924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 HTTP/1.1 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '383ca713-66ab-4951-9a59-144f78c95392'} Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.582489 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. Aug 30 16:28:15.590043 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.613082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 383ca713-66ab-4951-9a59-144f78c95392 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.614037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2306c99a-5a50-47fc-9e01-526c7772689f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392" status: 404 len: 111 microversion: 2.1 time: 0.128156 Aug 30 16:28:15.619220 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2688/4986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/383ca713-66ab-4951-9a59-144f78c95392 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.627093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.629678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.672704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.677364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.679736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.685170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.686656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.687327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.707631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 HTTP/1.1 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e60a046-857f-4633-90ce-737f6921e0d7'} Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.710788 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.714834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.717324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.718758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da2039f6-a495-465c-ab84-661d770f6c5d tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 404 len: 111 microversion: 2.1 time: 0.098264 Aug 30 16:28:15.723558 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2689/4987] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:15 2022] DELETE /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:15.732309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.734013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e60a046-857f-4633-90ce-737f6921e0d7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.743319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.744822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.745490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.746561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.747350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.747949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.768938 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 HTTP/1.1 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e60a046-857f-4633-90ce-737f6921e0d7'} Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.771588 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. Aug 30 16:28:15.777221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.780562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e60a046-857f-4633-90ce-737f6921e0d7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.781668 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5c7052e-89e5-4786-9659-301e374dbb28 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7" status: 404 len: 111 microversion: 2.1 time: 0.053747 Aug 30 16:28:15.783534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2690/4988] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/7e60a046-857f-4633-90ce-737f6921e0d7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:15.793308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.794027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.796854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:15.802054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 HTTP/1.1 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '94ffa957-fd91-4cbd-8f1e-06d833b5a451'} Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.804384 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.808617 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.811679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.812864 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c3ef6651-c3da-464c-ad3c-4cb3b1d69c8f tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451" status: 404 len: 111 microversion: 2.1 time: 0.024986 Aug 30 16:28:15.814041 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2691/4989] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:15 2022] DELETE /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:15.816151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1669b972-22cf-4dd0-8fcf-747ed0a316b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.633528 Aug 30 16:28:15.822732 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2299/4990] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:15.825771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.826682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 94ffa957-fd91-4cbd-8f1e-06d833b5a451] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.836427 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 HTTP/1.1 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '94ffa957-fd91-4cbd-8f1e-06d833b5a451'} Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:15.838512 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:15.844811 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:15.844811 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:15.844811 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:15.844811 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. Aug 30 16:28:15.844811 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:15.846770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:15.848174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:15.854364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 94ffa957-fd91-4cbd-8f1e-06d833b5a451 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:15.855788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.856333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.856942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.857372 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-709c448e-c3a0-41c0-ba60-dd705b962746 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451" status: 404 len: 111 microversion: 2.1 time: 0.037220 Aug 30 16:28:15.857917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:15.858551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:15.859231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:15.861119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2692/4991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/94ffa957-fd91-4cbd-8f1e-06d833b5a451 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:16.173811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:16.186130 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-99007fc5-e419-4ca2-b407-d0766e79822d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.344617 Aug 30 16:28:16.238201 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2300/4992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:15 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:16.280510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d4f2a15-3d39-4950-9656-741844d5c592 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1254174323", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d4f2a15-3d39-4950-9656-741844d5c592 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 173 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1254174323", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1254174323', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi -1 Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:16.284970 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d4f2a15-3d39-4950-9656-741844d5c592 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:16.289216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d4f2a15-3d39-4950-9656-741844d5c592 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010262 Aug 30 16:28:16.301900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:16.302564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:16.314211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2693/4993] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:16 2022] POST /compute/v2.1/servers => generated 145 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:16.317604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.318570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.319678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.328744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.329689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.330199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.335745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:16.532081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:16.541856 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78d66d97-fc7d-4df6-bd8e-94fc20e69176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.246417 Aug 30 16:28:16.564090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:16.564717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:16.567991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2301/4994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:16 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:16.574151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.574963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.575584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.576469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.577102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.577721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.582589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:16.758343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:16.767703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66ef5c14-a72e-48d5-8a28-76f6d1274fc8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.208557 Aug 30 16:28:16.768269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2694/4995] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:16 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:16.907789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1101d956-087b-4fc8-9877-ee8072d1e0da"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:16.910534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:16.918809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6940074d-8bf7-46cf-9a28-6bc537a60ef9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1869570366", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:16.919944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.920677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.921363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.922284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.923048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.923686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.923941 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6940074d-8bf7-46cf-9a28-6bc537a60ef9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6940074d-8bf7-46cf-9a28-6bc537a60ef9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 216 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1869570366", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1869570366', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.938140 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6940074d-8bf7-46cf-9a28-6bc537a60ef9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6940074d-8bf7-46cf-9a28-6bc537a60ef9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.025373 Aug 30 16:28:16.942176 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2695/4996] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:16 2022] POST /compute/v2.1/servers => generated 123 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:28:16.952298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:16.954813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:16.967800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.979387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.980192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:16.981208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:16.981940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:16.982647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.063421 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments HTTP/1.1 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 74 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: {"volumeAttachment": {"volumeId": "1101d956-087b-4fc8-9877-ee8072d1e0da"}} Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '5281e689-fa01-447f-a37e-e51da7e0b8be', 'body': {'volumeAttachment': {'volumeId': '1101d956-087b-4fc8-9877-ee8072d1e0da'}}} Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5140, in attach_volume Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4980, in _check_volume_already_attached Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:17.065200 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be Aug 30 16:28:17.070769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:17.072084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 400 to user: Invalid volume: volume 1101d956-087b-4fc8-9877-ee8072d1e0da is already attached to instances: 5281e689-fa01-447f-a37e-e51da7e0b8be {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:17.080692 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb2cedd5-f57b-4dde-ad4e-e37b81bd9295 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177234 Aug 30 16:28:17.081636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2302/4997] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:28:16 2022] POST /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 174 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:17.269043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:17.269717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:17.277282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.277479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.294783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.295651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.296292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.296674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:17.297145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.314113 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ad64c83d-96ed-4093-8e0e-5070762c4c0c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.362780 Aug 30 16:28:17.315654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2696/4998] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:16 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:17.342095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:17.343229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:17.355446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.358923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.359710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.361384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.363502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.367513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.469447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lazy-loading 'services' on Instance uuid 5281e689-fa01-447f-a37e-e51da7e0b8be {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:17.604712 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-69ec8cb6-7e3b-4baa-b24e-3f28916414d6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments/1101d956-087b-4fc8-9877-ee8072d1e0da" status: 202 len: 0 microversion: 2.1 time: 0.339335 Aug 30 16:28:17.605724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2303/4999] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:28:17 2022] DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments/1101d956-087b-4fc8-9877-ee8072d1e0da => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:28:17.620101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:17.626199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:17.646106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.650029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.651629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.652807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:17.655146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:17.657972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:17.742397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-960f8c01-e299-4e00-9761-31562665e959 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127680 Aug 30 16:28:17.745834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2304/5000] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:17 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:28:18.105025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:18.122565 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81e3dec0-fe23-40a3-8755-c2af4cc97f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.784872 Aug 30 16:28:18.126372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2697/5001] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:17 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:18.279412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1482724491", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-key-756151487", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:18.382718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] validate_networks() for [('41f78965-9e06-49c9-99ac-2886a39ad4ca', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:28:18.754657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:18.758108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:18.775355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:18.776004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:18.776550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:18.778428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:18.781294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:18.782024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:18.889980 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c04db55b-38d7-4e3a-a0bd-f316ec84242b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140002 Aug 30 16:28:18.906966 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2698/5002] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:18 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:19.066846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Invalid key_name provided. Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 246 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1482724491", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-key-756151487", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid key_name provided. Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1482724491', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'key_name': 'tempest-key-756151487', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-756151487 not found for user d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:19.071720 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 30 16:28:19.075854 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:19.082606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid key_name provided. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:19.092251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-836c3c7c-3bee-4545-843c-872436bb2999 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.817588 Aug 30 16:28:19.094092 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2305/5003] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:18 2022] POST /compute/v2.1/servers => generated 70 bytes in 820 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:28:19.104714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:19.105782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:19.116591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.123630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.124441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:19.125465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.126563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.127253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:19.478113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:19.505675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2747990c-60c0-4822-b8bc-6b03d0aa793b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.407169 Aug 30 16:28:19.506356 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2699/5004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:19 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:19.534255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:19.535148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:19.565228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.565731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.566179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:19.566935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.567393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.567828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:19.882674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:19.897238 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7afee78e-5f81-4ea1-87e9-ad12e9d46395 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.370002 Aug 30 16:28:19.898673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2306/5005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:19 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:19.905303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:19.907572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:19.936109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.936622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.937128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:19.937800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:19.938257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:19.938718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:20.010757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1513796238", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:20.030074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6481a81-e8ba-40cf-a160-77964efdf746 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128704 Aug 30 16:28:20.033387 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2700/5006] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:19 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:20.355008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.security_group_api [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Neutron security group does_not_exist not found {{(pid=122351) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 30 16:28:20.355620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 258 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1513796238", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1513796238', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 30 16:28:20.367496 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:20.372719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:20.381533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33c9f307-6919-47a8-9728-c11c68461bef tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.364255 Aug 30 16:28:20.381533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2307/5007] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 366 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:28:20.382815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:20.382815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:20.393014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:20.393521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:20.394351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:20.396099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:20.399357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:20.400096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.051783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.055859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.082511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.087204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.090462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.091512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.094662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.095036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.201492 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de37f2be-3148-49f1-963e-33bc96989995 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159403 Aug 30 16:28:21.205170 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2308/5008] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:21 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:28:21.243334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:21.256338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-401f3560-50fa-4db9-bbaf-0175c8f3fb60 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.881635 Aug 30 16:28:21.259553 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2701/5009] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:20 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:21.293818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.294624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.384737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.387437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.389725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.391100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.394470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.395732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.640830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.641353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.655122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.655635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.660164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.661694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.667370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.668083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.713133 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 HTTP/1.1 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '6057db1f-0c33-40bf-8969-215648d84fb7'} Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:21.716273 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.721270 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.723616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:21.724670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e3ac338-2634-418b-9263-7d5a959959c1 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 404 len: 111 microversion: 2.1 time: 0.088510 Aug 30 16:28:21.729350 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2702/5010] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:21 2022] DELETE /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:21.735224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.736070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 6057db1f-0c33-40bf-8969-215648d84fb7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.743674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.744470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.745160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.746124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.746863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.747495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.771057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 HTTP/1.1 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '6057db1f-0c33-40bf-8969-215648d84fb7'} Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.773162 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. Aug 30 16:28:21.778129 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.779879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 6057db1f-0c33-40bf-8969-215648d84fb7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:21.780938 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b35642e-eda4-4513-9489-61a1a307a72a tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7" status: 404 len: 111 microversion: 2.1 time: 0.050104 Aug 30 16:28:21.783088 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2703/5011] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:21 2022] GET /compute/v2.1/servers/6057db1f-0c33-40bf-8969-215648d84fb7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:21.796822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.798422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.807648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.808429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.809118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.810542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.811514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.812870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.850187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 HTTP/1.1 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e4b2dcf-13e8-4197-a971-069c20a4ab00'} Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:21.854446 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bbbb4bbd-19de-4bc8-ba0b-a04cf0e70f13 tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 404 len: 111 microversion: 2.1 time: 0.069961 Aug 30 16:28:21.861720 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2704/5012] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:21 2022] DELETE /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:21.870844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:21.872638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] [instance: 7e4b2dcf-13e8-4197-a971-069c20a4ab00] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:21.896417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.897422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.898280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.901972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:21.903340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:21.904282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:21.939665 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] HTTP exception thrown: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Request method failure captured: Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 HTTP/1.1 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjl-h13ixfaZhcMupXKNSU17CYB5Gu_BOFXGuzFtawk5ohPltSz1TB3lTnQqkv-Qq9pMC_flCgPCkaKWK6ikmTnBiNPaiJ_GyzQ18_kM4xQNEpAf9CthqOuXaPwsCgwEPOkjjxq3Shlt3lWRhkNT8mOXlWtgCb8ZqhzS-qhbAJn2kGs Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cdb2ae22edb4d87989fb377f5598e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cdb2ae22edb4d87989fb377f5598e39"}]}] Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 8cdb2ae22edb4d87989fb377f5598e39 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-335164141 Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 512a5e5b9ce048ce8a48dae5253b247f Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-335164141-project Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e4b2dcf-13e8-4197-a971-069c20a4ab00'} Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:21.941492 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. Aug 30 16:28:21.948994 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:21.951234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] Returning 404 to user: Instance 7e4b2dcf-13e8-4197-a971-069c20a4ab00 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:21.952429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-588c1255-0192-47cc-a619-2c99df122feb tempest-DeleteServersTestJSON-335164141 tempest-DeleteServersTestJSON-335164141-project] 10.222.0.47 "GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00" status: 404 len: 111 microversion: 2.1 time: 0.087657 Aug 30 16:28:21.953233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2705/5013] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:21 2022] GET /compute/v2.1/servers/7e4b2dcf-13e8-4197-a971-069c20a4ab00 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:22.035267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:22.057699 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c00a662-acce-4216-9965-a53a81390527 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.770461 Aug 30 16:28:22.059451 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2309/5014] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:21 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:22.078419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:22.078992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 5e491d08-92d5-4dc9-b63f-b9e1627a3df9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:22.091657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/5e491d08-92d5-4dc9-b63f-b9e1627a3df9 HTTP/1.1 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5e491d08-92d5-4dc9-b63f-b9e1627a3df9'} Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:22.102715 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 5e491d08-92d5-4dc9-b63f-b9e1627a3df9 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:22.107203 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9faa8235-f287-4a2f-b9c2-8846e6d1d767 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e491d08-92d5-4dc9-b63f-b9e1627a3df9" status: 404 len: 111 microversion: 2.1 time: 0.030041 Aug 30 16:28:22.113025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:22.113659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:22.118676 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2706/5015] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:22 2022] DELETE /compute/v2.1/servers/5e491d08-92d5-4dc9-b63f-b9e1627a3df9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:22.129048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.129541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.135947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:22.136721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.137204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.137872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:22.223375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:22.227156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:22.243802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.244385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.249565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:22.250437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.250934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.251585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:22.322503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f62df092-d298-4fa7-b250-df7abacc9b89 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108127 Aug 30 16:28:22.327835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2707/5016] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:22 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:22.478598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:22.490535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdb8e529-1322-4f0b-bc25-f922454a508c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.379337 Aug 30 16:28:22.493265 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2310/5017] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:22 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:22.519377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:22.520393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:22.539686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.540650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.541302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:22.543282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:22.543934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:22.544995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.079634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:23.089173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89e77481-d9a5-4c1a-aae8-5061a50ee16e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.573581 Aug 30 16:28:23.089656 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2708/5018] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:22 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:23.114992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:23.115538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:28:23.115935 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9223372036854775808 could not be found. Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9223372036854775808'} Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:23.117972 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4bbc8f0e-2f97-4cda-9ead-c57be1d642c9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009392 Aug 30 16:28:23.122572 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2311/5019] 10.222.0.47 () {58 vars in 1188 bytes} [Tue Aug 30 16:28:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:28:23.128358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:23.128988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:23.140100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.140610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.141058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.141779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.142241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.146786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.338140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:23.341165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:23.360428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.361319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.361930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.364952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.369002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.369641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.445078 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ee915f1-0ad7-4582-bd57-060d920a0d53 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110547 Aug 30 16:28:23.446296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2312/5020] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:23 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:23.458683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:23.471464 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce82a9a4-bde6-44f5-ad28-defbd8962176 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.346980 Aug 30 16:28:23.472892 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2709/5021] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:23.499977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:23.500598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:23.510636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:23.518798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.523599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.524442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:23.528078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:23.529422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:23.529856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.107050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:24.121167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ef83557-8b5f-4010-895e-6e7133dbbf06 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.621828 Aug 30 16:28:24.135035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2313/5022] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:24.145742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:24.146230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Failed to fetch instance by id -1 {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 16:28:24.146774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance -1 could not be found. Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance -1 could not be found. Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '-1'} Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:24.149290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:24.154048 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:24.154048 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:24.154048 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 30 16:28:24.154048 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:24.154048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:24.158810 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99e1f3b8-2c72-4df0-a32b-f75ad6f2a32f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008798 Aug 30 16:28:24.159402 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2710/5023] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:28:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:28:24.170218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:24.171547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:24.193811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.194893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.195621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.196827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.197502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.198117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23a49269-ad64-4ee5-9f02-7a5cc45c1677", "device": "/dev/sdb"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:24.198355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.201047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:24.217425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.223504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.224127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.225053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.225718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.226371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.674831 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-424c6c16-801b-4d78-9c4b-fce04cf1e959 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "POST /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482727 Aug 30 16:28:24.681958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2711/5024] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:28:24 2022] POST /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:28:24.705170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:24.710033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:24.736729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.742128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.742604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.752820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:24.752820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:24.752820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:24.847583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02faaf4b-97a4-40f7-8b64-88202d2c789c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163983 Aug 30 16:28:24.849519 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2712/5025] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:24 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:24.980474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:25.006375 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93956de2-a4b1-4344-89bd-112764193f87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.840203 Aug 30 16:28:25.012371 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2314/5026] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:24 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:25.034997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:25.036003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:25.043141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:25.050451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:25.051166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:25.052101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:25.055173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:25.056253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:25.861766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:25.864154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:25.893334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:25.899125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:25.899802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:25.900754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:25.901387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:25.902002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:25.986978 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-98987a6a-3e72-4ac3-88a8-3ab2061b3113 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129361 Aug 30 16:28:25.988569 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2315/5027] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:25 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:26.220028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:26.236253 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3132ec87-1352-4b9e-a67e-cd6022017a33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.205607 Aug 30 16:28:26.237834 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2713/5028] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:25 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:26.260520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:26.261070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: e1a48446-5285-4543-aee3-49798299f89c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:26.269763 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/e1a48446-5285-4543-aee3-49798299f89c/action HTTP/1.1 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 19 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: {"forceDelete": {}} Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e1a48446-5285-4543-aee3-49798299f89c', 'body': {'forceDelete': {}}} Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:26.281845 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:26.287214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:26.287214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:26.287214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. Aug 30 16:28:26.287214 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:26.288881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance e1a48446-5285-4543-aee3-49798299f89c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:26.289935 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9934fc9d-6787-42e5-815d-8f45c40c4879 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/e1a48446-5285-4543-aee3-49798299f89c/action" status: 404 len: 111 microversion: 2.1 time: 0.034318 Aug 30 16:28:26.291042 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2316/5029] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:26 2022] POST /compute/v2.1/servers/e1a48446-5285-4543-aee3-49798299f89c/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:26.299653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:26.300564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:26.308545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:26.309387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:26.310017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:26.310935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:26.311569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:26.312172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:26.642487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:26.654632 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a5daa8e-d814-446e-9e6f-1318f5e75b55 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.358658 Aug 30 16:28:26.656127 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2714/5030] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:26 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:26.676358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:26.677315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:26.685066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:26.685781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:26.686407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:26.687260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:26.687948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:26.688530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.000891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:27.003417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:27.023299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.029830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.030514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.031597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.032238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.032839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.036441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:27.115657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ecf2795-fdd9-4b87-8b18-7ab1f6ef8797 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118647 Aug 30 16:28:27.116535 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2715/5031] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:26 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:28:27.120544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:27.129042 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-873b4a9c-9616-4642-aef0-2d973244107b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.456468 Aug 30 16:28:27.139146 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2317/5032] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:26 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:27.159375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:27.161676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 256bfdab-3f58-4594-a0a1-2cd781a6a4ee] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:27.168775 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/256bfdab-3f58-4594-a0a1-2cd781a6a4ee/action HTTP/1.1 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 39 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: {"os-getConsoleOutput": {"length": 10}} Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '256bfdab-3f58-4594-a0a1-2cd781a6a4ee', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:27.181201 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 256bfdab-3f58-4594-a0a1-2cd781a6a4ee could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:27.186636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fbc02cac-2e66-4358-b949-e31884932a02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/256bfdab-3f58-4594-a0a1-2cd781a6a4ee/action" status: 404 len: 111 microversion: 2.1 time: 0.028411 Aug 30 16:28:27.189112 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2716/5033] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:27 2022] POST /compute/v2.1/servers/256bfdab-3f58-4594-a0a1-2cd781a6a4ee/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:27.193327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:27.194714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:27.209212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.209971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.210883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.211816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.212435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.213051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.687952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:27.696780 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88b4f40b-c204-405b-af16-236b05ce6b20 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.507735 Aug 30 16:28:27.706756 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2318/5034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:27 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:27.722234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:27.723964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:27.735385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.736345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.737382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:27.738520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:27.739226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:27.741710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.127467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.129683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.131031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:28.139328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.139829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.140265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.153642 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-57099ab6-e804-43ab-944c-a22f638ceb91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.435621 Aug 30 16:28:28.157651 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2717/5035] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:27 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:28.162732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.163459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.164091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.182079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.199819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: c8fd7094-e8a6-4edd-881e-133f8aee658e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.226405 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/c8fd7094-e8a6-4edd-881e-133f8aee658e HTTP/1.1 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c8fd7094-e8a6-4edd-881e-133f8aee658e'} Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:28.234518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:28.238904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance c8fd7094-e8a6-4edd-881e-133f8aee658e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:28.240655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-307ec0a6-f3f2-4b2e-9a0e-374a7a4593d4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/c8fd7094-e8a6-4edd-881e-133f8aee658e" status: 404 len: 111 microversion: 2.1 time: 0.059453 Aug 30 16:28:28.244569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2718/5036] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:28 2022] GET /compute/v2.1/servers/c8fd7094-e8a6-4edd-881e-133f8aee658e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:28.265396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.267045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.278403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8ce466c-0941-478f-bd20-6048abdcc154 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154750 Aug 30 16:28:28.279640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2319/5037] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:28:28 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:28:28.298089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.298645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.299098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.299869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.300301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.300738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.411292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.412061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.425221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.425944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.426581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.427463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.428118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.434386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.487201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:28:28.546328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:28.644376 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-75df2414-167e-4f30-94c6-7fd2e7ce03a7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 204 len: 0 microversion: 2.1 time: 0.236582 Aug 30 16:28:28.645399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2320/5038] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:28:28 2022] DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:28:28.657224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.657966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.673900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.674493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.677482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.679470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.681365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.683949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.741935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:28.751731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5272f76c-8b60-4098-89e4-71ba86bf1683 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.504531 Aug 30 16:28:28.753114 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2719/5039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:28 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:28.782756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:28.784623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:28.804215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.805125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.806915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:28.809421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:28.810018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:28.810598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:29.195011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:29.210428 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9794038e-9b0a-4c84-88b4-72c886311726 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.431290 Aug 30 16:28:29.211067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2720/5040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:28 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:29.282860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87567626-ac0b-484b-b3bc-d92808195174 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-950320325", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87567626-ac0b-484b-b3bc-d92808195174 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 237 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-950320325", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-950320325', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.308848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:29.315054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87567626-ac0b-484b-b3bc-d92808195174 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:29.317717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87567626-ac0b-484b-b3bc-d92808195174 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035320 Aug 30 16:28:29.322968 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2721/5041] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:28:29.329031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:29.335723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:29.349362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:29.349880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:29.350942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:29.352716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:29.354140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:29.354798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:29.406840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:29.415815 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-891f225b-4f7e-4ced-85cb-1781ae769a70 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1682 microversion: 2.1 time: 0.764673 Aug 30 16:28:29.422525 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2321/5042] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:28 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1682 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:29.798923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:29.830823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-520da347-ad0d-42f1-91ba-4b4ad8fee2b6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.506961 Aug 30 16:28:29.832498 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2722/5043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:29 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:29.856321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:29.857179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:29.864663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:29.865546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:29.866487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:29.867413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:29.868048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:29.868631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.318731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:30.335349 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c18e75a4-6575-449e-ae35-09041d98031b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.482497 Aug 30 16:28:30.339576 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2322/5044] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:29 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:30.445784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:30.446822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:30.464468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.470276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.473474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.474531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.475251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.481886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.637970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9923f8a-8912-445d-89aa-6ba4e3a05e95 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126828447", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9923f8a-8912-445d-89aa-6ba4e3a05e95 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 235 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126828447", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1126828447', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.643515 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9923f8a-8912-445d-89aa-6ba4e3a05e95 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:30.648654 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9923f8a-8912-445d-89aa-6ba4e3a05e95 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011044 Aug 30 16:28:30.657753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2323/5045] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:30 2022] POST /compute/v2.1/servers => generated 133 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:28:30.663257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:30.664465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:30.676728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.677236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.684286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.685302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.685955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.688066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.900105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:30.915740 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-441ceb1a-283f-4e30-8891-c897ad161d6e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.255609 Aug 30 16:28:30.931775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:30.937875 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2324/5046] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:30 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:30.944487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:30.945107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:30.945935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e7b1779-c5ca-4ce0-ba34-ca75899055bf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1682 microversion: 2.1 time: 0.504436 Aug 30 16:28:30.948066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2723/5047] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:30 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1682 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:30.965724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.966669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.966789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:30.967438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:30.967889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:30.968310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:31.695575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:31.724680 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a7e4195a-2416-4542-af1e-5897a54d6099 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.781538 Aug 30 16:28:31.742329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2325/5048] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:30 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:31.769696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:31.771612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: fdbd7203-0921-45cc-b017-7c2e9e17658d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:31.788575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:31.805664 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/fdbd7203-0921-45cc-b017-7c2e9e17658d/action HTTP/1.1 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 13 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: {"pause": {}} Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'fdbd7203-0921-45cc-b017-7c2e9e17658d', 'body': {'pause': {}}} Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:31.821854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:31.827191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:31.827191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:31.827191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. Aug 30 16:28:31.827191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:31.827191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance fdbd7203-0921-45cc-b017-7c2e9e17658d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:31.829076 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4329892-14c2-4b82-88d4-c6bc7d08465e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/fdbd7203-0921-45cc-b017-7c2e9e17658d/action" status: 404 len: 111 microversion: 2.1 time: 0.078721 Aug 30 16:28:31.833318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2724/5049] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:31 2022] POST /compute/v2.1/servers/fdbd7203-0921-45cc-b017-7c2e9e17658d/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:31.839484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:31.840375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:31.852188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:31.852697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:31.856732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:31.857552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:31.858034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:31.858516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:31.974970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:31.977305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:31.995111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:31.997490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:31.998557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:32.002048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:32.002704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:32.005356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:32.251373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:32.265086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a406ef32-841b-4e67-90b9-d6bcf7906cb0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1614 microversion: 2.1 time: 0.297276 Aug 30 16:28:32.292691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2725/5050] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:31 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1614 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:32.508561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:32.520257 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35f32326-dc9a-4a9c-a550-a9a3ffe33cbd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.684989 Aug 30 16:28:32.539692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2326/5051] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:31 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:32.549933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:32.549933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:32.561677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:32.567709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:32.571370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:32.573592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:32.575441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:32.576317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.000764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:33.015365 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82c64a78-ec16-4556-9b3e-dfbe283c82ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.473022 Aug 30 16:28:33.015995 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2726/5052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:32 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:33.043021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:33.043608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:33.054623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.058263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.059364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.060292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.063277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.064195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.212722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e82267a-d949-4f2a-8e41-7d5e8c476977 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.173425 Aug 30 16:28:33.224060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:33.224948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:33.232188 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2327/5053] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:33 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:28:33.236130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.236899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.237902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.239079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.239744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.240467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.292397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:33.293939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:33.303895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.304829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.305651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.306639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:33.307296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:33.307894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:33.617110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:33.631696 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-15b0150b-f6b9-4b13-88cd-7928a4588469 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1512 microversion: 2.1 time: 0.412767 Aug 30 16:28:33.635080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2727/5054] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:33 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:33.968984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:33.982885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10962750-f764-482c-9cfa-f76506854f6c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 200 len: 1614 microversion: 2.1 time: 0.696602 Aug 30 16:28:33.997521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5281e689-fa01-447f-a37e-e51da7e0b8be", "name": "network-vif-deleted", "tag": "ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:33.999750 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2328/5055] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:33 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 1614 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:34.018892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:34.023208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:34.024931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:34.042788 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] Creating event network-vif-deleted:ccd0a163-4a07-4df5-b6f4-53cc0f1c56fc for instance 5281e689-fa01-447f-a37e-e51da7e0b8be on n-h1-830883-28 Aug 30 16:28:34.050331 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4a46d96d-9b18-4123-a2a8-c4cfa49f516a req-f9273285-d84d-44d2-98ad-d226f44026a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066299 Aug 30 16:28:34.052463 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2728/5056] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:28:34.656463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:34.657075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:34.671271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:34.679576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:34.680361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:34.681704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:34.682551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:34.688405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:34.955435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:34.967123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e1e1fa5-ad8b-42a3-a340-7e17e12b937c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1492 microversion: 2.1 time: 0.314684 Aug 30 16:28:34.984602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2329/5057] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:34 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1492 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:34.991986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:34.992923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:35.014875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:35.015498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.016250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:35.016809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.019997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.023151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.024555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.025848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.049894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.050694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.051427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.066935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.067820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.068491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.114969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'pause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state paused Aug 30 16:28:35.115224 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be HTTP/1.1 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5281e689-fa01-447f-a37e-e51da7e0b8be'} Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:35.116979 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.122116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:35.123433 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d6c8acc-96dc-4095-8b3e-09e99e9dca13 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 404 len: 111 microversion: 2.1 time: 0.120042 Aug 30 16:28:35.124635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2330/5058] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:35 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 13 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: {"pause": {}} Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'pause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state paused Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'pause': {}}} Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state paused. Cannot pause while the instance is in this state. Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state paused Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:35.128292 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state paused Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'pause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state paused {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca82a3cf-1c56-4547-96e1-1946b6a2a1ae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 143 microversion: 2.1 time: 0.143386 Aug 30 16:28:35.136897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2729/5059] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:34 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 143 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 16:28:35.142165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-070e74f9-60b9-489a-837d-1c2356147a90 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '.version_select at 0x7fd357fd6790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:35.144771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:35.145458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:35.156784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.157464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.159114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.160330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.161029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.161575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.182629 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-070e74f9-60b9-489a-837d-1c2356147a90 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-452914495" status: 202 len: 0 microversion: 2.1 time: 0.044178 Aug 30 16:28:35.183953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2331/5060] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 16:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-452914495 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:28:35.291456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bf6a2220-a4ba-4a73-ba2d-3aff852b908d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.151873 Aug 30 16:28:35.295429 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2730/5061] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:35 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:28:35.300734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:35.301588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:35.309632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.312641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.314833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.315767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:35.320869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:35.321484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:35.806527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:35.814702 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f009ca5-3653-4ef6-8401-be4821897db3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1499 microversion: 2.1 time: 0.517792 Aug 30 16:28:35.815294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2332/5062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:35 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1499 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:36.838718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:36.839538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:36.855322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:36.861357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:36.862856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:36.923893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:36.928747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:36.929465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:37.354641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:37.370458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4ee191f1-b49e-48b4-9a9c-54fbb4e9d2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.536753 Aug 30 16:28:37.371329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2731/5063] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:36 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:37.404076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:37.404754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:37.411314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:37.412126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:37.413299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:37.416750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:37.417416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:37.418011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:38.189407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:38.227195 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-085224b8-3ecb-4b68-b994-d25447fd92b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.822433 Aug 30 16:28:38.228120 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2333/5064] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:37 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:38.250698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:38.253346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:38.263586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:38.269075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:38.270415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:38.272005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:38.272748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:38.274054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:38.300353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action HTTP/1.1 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 28 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: {"reboot": {"type": "SOFT"}} Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64709681-735f-4bd4-9fa9-609a19ceefcf', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1043, in _action_reboot Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:38.304098 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:38.314637 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:38.324457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:38.326670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de9bd93f-df96-4dde-afa0-9510e6fc4b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action" status: 404 len: 111 microversion: 2.1 time: 0.079255 Aug 30 16:28:38.329251 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2732/5065] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:38 2022] POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:38.339182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:38.340088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:38.351446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:38.352510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:38.353265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:38.354693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:38.355394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:38.356082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:39.117502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:39.132975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9cd2262b-07dc-422b-8b23-d7cfa4d975c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.799501 Aug 30 16:28:39.146452 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2334/5066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:38 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:39.159143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc7510b4-914e-4e9c-8526-2da3768a6c9c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: .version_select at 0x7fd35c44e700>, body: {"keypair": {"name": "tempest-keypair-1109212881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrdq6bskGgBCjN+qM9wYvH4W/EMu8WMlT0Exv00p4WGjUfw4WlZ2sEqho8a0m5KaFolVhy1B0qgJlryLs6xN0f/V4XzCtQLy/wXxcKpic5Na13vxj6/BVIaW2GSCn8Mog=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:39.173021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:39.173817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:39.181682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:39.182359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:39.183113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:39.183995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:39.184706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:39.185497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:39.191265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-bc7510b4-914e-4e9c-8526-2da3768a6c9c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:28:39.221191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-bc7510b4-914e-4e9c-8526-2da3768a6c9c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:28:39.283063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc7510b4-914e-4e9c-8526-2da3768a6c9c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128479 Aug 30 16:28:39.286387 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2733/5067] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:39.931313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:39.952290 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80aa5f2f-ed55-4b7a-89e6-54bbecee3e87 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.784800 Aug 30 16:28:39.953847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2335/5068] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:39 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:39.978079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:39.983539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 68e955aa-5871-42bf-93d1-1197afee2f22] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:39.993075 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/68e955aa-5871-42bf-93d1-1197afee2f22/action HTTP/1.1 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 28 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: {"reboot": {"type": "SOFT"}} Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '68e955aa-5871-42bf-93d1-1197afee2f22', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1043, in _action_reboot Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:39.995032 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. Aug 30 16:28:40.001239 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:40.003906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 68e955aa-5871-42bf-93d1-1197afee2f22 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:40.005467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f99df32f-5719-48f1-96be-95843ecc1b82 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/68e955aa-5871-42bf-93d1-1197afee2f22/action" status: 404 len: 111 microversion: 2.1 time: 0.033383 Aug 30 16:28:40.006615 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2734/5069] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:39 2022] POST /compute/v2.1/servers/68e955aa-5871-42bf-93d1-1197afee2f22/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:40.015250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:40.016134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:40.024954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.025752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.026367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:40.027241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.027842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.028691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:40.519464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:40.536441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db980bc5-da97-4f20-bb73-7a5c98fd7b39 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.524810 Aug 30 16:28:40.538891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2336/5070] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:40 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:40.561935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:40.562809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:40.581661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.584392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.586166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:40.590219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.591070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.592383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:40.852239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:40.867983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-624068b5-fa10-4561-94fa-b8725a7ee643 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.310152 Aug 30 16:28:40.872634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2735/5071] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:40 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:40.897263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:40.909267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:40.937864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.939975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.940435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:40.945527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:40.948656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:40.950189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.035000 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action HTTP/1.1 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 65 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64709681-735f-4bd4-9fa9-609a19ceefcf', 'body': {'rebuild': {'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325'}}} Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 16:28:41.044224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1188, in _action_rebuild Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:28:41.049683 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:41.055160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:41.057443 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4345a037-e683-4fe5-9797-9a355d0dec91 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action" status: 404 len: 111 microversion: 2.1 time: 0.165442 Aug 30 16:28:41.066439 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2736/5072] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:40 2022] POST /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf/action => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:41.079887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:41.080880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:41.101515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.104180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.104823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.107164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.107837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.108466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.306219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Calling method '.version_select at 0x7fd35cb6e700>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:41.308329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.309197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.309762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.339418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.344042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.345506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.387250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.388059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.388700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.392368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:41.398971 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30625fad-032a-4b34-be43-40a7cee0fb2e tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042 tempest-PortsAdminExtendedAttrsIpV6TestJSON-707906042-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.649853 Aug 30 16:28:41.405004 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2337/5073] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:28:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:41.792959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:41.802903 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-acd17aff-ba12-4149-a00a-af21aa2b98c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.733207 Aug 30 16:28:41.813943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2737/5074] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:41 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:41.828681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:41.829937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:41.846170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.846905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.847516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:41.848410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:41.849034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:41.849631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:42.350950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:42.367243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e18f156e-af91-4a0b-9001-a86649dfe2d9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.542431 Aug 30 16:28:42.376035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2338/5075] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:41 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:42.401374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:42.404571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 14b934fc-5742-4efe-9f78-d2c2464cd93b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:42.416030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/14b934fc-5742-4efe-9f78-d2c2464cd93b/action HTTP/1.1 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 65 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '14b934fc-5742-4efe-9f78-d2c2464cd93b', 'body': {'rebuild': {'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325'}}} Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1188, in _action_rebuild Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 16:28:42.421757 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. Aug 30 16:28:42.429221 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:42.431696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 14b934fc-5742-4efe-9f78-d2c2464cd93b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:42.432882 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ed0fe17-5bf8-4e9a-b122-b6fa5353dc11 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/14b934fc-5742-4efe-9f78-d2c2464cd93b/action" status: 404 len: 111 microversion: 2.1 time: 0.036714 Aug 30 16:28:42.434003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2738/5076] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:42 2022] POST /compute/v2.1/servers/14b934fc-5742-4efe-9f78-d2c2464cd93b/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:42.447835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:42.448583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:42.467190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:42.467750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:42.468203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:42.468940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:42.469397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:42.469830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:42.887347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-460673511", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76"}], "security_groups": [{"name": "tempest-securitygroup--546516433"}], "key_name": "tempest-keypair-1109212881", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:42.970121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:42.985830 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e766eb87-ca24-4a62-bf85-4148f6b39e1c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.546777 Aug 30 16:28:42.986792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2339/5077] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:42 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:43.011841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:43.012473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:43.026564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:43.027075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:43.027525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:43.028252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:43.028726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:43.029162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:43.079280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] validate_networks() for [('7f7ff3ba-ef0d-4b9a-a6c0-dc6a6f177d76', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:28:43.886999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:28:43.888166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:28:43.889445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:28:43.895256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:28:43.895701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:28:43.917976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:43.918793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:43.919391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:43.920283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:43.920943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:43.921659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:43.957850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:28:43.969790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Getting quotas for user 752f432be0744bb6a18240e184bbbf7f and project 1199f453110c40c0867072c6d4ff3b24. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:28:44.002701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:44.011910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:28:44.017232 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-637ef276-13b3-41a0-a173-78885bd6c043 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.009226 Aug 30 16:28:44.018856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:28:44.020687 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2340/5078] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:43 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:44.045517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:44.046828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 2c7ed26a-c43f-417d-806f-afdeb2eb53f3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:44.064673 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/2c7ed26a-c43f-417d-806f-afdeb2eb53f3/action HTTP/1.1 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 15 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: {"restore": {}} Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '2c7ed26a-c43f-417d-806f-afdeb2eb53f3', 'body': {'restore': {}}} Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:44.073475 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:44.078191 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:44.078191 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:44.078191 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. Aug 30 16:28:44.078191 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:44.086118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 2c7ed26a-c43f-417d-806f-afdeb2eb53f3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:44.087408 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a77ac467-df63-4bde-b3c8-2431980d8e37 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/2c7ed26a-c43f-417d-806f-afdeb2eb53f3/action" status: 404 len: 111 microversion: 2.1 time: 0.047726 Aug 30 16:28:44.091771 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2341/5079] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:44 2022] POST /compute/v2.1/servers/2c7ed26a-c43f-417d-806f-afdeb2eb53f3/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:44.111533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:44.115609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:44.166892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:44.167387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:44.167830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:44.168554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:44.169017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:44.169458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:44.173623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-535da1e6-55b1-4ba4-b7a9-a97af96b202a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.289812 Aug 30 16:28:44.181701 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2739/5080] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:28:44.188609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a30437b-c608-4235-ae64-1f0b3ec51198 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:44.189574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a30437b-c608-4235-ae64-1f0b3ec51198 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:44.369760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a30437b-c608-4235-ae64-1f0b3ec51198 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:44.383617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a30437b-c608-4235-ae64-1f0b3ec51198 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1241 microversion: 2.1 time: 0.197000 Aug 30 16:28:44.384579 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2740/5081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:44 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:44.627227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:44.641561 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-414d69ae-a355-46e8-8540-c2c3ed1f2d02 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.541897 Aug 30 16:28:44.645588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2342/5082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:44 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:44.671588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:44.672559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:44.685817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:44.690408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:44.691213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:44.692199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:44.695206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:44.696612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:45.405966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:45.407961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:45.425560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:45.428536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:45.429319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:45.430268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:45.430935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:45.433015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:45.699190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:45.709457 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7568471a-ae22-4527-a235-0370525bfb5c tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1293 microversion: 2.1 time: 0.307877 Aug 30 16:28:45.721886 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2343/5083] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:45 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1293 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:45.839002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:45.841426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:45.852815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-567840a6-b06b-4f44-8d81-ada085f6490f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.185825 Aug 30 16:28:45.853420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2741/5084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:44 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:45.879843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:45.880397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:45.889843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:45.890399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:45.890817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:45.895706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:45.897150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:45.897325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:45.963984 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'restore' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 15 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: {"restore": {}} Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: exception: Cannot 'restore' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'restore': {}}} Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state active. Cannot restore while the instance is in this state. Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:45.965552 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:45.973050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'restore' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:45.975852 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10ec8876-6965-4bc1-ab05-c41748ae5900 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 145 microversion: 2.1 time: 0.091339 Aug 30 16:28:45.977572 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2344/5085] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:45 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 145 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:28:45.986195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:45.987070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:45.995786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:45.996294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:45.996738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.007737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:46.008334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:46.008684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.624859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:46.648613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ea033223-897f-46dd-b232-2ea69a279131 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.665972 Aug 30 16:28:46.649817 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2742/5086] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:45 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:46.673452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:46.674077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:46.683591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:46.684090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:46.684535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.685252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:46.691368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:46.692058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.743735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:46.744212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:46.763992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:46.764723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:46.766402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.767347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:46.770365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:46.773448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:46.973682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:46.987731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb32e173-6e10-4594-8fb4-df53cf2923e3 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1299 microversion: 2.1 time: 0.255368 Aug 30 16:28:46.988644 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2743/5087] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:46 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:47.676625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:47.701093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-557cf712-bfd2-4f2c-b22e-2fa3f200c6b0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.031270 Aug 30 16:28:47.702010 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2345/5088] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:46 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:47.733606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:47.734084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 290bfbfa-a604-44bf-9459-a90dbc81111d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:47.747195 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/290bfbfa-a604-44bf-9459-a90dbc81111d/action HTTP/1.1 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 14 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: {"resume": {}} Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '290bfbfa-a604-44bf-9459-a90dbc81111d', 'body': {'resume': {}}} Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:47.762337 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 290bfbfa-a604-44bf-9459-a90dbc81111d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e7740746-db0b-43dc-bb84-84eeec2772b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/290bfbfa-a604-44bf-9459-a90dbc81111d/action" status: 404 len: 111 microversion: 2.1 time: 0.041810 Aug 30 16:28:47.767724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2744/5089] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:47 2022] POST /compute/v2.1/servers/290bfbfa-a604-44bf-9459-a90dbc81111d/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:28:47.775544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:47.776170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:47.793548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:47.796951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:47.797440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:47.798207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:47.800741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:47.801180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.016217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:48.017199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:48.039168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.040040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.040729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.043682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.044420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.045996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.209174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:48.235811 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-696b6783-e365-45ff-8e5a-151faa0cd028 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.465239 Aug 30 16:28:48.254329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2346/5090] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:47 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:48.268144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:48.269365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:48.286565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.289815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.290373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.291397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.293369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.295088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.384401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:48.396006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e77ec314-ac87-4d19-9b16-bfbe644af616 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1299 microversion: 2.1 time: 0.390378 Aug 30 16:28:48.410975 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2745/5091] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:48 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1299 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:48.657740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:48.668364 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8e93dd9-649b-4902-a532-f178ccdd14e8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.409760 Aug 30 16:28:48.691861 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2347/5092] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:48 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:48.699078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:48.699627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:48.712723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.713230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.713783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.718745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.719548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.720170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.793408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'resume' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 14 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: {"resume": {}} Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'resume' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'resume': {}}} Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state active. Cannot resume while the instance is in this state. Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:48.798725 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:28:48.805178 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:48.808882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'resume' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:48.810447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce1b48d7-4904-4622-97b9-4c18999fbd1a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 144 microversion: 2.1 time: 0.117182 Aug 30 16:28:48.814105 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2746/5093] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:48 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 144 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:28:48.821025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:48.821822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:48.831933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.836649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.837253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:48.839097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:48.841056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:48.843755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:49.183648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:49.210402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f705b14-e834-401d-8e07-f8f74ac2b84d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.381182 Aug 30 16:28:49.210402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2348/5094] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:48 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:49.225983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:49.228801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:49.237854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:49.243244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:49.243932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:49.244875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:49.245504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:49.247299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:49.419930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:49.420937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:49.449122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:49.451912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:49.452709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:49.474257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:49.475747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:49.476376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:50.088227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:50.103107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-559d8dd7-50d1-43c7-889a-d921e6f2f80a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.882799 Aug 30 16:28:50.105514 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2747/5095] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:49 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:50.311264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4446bee9-b610-4327-a861-47b9e9c6b995 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4446bee9-b610-4327-a861-47b9e9c6b995 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 160 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "41f78965-9e06-49c9-99ac-2886a39ad4ca"}]}} Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': '', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'networks': [{'uuid': '41f78965-9e06-49c9-99ac-2886a39ad4ca'}]}}} Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '' Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:28:50.317635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:28:50.323711 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:28:50.326917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4446bee9-b610-4327-a861-47b9e9c6b995 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:50.329971 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4446bee9-b610-4327-a861-47b9e9c6b995 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023834 Aug 30 16:28:50.332706 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2748/5096] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:28:50 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:28:50.348338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:50.349223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:50.368172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:50.368979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:50.369685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:50.370749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:50.371397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:50.371991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:50.395134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:50.433538 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-78a829b2-ba36-4eb6-9933-192344eb7bef tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 1.016243 Aug 30 16:28:50.434724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2349/5097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:49 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:50.780608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6724469f-9c3b-4ce2-a61b-18a72ab52167", "tag": "522d756b-e187-4c02-836f-d78fdffa7f81"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:50.794773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:50.795847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:50.796465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:50.811475 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] Creating event network-changed:522d756b-e187-4c02-836f-d78fdffa7f81 for instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 on n-h1-830883-28 Aug 30 16:28:50.818003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-aaf3bae1-b023-49a1-b77e-39bafb495301 req-66f3ab7e-c1a1-47e8-b817-4f9ddc60f44d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064003 Aug 30 16:28:50.820448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2350/5098] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:51.188841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:51.212608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-312d90db-a51b-4257-b3a7-50a23560f007 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.875226 Aug 30 16:28:51.214983 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2749/5099] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:50 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:51.251994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:51.252708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:51.260144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:51.260849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:51.261291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:51.262091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:51.262603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:51.264320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:51.456061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:51.456627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:51.468974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:51.469782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:51.470606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:51.473013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:51.473612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:51.474057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.008146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:52.023404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc81bc8b-23c9-4239-a86a-3fb0f932235c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.781600 Aug 30 16:28:52.024677 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2351/5100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:51 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:52.050202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:52.050781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 359dc61e-e463-4fec-9537-66e62e3233ff] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:52.063741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/359dc61e-e463-4fec-9537-66e62e3233ff/action HTTP/1.1 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 14 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: {"shelve": {}} Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '359dc61e-e463-4fec-9537-66e62e3233ff', 'body': {'shelve': {}}} Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:28:52.067443 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:28:52.073818 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:28:52.073818 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:28:52.073818 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. Aug 30 16:28:52.073818 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:28:52.079564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 359dc61e-e463-4fec-9537-66e62e3233ff could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:28:52.081632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ba0ab43-aba5-4a7a-a083-e9022661e25d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/359dc61e-e463-4fec-9537-66e62e3233ff/action" status: 404 len: 111 microversion: 2.1 time: 0.037129 Aug 30 16:28:52.083403 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2352/5101] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:52 2022] POST /compute/v2.1/servers/359dc61e-e463-4fec-9537-66e62e3233ff/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:28:52.093183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:52.094075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:52.108501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.109415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.110277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.111338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.112055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.112632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.349639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:52.366182 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-901be933-abc6-4f78-9fea-99e323985746 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.275959 Aug 30 16:28:52.368767 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2353/5102] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:52 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:52.393798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:52.394830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:52.404434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.405569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.406323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.408172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.408923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.409775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.704301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:52.716116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c662652-305f-4d91-9d16-9b7d27c2f51c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.327599 Aug 30 16:28:52.718039 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2354/5103] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:52 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:52.745241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:52.746283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:52.753909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.754785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.755426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.757153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:52.757865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:52.758563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:52.799825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lazy-loading 'flavor' on Instance uuid b2a51264-976e-452c-aee5-9c6d7157aa4a {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:28:52.822156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:52.859994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a111df2d-1a52-42f4-97ec-e02409e5a087 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 1.405355 Aug 30 16:28:52.862761 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2750/5104] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:51 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:28:52.953002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:53.220147 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53af14b5-3398-4479-a1cb-1a6ea33345b1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.481605 Aug 30 16:28:53.221843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2355/5105] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:28:52 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:28:53.243263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:53.243935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:53.260240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:53.263977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:53.265774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:53.285124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:53.288415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:53.289091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:53.885883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:53.887472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:53.889688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:53.901460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:53.906867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:53.907888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:53.908903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:53.912220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:53.912892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:53.934446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:54.235650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:54.242847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:54.255349 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9ed9285-08d5-4e9e-99c6-1936bc1c0b34 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 1.027837 Aug 30 16:28:54.256891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2751/5106] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:53 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:54.275340 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-322996f8-c17c-4fe8-bef9-deaf695b9cb2 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 0.395481 Aug 30 16:28:54.275976 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2356/5107] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:53 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:54.844937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:55.085821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1774364535", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "ba49baf7-4847-418f-a4ca-9fb9323520a8"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:55.188148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] validate_networks() for [('ba49baf7-4847-418f-a4ca-9fb9323520a8', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:28:55.278993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:55.280356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:55.287891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:55.288615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:55.289227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:55.290330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:55.291109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:55.291699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:55.581045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:55.596004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93edcccc-cc86-499b-a3f7-f4cd2d6c36ec tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.318745 Aug 30 16:28:55.612002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2357/5108] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:55 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:55.620243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:55.621290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:55.630201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:55.643683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:55.644818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:55.647067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:55.647887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:55.648596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:55.938238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:55.952835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34a38c09-346d-4d71-87c5-7aba1f37783a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 0.339055 Aug 30 16:28:55.953445 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2358/5109] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:55 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:56.623551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:56.624245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:56.640777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.644689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.648135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:56.649975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:56.651080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:56.652362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.179571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:57.207842 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df123683-451a-4cbf-bcd1-224fecc73238 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.589290 Aug 30 16:28:57.208441 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2359/5110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:56 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:57.241447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:57.242564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:57.265748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.266990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.274022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.282392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.284278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.284906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.784916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:28:57.785848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:28:57.786469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:28:57.794574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:28:57.796139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:28:57.823184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.824146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.835743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.836705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:57.837200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:57.840726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:57.944857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Getting quotas for project 2ae237d3950149958fce62f14be42ad9. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:28:57.965879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Getting quotas for user d2068934b4dd438794ac27b0c7a68ec5 and project 2ae237d3950149958fce62f14be42ad9. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:28:58.004229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:28:58.012083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:28:58.031751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.048605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-306aa9c4-184d-4aeb-899b-fc83d68d0d6f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 0.838437 Aug 30 16:28:58.059182 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2360/5111] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:57 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:58.165198 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7499c4a2-fabb-495d-bda4-4974e9ea5979 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.325034 Aug 30 16:28:58.166422 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2752/5112] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:28:58.177195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:58.178039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:58.231151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:58.232116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:58.241325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:58.242118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:58.242750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:58.244639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:58.245426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:58.247291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:58.675723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.718784 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c108cfd-f2dd-4754-996d-1f9ce0d9b824 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.464964 Aug 30 16:28:58.731851 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2753/5113] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:58 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:28:58.837774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.846772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.856816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:28:58.864094 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dda7d9fe-b58b-4db4-b6ed-cd07c68797a2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1259 microversion: 2.21 time: 0.686414 Aug 30 16:28:58.868751 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2361/5114] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:28:58 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1259 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:28:59.079776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:59.082232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:59.093443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:28:59.095850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.096761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.097455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.098792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.099588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.100413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.698146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6724469f-9c3b-4ce2-a61b-18a72ab52167", "name": "network-vif-plugged", "status": "completed", "tag": "522d756b-e187-4c02-836f-d78fdffa7f81"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:28:59.767442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.768724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.774720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.819322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] Creating event network-vif-plugged:522d756b-e187-4c02-836f-d78fdffa7f81 for instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 on n-h1-830883-28 Aug 30 16:28:59.839700 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8aa3eccf-a9e8-4837-9daf-deb0a7c0b22a req-71a641ae-d9d2-4a79-afe1-e83d30af34a7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142417 Aug 30 16:28:59.840931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2362/5115] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:28:59.849007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:28:59.876124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:28:59.887966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.888680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.889289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:28:59.900307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:28:59.902333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:28:59.905822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:00.077710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:00.087658 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-59ef2c5d-7acf-4376-8960-a4391673fa59 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 1.011760 Aug 30 16:29:00.096065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2754/5116] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:59 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:00.114182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:00.117071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:00.144133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:00.144988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:00.145653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:00.149739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:00.153139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:00.155563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:00.350069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:00.366600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:00.368253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:00.379402 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b2e0b48-56e4-4311-8201-877f0cdcc4fc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1311 microversion: 2.21 time: 0.281749 Aug 30 16:29:00.380065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2755/5117] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:00 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:00.564817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1925207466", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "44f33172-fb25-4c49-8a96-0e9e287eafc8"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:00.712417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] validate_networks() for [('44f33172-fb25-4c49-8a96-0e9e287eafc8', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:00.884206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:00.902520 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4405af09-521c-4ae4-baf2-fb6dd6d37256 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 1.051877 Aug 30 16:29:00.903223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2363/5118] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:28:59 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:01.116849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:01.117484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:01.143128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.143646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.144093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:01.144824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:01.145283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:01.145715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.258277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:02.259401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:02.260131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:02.260745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:02.261607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:02.277964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.280009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.280818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.281904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.285889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.286937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.320980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:02.329400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for user db3a24e1055246a194f7e96a72dff014 and project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:02.368390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:29:02.371614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:29:02.455378 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b7de8dd-da55-483d-8abb-a3335c44640e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070493 Aug 30 16:29:02.457691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2756/5119] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:29:02.477265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:02.481197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:02.497839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.506738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.507565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.508281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:02.508778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:02.509229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:02.924539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:02.941520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:02.946747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:02.948166 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-beadffd3-ccdc-4747-b08f-b185ace3760b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1317 microversion: 2.21 time: 0.481738 Aug 30 16:29:02.970257 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2757/5120] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:02 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:02.977272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:02.984817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:03.025129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.026035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.028921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.031282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.032058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.033899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.066668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:03.079444 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c8d0166f-aee1-4e66-a2fd-525e45d4e4b8 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1366 microversion: 2.1 time: 1.964221 Aug 30 16:29:03.101430 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2364/5121] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:01 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1366 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:03.113660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0da4461-36c4-4897-b011-377a38453b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:03.114895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0da4461-36c4-4897-b011-377a38453b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:03.406736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0da4461-36c4-4897-b011-377a38453b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:03.415722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0da4461-36c4-4897-b011-377a38453b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1218 microversion: 2.1 time: 0.313108 Aug 30 16:29:03.420091 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2365/5122] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:03 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1218 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:03.426575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:03.436364 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f6c86eb-ab54-4919-a45e-37efce599ba3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.464720 Aug 30 16:29:03.442416 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2758/5123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:02 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:03.468057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:03.468584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:03.490168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.495305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.495787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.496551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:03.501679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:03.502178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:03.692745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lazy-loading 'services' on Instance uuid 9dcf3b0b-569f-4927-8cbf-b6f78554b73f {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:03.878457 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8693d8a8-7e3e-4011-b563-9b0d2e302597 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f/os-volume_attachments/23a49269-ad64-4ee5-9f02-7a5cc45c1677" status: 202 len: 0 microversion: 2.1 time: 0.447417 Aug 30 16:29:03.879817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2366/5124] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:29:03 2022] DELETE /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f/os-volume_attachments/23a49269-ad64-4ee5-9f02-7a5cc45c1677 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:03.980226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:03.980884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:04.000366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.000888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.001342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.002087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.012647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.014802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.101817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:04.102550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:04.124328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.124630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.125113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.132471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.133252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.133864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.792404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:04.801925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:04.809851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:04.811074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1ad4a83-677d-4205-8855-bb13d85640c2 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.837209 Aug 30 16:29:04.833904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2759/5125] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:03 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:04.846201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:04.847265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:04.862539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.035083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:05.077729 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e49c7f7-eabc-4ce6-8245-b4a9be117c01 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1278 microversion: 2.1 time: 0.242116 Aug 30 16:29:05.079567 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2760/5126] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:04 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1278 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:05.086533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:05.103705 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-683ade3f-7a82-4e2e-b205-3c27007182d7 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1557 microversion: 2.1 time: 1.000270 Aug 30 16:29:05.107446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:05.112581 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2367/5127] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:04 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1557 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:05.116147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:05.133283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:05.138632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:05.147620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.152728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.155351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.162625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.163838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.167769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.171081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.172179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.176653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.178461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.179178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.180311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.428404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:05.441801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bae94981-4c82-43ab-aa1b-7a35549a3e0e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1534 microversion: 2.1 time: 0.359818 Aug 30 16:29:05.443365 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2761/5128] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:05 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1534 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:05.565146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1827660778", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4290dd04-80fe-40fd-bd1d-007db3b3e6d3"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:05.617868 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f54decaf-fd86-4aa9-993d-88c1916ef221 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.488730 Aug 30 16:29:05.620901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2368/5129] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 16:29:05 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-interface => generated 285 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:05.683853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] validate_networks() for [('4290dd04-80fe-40fd-bd1d-007db3b3e6d3', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:05.857655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:05.859024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:05.873709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.877743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.878518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:05.881929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:05.885264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:05.888612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.140145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:07.153598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:07.158943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:07.162831 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-247bbde7-1c45-49e3-a830-5b6b6071b5b4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 1.308233 Aug 30 16:29:07.181494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2369/5130] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:05 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:29:07.195696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:07.196781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:07.213012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.213768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.214407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.215420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.216102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.216992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.664340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:07.691151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed168257-c0a8-4c75-b82d-1e26b62bc218 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.504769 Aug 30 16:29:07.711727 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2370/5131] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:07 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:07.720460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:07.722281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:07.735362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.737717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.738195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:07.738969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:07.739437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:07.742146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.013551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:08.014032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:08.014543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:08.015006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:08.015429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:08.036311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.037468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.040240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.041137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.041619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.042958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.067018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:08.091979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Getting quotas for project ae2da4f05c75485380461bf786d5832e. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:08.107461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Getting quotas for user 39c64e79c8bd475690a27cae3978f945 and project ae2da4f05c75485380461bf786d5832e. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:08.145353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:29:08.150141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:29:08.278176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37636e88-314f-4ae3-9803-df8826ed7413 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832882 Aug 30 16:29:08.293651 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2762/5132] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:29:08.298961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad7dfe90-f976-4aad-b23c-86908afda352", "tag": "272cff0c-59c1-4d33-b44f-00f95701643b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:08.328379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.330930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.331541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.361492 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] Creating event network-changed:272cff0c-59c1-4d33-b44f-00f95701643b for instance ad7dfe90-f976-4aad-b23c-86908afda352 on n-h2-830883-28 Aug 30 16:29:08.373376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-28106c65-a2b9-43a0-bc5e-f138eee3ffd2 req-3905a60a-954a-4333-a4ae-7093217fdb57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078089 Aug 30 16:29:08.376772 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2763/5133] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:08.387248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:08.391278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:08.421502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.423008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.424039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.433131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:08.434070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:08.435982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:08.878972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:08.902534 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-921ab1fb-3349-4668-a881-591532e36f2a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1534 microversion: 2.1 time: 1.186991 Aug 30 16:29:08.904351 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2371/5134] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:07 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1534 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:08.925988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db76c30f-437b-4165-9173-a2e4d869d30f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:08.927676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db76c30f-437b-4165-9173-a2e4d869d30f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:09.075970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:09.089687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:09.118730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:09.126551 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9972e6f5-a084-49f6-91a2-6d4563260694 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.738347 Aug 30 16:29:09.130164 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2764/5135] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:08 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:09.166085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "name": "network-vif-plugged", "status": "completed", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:09.223223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:09.223756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:09.224357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:09.265287 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] Creating event network-vif-plugged:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:29:09.291981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-08385ebd-d6f6-41b2-8d7d-1b39b5825c23 req-b65e4219-daef-4850-996b-323a93194978 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149934 Aug 30 16:29:09.295152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2765/5136] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:09.302708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:09.311606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:09.331683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:09.334232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:09.336626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:09.337591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:09.339732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:09.340562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:09.485060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db76c30f-437b-4165-9173-a2e4d869d30f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:09.494229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db76c30f-437b-4165-9173-a2e4d869d30f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1228 microversion: 2.1 time: 0.588769 Aug 30 16:29:09.496391 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2372/5137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:08 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1228 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:09.823140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:09.835078 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34c95c79-6c14-479e-8fe6-2c94d6dceeb5 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.538285 Aug 30 16:29:09.841076 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2766/5138] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:09 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:09.928475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:09.930012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:09.957867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:09.959148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:09.970235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:09.971234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:09.975822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:09.976625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.020476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6724469f-9c3b-4ce2-a61b-18a72ab52167", "tag": "522d756b-e187-4c02-836f-d78fdffa7f81"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:10.050724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.051598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.052866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.101015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] Creating event network-changed:522d756b-e187-4c02-836f-d78fdffa7f81 for instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 on n-h1-830883-28 Aug 30 16:29:10.122897 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f723b7f2-fe21-4c54-8adf-3a50c7e84bfb req-328965d6-69b4-4031-921c-291c375ab7da service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.618571 Aug 30 16:29:10.129354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2373/5139] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:10.163097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:10.167903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:10.182377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.183573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.184413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.186165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.186891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.187550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.332303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:10.346844 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8c1c66f3-c265-41d9-a0ed-6f265c307b0b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1534 microversion: 2.1 time: 0.425583 Aug 30 16:29:10.358746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2767/5140] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:09 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1534 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:10.483595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0", "tag": "1d0b6cc1-4006-4ba4-bfa8-62fd956225d1"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:10.519695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.523715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.524357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.564517 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] Creating event network-changed:1d0b6cc1-4006-4ba4-bfa8-62fd956225d1 for instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 on n-h1-830883-28 Aug 30 16:29:10.576678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f216d0ad-8944-4019-9ba8-171e01df1959 req-c2a2364b-57f6-4b63-bff9-62ac1b967a7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096786 Aug 30 16:29:10.581694 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2768/5141] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:29:10.596844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:10.597862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:10.622209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.622689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.623145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.623881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.624346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.624786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.747324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:10.755607 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3173bf43-5da3-49df-9a00-2626e6df307f tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1288 microversion: 2.1 time: 0.172324 Aug 30 16:29:10.758411 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2769/5142] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:10 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:10.867279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:10.867913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:10.879927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.880618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.886387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:10.892006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:10.892719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:10.893399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.443024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:11.448670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b65c80a6-3e02-4127-85e1-961ee48f898b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.588769 Aug 30 16:29:11.450683 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2770/5143] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:10 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:11.459383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:11.460835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:11.517705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.519126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.519843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.523364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.525278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.526034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.719104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:11.737022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:11.744239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:11.752521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a37727f-cb0f-4ea0-a395-faf3dca7f2f0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 1.598411 Aug 30 16:29:11.757443 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2374/5144] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:10 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:11.785525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:11.787939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:11.814561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.818356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.822284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:11.828011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:11.829608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:11.831012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.075404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:12.086693 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06a2ffb9-d3bd-4ea6-8893-1c8fec962a4a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.634305 Aug 30 16:29:12.105221 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2771/5145] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:11 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:12.140374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:12.152864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4aaaf51c-5162-45d8-850e-b66ea6e6e3f3 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1286 microversion: 2.1 time: 0.373657 Aug 30 16:29:12.153452 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2375/5146] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:11 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1286 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:12.473374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:12.477122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:12.492840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.493525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.495948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.498196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.499878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.501404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.778164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:12.778841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:12.787279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.787839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.788228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.789307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:12.801473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:12.802786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:12.805935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:12.912142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:12.922583 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e803c567-1b07-443d-9c85-748380ec45fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.453333 Aug 30 16:29:12.928225 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2772/5147] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:12 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:13.113927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:13.115059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:13.129503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.132529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.134164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.135701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.137682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.138253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.288792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.299206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.301008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.303029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a230513b-e519-4fdc-a83d-0957f77ee1c1 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.528720 Aug 30 16:29:13.304132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2376/5148] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:12 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:13.309608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:13.310523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:13.316935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.318462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.319656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.320613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.321363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.322015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.541846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.555453 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3927a34-1dbf-4379-a547-a098dd015942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.447357 Aug 30 16:29:13.559621 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2773/5149] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:13 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:13.583941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:13.596746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed928c40-3ebd-4825-8651-4dbc342852b2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1286 microversion: 2.1 time: 0.290699 Aug 30 16:29:13.601537 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2377/5150] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:13 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1286 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:13.948776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:13.949549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:13.956819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.957579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.959027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:13.960216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:13.960949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:13.961601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.166411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:14.179399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-998b83fb-4c11-4ab2-9c3d-41f8674c6480 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.234694 Aug 30 16:29:14.180537 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2774/5151] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:13 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:14.309401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:14.310006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:14.330693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.331788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:14.332495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.333328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:14.334592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.337118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.342012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.342833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.368331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.381181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.382571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.384511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.387225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.389572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.414117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:29:14.619558 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c4fe4ac-0d99-47dc-845e-2827c7a28b6d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 204 len: 0 microversion: 2.1 time: 0.313638 Aug 30 16:29:14.620757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2378/5152] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:29:14 2022] DELETE /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:29:14.629744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:14.633211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:14.643174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.644474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.645168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.646556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.647367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.648184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.803894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:14.819943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:14.821386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:14.822557 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a771f102-cbf3-497d-846a-0f66f0d70b14 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.496058 Aug 30 16:29:14.823440 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2775/5153] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:14 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:14.828120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:14.831535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:14.843844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.844416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.845122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:14.846086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:14.846826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:14.847510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.009601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:15.028915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e54391c-a7a8-4e75-b9a0-fc57ea59b513 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1286 microversion: 2.1 time: 0.203892 Aug 30 16:29:15.047687 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2776/5154] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:14 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1286 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:15.059413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:15.060181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:15.071746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.073148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.073807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.074937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.077301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.077991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.167002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:15.180135 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff8aff82-1212-498a-8d05-7a98e5857e8c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.557711 Aug 30 16:29:15.183975 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2379/5155] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:14 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:15.200377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:15.201387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:15.213060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.213814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.214525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.215478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.220749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.221432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.297268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:15.309133 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-363d53e1-bf41-46b7-8a57-f58106e4d25b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1515 microversion: 2.1 time: 0.260028 Aug 30 16:29:15.309732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2777/5156] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:15 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:15.775550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:15.792924 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0276d7ae-7818-4c8c-a63f-0e0be9147ff6 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.596328 Aug 30 16:29:15.806676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2380/5157] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:15 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:15.845328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:15.846008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:15.867074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.867601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.868056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:15.880773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:15.881290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:15.881750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.055581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:16.056734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:16.067171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.069478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.070238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.071194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.075269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.075829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.488485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:16.514975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:16.517293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:16.518651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd3cfd02-1805-4a45-aa03-72f7b42179a4 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.677131 Aug 30 16:29:16.524704 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2778/5158] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:15 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:16.539741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:16.540874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:16.550017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.550995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.551705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.553313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:16.554013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:16.554725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:16.955394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:16.970580 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d660dcf3-1256-4345-8c71-a318bc6c3b7f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.443676 Aug 30 16:29:16.973348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2779/5159] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:16 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:16.985124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:16.985780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:17.008203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.009963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.012016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.016622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.017214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.017968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.316594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:17.350029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f44a72d-e930-4ee7-9b4b-e625bc92ccba tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1515 microversion: 2.1 time: 0.374346 Aug 30 16:29:17.358829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2780/5160] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:16 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:17.383755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:17.391631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:17.398702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.399215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.399668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.400396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.400864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.401541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.417960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:17.623018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:17.633644 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd7aa67c-9ea7-4d54-952b-bbd6c348347a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.273383 Aug 30 16:29:17.634990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2781/5161] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:17 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:17.655129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:17.656040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:17.681120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.685664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.686227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.691222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:17.692054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:17.692608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:17.778416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:17.837484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0da4ec63-65c9-4ce0-9618-cb4cc6137926 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 1.785817 Aug 30 16:29:17.867269 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2381/5162] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:16 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:17.994828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:17.995754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:18.010370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.010945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.011463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.013742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.014465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.014994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.024346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.046052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.047918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.048948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f32047d-39f9-41e0-b365-66b681be1eb0 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.412630 Aug 30 16:29:18.049528 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2782/5163] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:17 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:18.398488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:18.399481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:18.403745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:18.409293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:18.444544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.446084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.446859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.447796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.448440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.450367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.509835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.529259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0dfed98-3cf6-456b-b5de-b52562693453 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.538408 Aug 30 16:29:18.531557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2382/5164] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:17 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:18.575537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7dfe90-f976-4aad-b23c-86908afda352", "name": "network-vif-plugged", "status": "completed", "tag": "272cff0c-59c1-4d33-b44f-00f95701643b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:18.620367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.624161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.624794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.659800 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] Creating event network-vif-plugged:272cff0c-59c1-4d33-b44f-00f95701643b for instance ad7dfe90-f976-4aad-b23c-86908afda352 on n-h2-830883-28 Aug 30 16:29:18.683883 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3ac7d566-e9c8-44d0-9ead-d2954d91fba8 req-bdd77b96-dceb-42d8-96f1-999c41feeaf3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112297 Aug 30 16:29:18.684767 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2383/5165] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:18.698409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:18.700282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:18.718610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.731293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.731893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.732671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.733159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.733603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.934816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:18.944913 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-76bddd1f-3e11-4ce3-b313-03e3c90f7920 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1473 microversion: 2.1 time: 0.551527 Aug 30 16:29:18.946373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2783/5166] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:18 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1473 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:18.952013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:18.953492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:18.961382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.961830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.962332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:18.976658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:18.977404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:18.980617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.151891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.169510 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c52d2ee-093d-4a4b-bd25-a83351c41f2f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.481635 Aug 30 16:29:19.170044 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2384/5167] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:18 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:19.175525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dcf3b0b-569f-4927-8cbf-b6f78554b73f", "name": "network-vif-deleted", "tag": "f13a607d-ceda-4d38-8e5a-85b40ab82948"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:19.220238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.221251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.223021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.244197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.256553 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f03b61ef-72e0-4fe6-9cee-3441e3023453 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.308658 Aug 30 16:29:19.258630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2784/5168] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:18 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:19.263523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] Creating event network-vif-deleted:f13a607d-ceda-4d38-8e5a-85b40ab82948 for instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f on n-h2-830883-28 Aug 30 16:29:19.264886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:19.265690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:19.280642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-ab520c63-aeef-4425-a168-25edf2b38524 req-8e5841c5-80ce-49f7-a420-76a86ae56971 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108839 Aug 30 16:29:19.281264 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2385/5169] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:19.284376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.285476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.287950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.290838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.292145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.293273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.496410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.511575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.513521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.514930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfb912b0-de0c-4cbc-99e5-da57fce44052 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.254836 Aug 30 16:29:19.516525 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2785/5170] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:19 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:19.560845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:19.561842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:19.569419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:19.575717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.576517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.577192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.578090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.578938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.579859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.875888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:19.886647 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-290a0de1-d273-4948-8316-cfd0877b9251 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.330556 Aug 30 16:29:19.887981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2386/5171] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:19 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:19.971241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:19.972216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:19.985789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.988156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.990963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:19.992002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:19.992661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:19.993264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.047274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.047919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.048437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.048978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lazy-loading 'fault' on Instance uuid 9dcf3b0b-569f-4927-8cbf-b6f78554b73f {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:20.120960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:20.136800 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fb4449da-53a0-45f7-8fde-27da6c142416 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 200 len: 1309 microversion: 2.1 time: 0.171968 Aug 30 16:29:20.138140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2786/5172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:19 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:20.193957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:20.194567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:20.208736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.212659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.213406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.220944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.221790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.222583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.279780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:20.281002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:20.306872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.311038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.311841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.312660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.313224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.313739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.518647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:20.539825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16de5c68-8cc9-4add-9721-a56c8cff5735 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.349151 Aug 30 16:29:20.542908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2387/5173] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:20 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:20.568952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:20.570117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:20.623879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.626980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.629632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:20.632129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:20.635142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:20.635628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.207187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.228456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.230175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.232598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96263d86-d207-4dc7-8733-78c56fbb742c tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1359 microversion: 2.21 time: 0.687083 Aug 30 16:29:21.243129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2388/5174] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:20 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1359 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:21.248056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0", "name": "network-vif-plugged", "status": "completed", "tag": "1d0b6cc1-4006-4ba4-bfa8-62fd956225d1"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:21.267018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.267796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.268403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.293653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] Creating event network-vif-plugged:1d0b6cc1-4006-4ba4-bfa8-62fd956225d1 for instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 on n-h1-830883-28 Aug 30 16:29:21.307373 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-eace0556-9c2a-4191-9b52-7310219f9d65 req-f73db022-6909-4943-b775-477d51ae2e1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062694 Aug 30 16:29:21.313477 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2389/5175] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:21.329772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:21.330809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:21.346774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.347939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.348558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.351892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.352577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.353192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.358637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.373822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21296807-74d3-42ef-a38e-0aeac9208844 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 1.097553 Aug 30 16:29:21.390161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2787/5176] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:20 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:21.401601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:21.402578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 9dcf3b0b-569f-4927-8cbf-b6f78554b73f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:21.411959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.412864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.413554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.416597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.417355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.418025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.444549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] HTTP exception thrown: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Request method failure captured: Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f HTTP/1.1 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjoLXv9GqdrhWpJL4pzEt8nB2TQ64zFZbIYmw5i4WGkJAO1qsgLXGwfjKyM5__Ro9Ydz2RYCIhyv2yqfH89ZX7Gh-9qYM1YPl0nI2IviwesP_RbveBqw0mI2w0tiM1YdeZ50PZ1AOSVjPjDevH6G5th1P868PZXowVLpK4uAWtSZJys Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1993a73e328b444a9a148871f46328b2 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1993a73e328b444a9a148871f46328b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1993a73e328b444a9a148871f46328b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1993a73e328b444a9a148871f46328b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1993a73e328b444a9a148871f46328b2"}]}] Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1993a73e328b444a9a148871f46328b2 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesSnapshotTestJSON-1145832343-project Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: c3743d3266554386b5f9531ca284945b Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesSnapshotTestJSON-1145832343-project Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9dcf3b0b-569f-4927-8cbf-b6f78554b73f'} Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:21.447925 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. Aug 30 16:29:21.452671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:21.456523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Returning 404 to user: Instance 9dcf3b0b-569f-4927-8cbf-b6f78554b73f could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:21.457748 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae489fd5-d9bc-4cbb-9fd9-3cc0864e368f tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f" status: 404 len: 111 microversion: 2.1 time: 0.065434 Aug 30 16:29:21.459699 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2788/5177] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:21 2022] GET /compute/v2.1/servers/9dcf3b0b-569f-4927-8cbf-b6f78554b73f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:21.464965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567ea73d-7673-42b4-bacb-3e614ae770a7", "tag": "275237f1-5035-48f1-962d-d9942cf9501b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:21.515925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:21.522362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.523469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.524296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.571707 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] Creating event network-changed:275237f1-5035-48f1-962d-d9942cf9501b for instance 567ea73d-7673-42b4-bacb-3e614ae770a7 on n-h2-830883-28 Aug 30 16:29:21.585271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8118b303-ee8a-4e64-a044-13381bd5b774 req-b8fbcb2d-e1cc-4166-b0c6-a6934378cd7b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123913 Aug 30 16:29:21.590420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2789/5178] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:21.597452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:21.599106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:21.608357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.609946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.610665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.612616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:21.613331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:21.614977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:21.888187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:21.897109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6c14a04-2a03-4578-9195-17365daf30d4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.305192 Aug 30 16:29:21.911812 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2790/5179] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:21 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:22.236313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.245171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-824ac349-87dd-4d05-b3dc-680de09d74fc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.925487 Aug 30 16:29:22.245759 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2390/5180] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:21 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:22.276434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.277065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.296657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.301596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.305138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.306178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.306699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.307142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.406981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.407588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.417142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.431311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.432026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.432947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.433604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.434243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.615915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.625279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.631081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.632706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94b401eb-10b5-49bc-af8b-68581e8716a9 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1551 microversion: 2.21 time: 0.361083 Aug 30 16:29:22.633692 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2791/5181] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1551 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:22.657323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.657984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.665594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.666235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.666821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.667628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.668192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.668726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.701202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:29:22.734067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:22.745106 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-56b823b7-8552-4b42-bdf1-66cd74c0f511 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.341778 Aug 30 16:29:22.756201 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2391/5182] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:22.892798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe0f697e-f396-4c01-9e37-c22336ab8ac7 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 204 len: 0 microversion: 2.21 time: 0.239363 Aug 30 16:29:22.899520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2792/5183] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:29:22 2022] DELETE /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:29:22.903994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.907889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.924971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.932250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.933185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.936493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:22.937708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.938421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.939060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:22.944488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:22.985755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:22.996635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:22.997594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.000116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.000600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.001045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.218158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:23.233526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:23.236794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:23.241507 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b7fd9f2-f821-4443-9531-a2673cbb6d8b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1557 microversion: 2.21 time: 0.341961 Aug 30 16:29:23.250123 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2392/5184] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1557 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:29:23.272774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:23.273723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:23.282293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.283901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.284514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.285593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.286845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.287591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.292795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:23.423147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:23.431510 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75c28685-5e2c-405c-b29f-435aab43fa57 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1318 microversion: 2.1 time: 0.508372 Aug 30 16:29:23.433747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2793/5185] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:22 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:23.572417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:23.585629 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-738c0ca1-1d76-472b-8fbf-32e41ccde78e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.316410 Aug 30 16:29:23.588009 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2393/5186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:23.785503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:23.790345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:23.794260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.794930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.795469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:23.798341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:23.800523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:23.800523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.173372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.198003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41b89fbd-2fd5-4c9f-ab43-28db6a4f243b tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.425526 Aug 30 16:29:24.219038 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2794/5187] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:23 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:24.282382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:24.284483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:24.292760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:24.304504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.305305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.309750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.310838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.311517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.312175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.460018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:24.462564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:24.473240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.474691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.475591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.476501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.477139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.477777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.513753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.527125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.529592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.531762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e8714bb3-c5dd-458d-a9cd-b22fc897c429 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1557 microversion: 2.21 time: 0.253143 Aug 30 16:29:24.542495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2394/5188] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:24 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:24.613862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:24.615839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:24.635884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.636711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.637916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.640262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.640722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.641153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.805276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.820850 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a42e8def-0ab2-40b2-acb9-76f332bbc245 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1508 microversion: 2.1 time: 0.366473 Aug 30 16:29:24.835635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2795/5189] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:24 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:24.838331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:24.850045 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc2b8560-f3b8-4578-84b0-4ab702626123 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.241469 Aug 30 16:29:24.850271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:24.850826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:24.862977 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2395/5190] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:24 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:24.868723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.869147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.869586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:24.871567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:24.872278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:24.872739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.158074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:25.168329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e3622b7-20f1-4bac-a2c7-3447e35f47e4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1508 microversion: 2.1 time: 0.329253 Aug 30 16:29:25.169199 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2796/5191] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:24 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1508 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:25.190630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:25.195579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:25.218252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.219964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.220631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.221799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.222909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.225668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.230047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:25.230789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:25.237919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.249589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.250197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.251068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.251561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.252026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.286347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:25.334931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:25.336035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:25.336915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:25.337559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:25.338258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:25.465416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:25.479798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.480834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.481471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.482758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.483412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.484129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.524444 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00be4338-7747-4684-8577-09a5b47a922c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "POST /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0/action" status: 202 len: 1110 microversion: 2.1 time: 0.338496 Aug 30 16:29:25.539210 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2396/5192] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:29:25 2022] POST /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0/action => generated 1110 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 16:29:25.545427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:25.546404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:25.570279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.571667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.572965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.574117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.574906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.579123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.714933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:25.730813 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e54f245-5caf-4039-8ba8-43e575089ae5 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.502155 Aug 30 16:29:25.732660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2797/5193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:25 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:25.749610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:25.750695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:25.758045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.758941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.759977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:25.761237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:25.761951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:25.763045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:26.000664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:26.014376 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10746abe-e51b-450b-8700-cee4e371720f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.474497 Aug 30 16:29:26.030884 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2397/5194] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:25 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:26.030884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:26.030884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:26.040173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:26.040725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:26.041167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:26.042097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:26.042720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:26.043140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:26.215106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:26.230566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:26.238501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:26.241070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-31fc621f-a893-4ba3-b198-35572a810c5d tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1557 microversion: 2.21 time: 0.505382 Aug 30 16:29:26.259142 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2798/5195] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:25 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1557 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:26.609765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:26.622773 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2198a8f3-4ba3-4bfa-916f-089b17baffd0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.605528 Aug 30 16:29:26.624782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2398/5196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:26 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:26.753233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:26.754019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:26.768804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:26.769230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:26.769681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:26.770983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:26.785142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:26.785612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.039099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:27.039738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:27.053247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.053779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.054234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.064452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.066923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.073391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.192039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.217808 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7147ff2d-beca-4032-947e-b3ed24a42734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.468554 Aug 30 16:29:27.218544 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2799/5197] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:26 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:27.280027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:27.280027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:27.297545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.300462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.301013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.315357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.316116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.316725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.606066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.626687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.628850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.630244 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdea74c5-79c0-43cc-aa51-9a6eeb1cbe38 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1557 microversion: 2.21 time: 0.362149 Aug 30 16:29:27.630872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2800/5198] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:27 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1557 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:27.663355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:27.664263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:27.672799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.673521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.674737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.675638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:27.682038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:27.682820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:27.857256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.869551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-22f0e4c5-61bc-4a1d-aaf7-e2c8c858b2db tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.833030 Aug 30 16:29:27.883351 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2399/5199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:27 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:27.953634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:27.965662 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ccac723-7ed8-4851-9cc2-8dabf5f7434a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.313148 Aug 30 16:29:27.969121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2801/5200] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:27 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:28.138479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad7dfe90-f976-4aad-b23c-86908afda352", "name": "network-vif-deleted", "tag": "272cff0c-59c1-4d33-b44f-00f95701643b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:28.156044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.156759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.157369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.199180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] Creating event network-vif-deleted:272cff0c-59c1-4d33-b44f-00f95701643b for instance ad7dfe90-f976-4aad-b23c-86908afda352 on n-h2-830883-28 Aug 30 16:29:28.206679 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-685cb1d2-35eb-4f7b-8f4b-49b20e227dcf req-437cf6cc-7096-4464-b295-c60a3b6b7b7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073119 Aug 30 16:29:28.213445 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2400/5201] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:28.241473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:28.242340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:28.262412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.262940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.263403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.270038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.271384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.271842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.555150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:28.566986 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80664193-7a2a-4021-bbe9-464d76556138 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.330871 Aug 30 16:29:28.569165 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2802/5202] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:28 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:28.655329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:28.656454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:28.674397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.674874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.679419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.683171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.683668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.684117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.780561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.781716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.782266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.782981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lazy-loading 'fault' on Instance uuid ad7dfe90-f976-4aad-b23c-86908afda352 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:28.911839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:28.915899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:28.936143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.939615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.941414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:28.944574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:28.945361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:28.946064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:29.003124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.014846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.016300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd2068934b4dd438794ac27b0c7a68ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae237d3950149958fce62f14be42ad9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.017496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b0061cd-a6e7-433e-bde1-fc2a412dfebc tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 200 len: 1349 microversion: 2.21 time: 0.366654 Aug 30 16:29:29.026223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2401/5203] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:28 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 1349 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:29:29.034073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:29.038222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:29.048515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:29.052034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:29.052870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:29.053780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:29.056922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:29.057642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:29.308606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.326735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d8dfbba-33ac-4c97-811f-aa1098417562 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.435111 Aug 30 16:29:29.347195 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2803/5204] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:28 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:29.503989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.515077 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7aab9df-e211-4cfa-8299-63f29f7ae58e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.487151 Aug 30 16:29:29.516383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2402/5205] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:29 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:29.590648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:29.591364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:29.598576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:29.599895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:29.600857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:29.601673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:29.602147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:29.602609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:29.777657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:29.793167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f48f77d-0be6-4074-baf1-15856e4330fc tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.207214 Aug 30 16:29:29.794119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2804/5206] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:29 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:30.054781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.056255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.076962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.077964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.078654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.080318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.084054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.084728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.148943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] HTTP exception thrown: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Request method failure captured: Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 HTTP/1.1 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrGWI49pPbvokoKSX_7N1sBXim6C47Vn4Z6mGLX0QrfSrd8lmSQFhyyuSVrWD4JgblNXPzSLHeykHXVeWfX5BGIXwnEYYKl0g7DaFA22ptjvysv-gqMje7OWnCWgvB_tWPll5dEt_cgU4g6AZYGR_jSDpfUryN-yd4LeT52e6SmZ0c Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}] Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d2068934b4dd438794ac27b0c7a68ec5 Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'ad7dfe90-f976-4aad-b23c-86908afda352'} Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.150812 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Returning 404 to user: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3746227-8e21-4bf6-94f0-3028b8a8bc98 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 404 len: 111 microversion: 2.21 time: 0.114491 Aug 30 16:29:30.158676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2403/5207] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:29:30.162078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '.version_select at 0x7fd35cc535e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.162804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.183321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.184752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.185563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.186516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.187148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.187779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.347124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567ea73d-7673-42b4-bacb-3e614ae770a7", "name": "network-vif-plugged", "status": "completed", "tag": "275237f1-5035-48f1-962d-d9942cf9501b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:30.365221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.371120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.371959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.391217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19bdeb98-9a96-4a5a-bf9c-b7c2ef6e1c1b tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.234058 Aug 30 16:29:30.393861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] Creating event network-vif-plugged:275237f1-5035-48f1-962d-d9942cf9501b for instance 567ea73d-7673-42b4-bacb-3e614ae770a7 on n-h2-830883-28 Aug 30 16:29:30.402436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2805/5208] 10.222.0.47 () {60 vars in 1337 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352/os-instance-actions => generated 611 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:29:30.409094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.412184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.413144 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-899d4713-4bf4-47c5-8135-440096420a9d req-222caf85-310d-4b48-ab83-bc96afb7a6b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069524 Aug 30 16:29:30.414339 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2404/5209] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:29:30.428765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.429971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.433145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.434130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.434841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.435828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.436512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.437318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.446638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.448873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.449467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.452820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.465117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.467985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.496251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] HTTP exception thrown: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Request method failure captured: Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 HTTP/1.1 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrGWI49pPbvokoKSX_7N1sBXim6C47Vn4Z6mGLX0QrfSrd8lmSQFhyyuSVrWD4JgblNXPzSLHeykHXVeWfX5BGIXwnEYYKl0g7DaFA22ptjvysv-gqMje7OWnCWgvB_tWPll5dEt_cgU4g6AZYGR_jSDpfUryN-yd4LeT52e6SmZ0c Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}] Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d2068934b4dd438794ac27b0c7a68ec5 Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'ad7dfe90-f976-4aad-b23c-86908afda352'} Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:30.502843 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.507658 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.512860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Returning 404 to user: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:30.515004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10084892-9e01-460d-87a7-b636d477fc17 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 404 len: 111 microversion: 2.21 time: 0.098282 Aug 30 16:29:30.515004 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2405/5210] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:29:30 2022] DELETE /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:29:30.525820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.530542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] [instance: ad7dfe90-f976-4aad-b23c-86908afda352] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.538210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.539190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.539866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.540976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.541645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.542282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.572690 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] HTTP exception thrown: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Request method failure captured: Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 HTTP/1.1 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrGWI49pPbvokoKSX_7N1sBXim6C47Vn4Z6mGLX0QrfSrd8lmSQFhyyuSVrWD4JgblNXPzSLHeykHXVeWfX5BGIXwnEYYKl0g7DaFA22ptjvysv-gqMje7OWnCWgvB_tWPll5dEt_cgU4g6AZYGR_jSDpfUryN-yd4LeT52e6SmZ0c Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2ae237d3950149958fce62f14be42ad9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2ae237d3950149958fce62f14be42ad9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2ae237d3950149958fce62f14be42ad9"}]}] Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2ae237d3950149958fce62f14be42ad9 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1793502838 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d2068934b4dd438794ac27b0c7a68ec5 Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceActionsV221TestJSON-1793502838-project Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'ad7dfe90-f976-4aad-b23c-86908afda352'} Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.574558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. Aug 30 16:29:30.579766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:30.581173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] Returning 404 to user: Instance ad7dfe90-f976-4aad-b23c-86908afda352 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:30.584049 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c8e50ef-1e47-43ad-b2aa-d3fdb1cd38c5 tempest-InstanceActionsV221TestJSON-1793502838 tempest-InstanceActionsV221TestJSON-1793502838-project] 10.222.0.47 "GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352" status: 404 len: 111 microversion: 2.21 time: 0.060423 Aug 30 16:29:30.585534 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2406/5211] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/ad7dfe90-f976-4aad-b23c-86908afda352 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:29:30.596572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.599935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.613849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.617369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.621637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.622622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.623429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.624067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.919055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:30.939151 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6442b2a9-81c4-485d-8754-d39df2458b72 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.542737 Aug 30 16:29:30.939759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2806/5212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:30.940293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:30.952873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:30.953767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:30.955606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f9f780f-a4c5-4f0f-817b-fbc31f9df3b8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.368788 Aug 30 16:29:30.960253 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2407/5213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:30.975804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.980199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.980931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:30.987013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:30.991818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:30.992734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:31.479721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:31.488264 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bd226e0-4279-454a-ba82-db99405984e4 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1328 microversion: 2.1 time: 0.547050 Aug 30 16:29:31.488990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2807/5214] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:30 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1328 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:31.961485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:31.963485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:31.972621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:31.974785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:31.975985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:31.977909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:31.979363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:31.980319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:31.980894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:31.981613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:31.988636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:31.990439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:31.991317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:31.992254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:31.992906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:31.993538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:32.132686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:32.146614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57a53d03-eb22-43eb-8744-f2957fa14583 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.189135 Aug 30 16:29:32.147289 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2408/5215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:31 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:32.152124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1455336963", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "9b2b75c7-b60d-4048-8e2c-d196ebe5fb69"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:32.256440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] validate_networks() for [('9b2b75c7-b60d-4048-8e2c-d196ebe5fb69', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:32.336220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:32.355623 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16f0d5a3-bd8f-4e31-9ef6-7e2145e6aae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1529 microversion: 2.1 time: 0.379067 Aug 30 16:29:32.360257 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2808/5216] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:31 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1529 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:32.510456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:32.511874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:32.518655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:32.519152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:32.519927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:32.520970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:32.521589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:32.522676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:32.767393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:32.781587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73bc4369-12cf-48b6-8064-65d9d9b58956 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1528 microversion: 2.1 time: 0.275175 Aug 30 16:29:32.795522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2809/5217] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:32 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:32.808639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:32.809286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:32.825742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:32.827020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:32.829615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:32.830651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:32.831212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:32.833640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:32.852167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:29:32.852589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:29:32.853054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:29:32.853653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:29:32.854325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:29:33.248747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.249422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.249666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.250432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.250868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.251487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.271954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Getting quotas for project 1993a73e328b444a9a148871f46328b2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:29:33.279190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Getting quotas for user c3743d3266554386b5f9531ca284945b and project 1993a73e328b444a9a148871f46328b2. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:29:33.293950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:29:33.296276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:29:33.350250 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ce4f091-b185-4180-a67f-6c0e879013be tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.201653 Aug 30 16:29:33.350944 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2409/5218] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:29:33.356898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:33.356898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:33.362794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.363281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.363714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.364940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.365569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.366154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.614739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:33.616524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:33.625549 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc8510d8-e384-4986-96d2-a697152e0121 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.273571 Aug 30 16:29:33.626904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2410/5219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:33 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:33.628539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d334858e-20ed-4265-b633-0bccf35558d8 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1528 microversion: 2.1 time: 0.824500 Aug 30 16:29:33.632035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-425a6f46-6789-4086-8fec-65236502113d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:33.632915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2810/5220] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:32 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1528 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:33.648743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-425a6f46-6789-4086-8fec-65236502113d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:33.650938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:33.652325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:33.669111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.669802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.673901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.674677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:33.675152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:33.675590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:33.731845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-425a6f46-6789-4086-8fec-65236502113d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:33.741950 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-425a6f46-6789-4086-8fec-65236502113d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1219 microversion: 2.1 time: 0.113913 Aug 30 16:29:33.742557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2411/5221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:33 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:33.994614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:34.012908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63fd877a-53cb-4a0d-9361-003d2c009f69 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1511 microversion: 2.1 time: 0.378622 Aug 30 16:29:34.014726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2811/5222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:33 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:34.112812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:34.113287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.120767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.121726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.122416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.123275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.124104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.124486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.142528 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] HTTP exception thrown: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Request method failure captured: Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 HTTP/1.1 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrQAx8iPXu3Y7j1048glEi5zWqqagacH1UUB-HDAREEMdVgqxWLywFdyhm64MD5tga8IolULddz2joD-5Qp-e2C0oXySzeeWASzW9a449zZLMd1FmhCgblh8eVeaQGELauhhoBCEX--nX9mHZ4mciB2GJfkXSNK4QAYWoBvSBgT0F0 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 14a83327cf124409a517fcab790cd31d Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14a83327cf124409a517fcab790cd31d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_14a83327cf124409a517fcab790cd31d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/14a83327cf124409a517fcab790cd31d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14a83327cf124409a517fcab790cd31d"}]}] Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 14a83327cf124409a517fcab790cd31d Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1107739714-project Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 37859d36fa6f4a8b851d36faad4ed6ad Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714-project Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '567ea73d-7673-42b4-bacb-3e614ae770a7'} Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:34.157175 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Returning 404 to user: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfe53300-c333-4504-8e11-01adb310abdb tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] 10.222.0.47 "DELETE /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 404 len: 111 microversion: 2.1 time: 0.414294 Aug 30 16:29:34.164394 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2412/5223] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:29:33 2022] DELETE /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 111 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:34.171367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:34.171367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.181199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.190592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.190592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.190592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.190592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.190592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.459117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:34.475062 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9d9d406-094b-4484-aab6-958e906256e2 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1528 microversion: 2.1 time: 0.302685 Aug 30 16:29:34.475968 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2812/5224] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:34 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1528 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:34.495511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Action: 'update', calling method: >, body: {"server": {"name": "567ea73d-7673-42b4-bacb-3e614ae770a7_new"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:34.498065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.505929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.506484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.506930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.508056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.508820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.509425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.514824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:34.525361 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] HTTP exception thrown: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Request method failure captured: Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 HTTP/1.1 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 64 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrQAx8iPXu3Y7j1048glEi5zWqqagacH1UUB-HDAREEMdVgqxWLywFdyhm64MD5tga8IolULddz2joD-5Qp-e2C0oXySzeeWASzW9a449zZLMd1FmhCgblh8eVeaQGELauhhoBCEX--nX9mHZ4mciB2GJfkXSNK4QAYWoBvSBgT0F0 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 14a83327cf124409a517fcab790cd31d Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14a83327cf124409a517fcab790cd31d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_14a83327cf124409a517fcab790cd31d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/14a83327cf124409a517fcab790cd31d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/14a83327cf124409a517fcab790cd31d"}]}] Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 14a83327cf124409a517fcab790cd31d Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714 Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1107739714-project Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 37859d36fa6f4a8b851d36faad4ed6ad Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1107739714-project Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "567ea73d-7673-42b4-bacb-3e614ae770a7_new"}} Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '567ea73d-7673-42b4-bacb-3e614ae770a7', 'body': {'server': {'name': '567ea73d-7673-42b4-bacb-3e614ae770a7_new'}}} Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:29:34.527356 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 916, in update Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:34.533221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:29:34.534925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] Returning 404 to user: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:34.536251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14579cda-b83b-4d93-9bbf-a4a364e134a5 tempest-ServersNegativeTestMultiTenantJSON-1107739714 tempest-ServersNegativeTestMultiTenantJSON-1107739714-project] 10.222.0.47 "PUT /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 404 len: 111 microversion: 2.1 time: 0.044469 Aug 30 16:29:34.546616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:34.547466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.550512 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2413/5225] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:29:34 2022] PUT /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:34.556116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.556853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.557485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.558606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.559077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.559623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.590730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:29:34.607284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:34.649981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:34.651467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.665414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.666692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.668044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.669013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.669690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.670346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.729496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6ac2d06-4b53-4197-8fe2-665633dc53ac tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "DELETE /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 204 len: 0 microversion: 2.1 time: 0.186559 Aug 30 16:29:34.730745 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2813/5226] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:29:34 2022] DELETE /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:29:34.740284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:34.746522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:34.754124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.754924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.755525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:34.756226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:34.756760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:34.758547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:35.001754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:35.012709 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7402a5f9-d162-4097-b046-521091b627d9 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1534 microversion: 2.1 time: 0.277217 Aug 30 16:29:35.014856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:35.015046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2814/5227] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:34 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1534 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:35.026270 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a23aae94-ba0b-4453-a3d5-202262098a05 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.382757 Aug 30 16:29:35.032653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:35.033690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:35.036729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2414/5228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:34 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:35.048140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:35.049109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:35.051640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:35.052225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:35.052768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:35.059893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:35.059893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:35.059893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:35.060280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:35.061244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:35.061544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:35.061974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:35.062252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:35.062968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:35.256090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:35.275517 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f4308e0-5a91-44f3-9885-5038d0c415d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1223 microversion: 2.1 time: 0.259467 Aug 30 16:29:35.283535 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2815/5229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:35 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1223 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:35.400930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:35.411549 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dc15b733-5e3b-4909-b112-5fe8b911ede6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1511 microversion: 2.1 time: 0.373285 Aug 30 16:29:35.412945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2415/5230] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:35 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:36.043073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:36.046262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:36.055788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:36.059584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:36.076750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.083447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.084699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.088080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.089431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.091014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.092021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.092767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.094811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.095781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.100592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.101308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.377630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:36.387369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c071d3a7-5aad-436d-bf6d-3fbdfa0bc7e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.339869 Aug 30 16:29:36.403032 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2416/5231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:36 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:36.409646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:36.411476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:36.417796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:36.419346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.420103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.420759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.421883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.423152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.423797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.427799 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c83c5d8c-3b41-453f-ac25-038f7bacbb92 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1534 microversion: 2.1 time: 0.390202 Aug 30 16:29:36.428616 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2816/5232] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:36 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1534 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:36.454160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:36.455141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:36.465092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.465982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.467295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.468087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.468667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.469166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:36.583634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:36.595711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdd0ef87-dd09-4603-850c-8e566b94ed9d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1223 microversion: 2.1 time: 0.191009 Aug 30 16:29:36.600425 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2417/5233] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:36 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1223 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:36.722764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:36.732515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-723cfb51-2f8a-4fd3-8ca2-e4df3dd66a9f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1511 microversion: 2.1 time: 0.287773 Aug 30 16:29:36.747421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2817/5234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:36 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1511 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:36.968583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "name": "network-vif-unplugged", "status": "completed", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:36.992085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:36.994229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:36.995379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.012369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] Creating event network-vif-unplugged:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:29:37.022195 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-17776557-c365-4230-bf49-69ed37643008 req-d01ff624-bb51-4cd1-9560-0ac454e0923c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065258 Aug 30 16:29:37.023565 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2418/5235] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:37.411341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:37.412959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:37.422715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.423677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.424563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.425627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.427025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.427834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.459577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:37.460300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:37.479679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.481426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.481895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.482653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.483313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.483923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.785134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:37.810474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1260f50-0366-4180-b57d-6a36960f2a70 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.404076 Aug 30 16:29:37.811400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2818/5236] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:37 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:37.816038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:37.816668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:37.832113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.833285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.839044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:37.839827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:37.840315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:37.840772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.001704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:38.012061 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ec1edbc-2f0f-4871-9343-d95fe60a1dd9 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1279 microversion: 2.1 time: 0.199500 Aug 30 16:29:38.017472 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2819/5237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:37 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:38.029870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:38.030478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.046399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.048958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.049420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.050337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.052649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.054485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.302643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c64e79c8bd475690a27cae3978f945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da4f05c75485380461bf786d5832e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:38.321577 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-024d32be-49f7-4997-a7ea-1e73bbbbdce0 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 200 len: 1534 microversion: 2.1 time: 0.865928 Aug 30 16:29:38.323412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:38.324505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2419/5238] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:37 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 1534 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:38.334033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567ea73d-7673-42b4-bacb-3e614ae770a7", "name": "network-vif-deleted", "tag": "275237f1-5035-48f1-962d-d9942cf9501b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:38.346873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33dbb9da-d555-4429-adba-b207d5447f35 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1454 microversion: 2.1 time: 0.325347 Aug 30 16:29:38.348243 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2820/5239] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:38 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1454 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:38.371064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.372675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.374826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.379118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:38.380291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.390367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.390874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.391498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.393090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.394258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.395879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.414378 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] Creating event network-vif-deleted:275237f1-5035-48f1-962d-d9942cf9501b for instance 567ea73d-7673-42b4-bacb-3e614ae770a7 on n-h2-830883-28 Aug 30 16:29:38.421020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7200f5cf-718a-4b0b-95c8-a9272f098503 req-98955c5e-9a3b-4836-8425-ed7c0cbd4b82 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092811 Aug 30 16:29:38.421945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2420/5240] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:38.572265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:38.572858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.586337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.587266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.587936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.589110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.589852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.590723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.623843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:38.633566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de6fd592-6418-4eb2-a77d-7d08cc3cc3af tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1454 microversion: 2.1 time: 0.261885 Aug 30 16:29:38.637004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2821/5241] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:38 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1454 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:38.638963 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-716aaf98-d6d0-4d94-bfae-7a4a71782196 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/ips" status: 200 len: 150 microversion: 2.1 time: 0.072779 Aug 30 16:29:38.639612 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2421/5242] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:29:38 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:29:38.690752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:38.691317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.704966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.705618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.706195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.707924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.709636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.711290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.774068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lazy-loading 'flavor' on Instance uuid b2a51264-976e-452c-aee5-9c6d7157aa4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:38.812902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'shelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state shelved_offloaded Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 14 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: {"shelve": {}} Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'shelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state shelved_offloaded Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'shelve': {}}} Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:29:38.816209 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state shelved_offloaded Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state shelved_offloaded Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'shelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state shelved_offloaded {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1fbc4b19-f623-4644-8b73-ce993afffc07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 155 microversion: 2.1 time: 0.133715 Aug 30 16:29:38.826775 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2822/5243] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:29:38 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 155 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:29:38.828655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:38.829270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.846990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.852837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.853395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.854268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.854753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.855188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.856529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:38.858237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:38.882816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.889744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.890780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:38.892155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:38.893044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:38.904860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.440847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122351) unshelve /opt/stack/nova/nova/compute/api.py:4603}} Aug 30 16:29:39.562260 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1033fa9d-43da-48ed-9787-955081125404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.737614 Aug 30 16:29:39.571164 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2422/5244] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:29:38 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:39.581475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:39.582128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:39.586462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:39.600895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.601392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.601829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.602567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.603018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.603380 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9409aad-d2f0-4962-8fe8-843273aadfcd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.763844 Aug 30 16:29:39.603507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.605268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2823/5245] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:38 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:39.612750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:39.613627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] [instance: 567ea73d-7673-42b4-bacb-3e614ae770a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:39.650328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.652769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.653425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.654706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.656133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.656759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.677267 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] HTTP exception thrown: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Request method failure captured: Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 HTTP/1.1 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjq-hcSllKr9BIEdloQpliD7S5WoA2qe0j7lpeqrhGYGtUAB8tRhCntcuqNSyRF_KFKAxWuyL_RS0sOsBjrHejGzC7SZy2SF_475gGkmiPBMs1jf6dhiAgnCDBGbbw0d-WL5iUbxXMBmtnPS7pN5wQByQAClLMzKjNzqSQFcWOfaF2k Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ae2da4f05c75485380461bf786d5832e Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1519118299 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ae2da4f05c75485380461bf786d5832e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ae2da4f05c75485380461bf786d5832e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ae2da4f05c75485380461bf786d5832e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ae2da4f05c75485380461bf786d5832e"}]}] Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1519118299 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ae2da4f05c75485380461bf786d5832e Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1519118299 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1519118299-project Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 39c64e79c8bd475690a27cae3978f945 Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1519118299-project Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '567ea73d-7673-42b4-bacb-3e614ae770a7'} Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:39.680012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. Aug 30 16:29:39.685282 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:29:39.688544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] Returning 404 to user: Instance 567ea73d-7673-42b4-bacb-3e614ae770a7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:29:39.689696 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f062b42-5992-413d-9cfe-dc501b17d734 tempest-ServersNegativeTestMultiTenantJSON-1519118299 tempest-ServersNegativeTestMultiTenantJSON-1519118299-project] 10.222.0.47 "GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7" status: 404 len: 111 microversion: 2.1 time: 0.082975 Aug 30 16:29:39.691120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2824/5246] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:39 2022] GET /compute/v2.1/servers/567ea73d-7673-42b4-bacb-3e614ae770a7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:29:39.698109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:39.699257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:39.706120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.706995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.708542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.709529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:39.710243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:39.710920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:39.805252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:39.835256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7eb22495-05a3-4fc3-bcb9-d344a42a5267 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1277 microversion: 2.1 time: 0.261412 Aug 30 16:29:39.853958 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2423/5247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:39 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:40.063886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:40.075213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d14b2785-673e-4695-9b16-21c40557eae6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1462 microversion: 2.1 time: 0.382081 Aug 30 16:29:40.097537 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2825/5248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:39 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1462 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:40.633757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:40.634580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:40.644128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:40.646971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:40.649679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:40.651729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:40.652215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:40.652677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:40.869440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:40.870102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:40.899389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:40.901350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:40.903800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:40.905198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:40.905843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:40.907874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:41.259546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:41.273647 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-86488dfa-c4e0-4a68-9901-db6cf0800027 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.649037 Aug 30 16:29:41.275918 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2424/5249] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:40 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:41.294252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:41.296305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:41.302964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:41.313752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:41.316622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:41.317755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:41.317972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d100912-236a-4a57-a8a6-1a8942182fb5 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.454521 Aug 30 16:29:41.319777 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2826/5250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:40 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:41.321816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:41.321816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:41.323554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:41.516316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b0d577-53d4-4e2e-9d0a-7fbe8f581bef"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:41.519081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:41.533776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:41.534614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:41.535056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:41.536396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:41.536856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:41.537447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:41.816421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:41.842632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffebb55f-e52d-4f06-ae3a-69ce49d183c7 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1462 microversion: 2.1 time: 0.562011 Aug 30 16:29:41.848813 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2425/5251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:41 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1462 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:42.049334 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-403de89f-5af0-4aca-9544-3ea6a1ee3d54 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "POST /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536951 Aug 30 16:29:42.053509 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2827/5252] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:29:41 2022] POST /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:29:42.297114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:42.297824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:42.304664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.305240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.305792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.306649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.307252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.307791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.341280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:42.342327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:42.356209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.357112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.357818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.358896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.359602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.360275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.399401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:42.705198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:42.714690 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7f26498-f0ea-4f74-bc32-7a8396a56c93 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.377457 Aug 30 16:29:42.725034 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2828/5253] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:42 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:42.876024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:42.877031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:42.892432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.896499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.897286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.900296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:42.904021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:42.909376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:42.980087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:42.990389 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33f9e89d-1b67-4580-b1c3-6c0585d07df0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.697290 Aug 30 16:29:42.994959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2426/5254] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:42 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:43.079342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:43.090024 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c98cf61b-3225-4cf7-a203-8a99266cfd7e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.228116 Aug 30 16:29:43.102753 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2829/5255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:42 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:43.747112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:43.748554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:43.760662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:43.763714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:43.768856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:43.769777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:43.772826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:43.775754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:43.776447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:43.777089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.015611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:44.017217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:44.029711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:44.030653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:44.033130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.034094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:44.035275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:44.037393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.410385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:44.425444 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e8a2cd9-9fcf-41cc-8209-355e55df3558 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.413951 Aug 30 16:29:44.427732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2830/5256] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:44 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:44.446502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:44.447158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:44.461464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:44.468459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:44.470562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-12e8fab9-2911-4962-9028-cfb30718b912 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.730249 Aug 30 16:29:44.473801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:44.475327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2427/5257] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:43 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:44.484783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836a04fc-d8fd-4f46-b2fe-75de798cf6df", "tag": "35a3eaa4-6ec4-41e8-9664-252b6c7f135f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:44.488080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.489373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:44.499056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:44.499624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.505220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:44.510159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:44.510818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:44.537844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] Creating event network-changed:35a3eaa4-6ec4-41e8-9664-252b6c7f135f for instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df on n-h2-830883-28 Aug 30 16:29:44.543443 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-56430e8b-1ce9-42dc-94a7-f67fe58de9de req-d87bad95-ecf9-410a-8f06-825a3568567e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066707 Aug 30 16:29:44.544298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2428/5258] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:44.762483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:44.771684 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-76045076-829a-4017-8206-bbb077cb8dfd tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.342132 Aug 30 16:29:44.776471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2831/5259] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:44 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:45.448288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:45.448997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:45.467470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:45.470797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:45.473883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:45.474992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:45.481570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:45.482018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:45.498982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:45.500532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:45.535023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:45.535808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:45.536123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:45.536881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:45.537344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:45.537773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:46.212207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:46.221332 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2468f0e8-0d27-4f77-a787-e33e2c01337b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.777419 Aug 30 16:29:46.235366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2429/5260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:45 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:46.248054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:46.248964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:46.262114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:46.268018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:46.278059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:46.278600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:46.278936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:46.279847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:46.280479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:46.281270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:46.291169 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-166b4955-0a86-4eb2-9367-0ec84373076e tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.793786 Aug 30 16:29:46.295110 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2832/5261] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:45 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:46.636068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:46.663448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17d72250-2741-4a9a-9bb2-bc8dc423e1bb tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.426617 Aug 30 16:29:46.664095 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2430/5262] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:46 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:47.248272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:47.248907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:47.251719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:47.265728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.267842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.268695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:47.269660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.271674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.272445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:47.321001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:47.321808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:47.336805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.340248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.343335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:47.345861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.348200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.350064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:47.746417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:47.763922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6bc3da2-6e57-4b7e-91c0-5774c8b0ca2a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.520668 Aug 30 16:29:47.765130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2833/5263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:47 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:47.775252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:47.776239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:47.796706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.798210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.799337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:47.800553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:47.802163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:47.803045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:48.034532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:48.038811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:48.054628 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2621fcdd-12ec-4cf0-a972-c5cc5adc73d3 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.735010 Aug 30 16:29:48.056085 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2431/5264] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:47 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:48.230512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:48.241552 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-964ba19f-e005-4dc3-a4d6-8b38a90677da tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.473797 Aug 30 16:29:48.244390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2834/5265] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:47 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:48.791698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:48.793017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:48.813711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:48.815602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:48.817713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:48.818757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:48.819223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:48.819653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:49.080923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:49.083347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:49.107826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:49.108743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:49.109604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:49.111098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:49.112283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:49.113457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:49.705631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:49.715712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:49.725013 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3271d815-db2d-45cc-a1de-c8446f798d44 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.936496 Aug 30 16:29:49.727895 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2432/5266] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:48 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:49.742537 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47c1ae23-0c56-4c82-a967-564282baa835 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.669213 Aug 30 16:29:49.743774 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2835/5267] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:49 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:29:49.750375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:49.750955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:49.778728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:49.779509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:49.783409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:49.784567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:49.787466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:49.788172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:50.622866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:50.641494 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a823ad08-ffbb-476a-a134-d811682c92a2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.910251 Aug 30 16:29:50.644373 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2433/5268] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:49 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:50.749228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:50.751195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:50.765976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:50.767620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:50.786915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:50.791602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:50.794678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:50.795282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:50.796221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:50.797163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:50.800606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:50.802176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:50.803134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:50.809464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:50.810166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:50.815894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:51.297156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:51.313234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-62c07a20-517d-41e2-b589-b65330aa4e46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 0.565848 Aug 30 16:29:51.314075 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2836/5269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:50 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:51.673509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:51.674487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:51.685299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:51.687971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:51.690244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:51.690835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:51.692449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:51.698940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:51.705493 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5739a601-f2be-4c59-ae18-2d96d9768467 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.945004 Aug 30 16:29:51.714749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:51.723821 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2434/5270] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:50 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:52.022687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:52.034917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5cf373e4-a5c0-4b20-8857-05f60ddec404 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.365934 Aug 30 16:29:52.037728 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2837/5271] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:51 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:52.336364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:52.337195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:52.347097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:52.349940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:52.350814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:52.351918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:52.352771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:52.353559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:52.731777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:52.733460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:52.752039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:52.755204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:52.757397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:52.759578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:52.762486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:52.764105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.137945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:53.153159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61ddab80-2d8b-4d6b-abee-09828993e587 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.426847 Aug 30 16:29:53.156059 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2838/5272] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:52 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:53.166690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:53.171826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:53.185653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:53.186803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:53.187492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.188474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:53.189246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:53.189915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.599857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:53.610499 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e37a1d2-5a0c-4240-8fa5-c98472d8580a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.450683 Aug 30 16:29:53.624485 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2839/5273] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:53 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:53.632872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836a04fc-d8fd-4f46-b2fe-75de798cf6df", "name": "network-vif-plugged", "status": "completed", "tag": "35a3eaa4-6ec4-41e8-9664-252b6c7f135f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:53.645308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:53.646078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:53.646740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:53.662139 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] Creating event network-vif-plugged:35a3eaa4-6ec4-41e8-9664-252b6c7f135f for instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df on n-h2-830883-28 Aug 30 16:29:53.668758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-21d8c914-8ae4-4907-8e65-8fcffde46ea9 req-2ea7f330-c018-4d56-9e45-a7de732a2fcb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042616 Aug 30 16:29:53.670013 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2840/5274] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:53.861460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:53.878620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04b1f963-3859-4989-9dd1-030aec80f267 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1515 microversion: 2.1 time: 1.545978 Aug 30 16:29:53.902529 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2435/5275] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:52 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1515 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:54.183440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:54.185068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:54.224145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.228184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.228875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.231711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.234910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.236072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.627837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:54.637555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e3fc821-3aea-4c07-8392-a887ff87bfd2 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.464085 Aug 30 16:29:54.641261 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2841/5276] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:54 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:54.644256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:54.645181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:54.661584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.662589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.663246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.664193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.664867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.665491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.927359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:54.928397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:54.941232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.942598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.944649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:54.948198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:54.949847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:54.951660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:55.390571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:55.404441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04c8c25f-4fb7-4e75-ab87-19822e710942 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.770073 Aug 30 16:29:55.411670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2436/5277] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:54 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:55.662030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:55.662734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:55.680746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:55.681258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:55.681701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:55.682460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:55.682919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:55.683347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:56.047928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:56.063395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a48e7a14-42cf-4b66-a6ee-022db5f104df tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1521 microversion: 2.1 time: 1.142924 Aug 30 16:29:56.066245 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2842/5278] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:54 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1521 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:56.187602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:56.208475 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8e2c8614-b201-43f3-abe8-b38293675991 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1319 microversion: 2.1 time: 0.549384 Aug 30 16:29:56.211222 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2437/5279] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:55 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:56.437952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:56.438600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:56.464847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:56.467013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:56.467732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:56.468807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:56.471993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:56.472815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:56.792066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:56.824227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3febe70e-491d-4619-a477-7a4a3affbbd6 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.389974 Aug 30 16:29:56.825306 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2843/5280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:56 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:57.090106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.091003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.103677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.104941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.109278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.110285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.110979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.111685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.237624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.239401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.252480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.253300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.254405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.257439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.258128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.258935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.361951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lazy-loading 'services' on Instance uuid 6724469f-9c3b-4ce2-a61b-18a72ab52167 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:29:57.454208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff7a66fb-c92b-4c6f-9e3b-5367e694a103 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments/27b0d577-53d4-4e2e-9d0a-7fbe8f581bef" status: 202 len: 0 microversion: 2.1 time: 0.233936 Aug 30 16:29:57.459269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2844/5281] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:29:57 2022] DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments/27b0d577-53d4-4e2e-9d0a-7fbe8f581bef => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:29:57.495348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.496056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.544250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.544757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.545205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.545923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.546421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.546933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.555777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:57.572750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:29:57.577501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d130f0b6-05be-429b-b4f8-7550fedd1e5e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1521 microversion: 2.1 time: 0.490701 Aug 30 16:29:57.578197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2438/5282] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:57 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:57.597025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.608648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.645177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.651817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.652460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.654809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.657040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.659381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.786398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9f8412e-51f6-4735-bf9f-f1861ae7b0a6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205665 Aug 30 16:29:57.797517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2439/5283] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:29:57 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:57.856402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:57.859794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:57.887348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.897381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.898396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:57.899986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:57.908841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:57.909676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:58.182150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:58.193887 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f755be94-0433-4667-9124-733eff3c39d7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1509 microversion: 2.1 time: 0.734031 Aug 30 16:29:58.206617 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2845/5284] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:57 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1509 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:58.438405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2129221902", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "498b5844-7ec0-454f-8be9-96615a6a9155"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:58.598686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] validate_networks() for [('498b5844-7ec0-454f-8be9-96615a6a9155', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:29:58.634812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:29:58.647866 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b78dc62-1e85-4df3-a5da-29667708eb79 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.796844 Aug 30 16:29:58.648379 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2440/5285] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:57 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:29:58.684613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d6d23d0-5171-4f46-8279-c9926af13ae8", "device": "/dev/sdb"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:29:58.696420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:58.719911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:58.723798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:58.724522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:58.725456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:58.730801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:58.736794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:59.361396 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2755846-10ca-4d82-9e72-6bd9b2a57cfd tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "POST /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699895 Aug 30 16:29:59.382005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2441/5286] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:29:58 2022] POST /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:29:59.405157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:29:59.410882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:29:59.454088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:59.455433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:59.459311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:29:59.467571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:29:59.470942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:29:59.473024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.074837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:00.085786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-554e2413-7bba-4864-8fee-e312e62116d7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1521 microversion: 2.1 time: 0.700670 Aug 30 16:30:00.098330 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2442/5287] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:29:59 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:00.098330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:00.117166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:00.140061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.146387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.148617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.156853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.158779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.160602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.280168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:00.281429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:00.282143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:00.282813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:00.283447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:00.301595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.303884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.306840 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a380365e-f72f-4ac9-8477-0457fabadfbf tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213139 Aug 30 16:30:00.307253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.308335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.312665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2443/5288] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:00 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:00.315742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.317025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.328668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0", "name": "network-vif-plugged", "status": "completed", "tag": "1d0b6cc1-4006-4ba4-bfa8-62fd956225d1"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:00.368420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Getting quotas for project 3e9940560384417fa9fc205d52d47f56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:00.372138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.374857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.375976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Getting quotas for user d9611ec233c348fd9397734b6804e8e8 and project 3e9940560384417fa9fc205d52d47f56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:00.379050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.409321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Going to run 2 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:30:00.412774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:00.432389 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] Creating event network-vif-plugged:1d0b6cc1-4006-4ba4-bfa8-62fd956225d1 for instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 on n-h1-830883-28 Aug 30 16:30:00.469097 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-effae4c8-3ce4-4ae0-855a-6189efb9e5ed req-d1d149e9-92fe-47a0-803b-00aba188994d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154308 Aug 30 16:30:00.469097 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2444/5289] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:00.493569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=5c149854-6ec6-4da0-ac77-4c2c52949a3e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:00.501675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:00.507303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:00.538170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.538743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.539541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.540393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.540943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.541376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.734151 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c00bee1f-3883-4240-ac44-28c8340e74b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525191 Aug 30 16:30:00.747476 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2846/5290] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:30:00.769852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:00.835239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:00.842147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Searching by: {'deleted': False, 'project_id': '3e9940560384417fa9fc205d52d47f56'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:30:00.919672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.921966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.927369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:00.930360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:00.930894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:00.931352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.021742 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-09e7784e-6c15-44c5-8334-3151bfe0f8a8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.266150 Aug 30 16:30:01.022372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2847/5291] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:30:00 2022] GET /compute/v2.1/servers => generated 677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:01.043029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab76f271-e47c-4d1c-bc11-77bac68e7ac5 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:01.047153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab76f271-e47c-4d1c-bc11-77bac68e7ac5 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:01.235611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab76f271-e47c-4d1c-bc11-77bac68e7ac5 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:01.249940 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab76f271-e47c-4d1c-bc11-77bac68e7ac5 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1220 microversion: 2.1 time: 0.215026 Aug 30 16:30:01.252656 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2848/5292] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:01 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1220 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:01.264149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:01.268603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:01.315868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.317299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.319136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.320177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.327357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.328105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.617249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:01.633154 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-464b3df7-9da4-42f9-9453-1267f4dc29bf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1521 microversion: 2.1 time: 0.377259 Aug 30 16:30:01.636978 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2849/5293] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:01 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:01.645522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:01.650410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:01.669814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.671933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.673368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.675268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:01.676955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:01.681799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:01.775819 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d09a957-0a36-47f4-a211-f7da230f50de tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137276 Aug 30 16:30:01.776631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2850/5294] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:01 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:01.904091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:01.919416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c010147d-9b9f-4f91-85f8-045fe7708389 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 1.441198 Aug 30 16:30:01.920659 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2445/5295] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:00 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:02.280183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02059d50-803a-4720-96d1-6dc061c26e3d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:02.284017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02059d50-803a-4720-96d1-6dc061c26e3d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:02.507235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02059d50-803a-4720-96d1-6dc061c26e3d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:02.519771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02059d50-803a-4720-96d1-6dc061c26e3d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1220 microversion: 2.1 time: 0.247272 Aug 30 16:30:02.520466 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2851/5296] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:02 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1220 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:02.660331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:02.660966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:02.677380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:02.678566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:02.686888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:02.687719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:02.690135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:02.690649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:02.791480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:02.796895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:02.857413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:02.859579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:02.863936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:02.868872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:02.873476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:02.877497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.032717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:03.041517 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ba6ecc5-643a-4877-a514-394819b7aad3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1521 microversion: 2.1 time: 0.389408 Aug 30 16:30:03.050168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2446/5297] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:02 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:03.070732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1244d8bb-ce4f-4240-9464-7937421622d1 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.283648 Aug 30 16:30:03.071659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2852/5298] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:02 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:03.095642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:03.104611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:03.136513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.138732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.139872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.147223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.149734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.150678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.540510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:03.541243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:03.554633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.555043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.557827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.559358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:03.560018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:03.564996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:03.700461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:03.710050 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-882cfa36-8eea-4316-aa45-a69e427e136e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1272 microversion: 2.1 time: 0.173302 Aug 30 16:30:03.711349 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2853/5299] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:03 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:03.743095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:03.752140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:03.757440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e36802c2-de07-4945-bb5a-a4f206ce3047 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.705105 Aug 30 16:30:03.771782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2447/5300] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:03 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:04.064109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.064957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.076135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.086254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.093183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.094151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.094738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.103787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.104295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.104753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.128380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.131578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.132129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.132902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.139247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.141547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.250113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-780f60ac-8efb-4c37-b84b-021947de8a8d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169833 Aug 30 16:30:04.254914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2448/5301] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:04.479249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:04.487214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1234bdad-d5af-4f37-89d1-b8b7e08d01ef tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1506 microversion: 2.1 time: 0.427292 Aug 30 16:30:04.489994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2854/5302] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1506 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:04.510177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.511294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.520420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.521429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.522138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.523349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.524054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.524772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.733010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.734192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.742619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.743318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.744051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.744870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.745503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.746116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.887576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:04.889803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:04.902212 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-39ef7796-853a-4ae6-b33a-9a4ba9627abb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1278 microversion: 2.1 time: 0.168963 Aug 30 16:30:04.903341 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe808297-223e-4dce-ba10-95436660be45 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 200 len: 1506 microversion: 2.1 time: 0.395173 Aug 30 16:30:04.904404 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2855/5303] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:04.916217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.922478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.938334 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2449/5304] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:04.946524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.947383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.948047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.948976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.949650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.950294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.961566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:04.962138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:04.969972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.970529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.970973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:04.971683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:04.972138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:04.972609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.051364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:05.239317 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-20eae3c0-bc06-4ab5-971c-3332e89da2f9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 204 len: 0 microversion: 2.1 time: 0.282727 Aug 30 16:30:05.240970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2450/5305] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:04 2022] DELETE /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:05.268431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:05.271803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:05.284415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.289607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.290478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.292081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.292739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.294649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.370115 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47e60e84-ef29-4e0c-960e-9bea8b0ade4b tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106374 Aug 30 16:30:05.371350 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2451/5306] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:05 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:05.524913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-809060769", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "44f33172-fb25-4c49-8a96-0e9e287eafc8"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:05.554814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:05.567096 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63cb2973-60f1-4e83-a141-ac243b3ce071 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.658290 Aug 30 16:30:05.568495 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2856/5307] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:04 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:05.609641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] validate_networks() for [('44f33172-fb25-4c49-8a96-0e9e287eafc8', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:30:05.923837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:05.931078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:05.941645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.943292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.944018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:05.946864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:05.947530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:05.948173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.241023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:06.259627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b1e0be0-655d-4b2c-b1d0-ba0ec75c4203 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.339555 Aug 30 16:30:06.266589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2857/5308] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:05 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:06.383031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:06.385485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:06.404534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.408874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.409368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.410258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.413308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.415349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.478712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:06.479248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:06.479759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:06.480175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:06.481012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:06.496708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.497207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.497809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.506612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.507180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.507620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.538158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:06.545718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for user db3a24e1055246a194f7e96a72dff014 and project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:06.549114 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-444411c2-f6b9-4d4f-b7f2-4eec34969358 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170263 Aug 30 16:30:06.552182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2858/5309] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:06 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:06.560634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:30:06.563897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:06.600083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:06.601602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:06.614904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.615408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.615850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.616551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:06.617005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:06.617663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:06.654847 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2944826f-1b2a-4363-84df-32c18830f0e0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133591 Aug 30 16:30:06.655780 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2452/5310] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:30:06.666821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30b9eff7-460c-45f7-9fa6-7cc58187ac12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:06.674090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30b9eff7-460c-45f7-9fa6-7cc58187ac12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:06.814603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30b9eff7-460c-45f7-9fa6-7cc58187ac12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:06.824537 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30b9eff7-460c-45f7-9fa6-7cc58187ac12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1217 microversion: 2.1 time: 0.161756 Aug 30 16:30:06.825127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2453/5311] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:06 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:06.979821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:06.991801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d424d7b4-0113-4306-b03d-64fdde440c3c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.406026 Aug 30 16:30:06.998590 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2859/5312] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:06 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:07.296547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:07.297183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:07.313493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.314029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.314539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.315283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.315746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.320609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.565528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:07.568703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:07.578860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.579624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.580296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.581198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.582524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.583130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.650825 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9ec4b7f-259f-41d2-83bf-9f12807f760a tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089163 Aug 30 16:30:07.664443 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2860/5313] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 16:30:07 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:30:07.763348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:07.764106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:07.771455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.772331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.773105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.774111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.774992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.775696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.804755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:07.935443 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a123c98-e58c-487e-a98e-c6f65d430565 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 204 len: 0 microversion: 2.1 time: 0.175719 Aug 30 16:30:07.936861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2861/5314] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:07 2022] DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:07.944282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:07.945098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:07.953392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.954407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.955814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:07.957152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:07.957900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:07.958602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.054534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:08.070205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:08.082789 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d75ae94-5cbb-4196-81f7-2a9b5deb10ed tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.795686 Aug 30 16:30:08.087599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5db4e2a2-033f-42bd-a450-dca873335092 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1269 microversion: 2.1 time: 0.148914 Aug 30 16:30:08.088272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2454/5315] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:07 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:08.091368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2862/5316] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:07 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:08.102449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:08.103426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:08.108317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:08.112052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:08.138698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.140049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.141800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.148171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.151563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.152440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.153503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.154972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.156128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.159257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:08.160301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:08.160993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:08.211239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:08.761038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:08.773980 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc63fc92-36ec-43f4-8087-29097fafacae tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.679682 Aug 30 16:30:08.781151 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2863/5317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:08 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:09.114146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.116180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:09.128832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.129677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.138761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.139855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.140522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.141162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.383944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:09.392433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61141699-23e5-45f6-b107-e95de46de065 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.283762 Aug 30 16:30:09.406864 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2864/5318] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:09.412719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.413599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:09.420841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.421497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.422110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.423032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.423661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.424253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.570695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:09.599400 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1275 microversion: 2.1 time: 0.189112 Aug 30 16:30:09.619699 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2865/5319] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:09.621016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.622781 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001592 Aug 30 16:30:09.623626 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2866/5320] 10.222.0.47 () {56 vars in 886 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 16:30:09.632571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.634032 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002108 Aug 30 16:30:09.640823 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2867/5321] 10.222.0.47 () {54 vars in 1035 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 30 16:30:09.642837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.644800 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002487 Aug 30 16:30:09.652960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2868/5322] 10.222.0.47 () {54 vars in 1041 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:09.654438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.655347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:09.656084 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67f34f14-0214-43d2-8e69-a86cc64074a4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001431 Aug 30 16:30:09.670791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e35387f0-ed4a-42fe-92e0-39608ddee2f6 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1681 microversion: 2.1 time: 1.580146 Aug 30 16:30:09.671390 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2455/5324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:08 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1681 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:09.673437 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2869/5324] 10.222.0.47 () {56 vars in 886 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 16:30:09.808875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:09.809750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:09.831721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.832264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.832719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:09.833462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:09.833929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:09.846096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.563528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0", "name": "network-vif-deleted", "tag": "1d0b6cc1-4006-4ba4-bfa8-62fd956225d1"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:10.589927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.600465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.605227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.657666 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] Creating event network-vif-deleted:1d0b6cc1-4006-4ba4-bfa8-62fd956225d1 for instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 on n-h1-830883-28 Aug 30 16:30:10.669350 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-97623922-9d31-42eb-afc5-2f05231e3040 req-fde81262-0374-43d9-bef5-c5c48d15f86a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.690830 Aug 30 16:30:10.672026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2870/5325] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:10.683116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:10.688374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:10.698133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.698733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.699402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.700132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.700603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.701043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.757452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:10.772715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d1105cd-1586-4b87-9136-3a3c4d9c2cf4 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.968690 Aug 30 16:30:10.773310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2456/5326] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:09 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:10.779569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:10.796664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:10.815397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.816344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.817049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.820566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:10.821335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:10.822062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:10.974836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:11.102079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:11.116773 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a22c7641-484a-49a0-9913-bbea10185e71 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1275 microversion: 2.1 time: 0.334458 Aug 30 16:30:11.120267 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2457/5327] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:10 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:11.130639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:11.136624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:11.158077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:11.163201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:11.163746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:11.167195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:11.168655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:11.169443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:11.389129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:11.398802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d5c8e60-1ebf-42eb-8c7d-2db6ff5a1529 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1614 microversion: 2.1 time: 0.276559 Aug 30 16:30:11.403720 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2458/5328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:11 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1614 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:11.545705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:11.561163 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-562f176c-3fcc-40b4-947b-71afdc4e0332 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.887629 Aug 30 16:30:11.565069 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2871/5329] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:10 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:11.793079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:11.793684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:11.805130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:11.805637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:11.806086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:11.806831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:11.807303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:11.807736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.138844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:12.139476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:12.160815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.162458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.163147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.193452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.195018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.203838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.440043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:12.453836 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e24c46e1-2876-47f0-87d9-f36d1457bd07 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.664729 Aug 30 16:30:12.455094 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2459/5330] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:11 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:12.461138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:12.461692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:12.498216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.505570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.506508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.507532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.508168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.510914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.517419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:12.561832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:12.622837 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d9c1b2b-d89a-499f-b8c9-16f6f8c0e918 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1275 microversion: 2.1 time: 0.465439 Aug 30 16:30:12.636801 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2872/5331] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:12 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1275 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:12.653264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6724469f-9c3b-4ce2-a61b-18a72ab52167", "name": "network-vif-deleted", "tag": "522d756b-e187-4c02-836f-d78fdffa7f81"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:12.666064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:12.668835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.672230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.672931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.693987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] Creating event network-vif-deleted:522d756b-e187-4c02-836f-d78fdffa7f81 for instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 on n-h1-830883-28 Aug 30 16:30:12.701367 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d47575a7-4fee-4e1d-8120-a81df6ef8797 req-e3423843-acae-409c-9440-2ce3ff1b2217 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059343 Aug 30 16:30:12.702651 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2873/5332] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:12.709909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:12.711124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:12.721574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.722611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.723600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:12.724678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:12.725326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:12.725941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:13.415295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752f432be0744bb6a18240e184bbbf7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1199f453110c40c0867072c6d4ff3b24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:13.425944 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d700a077-0212-4b09-9249-ee1be4ed9915 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 200 len: 1326 microversion: 2.1 time: 0.969153 Aug 30 16:30:13.427035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2460/5333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:12 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 1326 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:13.432579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6835163-1d91-4a2b-8303-6de0f2591cb9", "tag": "b999c53e-a503-49cb-adbb-88a895f6fd6f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:13.477656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:13.483512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:13.485596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:13.539468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] Creating event network-changed:b999c53e-a503-49cb-adbb-88a895f6fd6f for instance d6835163-1d91-4a2b-8303-6de0f2591cb9 on n-h1-830883-28 Aug 30 16:30:13.563181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4a0c226d-20c0-4e0e-b626-1e538b0d1584 req-fa7494d1-0976-4b27-bcd3-7c37e26b7bff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131176 Aug 30 16:30:13.566619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2461/5334] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:13.688684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:13.698258 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bfcfcc7-2f9c-4382-a8a8-60dbd697f293 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.993582 Aug 30 16:30:13.699427 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2874/5335] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:12 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:13.704458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:13.705395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:13.713821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:13.714571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:13.715190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:13.716095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:13.716854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:13.718034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.069152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "name": "network-vif-plugged", "status": "completed", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:14.113767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.114161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.114625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.154854 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] Creating event network-vif-plugged:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:30:14.205318 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4ca5843a-a2ab-4acf-9087-991f31079656 req-a1f39403-5b1c-4703-9f1c-5b3ff1b096b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.633528 Aug 30 16:30:14.214219 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2462/5336] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:14.228136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:14.239275 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-697dd41c-f06f-48aa-84b0-61c30d692427 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.538570 Aug 30 16:30:14.245567 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2875/5337] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:13 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:14.260945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:14.261712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:14.297738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.314151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.316691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.321582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.327789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.331198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.454855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:14.455540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:14.470944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.474065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.475340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.476263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.477661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.478877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.522689 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 HTTP/1.1 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '6724469f-9c3b-4ce2-a61b-18a72ab52167'} Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:14.527534 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:14.539819 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:14.541883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:14.543189 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d489959-f10e-4262-b052-c22533eb7e3d tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 404 len: 111 microversion: 2.1 time: 0.098445 Aug 30 16:30:14.547694 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2876/5338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:14 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:14.556869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50438017-e4f1-44a9-b88e-fe5157bb2200 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '.version_select at 0x7fd35cba85e0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:14.597554 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50438017-e4f1-44a9-b88e-fe5157bb2200 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109212881" status: 202 len: 0 microversion: 2.1 time: 0.044752 Aug 30 16:30:14.598188 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2877/5339] 10.222.0.47 () {58 vars in 1221 bytes} [Tue Aug 30 16:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109212881 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:30:14.751245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:14.758344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:14.799264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.803115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.805685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:14.810619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:14.813353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:14.817142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:15.225313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:15.236566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ed87ec50-4122-402f-8cc8-1b1f19a717a4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.513620 Aug 30 16:30:15.237167 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2878/5340] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:14 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:15.269494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:15.270292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:15.285417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:15.285899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:15.286371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:15.287065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:15.287527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:15.287942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:15.680407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:15.692268 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0540e3ca-f71f-4656-901b-e45c38554f1f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.426363 Aug 30 16:30:15.693557 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2879/5341] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:15 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:16.051612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:16.063324 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb02a4a5-29d1-4375-ba14-fbedd177e28f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 1.847154 Aug 30 16:30:16.064668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2463/5342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:14 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:16.258079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:16.260894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:16.271977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:16.273264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:16.274714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:16.275548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:16.276305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:16.276833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:16.512831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:16.529467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5634ade-87af-47c6-a966-977633647605 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.275869 Aug 30 16:30:16.530961 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2880/5343] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:16 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:16.713697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:16.715480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:16.719101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:16.720414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:16.726608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:16.727539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:16.728210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:16.729429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:16.730325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:16.731039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:16.821094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:17.096424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:17.098085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:17.109706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:17.112245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:17.113107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:17.116528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:17.117365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:17.118977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:17.361407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:17.374235 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dafe8459-78a5-449c-ab06-747a70967a15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.292797 Aug 30 16:30:17.375384 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2881/5344] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:17 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:17.449461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c149854-6ec6-4da0-ac77-4c2c52949a3e", "tag": "f141e055-7961-4765-a9da-72776f391d7f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:17.467309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:17.467955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:17.468782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:17.482402 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] Creating event network-changed:f141e055-7961-4765-a9da-72776f391d7f for instance 5c149854-6ec6-4da0-ac77-4c2c52949a3e on n-h2-830883-28 Aug 30 16:30:17.488788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:17.489631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8e6a9284-85bc-45d0-8905-c38dea1e3537 req-81bb91da-c4dc-4e2c-bbfd-afb2d6cc0937 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042326 Aug 30 16:30:17.492021 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2882/5345] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:17.506703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02434d65-80c8-438c-89e1-9e37c081cc9e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.788855 Aug 30 16:30:17.508843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2464/5346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:16 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:17.555558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:17.556466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:17.589366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:17.592630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:17.593138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:17.594800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:17.595316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:17.595744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:17.840476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:17.849038 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cdc898f-f07f-4ab4-ad52-968008eb0e44 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.300636 Aug 30 16:30:17.852065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2883/5347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:17 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:18.397523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:18.398160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:18.415261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:18.417953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:18.420809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:18.434572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:18.434572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:18.434572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:18.529976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:18.530778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:18.552881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:18.553468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:18.555535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:18.556879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:18.559538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:18.560086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:19.244628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:19.246862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:19.260827 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-627654d2-2230-4ea4-8d7b-70210b297dc3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.867122 Aug 30 16:30:19.261450 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2465/5348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:18 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:19.281149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:19.290058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:19.293561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:19.302786 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4a06c7be-e669-4935-9c3b-bc1cf3480b8d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1520 microversion: 2.1 time: 0.772728 Aug 30 16:30:19.304508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:19.306554 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2884/5349] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:18 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1520 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:19.308733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:19.310053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:19.310979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:19.311463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:19.311908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:19.314769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6835163-1d91-4a2b-8303-6de0f2591cb9", "name": "network-vif-plugged", "status": "completed", "tag": "b999c53e-a503-49cb-adbb-88a895f6fd6f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:19.327631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:19.328794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:19.329516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:19.351296 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] Creating event network-vif-plugged:b999c53e-a503-49cb-adbb-88a895f6fd6f for instance d6835163-1d91-4a2b-8303-6de0f2591cb9 on n-h1-830883-28 Aug 30 16:30:19.371482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-50b40cb7-c399-4f57-b287-d3b845044583 req-96f5beae-5a98-44fc-9708-228b1afe02ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062277 Aug 30 16:30:19.373982 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2885/5350] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:19.568385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b255f8-3c36-4c3b-9bca-bf948e0bbe66", "tag": "c7a0f2fb-84ce-4685-aa9a-fda1baa641f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:19.582236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:19.583079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:19.583692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:19.598086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] Creating event network-changed:c7a0f2fb-84ce-4685-aa9a-fda1baa641f8 for instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 on n-h2-830883-28 Aug 30 16:30:19.605955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d44b0e5e-ef22-4383-ad53-7f4f87ba50d2 req-e04f5458-820f-4861-8e63-f0f38653da73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041965 Aug 30 16:30:19.609889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2886/5351] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:19.890327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:19.899567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acf7da60-a5b7-46d0-ad93-429c22e21f1d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.618588 Aug 30 16:30:19.900170 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2466/5352] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:19 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:20.285942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:20.287498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:20.309846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.310602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.311839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.312740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.313403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.314002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.325523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:20.327189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:20.340046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.342189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.342719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.347690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.349117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.350527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.549312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:20.559211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80201902-625f-46f9-b0d7-4102f1acc419 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.238402 Aug 30 16:30:20.560424 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2467/5353] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:20 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:20.580977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:20.584711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:20.606607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.607163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.609218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.610925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.611925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.614594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.740941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:20.753119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e10352f-e331-406f-8f74-f9f040f71468 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.471898 Aug 30 16:30:20.754375 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2887/5354] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:20 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:20.920767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:20.921397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:20.937366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.937872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.938334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.939240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:20.943842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:20.944550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:20.965930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:20.981818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b0b9ec84-1940-4578-806f-b1008bfdd9df tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.405423 Aug 30 16:30:20.998018 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2468/5355] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:20 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:21.030137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:21.032375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:21.039683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.040473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.041090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.042661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.043473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.044086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.332101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:21.347524 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11c1aab6-c827-490f-94da-ea45dc8ec9e7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1320 microversion: 2.1 time: 0.430626 Aug 30 16:30:21.363685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2888/5356] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:20 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:21.647355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:21.668890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cbd58a64-a433-422c-a908-675502e42c68 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.654297 Aug 30 16:30:21.669505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2469/5357] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:21 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:21.695117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98f75b04-4d41-4779-8cf5-58dc1f20897b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:21.708494 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-98f75b04-4d41-4779-8cf5-58dc1f20897b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98f75b04-4d41-4779-8cf5-58dc1f20897b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/ddfa420c-fa32-4f8d-a801-5f8a56356207/action HTTP/1.1 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: {"os-stop": {}} Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'ddfa420c-fa32-4f8d-a801-5f8a56356207', 'body': {'os-stop': {}}} Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1439, in _get_instance Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1472, in _stop_server Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _get_instance Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:21.733794 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98f75b04-4d41-4779-8cf5-58dc1f20897b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance ddfa420c-fa32-4f8d-a801-5f8a56356207 has no mapping to a cell. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98f75b04-4d41-4779-8cf5-58dc1f20897b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/ddfa420c-fa32-4f8d-a801-5f8a56356207/action" status: 404 len: 117 microversion: 2.1 time: 0.047005 Aug 30 16:30:21.745415 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2889/5358] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:21 2022] POST /compute/v2.1/servers/ddfa420c-fa32-4f8d-a801-5f8a56356207/action => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:21.747033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:21.747033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:21.765468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.776500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:21.777211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:21.785688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.786190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.788191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.790524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.792205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.792644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.802883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.803246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.804029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:21.804510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:21.807694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:21.827725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:22.238131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:22.250595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c8a6113-2395-4575-8503-2ad404135731 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.508764 Aug 30 16:30:22.256281 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2470/5359] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:21 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:22.283556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:22.285184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:22.293413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:22.298775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:22.299713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:22.301447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:22.302146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:22.303141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:22.725473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:22.758128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e31b66a-1e24-4bb4-8051-04370fb72c46 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.985005 Aug 30 16:30:22.764315 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2890/5360] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:21 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:22.777699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:22.778730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:22.792850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:22.793611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:22.794253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:22.795203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:22.795845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:22.796455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.194228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:23.198739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:23.211059 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-116faed9-01b6-4b2b-ad1b-e82a2db288b2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.931847 Aug 30 16:30:23.211676 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2471/5361] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:22 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:23.224855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:23.229057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.233110 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c58df338-cc9c-41c1-b7b5-41aa5f6703e0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 200 len: 1508 microversion: 2.1 time: 0.462635 Aug 30 16:30:23.235756 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2891/5362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:22 2022] GET /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:23.246892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:23.247771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 55317904-eaf8-4da9-bd77-d7ae1e5a4da7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.249011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.249524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.249968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.259655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.260172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.260625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.262182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/55317904-eaf8-4da9-bd77-d7ae1e5a4da7/action HTTP/1.1 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: {"suspend": {}} Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '55317904-eaf8-4da9-bd77-d7ae1e5a4da7', 'body': {'suspend': {}}} Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.273563 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.279147 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:23.279147 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:23.279147 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. Aug 30 16:30:23.279147 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.280317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 55317904-eaf8-4da9-bd77-d7ae1e5a4da7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:23.281386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cfb7652-da66-4eeb-b65d-c7baebe60ba8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/55317904-eaf8-4da9-bd77-d7ae1e5a4da7/action" status: 404 len: 111 microversion: 2.1 time: 0.044468 Aug 30 16:30:23.283170 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2892/5363] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:23 2022] POST /compute/v2.1/servers/55317904-eaf8-4da9-bd77-d7ae1e5a4da7/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:23.289387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:23.299327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.313066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.316075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.318598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 HTTP/1.1 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6724469f-9c3b-4ce2-a61b-18a72ab52167'} Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:23.318951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.324152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.325021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.325021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.325021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.325279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.328283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:23.329356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7c17096-53d8-4af6-8bfd-9bafcd2a7d76 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 404 len: 111 microversion: 2.1 time: 0.114365 Aug 30 16:30:23.331169 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2472/5364] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:23 2022] DELETE /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:23.339621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:23.345308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.363256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.364020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.364687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.365623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.366459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.367100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.676627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:23.689378 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3323d1dd-2145-43df-81d0-68c01b4b806e tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.356208 Aug 30 16:30:23.719300 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2473/5365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:23.733143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:23.735944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 6724469f-9c3b-4ce2-a61b-18a72ab52167] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.753576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.755458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.756492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.759187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.765543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.769309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.810377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 HTTP/1.1 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6724469f-9c3b-4ce2-a61b-18a72ab52167'} Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:23.812896 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. Aug 30 16:30:23.821017 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:23.824244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 6724469f-9c3b-4ce2-a61b-18a72ab52167 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:23.825955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6fbf6fb-8d40-48aa-bb96-ca837a4f5d3f tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167" status: 404 len: 111 microversion: 2.1 time: 0.105266 Aug 30 16:30:23.828127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2474/5366] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:23 2022] GET /compute/v2.1/servers/6724469f-9c3b-4ce2-a61b-18a72ab52167 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:23.836762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:23.837477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:23.847370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.847942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.848385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:23.849102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:23.849558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:23.849989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:24.140797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:24.151052 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1af51c98-5e28-44c7-bafb-ade0c89f4c0a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.865557 Aug 30 16:30:24.157504 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2893/5367] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:23 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:24.167984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:24.174462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:24.190925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:24.191546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:24.205989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:24.206842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:24.207599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:24.208045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:24.420810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:24.433298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8236a62-14a8-4291-b410-1e557fb4c560 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.273920 Aug 30 16:30:24.433925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2894/5368] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:24 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:24.644916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:24.659183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d387ea21-0ff7-4075-9c52-4e8753f7de33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.829216 Aug 30 16:30:24.661434 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2475/5369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:23 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:24.688799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:24.693446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:24.716880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:24.717384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:24.717835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:24.718586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:24.719052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:24.719486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:24.776089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lazy-loading 'flavor' on Instance uuid b2a51264-976e-452c-aee5-9c6d7157aa4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:24.975564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24df4856-3a3b-432d-bb14-da99fe4f98f2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.290591 Aug 30 16:30:24.976627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2895/5370] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:24 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:30:24.991708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:24.995783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:25.032197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.032759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.033212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.041299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.048905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.049696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.180260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:25.180980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:25.190280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.209529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.210796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.223623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.224134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.224588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.430653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:25.445693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb0a2839-44b9-48e2-935a-4f9aa1bc9437 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1515 microversion: 2.1 time: 0.460914 Aug 30 16:30:25.462220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2476/5371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:24 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1515 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:25.491564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:25.492424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:25.498944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.502056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.502778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.504519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:25.506929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:25.507610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:25.535117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:25.545564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b274300-b01a-4a3e-99f4-df43aa578d4a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.370299 Aug 30 16:30:25.552251 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2896/5372] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:25 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:25.769716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:25.814386 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0076dedd-3387-4313-92e2-832c8f9297fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.331484 Aug 30 16:30:25.819968 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2477/5373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:25 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:26.475786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:26.476504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:26.509869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:26.510423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:26.510887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:26.511620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:26.512098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:26.512540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:26.577679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:26.579140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:26.605329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:26.607076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:26.608369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:26.614713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:26.616952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:26.617653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:26.896464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:26.906072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5dc8824-0c58-4952-ab27-5508ec19ef33 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1515 microversion: 2.1 time: 0.435938 Aug 30 16:30:26.908070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2897/5374] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:26 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1515 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:27.124786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0a9aa1e-fe40-42eb-b948-65ac001146f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: .version_select at 0x7fd35c419700>, body: {"keypair": {"name": "tempest-keypair-450234330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyjVUWM811kPoqjerxlvEYCQ4EBPeRqkx+KSjrp122rRXMFJPEIyxG5CdYxkYyiA3kW1Vezy3ohZoop8XwfagzVOx5ZSUYZOdDpdTs8HjVl1Q0WEx4kWhj7c2VSYAD9mQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:27.148986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d0a9aa1e-fe40-42eb-b948-65ac001146f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for project fe02a8ef9802492eb1451995202d3eb7. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:27.156496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d0a9aa1e-fe40-42eb-b948-65ac001146f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for user f0510a99bf7f44958e978e7c9dba41ae and project fe02a8ef9802492eb1451995202d3eb7. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:27.220151 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0a9aa1e-fe40-42eb-b948-65ac001146f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.308480 Aug 30 16:30:27.224243 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2898/5375] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:30:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 315 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:30:27.251193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:27.254612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:27.270229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:27.270768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:27.271434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:27.272345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:27.275329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:27.275966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:27.614495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:27.627692 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed7d499c-aeca-4612-accd-27dbcb16247c tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 1.053662 Aug 30 16:30:27.630533 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2478/5376] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:26 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:27.772169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:27.780261 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2053862d-94a8-4651-a7f3-77d140f63d04 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.553350 Aug 30 16:30:27.780847 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2899/5377] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:27 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:27.930579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:27.932252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:27.939642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:27.940803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:27.950272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:27.951127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:27.952109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:27.952795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.406378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:28.423607 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-192b6d10-daec-422a-81d8-d93c9b7c0d64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1498 microversion: 2.1 time: 0.494568 Aug 30 16:30:28.427025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2479/5378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:27 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1498 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:28.457501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:28.458223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:28.468765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.469629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.470558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.473140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.473874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.474555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.517961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lazy-loading 'flavor' on Instance uuid b2a51264-976e-452c-aee5-9c6d7157aa4a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:28.535052 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'suspend' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state suspended Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: {"suspend": {}} Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'suspend' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state suspended Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'suspend': {}}} Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state suspended. Cannot suspend while the instance is in this state. Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 30 16:30:28.537507 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state suspended Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state suspended Aug 30 16:30:28.543012 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:28.545268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'suspend' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state suspended {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:28.546373 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e2963e7-c6ee-4c66-bd85-9bc48e632ff8 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 148 microversion: 2.1 time: 0.102710 Aug 30 16:30:28.556669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:28.557530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:28.563125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2900/5379] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:28 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 148 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:30:28.566061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.567707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.568417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.569373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.570461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.571123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.654592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:28.655543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:28.667083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.669057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.670572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.673475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.674244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.676157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.705040 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ed24f85-fd0d-4a1e-8b8c-7fc943ee5bd2 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 202 len: 0 microversion: 2.1 time: 0.152202 Aug 30 16:30:28.708347 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2480/5380] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:28 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:30:28.723773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:28.725060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:28.732770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.734222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.735336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:28.736335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:28.737035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:28.738147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:29.073769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:29.087631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66cce771-a426-4d62-b9b7-806b3c572fd4 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.436053 Aug 30 16:30:29.101260 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2901/5381] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:28 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:29.115660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:29.122138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:29.165417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:29.166336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:29.167445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:29.168808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:29.170930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:29.171608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:29.666583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:29.684546 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e7fba43-148d-485d-92fe-4423cc9530e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.594382 Aug 30 16:30:29.687856 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2902/5382] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:29 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:29.719762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b255f8-3c36-4c3b-9bca-bf948e0bbe66", "name": "network-vif-plugged", "status": "completed", "tag": "c7a0f2fb-84ce-4685-aa9a-fda1baa641f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:29.730834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:29.736935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:29.738461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:29.774076 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] Creating event network-vif-plugged:c7a0f2fb-84ce-4685-aa9a-fda1baa641f8 for instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 on n-h2-830883-28 Aug 30 16:30:29.784018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0cda4e7d-94bf-458a-a60e-af055db96668 req-8a0db5fe-d4bb-40cd-99ab-64504445941b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068848 Aug 30 16:30:29.786192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2903/5383] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:29.808739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:29.825370 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16b1c409-5595-4611-a65d-735e52821393 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1504 microversion: 2.1 time: 1.112137 Aug 30 16:30:29.832952 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2481/5384] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:28 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1504 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:30.122030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:30.124182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:30.135687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:30.140936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:30.142424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:30.147424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:30.148260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:30.149137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:30.710868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:30.711893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:30.728907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:30.729865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:30.730567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:30.734055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:30.734963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:30.735627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:30.947445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:30.983663 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bb55439-a5a2-447c-8a67-b896386511b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.871659 Aug 30 16:30:30.987951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2904/5385] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:30 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:30.998657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:31.011944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:31.026085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.026675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.027133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.027992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.028458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.028897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.056011 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be HTTP/1.1 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5281e689-fa01-447f-a37e-e51da7e0b8be'} Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:31.059025 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.066191 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.070263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:31.071535 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d91bc238-34fa-4623-a147-c1454e4311fb tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 404 len: 111 microversion: 2.1 time: 0.082399 Aug 30 16:30:31.073418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2905/5386] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:30 2022] DELETE /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:31.080697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:31.082037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:31.090918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.092313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.093018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.094623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.095370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.096227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.451319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:31.454761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:31.479146 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c8bf382-cfdc-44ee-8cda-ae9af3eda51c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1317 microversion: 2.1 time: 0.764871 Aug 30 16:30:31.483321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2482/5387] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:30 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:31.498238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:31.504483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: 5281e689-fa01-447f-a37e-e51da7e0b8be] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:31.531678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.532568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.536870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.537888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.539602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.543727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.607274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be HTTP/1.1 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5281e689-fa01-447f-a37e-e51da7e0b8be'} Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.623870 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance 5281e689-fa01-447f-a37e-e51da7e0b8be could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:31.629188 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e28057c5-02ec-409f-887d-eef61c00802e tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be" status: 404 len: 111 microversion: 2.1 time: 0.144342 Aug 30 16:30:31.632140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2483/5388] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:31 2022] GET /compute/v2.1/servers/5281e689-fa01-447f-a37e-e51da7e0b8be => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:31.663313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:31.667129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:31.691566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.692694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.695605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.702119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.707330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.708116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.755704 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 HTTP/1.1 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bbc6da81-90c9-4762-9c74-3d87b734a2b3'} Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:31.762417 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.769018 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.772417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:31.777448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:31.785822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ac6e556-b800-45ef-a7de-b36eb7e39086 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 404 len: 111 microversion: 2.1 time: 0.144538 Aug 30 16:30:31.788615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b361eb20-0713-4d52-95f0-34f57de952b9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1504 microversion: 2.1 time: 0.713875 Aug 30 16:30:31.790881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2484/5389] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:31 2022] DELETE /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:31.796981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2906/5390] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:31 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:31.810527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:31.811508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: bbc6da81-90c9-4762-9c74-3d87b734a2b3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:31.833552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c149854-6ec6-4da0-ac77-4c2c52949a3e", "name": "network-vif-plugged", "status": "completed", "tag": "f141e055-7961-4765-a9da-72776f391d7f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:31.845610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.849188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.853212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.854418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.859035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.859801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.869168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:31.875063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:31.875916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:31.902465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] Creating event network-vif-plugged:f141e055-7961-4765-a9da-72776f391d7f for instance 5c149854-6ec6-4da0-ac77-4c2c52949a3e on n-h2-830883-28 Aug 30 16:30:31.907728 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 HTTP/1.1 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bbc6da81-90c9-4762-9c74-3d87b734a2b3'} Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:31.914255 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. Aug 30 16:30:31.919240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:31.923028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance bbc6da81-90c9-4762-9c74-3d87b734a2b3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:31.924192 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b8846f6-dc5c-4ce5-9db1-11ad05151cc4 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3" status: 404 len: 111 microversion: 2.1 time: 0.128792 Aug 30 16:30:31.929736 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2485/5391] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:31 2022] GET /compute/v2.1/servers/bbc6da81-90c9-4762-9c74-3d87b734a2b3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:31.930809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-18af13d4-3bde-4568-a170-68d5e7ff274c req-5a443154-fbb5-4bfd-b689-5b45a32b8ca5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102747 Aug 30 16:30:31.932060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2907/5392] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:32.009226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:32.010234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:32.021861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:32.026174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:32.026745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:32.027588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:32.028808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:32.036938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:32.451047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1984547242", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dd13832-f3aa-4b56-96ad-423786bd5f53"}], "security_groups": [{"name": "tempest-securitygroup--1418191161"}], "key_name": "tempest-keypair-450234330", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:32.648334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:32.668415 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c9322460-dc67-4708-bace-fbc36120f23a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.662968 Aug 30 16:30:32.668536 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2486/5393] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:32 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:32.693532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:32.697098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:32.732563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:32.733750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:32.734886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:32.735888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:32.736524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:32.737276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:32.744227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] validate_networks() for [('6dd13832-f3aa-4b56-96ad-423786bd5f53', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:30:33.376414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:33.393709 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3d9025d0-dffd-419d-8e38-ec5362d107f4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1508 microversion: 2.1 time: 0.709755 Aug 30 16:30:33.396279 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2487/5394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:32 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1508 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:33.423279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:33.426283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:33.444997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:33.445719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:33.447154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:33.450861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:33.451384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:33.453170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:33.770805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:33.771376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:33.771753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:33.772212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:33.772596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:33.794090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:33.794768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:33.796151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:33.797217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:33.798800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:33.803749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:33.922698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:33.951118 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa337e99-0b81-49d9-ada7-9beccbceb939 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.551277 Aug 30 16:30:33.952419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2488/5395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:33 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:33.979907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:33.982928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:34.029532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.032287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.033867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.045739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.046685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.056937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.063859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for project fe02a8ef9802492eb1451995202d3eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:34.083277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for user f0510a99bf7f44958e978e7c9dba41ae and project fe02a8ef9802492eb1451995202d3eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:34.110808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:30:34.121980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:34.222891 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-478acc85-ab57-4106-97c7-b16c57633506 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.776692 Aug 30 16:30:34.232011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2908/5396] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:30:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:30:34.239683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:34.247714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:34.268533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:34.284753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.285773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.286519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.287948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.288638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.289308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.490808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:34.504835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6da18112-e76d-4625-8aaf-2a6b95ff7708 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1508 microversion: 2.1 time: 0.548258 Aug 30 16:30:34.505898 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2489/5397] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:33 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:34.516350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:34.519258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:34.535633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.536252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.536712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.540746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.541235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.541797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.617017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:34.620172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:34.634374 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dc2d0e38-3c08-49a3-b8df-2b8f1acb56b9 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1320 microversion: 2.1 time: 0.399517 Aug 30 16:30:34.635362 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2909/5398] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:34 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:34.642821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:34.644496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:34.727017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:34.742819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:34.744977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:34.747716 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c71e8129-1302-4fe6-9a0e-a296091a963c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1281 microversion: 2.20 time: 0.108654 Aug 30 16:30:34.749140 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2910/5399] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:34 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:34.759671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:34.769282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:34.811292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.811979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.815506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:34.816800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:34.817775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:34.819669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.032855 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-353f4c86-888e-4292-9b3c-912c80cfb88b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "PUT /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1080 microversion: 2.1 time: 0.281943 Aug 30 16:30:35.047449 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2911/5400] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:30:34 2022] PUT /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1080 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:35.070165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:35.081644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:35.082672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:35.087991 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10c5edef-cb47-4652-9133-cf05f7595d47 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.580766 Aug 30 16:30:35.102871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2490/5401] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:34 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:35.115348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.115875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:35.116415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.116546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: ef29ab50-0119-4fa8-86bf-f23d861a1464] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:35.117203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.118193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.119115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.120786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.122785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/ef29ab50-0119-4fa8-86bf-f23d861a1464/action HTTP/1.1 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 15 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: {"unpause": {}} Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'ef29ab50-0119-4fa8-86bf-f23d861a1464', 'body': {'unpause': {}}} Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:35.124728 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:35.132188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:35.132188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:35.132188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. Aug 30 16:30:35.132188 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:35.136371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance ef29ab50-0119-4fa8-86bf-f23d861a1464 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:35.137578 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff33225e-c4ff-4b6c-a140-fbfc38750573 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/ef29ab50-0119-4fa8-86bf-f23d861a1464/action" status: 404 len: 111 microversion: 2.1 time: 0.028137 Aug 30 16:30:35.141850 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2491/5402] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:35 2022] POST /compute/v2.1/servers/ef29ab50-0119-4fa8-86bf-f23d861a1464/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:30:35.161718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:35.167363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:35.188056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.191238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.192033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.194143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.195320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.197424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.538812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:35.564917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8d6a198-424f-432d-8948-fd7c8375a97e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1506 microversion: 2.1 time: 0.506989 Aug 30 16:30:35.566566 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2912/5403] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:35 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:35.601216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:35.601866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:35.611849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.612689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.613333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.614502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.615149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.615764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.667143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:35.693943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f2fc4ed-b998-4ae4-9df1-da3ad164f9bc tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.549211 Aug 30 16:30:35.712069 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2492/5404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:35 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:35.739014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:35.741597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:35.753862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.759406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.761704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.770789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:35.771524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:35.772166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:35.986036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.012601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f53bea84-490b-4f2e-b6e5-802eb4dcdaa0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1506 microversion: 2.1 time: 0.417265 Aug 30 16:30:36.014087 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2913/5405] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:35 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:36.042062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:36.045012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:36.067971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.069087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.070028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.082901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.088288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.092219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.186103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.201023 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d4515986-9fe6-4a02-a791-40156c577f68 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 200 len: 1509 microversion: 2.1 time: 0.486086 Aug 30 16:30:36.206347 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2493/5406] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:35 2022] GET /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:36.216684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:36.222157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:36.247937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.249163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.252960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.254151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.258611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.259366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.406206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.421818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.431790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.433308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bead2a44-0349-46cd-9f80-c6a3bcef09ce tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1333 microversion: 2.20 time: 0.220653 Aug 30 16:30:36.459210 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2494/5407] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:36 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1333 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:36.464564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:36.474444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:36.494157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.494746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.495195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.495911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.503882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.504771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.553668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:36.598253 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7ed7146d-9656-4ad5-854e-e35623271ca1 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.572211 Aug 30 16:30:36.606632 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2914/5408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:36 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:36.618139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:36.618752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:36.636860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.637359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.637806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.650256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.650535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.656397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.716930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 5c149854-6ec6-4da0-ac77-4c2c52949a3e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:36.727308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:36.728130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:36.728890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:36.729854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:36.730541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:36.922940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:36.951360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.952225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.959004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:36.961699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:36.967575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:36.969367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.039223 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eec4078d-3cb6-476c-b45c-752ba232032f tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e" status: 204 len: 0 microversion: 2.1 time: 0.425967 Aug 30 16:30:37.039895 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2915/5409] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:36 2022] DELETE /compute/v2.1/servers/5c149854-6ec6-4da0-ac77-4c2c52949a3e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:37.069425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:37.075725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:37.084817 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d9b57e7-d1a7-42a8-9e44-5fff2fa48417 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "POST /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66/action" status: 202 len: 1112 microversion: 2.1 time: 0.624358 Aug 30 16:30:37.100347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.102147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2495/5410] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:36 2022] POST /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66/action => generated 1112 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 16:30:37.112247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.112773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.113551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.115208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.117576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:37.118368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:37.120442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.135593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.137242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.142950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.147019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.147751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.150648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.209820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'unpause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 15 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: {"unpause": {}} Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'unpause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'unpause': {}}} Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state active. Cannot unpause while the instance is in this state. Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:37.212467 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:37.220708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:37.220708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:37.220708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:37.220708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:37.220708 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:37.227280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'unpause' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:37.232385 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98b45dbd-8deb-4560-b694-81acc45b3d0d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 145 microversion: 2.1 time: 0.180410 Aug 30 16:30:37.232385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2916/5411] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:37 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 145 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:30:37.236367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:37.243511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:37.255642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: d6835163-1d91-4a2b-8303-6de0f2591cb9] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:37.261868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.268626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.273574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.277157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.282017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.282546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.489782 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ae4ada0-71ce-4ddc-a1dd-98d8dc3fa399 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9" status: 204 len: 0 microversion: 2.1 time: 0.385909 Aug 30 16:30:37.490853 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2496/5412] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:37 2022] DELETE /compute/v2.1/servers/d6835163-1d91-4a2b-8303-6de0f2591cb9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:37.512984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:37.523391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:37.550444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.556239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.556912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.562331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.562961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.563678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.702679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:37.728700 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a38a4d3b-2387-434c-bbe3-cb961c2a358c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.498463 Aug 30 16:30:37.734837 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2917/5413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:37 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:37.756421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:37.758438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:37.783788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.784472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.791602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.798583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:37.801582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:37.802187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:37.943708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:37.964224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:37.966261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:37.969342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5254c140-c69e-46e8-804f-555207800239 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1339 microversion: 2.20 time: 0.233074 Aug 30 16:30:37.970401 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2918/5414] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:37 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1339 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:37.982136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1857617612", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "498b5844-7ec0-454f-8be9-96615a6a9155"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:38.089227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] validate_networks() for [('498b5844-7ec0-454f-8be9-96615a6a9155', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:30:38.587270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:38.596837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5f784d4-eb9b-4fe7-87a6-1de5acf4d0fa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.104440 Aug 30 16:30:38.597457 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2497/5415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:37 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:38.639535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:38.645613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:38.693463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:38.700167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:38.703553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:38.704588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:38.706646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:38.711205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.408264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:39.411939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:39.423826 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8597416f-b847-4d05-9ea2-0e88327a1a09 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.799162 Aug 30 16:30:39.427389 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2498/5416] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:38 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:39.433335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:39.445538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:39.457668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.458016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.458540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.465980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.472312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.472976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.484412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:30:39.485392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:30:39.486058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:30:39.486689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:30:39.487616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:30:39.514981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.515480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.523725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.524568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.525172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.525627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.626643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Getting quotas for project 3e9940560384417fa9fc205d52d47f56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:30:39.646636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Getting quotas for user d9611ec233c348fd9397734b6804e8e8 and project 3e9940560384417fa9fc205d52d47f56. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:30:39.687077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Going to run 2 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:30:39.693690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:39.800799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=7965b7d3-2b71-48dd-b45f-b86909147828,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:30:39.931065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53b70d9c-2cb0-4c5a-bc77-49024b36c302 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.959318 Aug 30 16:30:39.932259 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2919/5417] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:30:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 16:30:39.948583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:39.949486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:39.971529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.972570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.972819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:39.973545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:39.974014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:39.979472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.089784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:40.103767 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84451cf1-519b-432b-9783-0bdf7d599588 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.675062 Aug 30 16:30:40.115272 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2499/5418] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:39 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:40.120455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:40.123144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 6c26e604-7819-40da-8166-a9997d06b6e3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:40.136337 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/6c26e604-7819-40da-8166-a9997d06b6e3/action HTTP/1.1 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 18 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: {"unshelve": null} Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '6c26e604-7819-40da-8166-a9997d06b6e3', 'body': {'unshelve': None}} Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.140032 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. Aug 30 16:30:40.146232 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.153656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 6c26e604-7819-40da-8166-a9997d06b6e3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:40.154888 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0afe89f-d17e-48a3-9b42-754968cce37a tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/6c26e604-7819-40da-8166-a9997d06b6e3/action" status: 404 len: 111 microversion: 2.1 time: 0.038383 Aug 30 16:30:40.156109 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2500/5419] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:40 2022] POST /compute/v2.1/servers/6c26e604-7819-40da-8166-a9997d06b6e3/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:40.172253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:40.181648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:40.190422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Searching by: {'deleted': False, 'project_id': '3e9940560384417fa9fc205d52d47f56'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:30:40.256426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.258944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.261038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.263976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.267305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.267768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.385847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:30:40.478159 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7d62c80-83e9-45dd-9599-3287d9049c61 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.320742 Aug 30 16:30:40.479669 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2501/5420] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:30:40 2022] GET /compute/v2.1/servers => generated 1337 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:40.501021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:40.511106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:40.524751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.526237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.526956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.528076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.531351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.532078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.572713 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 HTTP/1.1 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e61857f0-1416-4611-9858-4553cd016785'} Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:40.580146 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:40.585677 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:40.587655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:40.589592 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c7b761d-a2ec-4922-8d86-a1cca9320c56 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 404 len: 111 microversion: 2.1 time: 0.095701 Aug 30 16:30:40.595663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2502/5421] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:40 2022] DELETE /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:40.621698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:40.622426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:40.651909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.656379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.656856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:40.657605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:40.662844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:40.666398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.797843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:41.836689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:41.845697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:41.859657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-740e92e2-23f8-4295-9ab2-3840a78a9acf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 1.925585 Aug 30 16:30:41.867457 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2920/5422] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:39 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:41.880505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:41.897992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:41.899088 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dbf7bc3c-6a6d-42c1-bf9f-daa7ba7dace5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 1.296798 Aug 30 16:30:41.900064 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2503/5423] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:40 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:41.901303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:41.927393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:41.930324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] [instance: e61857f0-1416-4611-9858-4553cd016785] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:41.943050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.946903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.947592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.953080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.959221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.960770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.967353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.969632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.975241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:41.980870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:41.985456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:41.988457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.029674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] HTTP exception thrown: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Request method failure captured: Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 HTTP/1.1 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjmhZIN4UZbJ39cdRNDOts35h2Crw1D1Zdx8nP-l1SOg64CY1qtNyrFJ3Tcl2DMekEdJmDDYUgtYdX2I58xl9SC-bzuCsxyvV7M-JLIIgcNcPwhDgK9H9Qjtg9Wk2zOOe_28BRTjGZGtqv6D2MOoMrjUatU-1QMrsaQrUNGFTk-i8rY Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1199f453110c40c0867072c6d4ff3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1199f453110c40c0867072c6d4ff3b24"}]}] Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1199f453110c40c0867072c6d4ff3b24 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-398837991 Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 752f432be0744bb6a18240e184bbbf7f Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeNegativeTest-398837991-project Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e61857f0-1416-4611-9858-4553cd016785'} Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:42.041360 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. Aug 30 16:30:42.046160 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:42.048109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] Returning 404 to user: Instance e61857f0-1416-4611-9858-4553cd016785 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:42.049258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c03747ea-aff6-4b86-9b4b-955cf4e861d0 tempest-AttachVolumeNegativeTest-398837991 tempest-AttachVolumeNegativeTest-398837991-project] 10.222.0.47 "GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785" status: 404 len: 111 microversion: 2.1 time: 0.143962 Aug 30 16:30:42.054437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2504/5424] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:41 2022] GET /compute/v2.1/servers/e61857f0-1416-4611-9858-4553cd016785 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:42.059477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:42.068153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:42.085975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.086773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.087601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.094139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.094915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.095622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.284318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:42.302271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c04d4fe-ef73-450f-99d9-01aff87234c6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1222 microversion: 2.1 time: 0.432055 Aug 30 16:30:42.309407 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2921/5425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:41 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1222 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:42.336526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6835163-1d91-4a2b-8303-6de0f2591cb9", "name": "network-vif-deleted", "tag": "b999c53e-a503-49cb-adbb-88a895f6fd6f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:42.390273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.391082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.391827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.413857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] Creating event network-vif-deleted:b999c53e-a503-49cb-adbb-88a895f6fd6f for instance d6835163-1d91-4a2b-8303-6de0f2591cb9 on n-h1-830883-28 Aug 30 16:30:42.424098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-246d39ad-8f7e-40ad-9fc6-abfb4615991f req-4e987e6b-a364-43c8-a7bd-a13cab86598a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110653 Aug 30 16:30:42.426026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2922/5426] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:42.434229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c149854-6ec6-4da0-ac77-4c2c52949a3e", "name": "network-vif-deleted", "tag": "f141e055-7961-4765-a9da-72776f391d7f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:42.466860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.467715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.468358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.500131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] Creating event network-vif-deleted:f141e055-7961-4765-a9da-72776f391d7f for instance 5c149854-6ec6-4da0-ac77-4c2c52949a3e on n-h2-830883-28 Aug 30 16:30:42.511126 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fd61fcf1-edaf-4bb8-8662-57a15bab8933 req-e577551e-eb0b-4fbc-bc95-751cd3db6970 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080658 Aug 30 16:30:42.516018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2923/5427] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:42.525099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:42.530377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:42.538206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.546500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.547207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:42.548282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:42.548931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:42.551659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.209038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.254867 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-755df8cd-ddda-4ffc-ba5b-a93d5eb076f8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 1.190457 Aug 30 16:30:43.276664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2505/5428] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:42 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:43.307925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:43.310120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:43.328393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.330644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.331543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.335170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.336566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.339317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.349071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.360065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b167259-b49a-42ac-b6ed-f83684b82caa tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.842164 Aug 30 16:30:43.363508 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2924/5429] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:42 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:43.382424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:43.388327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:43.398106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.405756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.408322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.415655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.416729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.417764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.548035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.562688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa428896-de8b-4186-9aff-4e038f8078f2 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1270 microversion: 2.1 time: 0.198039 Aug 30 16:30:43.578034 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2925/5430] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:43 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:43.599254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:43.599903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:43.607211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.607975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.608639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.609563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.610235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.611063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.676642 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Cannot 'unshelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action HTTP/1.1 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 18 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: {"unshelve": null} Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: exception: Cannot 'unshelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'unshelve': None}} Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a in vm_state active. Cannot unshelve while the instance is in this state. Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:30:43.678786 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active Aug 30 16:30:43.683656 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:43.685920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 409 to user: Cannot 'unshelve' instance b2a51264-976e-452c-aee5-9c6d7157aa4a while it is in vm_state active {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:43.687111 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b73690d2-5794-49b5-965d-ea5614f26e38 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action" status: 409 len: 146 microversion: 2.1 time: 0.107747 Aug 30 16:30:43.688919 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2926/5431] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:30:43 2022] POST /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:30:43.698404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:43.711298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:43.718159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.719019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.719534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.720318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:43.721024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:43.722079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:43.820194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.852745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.868266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:43.869462 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b011ad19-4bde-49ac-bc21-0a0031a49ac0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.591496 Aug 30 16:30:43.870472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2506/5432] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:43 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:44.282826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:44.285088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:44.291554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.292378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.293163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.294102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.294802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.295471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.420904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:44.430880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:44.433997 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a71350ae-52f2-451e-ba94-711dbf6f5be3 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.739657 Aug 30 16:30:44.451280 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2927/5433] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:43 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:44.457667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:44.458691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:44.466380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.467152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.467818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.468788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.469447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.470076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.652888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:44.673949 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-100bc6ee-1c2f-4bed-a4ac-66e0d7a8accd tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.394902 Aug 30 16:30:44.687310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2507/5434] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:44 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:44.697982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:44.717053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.717832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.719648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.737436 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] Creating event network-changed:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h1-830883-28 Aug 30 16:30:44.745503 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-fd58d09d-6a9d-45ff-92a5-2ffb33f0e3fd req-3d1db90d-377a-44a5-8d1f-f5db2d2e0581 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067028 Aug 30 16:30:44.746268 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2508/5435] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:44.752075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:44.752833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:44.754845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:44.761154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.761950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.762689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.763656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.764189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.764696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.931879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:44.943631 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8f5c6ab-ed5a-42e6-be60-7b0fdeea72b8 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1276 microversion: 2.1 time: 0.195894 Aug 30 16:30:44.945320 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2509/5436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:44 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:44.953290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:44.954286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:44.963756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.964561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.965384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:44.966488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:44.967176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:44.967837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.206485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:45.217470 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94559c2f-9d30-40cc-b402-345a15b1ddde tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.764971 Aug 30 16:30:45.219004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2928/5437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:44 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:45.240509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-703494752_updated"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:45.245447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b39db1ce-cc85-472f-a5bc-03654f8052c5] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:45.256144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/servers/b39db1ce-cc85-472f-a5bc-03654f8052c5 HTTP/1.1 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 80 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-703494752_updated"}} Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b39db1ce-cc85-472f-a5bc-03654f8052c5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-703494752_updated'}}} Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 916, in update Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 16:30:45.259256 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. Aug 30 16:30:45.266204 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:45.272791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance b39db1ce-cc85-472f-a5bc-03654f8052c5 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:45.276949 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-24228ec4-30f4-4f87-8454-5e5ffa0c5d9b tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "PUT /compute/v2.1/servers/b39db1ce-cc85-472f-a5bc-03654f8052c5" status: 404 len: 111 microversion: 2.1 time: 0.040878 Aug 30 16:30:45.276949 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2929/5438] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:30:45 2022] PUT /compute/v2.1/servers/b39db1ce-cc85-472f-a5bc-03654f8052c5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:45.285292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:45.285919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:45.295427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.296121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.296563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.298534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.299000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.299974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.307035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:45.319355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:45.320839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:45.322013 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-718c5d12-78f8-4879-99de-5b3cb77917ef tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.375160 Aug 30 16:30:45.324133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2510/5439] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:44 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:45.700474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:45.702634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:45.710851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.711644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.712283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.713827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.715368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.716006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.816067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:45.826270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f78f6929-f48c-43fa-b98c-4164242f6345 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.545712 Aug 30 16:30:45.826958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2930/5440] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:45 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:45.852751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:45.853385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:45.863871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.864612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.865592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:45.866579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:45.867236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:45.867847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.071739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.081884 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90d9e1e8-affb-4cba-9937-89b8605a6070 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.386049 Aug 30 16:30:46.082515 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2511/5441] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:45 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:46.100780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:46.101784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:46.110377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.112389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.113135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.114055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.114943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.115546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.240228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.249394 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4fc13f1-86a9-4541-8f01-9b70f0fe668f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.400532 Aug 30 16:30:46.249962 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2931/5442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:45 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:46.255732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:46.256474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:46.267152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.269355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.270005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.271172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.272658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.273407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.405891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.427009 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c37ec02-1cf9-4ce9-b77d-c4f400cf9859 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.323043 Aug 30 16:30:46.427696 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2512/5443] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:46 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:46.433433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-851171af-00d8-48fe-b6b2-26002d0472e5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-851171af-00d8-48fe-b6b2-26002d0472e5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: request: PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a HTTP/1.1 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 280 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.447010 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-851171af-00d8-48fe-b6b2-26002d0472e5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-851171af-00d8-48fe-b6b2-26002d0472e5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 400 len: 619 microversion: 2.1 time: 0.019158 Aug 30 16:30:46.451303 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2513/5444] 10.222.0.47 () {60 vars in 1257 bytes} [Tue Aug 30 16:30:46 2022] PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:30:46.458121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:46.458790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:46.458929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lazy-loading 'services' on Instance uuid 836a04fc-d8fd-4f46-b2fe-75de798cf6df {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:46.476650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.477157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.477607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.482869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.483370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.483820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.609808 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d481555e-9cd4-4e87-b261-6614162d91f1 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "DELETE /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df/os-volume_attachments/5d6d23d0-5171-4f46-8279-c9926af13ae8" status: 202 len: 0 microversion: 2.1 time: 0.357881 Aug 30 16:30:46.611044 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2932/5445] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:30:46 2022] DELETE /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df/os-volume_attachments/5d6d23d0-5171-4f46-8279-c9926af13ae8 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:30:46.617996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:46.618959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:46.634926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.635476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.636036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.637829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:46.639087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:46.640978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:46.941230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.951545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.953864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:46.955600 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ef26638-fafc-4bd5-8895-be81e84fbae0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.505275 Aug 30 16:30:46.956430 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2514/5446] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:46 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:47.104940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:47.106074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:47.114930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.115861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.116526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:47.117476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.118159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.120739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:47.305533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:47.325639 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db89c280-d941-415f-802a-9d8325ccdd52 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.711205 Aug 30 16:30:47.326593 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2933/5447] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:46 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:47.351160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:47.352288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:47.360115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.360962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.361685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:47.363634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.364881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.364881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:47.626556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:47.643987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed2925c8-c61b-4bb5-aa6b-401078567435 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.543397 Aug 30 16:30:47.658258 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2515/5448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:47 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:47.664843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:47.665549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:47.674828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.677876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.679139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:47.680109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:47.680752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:47.681360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.044785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.053986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16840aaf-6232-436c-a973-e7ce127fe49e tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.396181 Aug 30 16:30:48.054853 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2516/5449] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:47 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:48.073704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:48.074599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:48.082012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.082806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.083524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.083723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.084616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.085081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.087951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.091917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99a7471a-3052-45cb-8662-6fa578d81b64 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.747805 Aug 30 16:30:48.092522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2934/5450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:47 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:48.113441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a511ebe0-cb7e-4342-b836-1a3715dba7c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a511ebe0-cb7e-4342-b836-1a3715dba7c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: request: PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a HTTP/1.1 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 24 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": ""}} Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a', 'body': {'server': {'name': ''}}} Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '' Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:30:48.117357 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 16:30:48.122231 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:48.126683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a511ebe0-cb7e-4342-b836-1a3715dba7c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:48.126683 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a511ebe0-cb7e-4342-b836-1a3715dba7c0 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 400 len: 108 microversion: 2.1 time: 0.016023 Aug 30 16:30:48.138751 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2935/5451] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:30:48 2022] PUT /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:30:48.144032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:48.144762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:48.153355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.153864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.154384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.155167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.155637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.156124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.461917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.480586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.495874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.497091 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13ae8614-8fa6-4528-8b01-083d5ef21679 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.429060 Aug 30 16:30:48.514021 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2517/5452] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:48 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:48.514021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0211dcb0-61b7-4220-84d8-515715a102a3", "tag": "ef90a778-593c-4916-902f-c040552a4939"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:48.546944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.550956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.554730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.561621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:48.575031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f2c83ef-e039-4f68-93f4-ca4a73f32ad9 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1507 microversion: 2.1 time: 0.435116 Aug 30 16:30:48.576173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2936/5453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:48 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:48.601097 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] Creating event network-changed:ef90a778-593c-4916-902f-c040552a4939 for instance 0211dcb0-61b7-4220-84d8-515715a102a3 on n-h2-830883-28 Aug 30 16:30:48.618701 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bdd9d639-3140-4c9d-b49d-9c6692222cb8 req-45eca72a-e7eb-4a35-b67a-54b84eeb6253 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119469 Aug 30 16:30:48.619358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2518/5454] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:48.666633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:48.667530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:48.682350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.683193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.684491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:48.685496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:48.686319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:48.696084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.082205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:49.083471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:49.134329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.142523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.143669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.151303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.151794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.152256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.337452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:49.349074 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c11c71d-3b85-4e40-945a-aeeb8d054ca4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.687009 Aug 30 16:30:49.352172 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2937/5455] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:48 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:49.526014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:49.526673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:49.535061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.535572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.536027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.546012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:49.546619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:49.547074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:49.560723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:49.673789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:49.959957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:49.964480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:49.969323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:49.980485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:49.988608 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df523f01-af86-40e0-b1f1-4e375b2a543b tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.914640 Aug 30 16:30:49.990580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:49.999055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2519/5456] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:49 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:50.000762 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8bb5bc8b-5cf9-4174-8028-ebcdf52e0e28 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.478536 Aug 30 16:30:50.001858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2938/5457] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:49 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:30:50.375565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:50.376373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:50.386265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:50.389444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.394728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.395318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.396237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.396807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.397310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.701975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7965b7d3-2b71-48dd-b45f-b86909147828", "tag": "29e389b0-7ebe-43b7-8e06-973215218d7b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:50.724198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.726647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.727945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.772594 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] Creating event network-changed:29e389b0-7ebe-43b7-8e06-973215218d7b for instance 7965b7d3-2b71-48dd-b45f-b86909147828 on n-h1-830883-28 Aug 30 16:30:50.786351 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-aa129ef9-320c-4317-bbfd-9a23a3671777 req-0e661a50-ca8e-4d33-afe0-6f5c2a5c4378 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087815 Aug 30 16:30:50.794381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2939/5458] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:50.909597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:50.951226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:50.952067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:50.965020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:50.986450 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] Creating event network-vif-plugged:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h1-830883-28 Aug 30 16:30:51.005329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2fde05e2-1d76-4692-9e43-650961705783 req-569dbf46-b102-4109-88ec-4b7f16b2d89c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113958 Aug 30 16:30:51.006270 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2940/5459] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:51.038873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:51.044432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:51.055522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:51.059358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:51.061920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:51.063585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:51.066071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:51.067120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:51.250467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.268855 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3aab097-531c-43e7-9745-a9990f0ddaf0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.895003 Aug 30 16:30:51.273133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2520/5460] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:50 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:51.304825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:51.308230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:51.321836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:51.322478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:51.323259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:51.324988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:51.325675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:51.326476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:51.664419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.668719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50fed92e-3de2-409c-8333-22ecbf9d8ed1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.638902 Aug 30 16:30:51.669496 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2941/5461] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:51 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:51.769139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.788499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.790549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:51.792003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c85d85ed-1b16-4170-8e2f-af9a18cb8b77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1407 microversion: 2.20 time: 0.517811 Aug 30 16:30:51.806862 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2521/5462] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:51 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:52.292304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:52.292920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:52.313169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.313673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.314118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:52.314976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.315806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.316481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:52.692622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:52.693254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:52.718788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.719374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.719834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:52.720590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:52.721611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:52.722291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.495265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:53.508357 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0c43bb3-d287-4775-a5ac-73458d122d08 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.820649 Aug 30 16:30:53.529322 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2522/5463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:52 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:53.537710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:53.539364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:53.548145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.549890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.551079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.551970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.552601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.553462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.554954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:53.581670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cbe0c335-b365-421f-beaa-be6dd99e3b0e tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 1.290790 Aug 30 16:30:53.586707 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2942/5464] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:52 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:53.881438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:53.882396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:53.899364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.907045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.907770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.913950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:53.914708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:53.915330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:53.993753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:54.013650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.026716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.028218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.037662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f4d1eea-4194-4a71-9be1-396588a29719 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1599 microversion: 2.20 time: 0.506866 Aug 30 16:30:54.041777 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2523/5465] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:30:53 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1599 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:30:54.070460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:54.071270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:54.086755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.090194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.093154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.094823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.098520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.099561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.166523 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68cac067-eb16-4f10-b492-893c53a7ec98 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "DELETE /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 204 len: 0 microversion: 2.1 time: 0.289667 Aug 30 16:30:54.167455 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2943/5466] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:53 2022] DELETE /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:30:54.176946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:54.177677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:54.192069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:54.195829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.196369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.196832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.197572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.200247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.200719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.349502 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f19279f5-21e1-483d-a590-19f3260aa1f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.284446 Aug 30 16:30:54.351522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2524/5467] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:30:54 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:30:54.536630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:54.538100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:54.552485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.565960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.570694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.572882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.573512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.574038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.703817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.715070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08ef53c7-139c-40de-898b-543b2ddc949d tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1515 microversion: 2.1 time: 0.542939 Aug 30 16:30:54.727150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2944/5468] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:54 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1515 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:54.742150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:54.742820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:54.756074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.756594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.757014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.757726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.758188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.758675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:54.796450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:30:54.948402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:54.956759 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36399d52-f597-4934-9dfd-bba7b5674140 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.424800 Aug 30 16:30:54.961964 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2525/5469] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:54 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:30:54.970591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7965b7d3-2b71-48dd-b45f-b86909147828", "name": "network-vif-plugged", "status": "completed", "tag": "29e389b0-7ebe-43b7-8e06-973215218d7b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:54.994795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:54.997342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:54.997905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:55.030388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] Creating event network-vif-plugged:29e389b0-7ebe-43b7-8e06-973215218d7b for instance 7965b7d3-2b71-48dd-b45f-b86909147828 on n-h1-830883-28 Aug 30 16:30:55.040291 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7dbf2331-c4f2-4db4-997c-d19c11d6955e req-d0209dc0-f2bd-46f9-b27a-98983bf62c8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076780 Aug 30 16:30:55.041278 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2526/5470] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:55.122878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:55.136650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2102fc5b-80a3-4172-9cba-49197c7b55ab tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.401221 Aug 30 16:30:55.144805 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2945/5471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:54 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:55.754090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:55.755498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:55.764300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:55.764804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:55.765237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:55.765940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:55.766419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:55.766865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:55.988242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:55.989620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:56.004969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.008633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.011024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.011895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.012479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.023784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.128951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:56.138398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11731569-7f54-4465-806a-cdb8882149c7 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1515 microversion: 2.1 time: 0.389791 Aug 30 16:30:56.153934 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2527/5472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:55 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1515 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:56.451292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49a62c1d-5e95-44e1-bd8e-9810a0dcb225 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Action: 'create', calling method: .version_select at 0x7fd35d823dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1039140733", "metadata": {"Type": "work"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49a62c1d-5e95-44e1-bd8e-9810a0dcb225 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 122 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1039140733", "metadata": {"Type": "work"}}} Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1039140733', 'metadata': {'Type': 'work'}}}} Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:30:56.457543 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49a62c1d-5e95-44e1-bd8e-9810a0dcb225 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49a62c1d-5e95-44e1-bd8e-9810a0dcb225 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.303390 Aug 30 16:30:56.464338 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2528/5473] 10.222.0.47 () {60 vars in 1156 bytes} [Tue Aug 30 16:30:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 305 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:30:56.468842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:56.469482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:56.474927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:56.477600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.478100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.478569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.479634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.480302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.481096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.499163 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da43d15e-45fd-40d0-bae4-dd3d4dcaeb6a tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.517279 Aug 30 16:30:56.503041 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2946/5474] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:55 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:56.515193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1457721b-4b71-4fb1-8151-be0b64620a3e tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Action: 'create', calling method: .version_select at 0x7fd357cf5e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-395977528", "metadata": {"Type": "work"}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1457721b-4b71-4fb1-8151-be0b64620a3e tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 119 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-395977528", "metadata": {"Type": "work"}}} Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-395977528', 'metadata': {'Type': 'work'}}}} Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '0' Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:30:56.525366 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1457721b-4b71-4fb1-8151-be0b64620a3e tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.531754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1457721b-4b71-4fb1-8151-be0b64620a3e tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023641 Aug 30 16:30:56.532929 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2947/5475] 10.222.0.47 () {60 vars in 1156 bytes} [Tue Aug 30 16:30:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:30:56.545826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a091d970-b139-499b-b809-03f04529180c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Action: 'create', calling method: .version_select at 0x7fd357c06820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1100834352", "metadata": {"Type": "work"}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a091d970-b139-499b-b809-03f04529180c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 119 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1100834352", "metadata": {"Type": "work"}}} Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1100834352', 'metadata': {'Type': 'work'}}}} Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi '' Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:30:56.554608 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 16:30:56.561055 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.562282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a091d970-b139-499b-b809-03f04529180c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.564675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a091d970-b139-499b-b809-03f04529180c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028605 Aug 30 16:30:56.567323 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2948/5476] 10.222.0.47 () {60 vars in 1156 bytes} [Tue Aug 30 16:30:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:30:56.581924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3cd2322-e31a-47e5-919a-b3ac9b3a7d73 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Calling method '.version_select at 0x7fd357c06c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:56.656348 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-e3cd2322-e31a-47e5-919a-b3ac9b3a7d73 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] HTTP exception thrown: Volume tempest-invalid-606177826 could not be found. Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3cd2322-e31a-47e5-919a-b3ac9b3a7d73 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-606177826 HTTP/1.1 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: exception: Volume tempest-invalid-606177826 could not be found. Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'tempest-invalid-606177826'} Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-606177826 could not be found. (HTTP 404) (Request-ID: req-a039424d-857c-4ef1-8eaf-bdee22f90014) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:56.664692 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-606177826 could not be found. Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-606177826 could not be found. Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-606177826 could not be found. Aug 30 16:30:56.670252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.677059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3cd2322-e31a-47e5-919a-b3ac9b3a7d73 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 404 to user: Volume tempest-invalid-606177826 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.677964 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3cd2322-e31a-47e5-919a-b3ac9b3a7d73 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-606177826" status: 404 len: 98 microversion: 2.1 time: 0.103284 Aug 30 16:30:56.680652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2949/5477] 10.222.0.47 () {58 vars in 1215 bytes} [Tue Aug 30 16:30:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-606177826 => generated 98 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:30:56.691486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:56.691974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:56.703303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.703850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.704237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.715337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.716315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.716782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.740217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf HTTP/1.1 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64709681-735f-4bd4-9fa9-609a19ceefcf'} Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:56.741884 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.747377 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.752252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.754280 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b43e2a0-4b07-4f84-ac4a-feefa71f134d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 404 len: 111 microversion: 2.1 time: 0.072410 Aug 30 16:30:56.755435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2950/5478] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:56 2022] DELETE /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:56.761003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ffe8ba49-abb1-402c-b4d1-737e98be42ea tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004375 Aug 30 16:30:56.762999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2951/5479] 10.222.0.47 () {58 vars in 1140 bytes} [Tue Aug 30 16:30:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:30:56.786482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:56.789538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: 64709681-735f-4bd4-9fa9-609a19ceefcf] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:56.804066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.807234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.807919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.808836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.810813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.811443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.838387 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf HTTP/1.1 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '64709681-735f-4bd4-9fa9-609a19ceefcf'} Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:56.846792 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. Aug 30 16:30:56.852274 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:56.855344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance 64709681-735f-4bd4-9fa9-609a19ceefcf could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:56.856398 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3db826bd-20a1-404d-8464-9b49cd32d084 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf" status: 404 len: 111 microversion: 2.1 time: 0.092003 Aug 30 16:30:56.857392 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2952/5480] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:56 2022] GET /compute/v2.1/servers/64709681-735f-4bd4-9fa9-609a19ceefcf => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:56.862614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc794c35-1ef5-4da9-a7dd-e5d9bcaacaec tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004049 Aug 30 16:30:56.863944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2953/5481] 10.222.0.47 () {58 vars in 1137 bytes} [Tue Aug 30 16:30:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 16:30:56.873200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:56.874239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:56.883245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.884120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.884741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.885914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:56.886408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:56.886841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:56.917247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:30:57.047019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:57.064959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98e7e044-b021-4aa8-840b-cb4b40937d16 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 204 len: 0 microversion: 2.1 time: 0.196929 Aug 30 16:30:57.066327 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2954/5482] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:30:56 2022] DELETE /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:30:57.066626 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c6b7fda-7017-4e06-aa8a-f5c0115275c7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.603159 Aug 30 16:30:57.070259 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2529/5483] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:56 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:57.075507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:57.075864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af0845bf-d9e4-4c5a-8fad-22a24816980c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Calling method '.version_select at 0x7fd35cd869d0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:57.088335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.089125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.089802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.105604 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] Creating event network-changed:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h1-830883-28 Aug 30 16:30:57.108654 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-af0845bf-d9e4-4c5a-8fad-22a24816980c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] HTTP exception thrown: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af0845bf-d9e4-4c5a-8fad-22a24816980c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/os-volumes/83f7e18a-7b23-449b-b879-a3184056160f HTTP/1.1 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '83f7e18a-7b23-449b-b879-a3184056160f'} Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. (HTTP 404) (Request-ID: req-203aaed3-6589-4c12-9832-47815492bb50) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:30:57.110797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. Aug 30 16:30:57.116766 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.120159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af0845bf-d9e4-4c5a-8fad-22a24816980c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 404 to user: Volume 83f7e18a-7b23-449b-b879-a3184056160f could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:57.125730 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af0845bf-d9e4-4c5a-8fad-22a24816980c tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/83f7e18a-7b23-449b-b879-a3184056160f" status: 404 len: 109 microversion: 2.1 time: 0.049196 Aug 30 16:30:57.125730 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2530/5484] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:30:57 2022] DELETE /compute/v2.1/os-volumes/83f7e18a-7b23-449b-b879-a3184056160f => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:57.126575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8b5cec5d-9d97-439b-87e2-d2e587743f08 req-38e25ff1-967c-4c65-b47f-5a1626a68a93 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052897 Aug 30 16:30:57.127558 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2955/5485] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:30:57.130457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:57.131421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:57.137149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6af2fbef-ee4f-4f08-be81-50c1355aefe0 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Calling method '.version_select at 0x7fd357c06f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:57.141784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.142962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.143940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.144946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.145667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.146440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.216575 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6af2fbef-ee4f-4f08-be81-50c1355aefe0 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] HTTP exception thrown: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6af2fbef-ee4f-4f08-be81-50c1355aefe0 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Request method failure captured: Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/os-volumes/93c2262e-c51e-484c-b84d-0f210e97815e HTTP/1.1 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjs_RnFtsSr9_5Y_XE1-zP84Try_k1Oto0ryAbJ7TKLVlIdYhEy3S2TuXl6wdIe2-icLu09IPUmlkib13wA8Alsq1GZ9aUGtZ00eId5qajmYiUZTnXJt-kyVRZnnOcKgn0rv3Hjx_IrpVcnT_B41EE0JzEa99cOFsV327A6PWMEe1tQ Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a1541b9e5ad49f08c7a3fde3f470efc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a1541b9e5ad49f08c7a3fde3f470efc"}]}] Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1a1541b9e5ad49f08c7a3fde3f470efc Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesNegativeTest-34081635 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 3c0f3bcef35b477d8553c1e45ebafdf4 Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesNegativeTest-34081635-project Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: method: Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: exception: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '93c2262e-c51e-484c-b84d-0f210e97815e'} Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. (HTTP 404) (Request-ID: req-921d4154-a27d-4bed-87de-608d3d2fbc7e) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:30:57.218887 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. Aug 30 16:30:57.225265 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:30:57.236318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6af2fbef-ee4f-4f08-be81-50c1355aefe0 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] Returning 404 to user: Volume 93c2262e-c51e-484c-b84d-0f210e97815e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:30:57.236318 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6af2fbef-ee4f-4f08-be81-50c1355aefe0 tempest-VolumesNegativeTest-34081635 tempest-VolumesNegativeTest-34081635-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/93c2262e-c51e-484c-b84d-0f210e97815e" status: 404 len: 109 microversion: 2.1 time: 0.101908 Aug 30 16:30:57.236318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2956/5486] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:30:57 2022] GET /compute/v2.1/os-volumes/93c2262e-c51e-484c-b84d-0f210e97815e => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:30:57.244131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:57.245465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:57.255879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.257139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.257794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.258816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.260350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.261249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.480058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:57.498865 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d907029-5c50-4c1d-bb00-846599ca436f tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.373625 Aug 30 16:30:57.503086 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2531/5487] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:57 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:57.523475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:57.524388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:57.538006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.538870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.540000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.540732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.541243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.542811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.617877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:57.630134 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f195508-efc7-466b-9bea-05a5c0768944 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1515 microversion: 2.1 time: 0.390826 Aug 30 16:30:57.631740 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2957/5488] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:57 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:57.864731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836a04fc-d8fd-4f46-b2fe-75de798cf6df", "name": "network-vif-deleted", "tag": "35a3eaa4-6ec4-41e8-9664-252b6c7f135f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:57.882753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.883205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.883643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.912185 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] Creating event network-vif-deleted:35a3eaa4-6ec4-41e8-9664-252b6c7f135f for instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df on n-h2-830883-28 Aug 30 16:30:57.924996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5bb63b9e-11cc-4a82-a1a9-e12b48efd54e req-446a8596-fa79-41a5-9808-8ee6eb4c1af8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061715 Aug 30 16:30:57.925660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2958/5489] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:57.960931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0211dcb0-61b7-4220-84d8-515715a102a3", "name": "network-vif-plugged", "status": "completed", "tag": "ef90a778-593c-4916-902f-c040552a4939"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:30:57.974148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:57.974667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:57.975102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:57.989331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:57.998640 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd5463c8-2cab-4903-97da-d9e1b391ffce tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.481340 Aug 30 16:30:57.999227 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2532/5490] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:57 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:58.022938 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] Creating event network-vif-plugged:ef90a778-593c-4916-902f-c040552a4939 for instance 0211dcb0-61b7-4220-84d8-515715a102a3 on n-h2-830883-28 Aug 30 16:30:58.034510 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2a443c6d-5231-4852-aa0a-433b9717f0a4 req-9ef03411-5f7f-456c-9ca0-ca6d92114959 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078629 Aug 30 16:30:58.035146 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2959/5491] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:30:58.103568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:58.104885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:58.133949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.137589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.138971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.141366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.148384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.149169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.487426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:58.513819 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3021ff57-6305-4056-a2c7-20e010f0e7d0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.413100 Aug 30 16:30:58.515035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2533/5492] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:58 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:58.532588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:58.534137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:58.550750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.551421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.553637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.554866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.556592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.557047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.653230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:58.653866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:58.663785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.664286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.664733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.665442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:58.665909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:58.666364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:58.771485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:58.780677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02b1c381-4989-4852-9aa0-8cf3357b2981 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1304 microversion: 2.1 time: 0.131572 Aug 30 16:30:58.781815 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2534/5493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:58 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:59.021206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:59.021845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:59.035306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.036267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.036921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.037892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.038595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.040351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.160742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:59.175448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11371e8a-5cbf-4a30-846f-9791a283352d tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.647241 Aug 30 16:30:59.176036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2960/5494] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:58 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:59.240513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:59.250987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-79af7156-61e2-4933-89ac-bfd40221dbac tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.235432 Aug 30 16:30:59.252632 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2535/5495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:59 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:59.541447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:59.542057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:59.551496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.552249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.552857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.554393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.555171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.555869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.758531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:59.767731 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6c2439b-b0c9-4370-b317-58c644c547b0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.230537 Aug 30 16:30:59.769529 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2961/5496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:59 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:30:59.804928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:30:59.804928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:30:59.811893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.812700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.813350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.814279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.815801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.816472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.850798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:30:59.851528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:30:59.852205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:30:59.852863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lazy-loading 'fault' on Instance uuid 836a04fc-d8fd-4f46-b2fe-75de798cf6df {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:30:59.952662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3743d3266554386b5f9531ca284945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1993a73e328b444a9a148871f46328b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:30:59.969607 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-68fef3d8-775f-42da-b182-e327cb152f4b tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 200 len: 1309 microversion: 2.1 time: 0.169598 Aug 30 16:30:59.988252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2536/5497] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:30:59 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 1309 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:00.199017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:00.200048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:00.217742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.217742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.217742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.217742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.223291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.225000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.274608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:00.275470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:00.289567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.290295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.290584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.294145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.295253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.297241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.636140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:00.653793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6af3ff2b-4e11-4a8d-a726-e17b2e09c350 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1318 microversion: 2.1 time: 0.378107 Aug 30 16:31:00.659018 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2537/5498] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:00 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:00.747589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd227c38d5aaf416b806556a431d0cdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e61195c24fb4000a372e7fbab7b9fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:00.763581 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-526cab0a-c058-466a-8b11-0921cc703f9c tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 200 len: 1513 microversion: 2.1 time: 0.567503 Aug 30 16:31:00.765424 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2962/5499] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:00 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 1513 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:00.791565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:00.792198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:00.816836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.817603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.826039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.828510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.829052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.833789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.869110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a51264-976e-452c-aee5-9c6d7157aa4a", "name": "network-vif-deleted", "tag": "21d73bc2-206c-4925-8629-cd4aea7feb0a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:00.912143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:00.925088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:00.928511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:00.989510 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] Creating event network-vif-deleted:21d73bc2-206c-4925-8629-cd4aea7feb0a for instance b2a51264-976e-452c-aee5-9c6d7157aa4a on n-h2-830883-28 Aug 30 16:31:01.009109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-85417776-fd70-4578-af7b-f387df7edb84 req-c9defc7e-51c5-4114-b3af-760c309a7724 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145945 Aug 30 16:31:01.009962 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2963/5500] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:01.041825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:01.042785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] [instance: 836a04fc-d8fd-4f46-b2fe-75de798cf6df] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:01.051192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.054225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.055050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.056074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.056723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.057299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.085442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] HTTP exception thrown: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Request method failure captured: Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df HTTP/1.1 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjoLXv9GqdrhWpJL4pzEt8nB2TQ64zFZbIYmw5i4WGkJAO1qsgLXGwfjKyM5__Ro9Ydz2RYCIhyv2yqfH89ZX7Gh-9qYM1YPl0nI2IviwesP_RbveBqw0mI2w0tiM1YdeZ50PZ1AOSVjPjDevH6G5th1P868PZXowVLpK4uAWtSZJys Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 1993a73e328b444a9a148871f46328b2 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1993a73e328b444a9a148871f46328b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1993a73e328b444a9a148871f46328b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1993a73e328b444a9a148871f46328b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1993a73e328b444a9a148871f46328b2"}]}] Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 1993a73e328b444a9a148871f46328b2 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1145832343 Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesSnapshotTestJSON-1145832343-project Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: c3743d3266554386b5f9531ca284945b Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesSnapshotTestJSON-1145832343-project Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '836a04fc-d8fd-4f46-b2fe-75de798cf6df'} Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:01.087850 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. Aug 30 16:31:01.091718 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.097960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] Returning 404 to user: Instance 836a04fc-d8fd-4f46-b2fe-75de798cf6df could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:01.097960 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ebb2634-ad48-4868-ae2a-92578bcb9a26 tempest-VolumesSnapshotTestJSON-1145832343 tempest-VolumesSnapshotTestJSON-1145832343-project] 10.222.0.47 "GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df" status: 404 len: 111 microversion: 2.1 time: 0.081815 Aug 30 16:31:01.099264 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2964/5501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:01 2022] GET /compute/v2.1/servers/836a04fc-d8fd-4f46-b2fe-75de798cf6df => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:01.232670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:01.243562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43643c3d-24e2-4223-b43a-5b749180cfb1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.456859 Aug 30 16:31:01.258103 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2538/5502] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:00 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:01.682022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:01.682978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:01.694913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.703830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.704522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.707394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.713617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.716292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.798462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:01.802518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] [instance: b2a51264-976e-452c-aee5-9c6d7157aa4a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:01.819400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.820459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.821147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.823054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:01.823976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:01.824788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:01.828862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:01.847175 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] HTTP exception thrown: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Request method failure captured: Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a HTTP/1.1 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjpj0MCeu8PqSW-3IMv3JJguo9qI5tLmw90TFPb7ItKNVVqC0lcwG_Tq2aJ9GZIAPKhZo42sciHZv9Nacj46JRZ8Ni9vq3ioAy1AvUx9nrWRClv1zu-JjJpQQwFXdtMLY-axvyuZEYleCqZ4nreB2iwzFQ3MJa5K9_Fb4FZkqDeePM0 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1e61195c24fb4000a372e7fbab7b9fb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1e61195c24fb4000a372e7fbab7b9fb2"}]}] Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 1e61195c24fb4000a372e7fbab7b9fb2 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1662376041 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d227c38d5aaf416b806556a431d0cdb0 Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1662376041-project Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'b2a51264-976e-452c-aee5-9c6d7157aa4a'} Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:01.849365 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. Aug 30 16:31:01.852367 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:01.854135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] Returning 404 to user: Instance b2a51264-976e-452c-aee5-9c6d7157aa4a could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:01.855226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-925157f5-6594-455b-ba7d-62a697eb9ee5 tempest-ServersNegativeTestJSON-1662376041 tempest-ServersNegativeTestJSON-1662376041-project] 10.222.0.47 "GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a" status: 404 len: 111 microversion: 2.1 time: 0.074990 Aug 30 16:31:01.859605 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2539/5503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:01 2022] GET /compute/v2.1/servers/b2a51264-976e-452c-aee5-9c6d7157aa4a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:02.066951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:02.087234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65c2914c-91db-4732-b6a0-de46517688f6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1506 microversion: 2.1 time: 0.406296 Aug 30 16:31:02.087877 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2965/5504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:01 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:02.117655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:02.120748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:02.145535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.146250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.146897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.147794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.148456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.149066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.269100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:02.270051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:02.290457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.290966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.296230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.300933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.306722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.307416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.622702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:02.630824 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c33edeca-ad65-4bd4-b072-f7c3c6ef9982 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.368984 Aug 30 16:31:02.631357 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2966/5505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:02 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:02.643028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:02.651893 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-32e23876-1504-4444-90dd-91d209dc5dfb tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 200 len: 1507 microversion: 2.1 time: 0.546662 Aug 30 16:31:02.656455 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2540/5506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:02 2022] GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:02.682794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:02.683515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:02.697918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.705650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.706453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.707445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.708126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.710852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.769263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:31:02.962618 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e30f9e7-e7be-4b9b-98f4-d137290700d6 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 204 len: 0 microversion: 2.1 time: 0.281457 Aug 30 16:31:02.964710 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2967/5507] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:02 2022] DELETE /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:31:02.974800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:02.975314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:02.988084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.988805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.989800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:02.992618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:02.994655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:02.995186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.102774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:31:03.284677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-576e716b-ce50-4c5d-8cd9-0eb2418f78c3 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 204 len: 0 microversion: 2.1 time: 0.315531 Aug 30 16:31:03.286238 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2541/5508] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:02 2022] DELETE /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:31:03.296303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:03.297622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:03.305211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.306119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.307282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.307942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.308648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.309469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.532679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:03.541772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7105d44a-89dc-4ccb-963f-c063291e90dc tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 200 len: 1513 microversion: 2.1 time: 0.251276 Aug 30 16:31:03.542395 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2968/5509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:03 2022] GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:03.655408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:03.656301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:03.663291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.663961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.664392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:03.665228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:03.665811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:03.666407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:04.289134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:04.303289 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46c1a103-c15f-44d0-9eff-61c680c69eb4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.650820 Aug 30 16:31:04.303894 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2542/5510] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:03 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:04.563984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:04.565198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:04.583762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:04.584523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:04.592376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:04.593379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:04.594023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:04.594700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:04.632722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:05.095098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:05.115906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-abbcf697-9a0b-4bd4-9e5c-d26b13c9837d tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 200 len: 1513 microversion: 2.1 time: 0.556066 Aug 30 16:31:05.118855 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2969/5511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:04 2022] GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:05.325356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:05.325995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:05.337225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:05.339506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:05.340107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:05.342579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:05.343193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:05.346322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:05.793577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7965b7d3-2b71-48dd-b45f-b86909147828", "name": "network-vif-deleted", "tag": "29e389b0-7ebe-43b7-8e06-973215218d7b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:05.833420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:05.836544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:05.844073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:05.857057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:05.880410 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70709662-18e4-4519-9309-5aaaf0f1bd9c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1517 microversion: 2.1 time: 0.559178 Aug 30 16:31:05.882202 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2543/5512] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:05 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1517 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:05.894388 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] Creating event network-vif-deleted:29e389b0-7ebe-43b7-8e06-973215218d7b for instance 7965b7d3-2b71-48dd-b45f-b86909147828 on n-h1-830883-28 Aug 30 16:31:05.912877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f39b51d9-14d9-46cc-91e1-5b997502040a req-6e29f119-31e5-4aff-b2af-659ab95155c6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122870 Aug 30 16:31:05.918071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2970/5513] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:06.139485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:06.140330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:06.156561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.158868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.160450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.165841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.166656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.167208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.245728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.246687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.247819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.248986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lazy-loading 'fault' on Instance uuid 7965b7d3-2b71-48dd-b45f-b86909147828 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:31:06.356518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:06.370055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a775cda8-e592-48bc-8a48-03fc8605e8a1 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 200 len: 1308 microversion: 2.1 time: 0.235772 Aug 30 16:31:06.371031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2544/5514] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:06 2022] GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:06.905992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:06.906733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:06.927142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.927558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.927998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:06.928703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:06.929156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:06.929586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.119261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0211dcb0-61b7-4220-84d8-515715a102a3", "name": "network-vif-deleted", "tag": "ef90a778-593c-4916-902f-c040552a4939"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:07.135188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.135882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.136482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.151201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] Creating event network-vif-deleted:ef90a778-593c-4916-902f-c040552a4939 for instance 0211dcb0-61b7-4220-84d8-515715a102a3 on n-h2-830883-28 Aug 30 16:31:07.163428 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-69a4ab75-4193-47f7-882b-7ab206792dc2 req-f580897a-2227-4b80-8165-254ba4734bb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047875 Aug 30 16:31:07.164352 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2545/5515] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:07.281883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:07.290437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-958e06c4-6bbc-4326-a997-cfd9de11aad7 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 0.389495 Aug 30 16:31:07.291090 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2971/5516] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:06 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:07.395008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:07.395718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 7965b7d3-2b71-48dd-b45f-b86909147828] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:07.409690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.410191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.410651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.411633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.412263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.412861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.429157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] HTTP exception thrown: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Request method failure captured: Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 HTTP/1.1 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjsFtVdubWYhLUz6UlLdDkARovYrMB7DQ3MdKQqByvWeNp3a2HnED76etUqDdl7xOJ43KxeMruWm0XGqIrJUu8Ux5aIoDnqSIxTczs-HKu_cST4OfRIGNaLpEJg1rh2OdvLuVVngeqrVqdB2f1oqWDXQANw0jqc9Hh-J7mlE6f8VoLI Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3e9940560384417fa9fc205d52d47f56 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e9940560384417fa9fc205d52d47f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3e9940560384417fa9fc205d52d47f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3e9940560384417fa9fc205d52d47f56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e9940560384417fa9fc205d52d47f56"}]}] Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3e9940560384417fa9fc205d52d47f56 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateTestJSON-1172488182-project Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d9611ec233c348fd9397734b6804e8e8 Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateTestJSON-1172488182-project Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7965b7d3-2b71-48dd-b45f-b86909147828'} Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:07.431161 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. Aug 30 16:31:07.434097 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:07.435998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Returning 404 to user: Instance 7965b7d3-2b71-48dd-b45f-b86909147828 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:07.437035 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-60570206-f228-4dec-a7f3-62bdcc4b9df0 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828" status: 404 len: 111 microversion: 2.1 time: 0.047849 Aug 30 16:31:07.438073 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2546/5517] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:07 2022] GET /compute/v2.1/servers/7965b7d3-2b71-48dd-b45f-b86909147828 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:07.448457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:07.449501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:07.459677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.460467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.461133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.462888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:07.463942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:07.465317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:07.629484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:07.640473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe8279bb-9f42-4094-9baf-b8b8933dd8bd tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1470 microversion: 2.1 time: 0.198084 Aug 30 16:31:07.646727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2972/5518] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:07 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:08.312832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:08.314975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:08.344278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.345404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.345952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:08.346727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.347173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.347600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:08.667765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:08.668397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:08.680004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.680692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.681149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:08.681873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:08.686489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:08.687162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:08.761869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:08.797528 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3994ff47-2b93-4003-ace1-3c7b221f884c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 0.469591 Aug 30 16:31:08.814342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2547/5519] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:08 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:08.873529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9611ec233c348fd9397734b6804e8e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e9940560384417fa9fc205d52d47f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:08.895813 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98778932-c92b-4951-9159-219b53155146 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 200 len: 1470 microversion: 2.1 time: 0.231910 Aug 30 16:31:08.906652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2973/5520] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:08 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:09.479471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b255f8-3c36-4c3b-9bca-bf948e0bbe66", "name": "network-vif-unplugged", "status": "completed", "tag": "c7a0f2fb-84ce-4685-aa9a-fda1baa641f8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:09.504231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.505050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.506084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.552087 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] Creating event network-vif-unplugged:c7a0f2fb-84ce-4685-aa9a-fda1baa641f8 for instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 on n-h2-830883-28 Aug 30 16:31:09.564343 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c9c2d233-e4a6-42b9-801a-caa53bde2505 req-f0e137d2-58d6-447f-94e2-cd52b9238f63 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096281 Aug 30 16:31:09.567354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2548/5521] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:31:09.831026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:09.831721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:09.840598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.841721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.842542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.844381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.844998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.846156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.921385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:09.922254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] [instance: 0211dcb0-61b7-4220-84d8-515715a102a3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:09.932776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.937820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.938589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.939649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:09.940357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:09.941011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:09.959219 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] HTTP exception thrown: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Request method failure captured: Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 HTTP/1.1 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjsFtVdubWYhLUz6UlLdDkARovYrMB7DQ3MdKQqByvWeNp3a2HnED76etUqDdl7xOJ43KxeMruWm0XGqIrJUu8Ux5aIoDnqSIxTczs-HKu_cST4OfRIGNaLpEJg1rh2OdvLuVVngeqrVqdB2f1oqWDXQANw0jqc9Hh-J7mlE6f8VoLI Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 3e9940560384417fa9fc205d52d47f56 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e9940560384417fa9fc205d52d47f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3e9940560384417fa9fc205d52d47f56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3e9940560384417fa9fc205d52d47f56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3e9940560384417fa9fc205d52d47f56"}]}] Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 3e9940560384417fa9fc205d52d47f56 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1172488182 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateTestJSON-1172488182-project Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d9611ec233c348fd9397734b6804e8e8 Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateTestJSON-1172488182-project Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '0211dcb0-61b7-4220-84d8-515715a102a3'} Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:09.961425 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. Aug 30 16:31:09.965395 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:09.967073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] Returning 404 to user: Instance 0211dcb0-61b7-4220-84d8-515715a102a3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:09.968196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4122027d-66b5-4c20-8610-e374ebbd1ea7 tempest-MultipleCreateTestJSON-1172488182 tempest-MultipleCreateTestJSON-1172488182-project] 10.222.0.47 "GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3" status: 404 len: 111 microversion: 2.1 time: 0.051863 Aug 30 16:31:09.975302 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2549/5522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:09 2022] GET /compute/v2.1/servers/0211dcb0-61b7-4220-84d8-515715a102a3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:31:10.289560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:10.299236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-270c932b-aa90-4b5e-8fc8-8c907db22543 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 0.472982 Aug 30 16:31:10.299833 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2974/5523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:09 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:11.324122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:11.324818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:11.341160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:11.342905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:11.343934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:11.344936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:11.349985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:11.350692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:11.873955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:11.894166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90e3a885-f1a8-478a-97b6-c2bbc0507780 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 0.572102 Aug 30 16:31:11.895026 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2550/5524] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:11 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:12.917232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:12.918250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:12.933417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:12.934133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:12.934807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:12.935656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:12.936250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:12.936875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:13.599394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b255f8-3c36-4c3b-9bca-bf948e0bbe66", "name": "network-vif-plugged", "status": "completed", "tag": "c7a0f2fb-84ce-4685-aa9a-fda1baa641f8"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:13.622020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:13.625518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:13.625667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:13.653835 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] Creating event network-vif-plugged:c7a0f2fb-84ce-4685-aa9a-fda1baa641f8 for instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 on n-h2-830883-28 Aug 30 16:31:13.676750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7215c8d0-ad64-4d62-864d-7613c1fb5b0b req-552993ac-43ce-45f1-9a3e-e8264f6ed116 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084151 Aug 30 16:31:13.677898 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2551/5525] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:31:14.141228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:14.152238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-238b7e73-5691-418d-8b26-71ccf1ab6c63 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 1.238918 Aug 30 16:31:14.181208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2975/5526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:12 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:15.179733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:15.181338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:15.193716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:15.200542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:15.201303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:15.201936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:15.206517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:15.207528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:15.208123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:15.663463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:15.679016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4aef9bf5-3c30-418b-9b16-59b33ce61ac0 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1523 microversion: 2.1 time: 0.505188 Aug 30 16:31:15.695168 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2552/5527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:15 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:16.705637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:16.706264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:16.716688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:16.717192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:16.717981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:16.724250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:16.724815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:16.725267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:16.909250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:16.920090 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce24e5bf-2d20-4352-b275-7f9c0709995c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1508 microversion: 2.1 time: 0.219080 Aug 30 16:31:16.920691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2976/5528] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:16 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:16.944449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:16.947039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:16.957857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:16.958742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:16.959609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:16.960557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:16.961854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:16.962660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:17.164155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:17.174593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8cabf8ca-1481-4b95-9167-879ca41c3a42 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 200 len: 1508 microversion: 2.1 time: 0.236126 Aug 30 16:31:17.176127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2553/5529] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:16 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:17.210554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:17.210554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:17.215385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:17.219836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:17.220491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:17.223714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:17.224220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:17.224781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:17.259518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:31:17.435811 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f03191b0-8882-4bc3-af2e-16e5d22741fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 204 len: 0 microversion: 2.1 time: 0.239396 Aug 30 16:31:17.436732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2977/5530] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:17 2022] DELETE /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:31:17.700328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-435446985", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "44f33172-fb25-4c49-8a96-0e9e287eafc8"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:17.810008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] validate_networks() for [('44f33172-fb25-4c49-8a96-0e9e287eafc8', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:31:18.391038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:31:18.391618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:31:18.392220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:31:18.392948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:31:18.393659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:31:18.404805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:18.405306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:18.405887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:18.406449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:18.407106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:18.407724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:18.432780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:31:18.438612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Getting quotas for user db3a24e1055246a194f7e96a72dff014 and project 5f044138df1d4ba8958255051eb6afd7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:31:18.454956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:31:18.458254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:31:18.547062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80883abc-20e9-4197-9fe6-86d7568e014f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848362 Aug 30 16:31:18.551697 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2554/5531] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:31:18.565242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0fb7a85c-dd81-47c2-aca2-44683bee0db1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:18.567053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0fb7a85c-dd81-47c2-aca2-44683bee0db1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:18.822144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0fb7a85c-dd81-47c2-aca2-44683bee0db1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:18.830995 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0fb7a85c-dd81-47c2-aca2-44683bee0db1 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1217 microversion: 2.1 time: 0.271420 Aug 30 16:31:18.836110 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2978/5532] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:18 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:19.862527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:19.863215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:19.873164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:19.874430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:19.875168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:19.877047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:19.878612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:19.879743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:20.040681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:20.051065 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-991c3e43-7c5a-40fa-b430-11114862e7e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1269 microversion: 2.1 time: 0.197024 Aug 30 16:31:20.052125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2555/5533] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:19 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:20.550981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b255f8-3c36-4c3b-9bca-bf948e0bbe66", "name": "network-vif-deleted", "tag": "c7a0f2fb-84ce-4685-aa9a-fda1baa641f8"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:20.575749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:20.576246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:20.576687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:20.609981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] Creating event network-vif-deleted:c7a0f2fb-84ce-4685-aa9a-fda1baa641f8 for instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 on n-h2-830883-28 Aug 30 16:31:20.636599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-afe6f266-a8fc-4c15-8c5c-de455097b80a req-3b4e4e4c-6ad9-4281-8192-d1f65236ab0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089773 Aug 30 16:31:20.637236 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2979/5534] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:21.073346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:21.076197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:21.099753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:21.100515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:21.101148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:21.102049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:21.102722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:21.103344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:21.263442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:21.273717 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-56d805c2-746a-49d6-9fa1-12543bfcc5fe tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1275 microversion: 2.1 time: 0.204269 Aug 30 16:31:21.276362 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2556/5535] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:21 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:22.315499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:22.317078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:22.326890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:22.328138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:22.328800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:22.330429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:22.331816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:22.332545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:22.822226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:22.846099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e1171ac-7b07-40ff-aeb8-903b9af60d12 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.538160 Aug 30 16:31:22.858011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2980/5536] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:22 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:23.870506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:23.873085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:23.887314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:23.888264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:23.890176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:23.891887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:23.892799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:23.895471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:24.455174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:24.467957 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8da0df17-a936-4c62-ac49-2279bcc4a38c tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.601537 Aug 30 16:31:24.475595 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2557/5537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:23 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:25.262129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e02716c5-f4ec-4ed9-b925-e49cf7b9cf74", "tag": "7ed12613-10fc-44fb-8bf2-2fef94c6e16e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:25.278976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:25.303295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:25.304011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:25.304919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:25.346107 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] Creating event network-changed:7ed12613-10fc-44fb-8bf2-2fef94c6e16e for instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 on n-h2-830883-28 Aug 30 16:31:25.361326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4dde9e70-b4af-42f3-8d00-5f02f0e672ee req-2d4878a9-4f33-428e-99bb-026f50de6838 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102694 Aug 30 16:31:25.368621 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2981/5538] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:25.491712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:25.493428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:25.511350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:25.512775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:25.514593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:25.515433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:25.519985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:25.520552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:25.564540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:26.738260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:26.754550 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e5f6628-a673-48d8-b03e-25ccb4b95055 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 1.263637 Aug 30 16:31:26.756582 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2558/5539] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:25 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:27.780376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:27.783967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:27.818492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:27.825647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:27.826652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:27.830107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:27.832705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:27.836366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:28.457496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:28.468885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-805a9378-c49d-42c8-a631-e3f5286f599a tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.695968 Aug 30 16:31:28.470539 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2982/5540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:27 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:29.491551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:29.494100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:29.497400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:29.498636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:29.509909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:29.512066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:29.513831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:29.516404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:29.517082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:29.517677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:29.809919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:29.810800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:29.829559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:29.831856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:29.833672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:29.833672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:29.833934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:29.834559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:29.835129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:29.888988 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ab2bea8-1214-4789-ab16-2f482adbc62c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/ips" status: 200 len: 151 microversion: 2.20 time: 0.082881 Aug 30 16:31:29.898639 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2983/5541] 10.222.0.47 () {60 vars in 1289 bytes} [Tue Aug 30 16:31:29 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:31:30.289377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:30.327113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6713e77-0bb9-4d59-b09c-c83042b312bc tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.833309 Aug 30 16:31:30.343204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2559/5542] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:29 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:30.373529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Action: 'create', calling method: .version_select at 0x7fd357c15f70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:30.474296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Getting quotas for project 943ba79463084ed090da54ea268797e3. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:31:30.486795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Getting quotas for user e1b3ab8e909b4fca88064e1353bb61e3 and project 943ba79463084ed090da54ea268797e3. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:31:30.597504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Getting quotas for project 943ba79463084ed090da54ea268797e3. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:31:30.604870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Getting quotas for user e1b3ab8e909b4fca88064e1353bb61e3 and project 943ba79463084ed090da54ea268797e3. Resources: {'server_groups'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:31:30.622965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e8022d2-19f4-4ba0-b41a-eac1a9719913 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] 10.222.0.47 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.692868 Aug 30 16:31:30.631986 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2984/5543] 10.222.0.47 () {62 vars in 1214 bytes} [Tue Aug 30 16:31:29 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:31:30.636314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a31d7d2-abce-4934-a77a-305710677571 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:30.697264 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a31d7d2-abce-4934-a77a-305710677571 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.064107 Aug 30 16:31:30.700877 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2560/5544] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Aug 30 16:31:30 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:31:30.710621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2a5ff4e-8970-418e-a1ca-c5cc9bab0caa tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:30.730871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2a5ff4e-8970-418e-a1ca-c5cc9bab0caa tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] 10.222.0.47 "GET /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35" status: 200 len: 235 microversion: 2.64 time: 0.024005 Aug 30 16:31:30.731443 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2985/5545] 10.222.0.47 () {60 vars in 1304 bytes} [Tue Aug 30 16:31:30 2022] GET /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35 => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:31:30.745226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-103022fc-ac96-4a22-a7f4-8ac7de7d2553 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:30.804384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-103022fc-ac96-4a22-a7f4-8ac7de7d2553 tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35" status: 204 len: 0 microversion: 2.64 time: 0.064020 Aug 30 16:31:30.807522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2561/5546] 10.222.0.47 () {60 vars in 1307 bytes} [Tue Aug 30 16:31:30 2022] DELETE /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:31:30.820835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7102336-979c-46ee-8e40-e8439b93cc0c tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:30.827678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c7102336-979c-46ee-8e40-e8439b93cc0c tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] HTTP exception thrown: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7102336-979c-46ee-8e40-e8439b93cc0c tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Request method failure captured: Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35 HTTP/1.1 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjth4G5TFeDha6WbyoCs5Xb5tnuzwkoVrvDC0k3pulOLtfXWz7mbps9YQVI13lDyubzxCWbsLC9PCFCAmnUSIRYPjkkTMblBinL22ADN_ZcKZdl1VxlxVLarCUVAkMMUm1lmLYQRCNKcdyxOzEA4mfn0RMmvFaQQBy3ZmeQ85rOhWsk Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.64 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 943ba79463084ed090da54ea268797e3 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerGroup264TestJSON-533032126 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/943ba79463084ed090da54ea268797e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_943ba79463084ed090da54ea268797e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/943ba79463084ed090da54ea268797e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/943ba79463084ed090da54ea268797e3"}]}] Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerGroup264TestJSON-533032126 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 943ba79463084ed090da54ea268797e3 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerGroup264TestJSON-533032126 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerGroup264TestJSON-533032126-project Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: e1b3ab8e909b4fca88064e1353bb61e3 Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerGroup264TestJSON-533032126-project Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'cb031c97-815a-4c24-baa4-63662d634d35'} Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:30.830695 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7102336-979c-46ee-8e40-e8439b93cc0c tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] Returning 404 to user: Instance group cb031c97-815a-4c24-baa4-63662d634d35 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7102336-979c-46ee-8e40-e8439b93cc0c tempest-ServerGroup264TestJSON-533032126 tempest-ServerGroup264TestJSON-533032126-project] 10.222.0.47 "DELETE /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35" status: 404 len: 117 microversion: 2.64 time: 0.018581 Aug 30 16:31:30.835529 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2986/5547] 10.222.0.47 () {60 vars in 1307 bytes} [Tue Aug 30 16:31:30 2022] DELETE /compute/v2.1/os-server-groups/cb031c97-815a-4c24-baa4-63662d634d35 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:31:31.352607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:31.353238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:31.369425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:31.369927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:31.375538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:31.377346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:31.377591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:31.378029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:32.265686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:32.277218 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18ea2c20-3a01-44e7-bbcf-22f840af8c2d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.928442 Aug 30 16:31:32.278972 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2562/5548] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:31 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:33.301261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:33.302041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:33.334742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.335259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.335832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.337006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.338133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.340481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.417229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:33.417951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:33.428384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.428727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.429322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.437174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.443483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.444503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.520619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lazy-loading 'flavor' on Instance uuid 001c8996-5696-42df-9845-1d837dba1e0e {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:31:33.881480 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fba8dd44-f379-4592-bd8a-72068aa24040 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/action" status: 202 len: 0 microversion: 2.20 time: 0.467420 Aug 30 16:31:33.882889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2563/5549] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:31:33 2022] POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:31:33.920620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:33.922125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:33.956772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.961350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:33.961673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.962250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.963994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:33.967611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:33.968345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:33.978236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2472dd5-0207-4b1d-9b60-4d5a7024a95d tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.681263 Aug 30 16:31:33.997559 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2987/5550] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:33 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:34.297316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:34.303359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02716c5-f4ec-4ed9-b925-e49cf7b9cf74", "name": "network-vif-plugged", "status": "completed", "tag": "7ed12613-10fc-44fb-8bf2-2fef94c6e16e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:34.319498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:34.325869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:34.326030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:34.326470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:34.327687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64cf8c9a-fe3b-481b-bef8-3e1aa504a3db tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.425102 Aug 30 16:31:34.331283 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2564/5551] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:33 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:34.341103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:34.365703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] Creating event network-vif-plugged:7ed12613-10fc-44fb-8bf2-2fef94c6e16e for instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 on n-h2-830883-28 Aug 30 16:31:34.373284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2db8fe32-72bc-455a-abbd-eef3d45067c9 req-7d483d0e-67de-4927-a5f6-d1090d2b7448 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074465 Aug 30 16:31:34.374604 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2988/5552] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:31:35.004744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:35.005769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:35.020071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:35.021524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:35.021989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:35.022923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:35.024354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:35.024942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:35.309638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:35.329726 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c2bd6946-cc3c-4cf7-a8db-90f66b9e8af4 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1317 microversion: 2.1 time: 0.330661 Aug 30 16:31:35.343830 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2565/5553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:34 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:35.360464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:35.361967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:35.373923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:35.375688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:35.379760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:35.382922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:35.383747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:35.385147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:35.399971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:35.741928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:35.753913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:35.756297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:35.757783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cc592b3-b1df-415e-8f12-eb116fcbb1d7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.408672 Aug 30 16:31:35.771156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2989/5554] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:35 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:36.358941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:36.359815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:36.382847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.383641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.384668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:36.385562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.386276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.386938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:36.746432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:36.759127 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1c86dfa-058b-4100-87a7-2a614d5b85fb tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1508 microversion: 2.1 time: 0.405684 Aug 30 16:31:36.760235 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2566/5555] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:36 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:36.784709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:36.790035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:36.790690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:36.796132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:36.816359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.816359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.816359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:36.818868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.819720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.820724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.821341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:36.821607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.822178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:36.823086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:36.826808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:36.827425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.181250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:37.194698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ef6784a-811e-484a-9952-a28f34fb65d3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1508 microversion: 2.1 time: 0.408332 Aug 30 16:31:37.210332 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2567/5556] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:36 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:37.228198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:37.231511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:37.241308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.241811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.242449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.243657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.244314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.244754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.392984 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57c50d07-afbc-48b2-9483-a79ea2ad500b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "PUT /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1080 microversion: 2.1 time: 0.181144 Aug 30 16:31:37.415557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2568/5557] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:31:37 2022] PUT /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1080 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:37.425706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:37.426719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:37.433324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.434381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.440548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.441828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.442459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.443022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.643791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:37.652432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:37.659763 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2e5a227-2f93-4a30-905a-e67e0ab02d83 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1506 microversion: 2.1 time: 0.238899 Aug 30 16:31:37.665974 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2569/5558] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:37 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:37.668772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:37.674563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:37.676410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79ea4cfc-98dd-4e82-84aa-749fea454957 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.895595 Aug 30 16:31:37.677014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2990/5559] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:36 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:37.687270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:37.688145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:37.713064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.713647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.714092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:37.719329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:37.721007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:37.721801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.055555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.064958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c7430c0-2561-4430-9a9e-22d9232d8408 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1506 microversion: 2.1 time: 0.382328 Aug 30 16:31:38.065891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2570/5560] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:37 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:38.087987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:38.090993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:38.107469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.110524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.111216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.112668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.114564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.116020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.283965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c0d31d4c-b64f-4331-80a1-f22b01f09baf tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "PUT /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1082 microversion: 2.1 time: 0.200278 Aug 30 16:31:38.285367 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2991/5561] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:31:38 2022] PUT /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1082 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:38.303462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:38.304414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:38.325054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.325569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.326013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.331045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.334948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.335414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.664484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.675593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1c034bc-ff5f-4705-821f-e9708a3fb7e3 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1508 microversion: 2.1 time: 0.374884 Aug 30 16:31:38.676226 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2571/5562] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:38 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:38.697923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:38.698915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:38.711025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:38.714798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.715653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.716298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.721141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.722018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.726137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.727256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:38.745874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.746588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.747004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.747704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:38.748389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:38.749013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:38.976303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.986335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.987989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.989483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:38.990788 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d2695911-6d7a-41fe-a327-c2e3bb80ad77 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.283623 Aug 30 16:31:38.991652 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2572/5563] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:38 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:38.996116 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d0cfe49-4d91-4775-8711-9990c99a9281 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1508 microversion: 2.1 time: 0.302719 Aug 30 16:31:38.999563 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2992/5564] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:38 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:39.018976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:39.020468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:39.025474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.026619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.026619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.027104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.027556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.027980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.059140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:31:39.086962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:39.162339 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-efa50653-2601-44f7-b0b6-f94cd5433ead tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 204 len: 0 microversion: 2.1 time: 0.147088 Aug 30 16:31:39.163809 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2573/5565] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:39 2022] DELETE /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:31:39.176068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:39.176990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:39.187081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.188443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.189159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.190157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.191661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.192404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.238919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:31:39.295809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.compute.api [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Instance is already in deleting state, ignoring this request Aug 30 16:31:39.296988 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa139a87-f0cc-4018-b956-a200f88e2f15 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 204 len: 0 microversion: 2.1 time: 0.126664 Aug 30 16:31:39.297677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2993/5566] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:39 2022] DELETE /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:31:39.306629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:39.307551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:39.313691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.314174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.314650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.315457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:39.315932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:39.316696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:39.504107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:39.525977 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c472a3f3-614d-4dae-97af-4ced036609e9 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1514 microversion: 2.1 time: 0.223573 Aug 30 16:31:39.527368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2574/5567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:39 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:40.023744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:40.024363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:40.037824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:40.038338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:40.038780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:40.040124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:40.062008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:40.062933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:40.319286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:40.331776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:40.334781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:40.336675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1601ffc-4a1d-4e9e-8b8e-d11fa01aa2c9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.318864 Aug 30 16:31:40.356032 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2994/5568] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:40 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:40.549406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:40.550036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:40.557226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:40.557576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:40.558008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:40.558847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:40.559454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:40.560036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:40.753324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:40.762504 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d4abd17-69ea-462e-a112-ac411de55d51 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1514 microversion: 2.1 time: 0.217072 Aug 30 16:31:40.763321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2575/5569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:40 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:41.361907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:41.363522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:41.379927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:41.385082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.387595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.389314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.391138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.392005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.392607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.491494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e02716c5-f4ec-4ed9-b925-e49cf7b9cf74", "name": "network-vif-deleted", "tag": "7ed12613-10fc-44fb-8bf2-2fef94c6e16e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:41.523735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.527079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.530521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.570912 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] Creating event network-vif-deleted:7ed12613-10fc-44fb-8bf2-2fef94c6e16e for instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 on n-h2-830883-28 Aug 30 16:31:41.588015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6ba8f600-5e63-4a5e-815b-0842407844b0 req-6d4a9242-4a31-4bd9-96cc-6872bb3a0e19 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100108 Aug 30 16:31:41.588648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2576/5570] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:31:41.748400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:41.760831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:41.764899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:41.766812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f63b26d-9bc4-4c0b-abaa-f7544e318bea tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.409114 Aug 30 16:31:41.768699 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2995/5571] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:41 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:41.796340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:41.797402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:41.817697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.818796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.819472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.820785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.822542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.823226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.868118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:41.868736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:41.869154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:41.869819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lazy-loading 'fault' on Instance uuid e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:31:41.925594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db3a24e1055246a194f7e96a72dff014', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f044138df1d4ba8958255051eb6afd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:41.936003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c9d0b81-2a52-4def-9fc1-f69e7b17e74b tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 200 len: 1307 microversion: 2.1 time: 0.152851 Aug 30 16:31:41.936770 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2577/5572] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:41 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:42.800495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:42.801117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:42.821450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:42.822372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:42.823013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:42.823904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:42.824516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:42.825112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:42.961814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:42.963302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: e02716c5-f4ec-4ed9-b925-e49cf7b9cf74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:42.978642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:42.979152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:42.980149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:42.981239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:42.981850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:42.984810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.027014 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] HTTP exception thrown: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Request method failure captured: Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 HTTP/1.1 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrLJrOLoHCAn3kaPVjknCtFwZSF3yngNrTjy7_f2NmYJDa8VOUV4Q04GP4MIlBsWclTD_Y2p3U_Zk2RSttkCtIFsiLtetFa0GSxS2OhoRBLwS3qd-x5o0uotxz6rKWJSlXCBfLRbuTvKbijqY5OZ1SDYOuAc7VEFkwkQ0JIwrMzjHk Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}] Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db3a24e1055246a194f7e96a72dff014 Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e02716c5-f4ec-4ed9-b925-e49cf7b9cf74'} Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.029522 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. Aug 30 16:31:43.034262 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.035438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Returning 404 to user: Instance e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:43.036620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-232e9059-45a5-4574-a3be-136e70995f35 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74" status: 404 len: 111 microversion: 2.1 time: 0.079892 Aug 30 16:31:43.042815 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2578/5573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:42 2022] GET /compute/v2.1/servers/e02716c5-f4ec-4ed9-b925-e49cf7b9cf74 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:43.057086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:43.058124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:43.082671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.084536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.089436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.091008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.092499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.093031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.127521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] HTTP exception thrown: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Request method failure captured: Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 HTTP/1.1 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrLJrOLoHCAn3kaPVjknCtFwZSF3yngNrTjy7_f2NmYJDa8VOUV4Q04GP4MIlBsWclTD_Y2p3U_Zk2RSttkCtIFsiLtetFa0GSxS2OhoRBLwS3qd-x5o0uotxz6rKWJSlXCBfLRbuTvKbijqY5OZ1SDYOuAc7VEFkwkQ0JIwrMzjHk Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}] Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db3a24e1055246a194f7e96a72dff014 Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f2b255f8-3c36-4c3b-9bca-bf948e0bbe66'} Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:43.130345 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.134480 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.135873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Returning 404 to user: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:43.137590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09990821-f73b-4845-a101-c6991226a8fa tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 404 len: 111 microversion: 2.1 time: 0.088440 Aug 30 16:31:43.138588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2579/5574] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:43 2022] DELETE /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:43.142411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:43.148783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:43.150061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: f2b255f8-3c36-4c3b-9bca-bf948e0bbe66] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:43.161180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.162351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.163107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:43.163657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.164688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.165063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:43.166097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.166746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.171036 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7641f4ce-a884-4e31-8981-4f5933af424a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.375707 Aug 30 16:31:43.176571 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2996/5575] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:42 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:43.195383 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] HTTP exception thrown: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Request method failure captured: Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 HTTP/1.1 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrLJrOLoHCAn3kaPVjknCtFwZSF3yngNrTjy7_f2NmYJDa8VOUV4Q04GP4MIlBsWclTD_Y2p3U_Zk2RSttkCtIFsiLtetFa0GSxS2OhoRBLwS3qd-x5o0uotxz6rKWJSlXCBfLRbuTvKbijqY5OZ1SDYOuAc7VEFkwkQ0JIwrMzjHk Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}] Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db3a24e1055246a194f7e96a72dff014 Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f2b255f8-3c36-4c3b-9bca-bf948e0bbe66'} Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.201310 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Returning 404 to user: Instance f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:43.205099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1d7dc92-5ec3-4037-bb86-bead832d6b96 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66" status: 404 len: 111 microversion: 2.1 time: 0.059571 Aug 30 16:31:43.205644 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2580/5576] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:43 2022] GET /compute/v2.1/servers/f2b255f8-3c36-4c3b-9bca-bf948e0bbe66 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:43.215386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:43.215884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:43.224271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.225543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.226833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.228703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.229980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.230640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.255691 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] HTTP exception thrown: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Request method failure captured: Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 HTTP/1.1 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjrLJrOLoHCAn3kaPVjknCtFwZSF3yngNrTjy7_f2NmYJDa8VOUV4Q04GP4MIlBsWclTD_Y2p3U_Zk2RSttkCtIFsiLtetFa0GSxS2OhoRBLwS3qd-x5o0uotxz6rKWJSlXCBfLRbuTvKbijqY5OZ1SDYOuAc7VEFkwkQ0JIwrMzjHk Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}] Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: db3a24e1055246a194f7e96a72dff014 Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0'} Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:43.257671 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.261126 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.264859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Returning 404 to user: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:43.265966 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-221fc63e-2c18-4c82-86a2-9ad607f355e8 tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 404 len: 111 microversion: 2.1 time: 0.055069 Aug 30 16:31:43.268585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2997/5577] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:31:43 2022] DELETE /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:31:43.278152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:43.279059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] [instance: 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:43.293595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.293795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.294250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.302138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:43.302892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:43.303477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:43.328063 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] HTTP exception thrown: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Request method failure captured: Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 HTTP/1.1 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjrLJrOLoHCAn3kaPVjknCtFwZSF3yngNrTjy7_f2NmYJDa8VOUV4Q04GP4MIlBsWclTD_Y2p3U_Zk2RSttkCtIFsiLtetFa0GSxS2OhoRBLwS3qd-x5o0uotxz6rKWJSlXCBfLRbuTvKbijqY5OZ1SDYOuAc7VEFkwkQ0JIwrMzjHk Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5f044138df1d4ba8958255051eb6afd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5f044138df1d4ba8958255051eb6afd7"}]}] Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5f044138df1d4ba8958255051eb6afd7 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-646245403 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: db3a24e1055246a194f7e96a72dff014 Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-646245403-project Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0'} Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:31:43.341269 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. Aug 30 16:31:43.345786 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:31:43.347841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] Returning 404 to user: Instance 8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:31:43.348940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29cdca3b-7f2e-436c-a80f-fd6c62058d5f tempest-ServerDiskConfigTestJSON-646245403 tempest-ServerDiskConfigTestJSON-646245403-project] 10.222.0.47 "GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0" status: 404 len: 111 microversion: 2.1 time: 0.075602 Aug 30 16:31:43.350270 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2581/5578] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:43 2022] GET /compute/v2.1/servers/8d47d9ab-8991-4184-9cc1-8d3bb41ed0d0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:31:44.207495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:44.208765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:44.222805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:44.223778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:44.226803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:44.227747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:44.233307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:44.234246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:44.698817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:44.709104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:44.713589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:44.720464 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11be2810-37ef-4749-96d1-d6e7e573e575 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.517541 Aug 30 16:31:44.741689 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2998/5579] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:44 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:45.746383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:45.747130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:45.749688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:45.768444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:45.783346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:45.784165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:45.788464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:45.789145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:45.789594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:46.450925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:46.461453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:46.464592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:46.466496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c215762-a416-4152-a037-2bf55b46ac7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1744 microversion: 2.20 time: 0.724266 Aug 30 16:31:46.467779 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2582/5580] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:45 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1744 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:47.051131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:47.079493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:47.092338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:47.093166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:47.134794 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] Creating event network-vif-plugged:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h1-830883-28 Aug 30 16:31:47.151497 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-62c59667-5f1f-4891-83b9-69641bbfe4f3 req-38b1a7c7-dabe-412c-9fa6-31766e71934c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105283 Aug 30 16:31:47.155217 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 2999/5581] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:31:47.494947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:47.496162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:47.515575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:47.518928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:47.519576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:47.521799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:47.523389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:47.524005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:48.051595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:48.091317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:48.093361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:48.098151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b17a42d-4a4b-4e38-bd80-4dde026e14e9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.607853 Aug 30 16:31:48.122619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2583/5582] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:47 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:49.128446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:49.129164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:49.150260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:49.150786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:49.162427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:49.167439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:49.168850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:49.170331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:49.786677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:49.801533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:49.803115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:49.804356 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9d825f7-b21b-4bb3-bc60-8803ddc444b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.680942 Aug 30 16:31:49.809026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3000/5583] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:49 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:50.828442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:50.829653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:50.857777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:50.858278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:50.862586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:50.864173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:50.864455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:50.864892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:51.309056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:51.320321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:51.321767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:51.323038 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-154d8e7e-de0f-4eeb-ae93-b802058179b7 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.498567 Aug 30 16:31:51.323597 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2584/5584] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:50 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:52.356107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:52.357401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:52.393203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:52.393850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:52.396821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:52.398874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:52.400346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:52.404496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:52.925822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:52.976236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:52.988711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:52.989987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a11bdcad-99bf-4050-9db3-81f43c91a05f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.640352 Aug 30 16:31:53.005790 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3001/5585] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:52 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:54.031391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:54.032852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:54.051826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:54.052523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:54.053060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:54.054057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:54.057743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:54.058537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:54.559215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:54.573779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:54.574978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:54.584784 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-872369c3-bafb-4aec-8e3b-6a0e65574295 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.552709 Aug 30 16:31:54.588537 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2585/5586] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:54 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:55.610644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:55.611274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:55.623790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:31:55.626505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:55.627176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:55.627685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:55.628414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:55.628879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:55.631342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:55.879666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:55.890403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:55.903612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:55.904872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-825f9641-9e2b-4380-93b2-79c5ba93c6d9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.298692 Aug 30 16:31:55.905454 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3002/5587] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:55 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:31:56.167299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2105543935", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:31:56.286441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] validate_networks() for [('36740d36-1b1d-4da9-8135-62772cd005fe', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:31:56.932203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:56.932814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:56.955236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:56.955795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:56.956254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:56.957001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:56.957532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:56.957968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:57.477753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:57.499149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:57.502069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:57.508505 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65cc4c16-6182-470b-994e-fc2658a40d3b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.580227 Aug 30 16:31:57.523210 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3003/5588] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:56 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:31:57.567586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:31:57.568629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:31:57.569274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:31:57.569828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:31:57.570460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:31:57.614073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:57.614881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:57.615634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:57.616601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:57.617309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:57.617912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:57.669506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Getting quotas for project 2a61bed1f18b4dde9c5deec22ede5b63. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:31:57.683522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Getting quotas for user d10c6bd2028d46aab9d3bec26b7b73c2 and project 2a61bed1f18b4dde9c5deec22ede5b63. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:31:57.713602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:31:57.725748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:31:57.868741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-530244ba-9845-4d1f-9f92-6ce276adcc4e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.198846 Aug 30 16:31:57.880340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2586/5589] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:31:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:31:57.884829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd3a294d-d731-43e7-9d28-abe96d2bf5b0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:57.885461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd3a294d-d731-43e7-9d28-abe96d2bf5b0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:58.049035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd3a294d-d731-43e7-9d28-abe96d2bf5b0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:58.057308 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd3a294d-d731-43e7-9d28-abe96d2bf5b0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1214 microversion: 2.1 time: 0.180222 Aug 30 16:31:58.061095 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3004/5590] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:57 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:31:58.538860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:58.539633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:58.557234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:58.559309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:58.561081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:58.566485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:31:58.567442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:31:58.569115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:31:59.082709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12bc6ca5-5e8e-4c05-9a2d-7378b2176213 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:31:59.083534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12bc6ca5-5e8e-4c05-9a2d-7378b2176213 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:31:59.447384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12bc6ca5-5e8e-4c05-9a2d-7378b2176213 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:59.456437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12bc6ca5-5e8e-4c05-9a2d-7378b2176213 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1214 microversion: 2.1 time: 0.378647 Aug 30 16:31:59.462608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3005/5591] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:31:59 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1214 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:31:59.852044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:59.868992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:59.879539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:31:59.895343 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7aa81d1f-a796-4837-95b5-007431b19098 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 1.360345 Aug 30 16:31:59.900462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2587/5592] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:31:58 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:00.482903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:00.483522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:00.503522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:00.506501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:00.508415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:00.511847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:00.513031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:00.516443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:00.729122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:00.751395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8534411-08c8-49ab-b4f4-5a0173d863b6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1274 microversion: 2.1 time: 0.267491 Aug 30 16:32:00.753704 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3006/5593] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:00 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:00.924902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:00.926426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:00.948349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:00.949287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:00.952937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:00.956814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:00.959291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:00.960016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:01.773971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:01.776824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:01.795261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:01.795758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:01.796205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:01.796939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:01.797393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:01.808449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:01.839700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:02.049806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:02.067893 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3e07085-b34b-45cd-bfe4-c4ce61fa1206 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1272 microversion: 2.1 time: 0.298147 Aug 30 16:32:02.079977 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3007/5594] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:01 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:02.481978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:02.492576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:02.517083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:02.520220 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-161a64d6-1acc-4618-a1ca-917925b349fa tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 1.599480 Aug 30 16:32:02.524726 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2588/5595] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:00 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:03.098823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:03.099453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:03.127309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:03.129841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:03.130633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:03.131537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:03.132177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:03.132929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:03.503700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:03.529591 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85d1cd06-3ccb-4793-8a84-66011c6f2427 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1272 microversion: 2.1 time: 0.437854 Aug 30 16:32:03.536086 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3008/5596] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:03 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1272 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:03.544268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:03.544878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:03.575891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:03.579110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:03.582803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:03.587899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:03.589438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:03.608106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:04.559033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:04.559729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:04.587160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:04.587715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:04.588182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:04.588922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:04.589397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:04.589838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:04.644537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:04.666163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:04.668713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:04.690871 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-841c0458-fc74-4559-8fc6-cb4b631d257d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 1.137781 Aug 30 16:32:04.711524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2589/5597] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:03 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:05.524452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:05.544744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5f01520b-3736-444e-84f2-97fa7b112864 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.980389 Aug 30 16:32:05.547550 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3009/5598] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:04 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:05.731957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:05.733713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:05.760554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:05.761374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:05.764201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:05.768026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:05.769014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:05.771495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:06.511191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:06.542485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:06.544319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:06.562077 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77f042ef-0493-40f8-90dd-3caa27cfda08 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.833097 Aug 30 16:32:06.567644 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2590/5599] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:05 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:06.571173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:06.571809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:06.590751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:06.593113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:06.595671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:06.596625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:06.601828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:06.602591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:07.001278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:07.016123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8433fb-1d5f-45d0-9019-8f2d03e83989", "tag": "49d01b64-2dbe-4b5a-9f48-9e66e88a649b"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:07.032355 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4e6351c-1ae6-4446-83bb-db5b9be51ffc tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.465215 Aug 30 16:32:07.040806 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3010/5600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:06 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:07.063884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:07.064421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:07.066993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:07.151377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] Creating event network-changed:49d01b64-2dbe-4b5a-9f48-9e66e88a649b for instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 on n-h2-830883-28 Aug 30 16:32:07.181853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3ab06bf6-725a-43fe-b544-74ee8edb4dfd req-d0fede60-c839-4570-941b-755814d72b24 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171898 Aug 30 16:32:07.184109 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2591/5601] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:07.590800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:07.591422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:07.605228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:07.605753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:07.606194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:07.606936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:07.607403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:07.607819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:08.064511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:08.065764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:08.068174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:08.072773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:08.107975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:08.111611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:08.116226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:08.130427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:08.131257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:08.131901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:08.287375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:08.300365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:08.314603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:08.317942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-303d2961-e313-448c-b114-c82a937fbe97 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.730944 Aug 30 16:32:08.327121 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3011/5602] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:07 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:08.659188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:08.677685 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2622505c-62b5-4e90-a6bc-9da9a06f1a9e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.617867 Aug 30 16:32:08.678721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2592/5603] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:08 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:09.347351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:09.348485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:09.361666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:09.362655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:09.363272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:09.364232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:09.366985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:09.367988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:09.462601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:09.705300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:09.705910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:09.727639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:09.728243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:09.728704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:09.728814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:09.729420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:09.729872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:09.730835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:09.736488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:09.744008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:09.762244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:09.763675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1710f258-ba3d-4a50-93e3-0816a29c333f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.422734 Aug 30 16:32:09.764275 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3012/5604] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:09 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:10.487325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:10.509221 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a835ad4e-4682-4eb6-9c65-5428f64d04b4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.805128 Aug 30 16:32:10.518486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2593/5605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:09 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:10.789023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:10.789966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:10.806533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:10.813452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:10.817031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:10.817963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:10.822066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:10.826502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:11.335082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:11.347703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:11.357200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:11.361097 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6121552-de85-4f65-a769-d24b799db13a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.577995 Aug 30 16:32:11.370822 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3013/5606] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:10 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:11.544378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:11.545702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:11.562894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:11.563727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:11.565000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:11.567142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:11.571183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:11.575486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:12.392445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:12.393058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:12.412968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:12.429538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:12.432590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:12.433504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:12.439608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:12.440295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:12.805269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:12.815314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:12.817008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:12.818204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-252e6ed4-8ea2-4125-bbe6-bc516db5389b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.433564 Aug 30 16:32:12.830138 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3014/5607] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:12 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:13.277996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:13.289784 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48d56bbf-3037-4f98-87f1-27e9ef517b13 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 1.751415 Aug 30 16:32:13.293980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2594/5608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:11 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:13.855676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:13.856445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:13.914386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:13.915109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:13.915826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:13.916809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:13.917287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:13.917733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:14.316913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:14.317545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:14.332938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:14.333496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:14.342445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:14.346242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:14.346828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:14.348683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:14.721658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:14.730184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:14.731685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:14.732878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce03fd71-0c7d-4a42-91fa-0565e211be26 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.881708 Aug 30 16:32:14.733436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3015/5609] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:13 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:15.012059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:15.026189 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-65e08727-0e97-48c1-b2ef-3b1d9ed96578 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.713644 Aug 30 16:32:15.035603 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2595/5610] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:14 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:15.757168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:15.759010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:15.800073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:15.807251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:15.807747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:15.811098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:15.811622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:15.815199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.049434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:16.050206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:16.061632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:16.069618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:16.070728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:16.076071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.077024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:16.080359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:16.082069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.800796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:16.811065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:16.812595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:16.813985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db0cd90e-bd8d-4d26-83e8-e8edc774c7e6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 1.060938 Aug 30 16:32:16.846066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3016/5611] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:15 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:16.851269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8433fb-1d5f-45d0-9019-8f2d03e83989", "name": "network-vif-plugged", "status": "completed", "tag": "49d01b64-2dbe-4b5a-9f48-9e66e88a649b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:16.917633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:16.919687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:16.922234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:16.986734 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] Creating event network-vif-plugged:49d01b64-2dbe-4b5a-9f48-9e66e88a649b for instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 on n-h2-830883-28 Aug 30 16:32:17.017755 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-415d594e-30d6-4d31-939a-229bfaa83a11 req-d1f9f7f3-1dde-4e9d-8627-ec35a6bf03fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170030 Aug 30 16:32:17.028933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3017/5612] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:17.152241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:17.176400 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9d95c03-c10a-4e6e-894d-ad581b99edf9 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 1.129520 Aug 30 16:32:17.181299 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2596/5613] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:16 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:17.874059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:17.875320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:17.895887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:17.896394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:17.905918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:17.913334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:17.913907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:17.924931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:18.224258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:18.225414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:18.257452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:18.259464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:18.259926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:18.265915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:18.271160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:18.271160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:18.657762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:18.683662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:18.697212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:18.699921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:18.704412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1e8364b-42c6-4068-97cf-9b9195620b88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.834931 Aug 30 16:32:18.707980 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2c1dbcd0-03d8-4301-8d72-2be4af38283a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1314 microversion: 2.1 time: 0.491602 Aug 30 16:32:18.710729 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3018/5614] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:17 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:18.730720 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2597/5615] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:18 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:19.046214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1282542548", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "29888241-28b2-4b45-982b-1043b15170ce"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:19.287870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] validate_networks() for [('29888241-28b2-4b45-982b-1043b15170ce', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:32:19.733111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:19.734839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:19.784900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:19.785811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:19.786522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:19.787771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:19.788637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:19.789286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.224164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:20.260896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:20.266368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:20.271883 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-260b754c-d8a7-411b-9947-f18fc2d930c5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.542001 Aug 30 16:32:20.274275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2598/5616] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:19 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:20.282164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:20.283378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:20.307058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.307574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.308454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.310656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.314136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.315326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.693590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:20.711448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24d7ca5c-b723-4318-b91b-df60a0c17d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1501 microversion: 2.1 time: 0.432111 Aug 30 16:32:20.712271 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2599/5617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:20 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1501 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:20.737122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:20.739250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:20.763034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.764428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.766447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.771025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.771996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.776355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.812398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:32:20.813499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:32:20.814134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:32:20.814785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:32:20.815350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:32:20.836576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lazy-loading 'flavor' on Instance uuid 8f8433fb-1d5f-45d0-9019-8f2d03e83989 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:32:20.848078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.850546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.858227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.861564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:20.863510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:20.864002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:20.931371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Getting quotas for project 03b7584b19ba4753b43ae49cbf5e936b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:32:20.956254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Getting quotas for user 58c6a80c9df8485dbfa79754a5bddd6e and project 03b7584b19ba4753b43ae49cbf5e936b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:32:21.006959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:32:21.009404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:32:21.033823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49bfaa57-a554-4a1e-b3b8-3d69a285923f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "POST /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989/action" status: 200 len: 32 microversion: 2.1 time: 0.298259 Aug 30 16:32:21.036627 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2600/5618] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:32:20 2022] POST /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:32:21.050921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:21.054142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:21.072885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:21.073722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:21.074822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:21.080653 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca175f74-1fa5-4f54-840a-ade651497d5b tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368680 Aug 30 16:32:21.081991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3019/5619] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:32:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:32:21.087620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:21.088166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:21.088631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:21.097057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c161f752-23de-4f00-9091-d451fabd3ac8 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:21.098057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c161f752-23de-4f00-9091-d451fabd3ac8 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:21.261253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c161f752-23de-4f00-9091-d451fabd3ac8 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:21.269227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c161f752-23de-4f00-9091-d451fabd3ac8 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1217 microversion: 2.1 time: 0.179622 Aug 30 16:32:21.272481 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3020/5620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:21 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:21.298694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:21.299279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:21.309621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:21.310118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:21.310588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:21.311285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:21.311745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:21.312283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:21.905225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:21.916092 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6826b62-da13-4fa9-9318-0704372f03ad tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.874065 Aug 30 16:32:21.917597 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2601/5621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:21 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:22.257385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:22.277908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:22.281618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:22.284465 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0bc90874-50ac-40b1-be7d-8b1ec333cbc8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1739 microversion: 2.20 time: 0.989523 Aug 30 16:32:22.285789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3021/5622] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:21 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1739 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:22.303014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:22.303648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:22.326749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:22.328017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:22.330502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:22.331509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:22.332990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:22.334921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:22.711385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:22.726168 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-caf2e7c4-da62-451d-b960-905210d9055c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1221 microversion: 2.1 time: 0.434016 Aug 30 16:32:22.729544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2602/5623] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:22 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1221 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:22.944443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:22.946294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:22.978531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:22.979153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:22.979710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:22.980368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:22.985394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:22.986266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:23.310596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:23.312933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:23.341823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:23.342356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:23.342808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:23.343608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:23.344034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:23.344462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.033412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:24.043090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:24.056256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:24.059525 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6eea0ff1-f0f1-47ce-9699-e79276db14ab tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1721 microversion: 2.20 time: 0.752818 Aug 30 16:32:24.062449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2603/5624] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:23 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1721 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:24.081410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:24.095617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:24.121677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.125576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.126189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.128796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:24.129286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:24.129979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:24.382778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:24.393653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0300d6ee-951d-42da-b24d-0c1ccd781981 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1275 microversion: 2.1 time: 0.330017 Aug 30 16:32:24.397478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2604/5625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:24 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1275 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:24.658604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:24.673529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c164523-e193-447f-b211-445029390d85 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 1.733824 Aug 30 16:32:24.687590 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3022/5626] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:22 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:25.091842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.093745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.104609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.105582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.106245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.107223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.107895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.108530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.345854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "name": "network-vif-unplugged", "status": "completed", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:25.368173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.368950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.369853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.389407 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] Creating event network-vif-unplugged:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h1-830883-28 Aug 30 16:32:25.396519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a7977f8e-861d-4bc1-9984-29a4f9eebc2c req-a13ebf67-266c-41aa-bb1f-502561fa3d52 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055161 Aug 30 16:32:25.398601 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3023/5627] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:32:25.424420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.425432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.442779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.443283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.443726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.449240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.455121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.455612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.638741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.649225 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16f4e6a1-41a1-4bf8-8535-86802e9aee88 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1275 microversion: 2.1 time: 0.230442 Aug 30 16:32:25.650149 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3024/5628] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:25 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:25.701255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.710816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:25.711618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:25.715252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:25.719251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.721026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.722262 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3c1abd6-798d-4702-a148-daa7a27de9e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1721 microversion: 2.20 time: 0.635191 Aug 30 16:32:25.723152 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2605/5629] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:25 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1721 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:25.726968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.727484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.730500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.731326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:25.731806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:25.732243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:25.953098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:25.964463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bd44169-d599-4dfd-a8a7-f10e7babea17 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.257458 Aug 30 16:32:25.970406 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3025/5630] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:25 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:26.679080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:26.679852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:26.705376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.706891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.707589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:26.708548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.709711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.710520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:26.749053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:26.749895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:26.772885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.775357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.775912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:26.776767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:26.777340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:26.778277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.024566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.033394 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-701f6c8c-c599-4ae6-9055-bc89a44a2e05 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.362265 Aug 30 16:32:27.034330 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2606/5631] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:26 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:27.048564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:27.049141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:27.056877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.057385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.057829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.058587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.059046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.059493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.094456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.099004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:27.109678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.111300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.113299 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8dac0825-9e5f-42b3-899f-13ee56c6b37f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1724 microversion: 2.20 time: 0.367783 Aug 30 16:32:27.127248 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3026/5632] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:26 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:27.139656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43e44de3-deaf-4053-b7b5-7b202254b95f"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:27.142791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:27.150592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.151312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.151926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.152633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.154172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.155156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.320192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:27.323613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:27.344116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a27fbf7-1f0a-425a-ad09-c570b9ed739a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.304526 Aug 30 16:32:27.345366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2607/5633] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:27 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:27.696412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0be966c-ac96-4b3e-b2e9-a60187a8e5e2", "tag": "18246e2a-e068-4617-a446-67fb97a3b93f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:27.729996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.732406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.735289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.742137 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-436f05b7-32e3-467f-8038-20438fe410f8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.607401 Aug 30 16:32:27.743453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3027/5634] 10.222.0.47 () {62 vars in 1364 bytes} [Tue Aug 30 16:32:27 2022] POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 188 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:32:27.768590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] Creating event network-changed:18246e2a-e068-4617-a446-67fb97a3b93f for instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 on n-h1-830883-28 Aug 30 16:32:27.781414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bd27b42b-c627-4b17-9bf2-effc45d91e8e req-52b5442f-090a-43fc-a22e-d8548b130251 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088519 Aug 30 16:32:27.784802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2608/5635] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:32:27.973192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:27.973948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:27.991328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.992914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.993377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:27.994323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:27.994943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:27.995731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.041862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122352) unshelve /opt/stack/nova/nova/compute/api.py:4603}} Aug 30 16:32:28.056452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:28.057163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:28.076036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.076815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.077852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.078840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.079544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.080237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.172298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4855d8df-2e7f-43db-bc8d-81691fc742ec tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/action" status: 202 len: 0 microversion: 2.20 time: 0.201507 Aug 30 16:32:28.173824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3028/5636] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:32:27 2022] POST /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:32:28.184739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:28.187592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:28.207072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.207880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.209235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.210156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.210826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.211456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.382206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.396752 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77c9d627-9a3d-43e1-b18d-179108ab3ddc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.342629 Aug 30 16:32:28.417658 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2609/5637] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:28 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:28.430585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:28.432984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:28.447286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.450945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.451829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.454676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:28.456005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:28.457397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:28.679585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.690907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.705071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.707700 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83cf176e-71c1-4046-a01e-5ca6cda4fb0f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1750 microversion: 2.20 time: 0.529809 Aug 30 16:32:28.711723 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3029/5638] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:28 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1750 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:28.843854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:28.855254 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8716e975-be03-45e6-8bc2-987d18dd1c7f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.436170 Aug 30 16:32:28.857188 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2610/5639] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:28 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:29.425715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.427873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.439800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.440889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.441587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.442529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.443946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.444844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.708659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:29.719040 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc5c3d65-9ac0-48c3-af74-e48373cf185d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.298267 Aug 30 16:32:29.720128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3030/5640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:29 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:29.739576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.741821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.791251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.800096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.800643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.802864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.807266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.807997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.891710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:29.895794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:29.937626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.938239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.938782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:29.947248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:29.948052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:29.948498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:30.183431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:30.198981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2c2dd92-11b3-46f0-a347-31048af6e393 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.325005 Aug 30 16:32:30.202381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3031/5641] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:29 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:30.499323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:30.512566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:30.517978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:30.519591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c50b08b-6fa0-48ea-8ca5-28f80a0e6af8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1750 microversion: 2.20 time: 0.785250 Aug 30 16:32:30.522124 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2611/5642] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:29 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1750 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:30.745054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:30.746363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:30.761391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:30.763205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:30.763882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:30.769276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:30.770073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:30.770788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:30.896619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:31.145240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.158821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ccf57c84-29b6-4780-b56f-7170f1211a6d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.416569 Aug 30 16:32:31.161233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3032/5643] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:30 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:31.224459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:31.224556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:31.237569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.238071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.240495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.241319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.241805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.246673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.545260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:31.545930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:31.548856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:31.575521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.576200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.576673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.581540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:31.582452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:31.583309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:31.807202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.827711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09998cc7-65bc-4263-b755-e205632bddaa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.608426 Aug 30 16:32:31.833691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2612/5644] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:31 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:31.864387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.877969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.880015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:31.881474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee6799e8-d804-45e5-a3e1-3b1132e1b7a8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.340281 Aug 30 16:32:31.882613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3033/5645] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:31 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:32.195329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.196252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.231128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.231956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.232610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.233636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.234361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.235660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.520023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:32.531016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d731bc8d-83c6-4140-9166-5943fead4322 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.351554 Aug 30 16:32:32.533740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2613/5646] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:32.854398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.854927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.874823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.876038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.876630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.877518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.878123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.878733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.905874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:32.907246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:32.922534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.923318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.923908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:32.924780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:32.925380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:32.927739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.252727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:33.262051 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc44a192-a959-4d2a-b6c9-6f3ee326800d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.411579 Aug 30 16:32:33.265811 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3034/5647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:33.278357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:33.295260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:33.299457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:33.300810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49d45e7f-6cdb-41aa-b16c-ae339b4c0fbf tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.399535 Aug 30 16:32:33.307871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2614/5648] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:32 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:33.554213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:33.555355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:33.564725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.565878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.566683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.567597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.568242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.568852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.724718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0be966c-ac96-4b3e-b2e9-a60187a8e5e2", "name": "network-vif-plugged", "status": "completed", "tag": "18246e2a-e068-4617-a446-67fb97a3b93f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:33.744907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:33.746590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:33.748180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:33.777746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] Creating event network-vif-plugged:18246e2a-e068-4617-a446-67fb97a3b93f for instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 on n-h1-830883-28 Aug 30 16:32:33.789602 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-49f7f155-5353-411e-a85d-a44d722c92da req-00e049c6-ed33-410f-9838-d8e9d59d3178 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068755 Aug 30 16:32:33.793286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2615/5649] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:32:33.996198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.007820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-26be62cd-e280-442d-b77b-24aeff4d8704 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.457984 Aug 30 16:32:34.010057 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3035/5650] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:33 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:34.286671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:34.287388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:34.302111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:34.302665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:34.303186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:34.303912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:34.304380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:34.304814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:34.334387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:34.335019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:34.345962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:34.346705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:34.347901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:34.348805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:34.349432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:34.352387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:34.575758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.587153 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d71eb63b-e682-4c77-8526-bd1ac282aa0d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.304471 Aug 30 16:32:34.600471 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2616/5651] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:34 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:34.913498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.932669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.938961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:34.946528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-049fe313-78fe-4ea4-bcb5-2003deb99a2c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.612992 Aug 30 16:32:34.947366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3036/5652] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:34 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:35.032109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:35.033027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:35.039722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.040395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.041023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.042015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.042676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.043296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.442350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:35.450762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a118e45-f801-4409-8564-427b8ef62923 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1317 microversion: 2.1 time: 0.423305 Aug 30 16:32:35.451359 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2617/5653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:35 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:35.609344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:35.610852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:35.622007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.627524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.628238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.629152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.629934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.630557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.972999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:35.973539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:35.981985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.982876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.984310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:35.985816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:35.986590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:35.987483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.033000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.060808 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1b8c278-2007-4606-b1a7-019a6f2ffc6e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.454524 Aug 30 16:32:36.078003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3037/5654] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:35 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:36.309854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.324739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.327308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.329532 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-65f28bf6-68b3-4f79-b200-2cc3f9e237cc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.359926 Aug 30 16:32:36.345931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2618/5655] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:35 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:36.477276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:36.477857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:36.493938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.494490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.494924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.495639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.496098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.496532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.721394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.731403 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d16b7c7d-f3eb-466a-9ca3-42ad475d10b5 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1505 microversion: 2.1 time: 0.263518 Aug 30 16:32:36.744742 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3038/5656] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:36 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:36.756833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:36.757396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:36.775155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.776091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.776743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.777881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.778611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.779378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.823951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:36.825958 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0263a6dc-eb4b-44f3-ab60-b5588e9e13e0 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/os-instance-actions/req-ca175f74-1fa5-4f54-840a-ade651497d5b" status: 200 len: 313 microversion: 2.1 time: 0.073946 Aug 30 16:32:36.827566 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2619/5657] 10.222.0.47 () {58 vars in 1419 bytes} [Tue Aug 30 16:32:36 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/os-instance-actions/req-ca175f74-1fa5-4f54-840a-ade651497d5b => generated 313 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:36.840713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:36.843686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:36.859795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.866690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.867296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.870272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:36.870803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:36.872660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:36.934049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:37.062192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7973859-b2fd-40ef-a7a5-93db11fa348c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "POST /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/action" status: 202 len: 0 microversion: 2.1 time: 0.224334 Aug 30 16:32:37.064719 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3039/5658] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:32:36 2022] POST /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:32:37.082282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:37.082970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:37.091052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.091475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.091919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.092297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:37.092653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.093075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:37.093185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.093636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.112101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.112782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.113242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.129331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.130517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.132878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.498641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.511232 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7f6efd8-fdc6-41b9-bbbb-699de127e093 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.427631 Aug 30 16:32:37.512172 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3040/5659] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:37 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:37.528424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:37.529059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:37.540558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.542882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.544323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.545201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:37.546819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:37.549924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:37.628705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.651684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4cc700b0-37c0-4756-bd6e-0c81b52e1837 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1507 microversion: 2.1 time: 0.576354 Aug 30 16:32:37.652265 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2620/5660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:37 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1507 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:37.902010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.918810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.926677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:37.936433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8bf00d03-4f53-4a75-bfaf-b5ec87fe1613 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.423014 Aug 30 16:32:37.940228 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3041/5661] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:37 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:38.538404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:38.538952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:38.555508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.556841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.558088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.559634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.560317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.562373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.681791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:38.686984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:38.706552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.707064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.707496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.708213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:38.708673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:38.709100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:38.871257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:38.880628 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0b34b19-daca-4299-a3e8-42d5425f4256 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.347637 Aug 30 16:32:38.881219 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2621/5662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:38 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:38.995909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:38.998008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:39.011534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:39.012583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:39.013224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:39.014348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:39.015386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:39.015988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:39.232216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:39.248276 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef195abb-f7f7-46d7-8c10-48c1b4609efc tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1512 microversion: 2.1 time: 0.570292 Aug 30 16:32:39.249477 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3042/5663] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:38 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:39.323826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:39.340735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:39.346642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:39.348272 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1115c9d-f458-4dee-ba3e-902ac4bd0aa3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1752 microversion: 2.20 time: 0.377766 Aug 30 16:32:39.348857 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2622/5664] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:38 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1752 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:39.901224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:39.902161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:39.915221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:39.917826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:39.921275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:39.923830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:39.925237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:39.928782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.273717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:40.274795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:40.292787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.293793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.294635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.295561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.296408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.297055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.301301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:40.314874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5168e633-df26-4aa5-8e50-87d9cd643629 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.416983 Aug 30 16:32:40.316398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3043/5665] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:39 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:40.373544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:40.374897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:40.390406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.391219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.391648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.392585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.393194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.393769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.708563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:40.724161 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9e53699-0e79-4783-a73a-302ec402a07d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1505 microversion: 2.1 time: 0.454688 Aug 30 16:32:40.725904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2623/5666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:40 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:40.748177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '.version_select at 0x7fd360ff2ee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:40.749829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:40.769958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.770931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.771392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.772134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.772596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.773186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.827631 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d49f04d6-b21e-433f-af03-702a7372d466 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.083335 Aug 30 16:32:40.830027 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2624/5667] 10.222.0.47 () {58 vars in 1296 bytes} [Tue Aug 30 16:32:40 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2/os-instance-actions => generated 611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:40.846933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:40.849195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:40.863590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.864395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.865054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.866895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:40.867566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:40.868236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:40.911167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:32:40.915441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:41.054101 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee64c266-7254-44b9-ad20-d23e8ec1125c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 204 len: 0 microversion: 2.1 time: 0.216003 Aug 30 16:32:41.055180 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2625/5668] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:32:40 2022] DELETE /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:32:41.059600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.067964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:41.069059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:41.083297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.084323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.084629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.085031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.085724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.086460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.087051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.088635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.096769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4daf4f92-02cf-4b46-82d7-4f5b1dac9586 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.727259 Aug 30 16:32:41.099589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3044/5669] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:40 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:41.221132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:41.256259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.256760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.257198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.294969 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] Creating event network-changed:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h2-830883-28 Aug 30 16:32:41.306904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7731418f-6743-4154-980f-55ac941acbad req-662047c1-3f13-4900-bf56-979874c9218f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098473 Aug 30 16:32:41.320697 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3045/5670] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:41.346227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:41.347249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:41.371925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.376149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.377805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.379462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:41.380815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:41.382115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:41.507505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.516995 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa90368f-4a75-4586-9682-f20822c19a67 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1511 microversion: 2.1 time: 0.457347 Aug 30 16:32:41.522448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2626/5671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:41 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:41.710214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:41.719342 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40c6856b-eaa0-43b3-9537-840320b6b3cf tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.378502 Aug 30 16:32:41.722920 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3046/5672] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:41 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:42.121948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:42.123401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:42.131118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.131612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.132059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.132762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.133570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.134339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.531336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:42.537427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:42.538198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:42.547000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:42.548485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:42.549984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.550579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.552157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.553108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.553241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89c3e390-8e97-40b7-b3e9-874354e86823 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.436344 Aug 30 16:32:42.553824 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2627/5673] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:42 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:42.554592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.556492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.744168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:42.744703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:42.755317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.755805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.758179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.761366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:42.762095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:42.762855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:42.886027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:42.899143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba445215-6489-451e-9b9f-25f1ddead816 tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1511 microversion: 2.1 time: 0.365618 Aug 30 16:32:42.902804 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3047/5674] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:42 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:43.331094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:43.349603 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a5b29ed-341e-4dd7-bec2-93f31e5d92f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.609589 Aug 30 16:32:43.352208 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2628/5675] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:42 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:43.581808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:43.584643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:43.604999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.605503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.605942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:43.606672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.623483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.624783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:43.929178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:43.933698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:43.954363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.955123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.956335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:43.959679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:43.960300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:43.961714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:44.322828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:44.333098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:44.354014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:44.355419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3b04e10-7aa8-4696-b68b-790162877757 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.778013 Aug 30 16:32:44.356023 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3048/5676] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:43 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:44.376409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:44.378652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:44.404700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:44.408104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:44.425719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:44.426518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:44.427016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:44.427443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:44.873359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:44.883609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d3051a7-04af-4137-9906-c8e7260a3d2d tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1511 microversion: 2.1 time: 0.962291 Aug 30 16:32:44.905014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2629/5677] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:43 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1511 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:45.160249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:45.174140 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-314e2ea8-1a13-455e-aa38-077d4cd1631d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.801983 Aug 30 16:32:45.182944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3049/5678] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:44 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:45.386088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:45.386973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:45.418080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.422403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.422969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.427958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.428583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.432016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.770568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0be966c-ac96-4b3e-b2e9-a60187a8e5e2", "name": "network-vif-deleted", "tag": "18246e2a-e068-4617-a446-67fb97a3b93f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:45.807153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.808699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.810229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.847493 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] Creating event network-vif-deleted:18246e2a-e068-4617-a446-67fb97a3b93f for instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 on n-h1-830883-28 Aug 30 16:32:45.870789 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-44ef508a-0046-44bb-b87f-e28e8abc859c req-d708440a-af97-44aa-a354-91c5feca9486 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104807 Aug 30 16:32:45.871987 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3050/5679] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:32:45.928765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:45.931389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:45.961242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.963838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.965007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:45.969235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:45.970117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:45.972542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:46.085447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:46.087398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:46.088154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:46.089958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lazy-loading 'fault' on Instance uuid f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:32:46.274383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c6a80c9df8485dbfa79754a5bddd6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b7584b19ba4753b43ae49cbf5e936b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:46.308264 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c149635a-44e5-4948-889b-e228c864c55e tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 200 len: 1307 microversion: 2.1 time: 0.390556 Aug 30 16:32:46.309027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3051/5680] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:45 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 1307 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:46.326597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:46.335596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:46.354135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:46.354914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:46.356279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:46.357631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:46.362008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:46.362803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:46.512653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:46.537081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:46.539000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:46.540451 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11d155e6-3578-45d0-b0ca-a83e43a1a0f9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 1.159092 Aug 30 16:32:46.552903 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2630/5681] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:45 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:47.336917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:47.338465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] [instance: f0be966c-ac96-4b3e-b2e9-a60187a8e5e2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:47.347731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:47.356155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.358995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.359690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.360757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.361529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.362151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.396229 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] HTTP exception thrown: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Request method failure captured: Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 HTTP/1.1 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjuRNScCSE3ku1E6qDO2tmR5McSulW6_tNeGL1DwYZT0VdNav5RONRzPNvn5CIsPyVpZ36XXfFL5cLDS4zBaK9TUeqX0UFYadwv36tdY1lFLJx7q3EuxpI_7n92OD7hVB0HugEX51_QjNYHeIAggchanMD2u37PLjER2OffK4bmVL9U Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 03b7584b19ba4753b43ae49cbf5e936b Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-InstanceActionsTestJSON-1522794630 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/03b7584b19ba4753b43ae49cbf5e936b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_03b7584b19ba4753b43ae49cbf5e936b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/03b7584b19ba4753b43ae49cbf5e936b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/03b7584b19ba4753b43ae49cbf5e936b"}]}] Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-InstanceActionsTestJSON-1522794630 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 03b7584b19ba4753b43ae49cbf5e936b Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1522794630 Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-InstanceActionsTestJSON-1522794630-project Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 58c6a80c9df8485dbfa79754a5bddd6e Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-InstanceActionsTestJSON-1522794630-project Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f0be966c-ac96-4b3e-b2e9-a60187a8e5e2'} Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:32:47.398237 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. Aug 30 16:32:47.402710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:32:47.404097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] Returning 404 to user: Instance f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:32:47.405818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a050360-baa0-4646-b43e-7df69762c06c tempest-InstanceActionsTestJSON-1522794630 tempest-InstanceActionsTestJSON-1522794630-project] 10.222.0.47 "GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2" status: 404 len: 111 microversion: 2.1 time: 0.074353 Aug 30 16:32:47.406871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2631/5682] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:47 2022] GET /compute/v2.1/servers/f0be966c-ac96-4b3e-b2e9-a60187a8e5e2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:32:47.568347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:47.569826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:47.599487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.612021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.612805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.613697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:47.617991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:47.618795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:47.658834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:47.680796 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f714680c-4e02-4c25-8ef9-e58d8cb789f0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 1.367264 Aug 30 16:32:47.683149 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3052/5683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:46 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:48.349217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:48.359917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:48.361396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:48.390017 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d033263-ed5a-4c67-91da-6957b3026cf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.799191 Aug 30 16:32:48.391503 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2632/5684] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:47 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:48.711608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:48.712249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:48.739745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:48.740519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:48.741125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:48.742287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:48.743011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:48.743604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:49.255601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:49.267809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-867fb925-f6cf-40af-968d-8e41ef7ececa tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.559943 Aug 30 16:32:49.270824 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3053/5685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:48 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:49.423242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:49.424008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:49.431813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:49.432381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:49.432936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:49.433744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:49.435395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:49.436815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:49.830728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:49.844548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:49.848056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:49.853313 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0187e75e-c007-449b-9bf4-88728a9ce97d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.433128 Aug 30 16:32:49.858805 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2633/5686] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:49 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:50.295140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:50.296619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:50.308713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.311530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.315576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:50.316728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.317434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.318870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:50.891936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:50.895151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:50.925897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:50.967830 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38b138dc-568e-4871-832a-9e8bfcb156c8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.657195 Aug 30 16:32:50.968463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.984659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.985526 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3054/5687] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:50 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:50.985720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:50.985720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:50.987294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:50.987766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:51.911190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:51.923036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:51.943154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:51.944446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3fc85f0c-353a-4981-8e81-49879584b860 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 1.064969 Aug 30 16:32:51.953147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2634/5688] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:50 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:51.998384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:51.999325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:52.027641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:52.028347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:52.028790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:52.030423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:52.032370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:52.035463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:52.856431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:52.883154 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75aaec4c-a36b-43b3-a927-0472b2a266a4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1507 microversion: 2.1 time: 0.887453 Aug 30 16:32:52.884666 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3055/5689] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:51 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1507 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:52.980296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:52.982094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:53.027277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:53.028510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:53.029677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:53.031280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:53.032140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:53.032778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:53.807936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:53.822651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:53.824108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:53.831876 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea5a7c8c-0e42-4381-a0f9-b0952bc8e142 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.855663 Aug 30 16:32:53.846124 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2635/5690] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:52 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:53.910334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:53.920646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:53.950051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:53.950957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:53.953642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:53.954683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:53.958128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:53.961452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:54.055895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:54.558818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:54.575358 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a8b0164-5026-40d8-80c4-34e0452eedc2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1487 microversion: 2.1 time: 0.666919 Aug 30 16:32:54.578422 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3056/5691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:53 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1487 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:32:54.870624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:54.871497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:54.902224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:54.905800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:54.911904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:54.921238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:54.929059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:54.931449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:55.042814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1754569282", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:32:55.246713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] validate_networks() for [('36740d36-1b1d-4da9-8135-62772cd005fe', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:32:55.941804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:55.958888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:55.963587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:55.969391 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af551850-a66d-4d59-92ed-8a784d96e537 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 1.102742 Aug 30 16:32:55.970945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2636/5692] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:54 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:56.996287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:56.997014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:57.009232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:57.009991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:57.010656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:57.011604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:57.014474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:57.015163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:32:57.459602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:32:57.493978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:57.497477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:57.499446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:57.503266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:57.504032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:57.505286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:57.598100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Getting quotas for project 2a61bed1f18b4dde9c5deec22ede5b63. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:32:57.628555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Getting quotas for user d10c6bd2028d46aab9d3bec26b7b73c2 and project 2a61bed1f18b4dde9c5deec22ede5b63. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:32:57.658442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:57.684282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:57.693521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:57.703361 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-14b9eaaa-87cf-4f30-894e-b30a1f02cf7d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.704769 Aug 30 16:32:57.705760 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2637/5693] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:56 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:32:57.706699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:32:57.710699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:32:57.891938 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-262c6f3b-b066-4657-b657-2a5cf5141084 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.856463 Aug 30 16:32:57.899561 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3057/5694] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:32:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:32:57.905938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d65e176-3911-4c2f-a7c2-2a23b2c5c1f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:57.906895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d65e176-3911-4c2f-a7c2-2a23b2c5c1f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:58.097901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d65e176-3911-4c2f-a7c2-2a23b2c5c1f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:58.107167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d65e176-3911-4c2f-a7c2-2a23b2c5c1f6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1214 microversion: 2.1 time: 0.206830 Aug 30 16:32:58.113450 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2638/5695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:57 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:32:58.731350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:58.733358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:58.753212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:58.755312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:58.756305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:58.759362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:58.760513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:58.764826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:59.140365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:32:59.140813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:32:59.184330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:59.184912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:59.185427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:59.192686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:32:59.197144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:32:59.198397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:32:59.517920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:59.531925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:59.534829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:59.540854 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ada4f027-b445-44a5-a79a-378ec7dbddb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.813107 Aug 30 16:32:59.555487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3058/5696] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:32:58 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:32:59.946274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:32:59.960556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b87a67e4-cecb-4b77-8050-f1ba9d0c4eac tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1218 microversion: 2.1 time: 0.825792 Aug 30 16:32:59.968002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2639/5697] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:32:59 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1218 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:00.572242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:00.573718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:00.589979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:00.591132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:00.592114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:00.593084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:00.593962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:00.598132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:00.989254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:00.991860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:01.007010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:01.009752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:01.010319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:01.011141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:01.011675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:01.012198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:01.447127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:01.458059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:01.476793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:01.478057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be64b1e0-7ba2-4af5-816a-5082315d79a2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.910306 Aug 30 16:33:01.478681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3059/5698] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:00 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:01.606801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:01.621207 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9b084ac-175a-40a7-ad05-18a41771d09f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1272 microversion: 2.1 time: 0.637062 Aug 30 16:33:01.627343 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2640/5699] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:00 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1272 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:02.504366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:02.505000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:02.518153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:02.525491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:02.533674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:02.537538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:02.538050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:02.538530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:02.647866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:02.649316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:02.684950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:02.691206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:02.695191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:02.696176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:02.700616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:02.705848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:02.946754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:02.962377 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c712f07a-11d0-411e-acaa-6c896d07dca6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1272 microversion: 2.1 time: 0.316678 Aug 30 16:33:02.965494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2641/5700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:02 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:03.072576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:03.094980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:03.099058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:03.101047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-52120a33-2b59-44d3-ae10-c99d40688526 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.601591 Aug 30 16:33:03.102183 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3060/5701] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:02 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:03.988230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:03.990281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:04.020465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:04.023698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:04.025716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:04.029131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:04.035078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:04.036873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:04.111643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:04.130149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:04.131051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:04.143877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:04.144477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:04.145022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:04.145842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:04.151894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:04.152442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:04.479442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:04.493252 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f82341ec-790a-4ad3-8443-30a44868914f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.509059 Aug 30 16:33:04.498062 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2642/5702] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:03 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:04.608358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:04.627731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:04.631889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:04.634167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c28a6e2-5a20-4148-bd8e-9e9b7b28ac06 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.507133 Aug 30 16:33:04.636347 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3061/5703] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:04 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:33:05.521300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:05.522633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:05.563402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:05.564091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:05.564678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:05.565829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:05.566558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:05.567293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:05.880364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1125762182", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "01b541e8-9dcd-4fda-8cae-63a924e1d40e"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:05.967954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] validate_networks() for [('01b541e8-9dcd-4fda-8cae-63a924e1d40e', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:33:06.758960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:33:06.759980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:33:06.760853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:33:06.761462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:33:06.763106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:33:06.775122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:06.776228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:06.776731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:06.778189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:06.778930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:06.780823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:06.823316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:06.830546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for user 2e08e32144fd4c3995c2baa753856031 and project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:06.855100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:33:06.862883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:33:06.971989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34f00c1b-77ab-4b60-8443-d8508840ed1d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436259 Aug 30 16:33:06.988649 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3062/5704] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:33:06.999662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:07.000541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:07.012617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:07.013493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:07.015250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:07.016254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:07.019448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:07.021489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:07.122770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:07.130955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1de0404b-9cfa-43ea-b063-3e5a44e7f453 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 1.616929 Aug 30 16:33:07.156001 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2643/5705] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:05 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:07.160985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-79261531", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "01b541e8-9dcd-4fda-8cae-63a924e1d40e"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:07.260821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] validate_networks() for [('01b541e8-9dcd-4fda-8cae-63a924e1d40e', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:33:07.493384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:07.508398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:07.512181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:07.521393 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be7ee735-3ec5-4b2d-bf21-6533b2276b8b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.530227 Aug 30 16:33:07.522141 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3063/5706] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:06 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:07.898810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7", "tag": "f36995dc-3ec4-480a-9746-ff6149548c57"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:07.931269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:07.931773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:07.932221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:07.980603 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] Creating event network-changed:f36995dc-3ec4-480a-9746-ff6149548c57 for instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 on n-h1-830883-28 Aug 30 16:33:07.998895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9cd6cd49-0363-4117-acf8-8b951f0cb9ca req-e81c7f9d-7f53-49b5-91b9-ad5595e17fef service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100835 Aug 30 16:33:08.002262 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3064/5707] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:08.103257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:08.597625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8d1fa42-fe00-4a5d-925f-79f5cccd29e2 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1227705300", "availability_zone": "foo_zone"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:08.650033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.aggregate [None req-b8d1fa42-fe00-4a5d-925f-79f5cccd29e2 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Generated uuid ad6efb43-d6f0-4930-89c9-4aeb7c74a2ed for aggregate {{(pid=122352) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 16:33:08.688401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8d1fa42-fe00-4a5d-925f-79f5cccd29e2 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.571770 Aug 30 16:33:08.689414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3065/5708] 10.222.0.47 () {60 vars in 1164 bytes} [Tue Aug 30 16:33:08 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:08.705957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:08.707524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:08.716470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:08.718934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:08.719625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:08.720655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:08.721354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:08.722194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:09.115527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:33:09.116088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:33:09.116418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:33:09.116821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:33:09.117235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:33:09.139477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:09.140041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:09.148185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:09.157170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:09.158039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:09.158703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:09.207261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:09.217760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for user 2e08e32144fd4c3995c2baa753856031 and project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:09.235699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:33:09.238264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:33:09.299981 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bdc50ad3-c96a-49bd-b334-7742ddcd77dc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142743 Aug 30 16:33:09.301327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2644/5709] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:33:09.306403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:09.307249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:09.316047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:09.316831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:09.317466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:09.318544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:09.319145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:09.319772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:09.604647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:09.619285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9c453bc-312a-47b3-99e7-bda021a5769c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.918024 Aug 30 16:33:09.634665 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3066/5710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:08 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:09.643005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe3465ae-347d-4f65-a0d3-4d336120241e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:09.694855 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe3465ae-347d-4f65-a0d3-4d336120241e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.058968 Aug 30 16:33:09.703473 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3067/5711] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:33:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:09.714517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-549888986", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "451", "networks": [{"uuid": "01b541e8-9dcd-4fda-8cae-63a924e1d40e"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:10.273052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:10.275686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] validate_networks() for [('01b541e8-9dcd-4fda-8cae-63a924e1d40e', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:33:10.285828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:10.289553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:10.303856 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e57709d5-4cb5-4ee4-88ec-46fcbaa9ef0c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.999891 Aug 30 16:33:10.305635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2645/5712] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:09 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:10.341133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:10.354519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:10.360496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:10.361766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:10.364282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:10.365482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:10.367691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:10.473592 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-60c9f9a1-1572-4222-b4d4-cee647d34c37 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.143574 Aug 30 16:33:10.475150 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2646/5713] 10.222.0.47 () {58 vars in 1176 bytes} [Tue Aug 30 16:33:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:10.492945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea918e3f-e681-4e67-8c6b-374db0c6487e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:10.504323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea918e3f-e681-4e67-8c6b-374db0c6487e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.019783 Aug 30 16:33:10.505568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2647/5714] 10.222.0.47 () {58 vars in 1143 bytes} [Tue Aug 30 16:33:10 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:10.520281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89383d71-2883-47da-84d4-61aadfcdee0d tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:10.549569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89383d71-2883-47da-84d4-61aadfcdee0d tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:10.550080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89383d71-2883-47da-84d4-61aadfcdee0d tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:10.553096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89383d71-2883-47da-84d4-61aadfcdee0d tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:10.955869 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89383d71-2883-47da-84d4-61aadfcdee0d tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.440953 Aug 30 16:33:10.964881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2648/5715] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:33:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:10.972053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:10.972993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:10.981972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:10.983279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:10.983934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:10.986370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:10.987140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:10.987723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:11.278578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:33:11.280159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:33:11.280817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:33:11.281941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:33:11.282556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:33:11.314325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:11.314838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:11.315522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:11.317333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:11.317795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:11.318421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:11.362366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:11.370341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Getting quotas for user 2e08e32144fd4c3995c2baa753856031 and project cd2c7e48560a41ae95461e297734c48f. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:11.372291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:11.382670 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-276ee098-1a64-4ad5-8b63-f8199cf9cfc5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1318 microversion: 2.1 time: 0.415792 Aug 30 16:33:11.387952 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2649/5716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:10 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:11.392375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:33:11.393238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e15a15a-20ce-4a0d-9e7d-b494d482f111 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:11.395226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:33:11.422338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e15a15a-20ce-4a0d-9e7d-b494d482f111 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.032737 Aug 30 16:33:11.422978 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2650/5717] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:33:11 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:11.433949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:11.437458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:11.449997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:11.450616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:11.451548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:11.452409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:11.459071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:11.459760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:11.467737 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-97c5561a-8197-4de5-b6db-83d30c99f1fd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.766882 Aug 30 16:33:11.468694 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3068/5718] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:33:11.477340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95221d66-ebf4-4906-b166-3cc25496fd6c tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1224131056", "availability_zone": "foo_zone"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:11.734329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-95221d66-ebf4-4906-b166-3cc25496fd6c tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.259286 Aug 30 16:33:11.737647 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3069/5719] 10.222.0.47 () {60 vars in 1173 bytes} [Tue Aug 30 16:33:11 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:11.751177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3423c8d-b35f-41e2-9d6d-a8ae8fba63e1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:11.753215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3423c8d-b35f-41e2-9d6d-a8ae8fba63e1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:12.277407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3423c8d-b35f-41e2-9d6d-a8ae8fba63e1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:12.300835 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3423c8d-b35f-41e2-9d6d-a8ae8fba63e1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1220 microversion: 2.1 time: 0.561384 Aug 30 16:33:12.306594 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3070/5720] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:11 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1220 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:12.324020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d3fe0df-301b-430a-af97-17ddb8e90296 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:12.443559 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d3fe0df-301b-430a-af97-17ddb8e90296 tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.131106 Aug 30 16:33:12.456291 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3071/5721] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:33:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:12.465041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:12.470754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:12.504600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:12.508800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:12.511442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:12.512511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:12.515791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:12.516970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:12.666808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:12.684598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:12.693004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:12.697989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-41a4e3a6-4a94-48d3-a777-1227750f520b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 1.268731 Aug 30 16:33:12.702640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2651/5722] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:11 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:12.713148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83de96f9-703b-41ac-af2f-b200bdf3cf2e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:12.760655 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83de96f9-703b-41ac-af2f-b200bdf3cf2e tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.056045 Aug 30 16:33:12.761276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2652/5723] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:33:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:12.775059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-efc4fdc8-f64b-4511-9bd5-a6e56befffbf tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-830883-28"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:12.805587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efc4fdc8-f64b-4511-9bd5-a6e56befffbf tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:12.806118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efc4fdc8-f64b-4511-9bd5-a6e56befffbf tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:12.806595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efc4fdc8-f64b-4511-9bd5-a6e56befffbf tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.056760 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-efc4fdc8-f64b-4511-9bd5-a6e56befffbf tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.287097 Aug 30 16:33:13.061175 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2653/5724] 10.222.0.47 () {60 vars in 1194 bytes} [Tue Aug 30 16:33:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:13.074225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c7fd6c5-4b8d-4287-9689-ea88eb38b7bc tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:13.159402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c7fd6c5-4b8d-4287-9689-ea88eb38b7bc tempest-TestAggregatesBasicOps-1340593081 tempest-TestAggregatesBasicOps-1340593081-project-admin] 10.222.0.47 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.090427 Aug 30 16:33:13.172518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2654/5725] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:33:13 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 16:33:13.490994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:13.500906 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ad0662f-fe5c-4f45-9775-11c340887059 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1318 microversion: 2.1 time: 1.043352 Aug 30 16:33:13.502523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3072/5726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:12 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1318 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:13.524351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:13.525173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:13.533251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.533750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.534497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.535227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.536151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.536775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.715463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Calling method '.version_select at 0x7fd360e07820>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:13.717618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.718228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.718892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.760004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.760820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.762478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.791124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.792031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.792690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.811222 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f10cb0b-9a21-4189-b051-784fa6926ec2 tempest-PortsAdminExtendedAttrsTestJSON-1454190635 tempest-PortsAdminExtendedAttrsTestJSON-1454190635-project-admin] 10.222.0.47 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.488368 Aug 30 16:33:13.811845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2655/5727] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:33:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:13.825067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:13.825701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:13.828851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:13.837540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.838048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.838540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:13.839248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:13.851380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:13.859029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43bfc3da-0b6f-4b0b-81ff-ae28e9d598ff tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1272 microversion: 2.1 time: 0.329423 Aug 30 16:33:13.860497 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3073/5728] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:13 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:13.877507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:14.173485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:14.195548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:14.197810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:14.199443 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f99e610-c6b1-4dbb-9d73-be0395bd44d4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.384425 Aug 30 16:33:14.204602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2656/5729] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:13 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:14.524913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:14.526208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:14.537261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:14.539213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:14.539708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:14.542213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:14.542721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:14.543170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:14.881163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:14.882282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:14.898169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:14.900118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:14.901972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:14.903822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:14.905363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:14.905824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:14.922812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:14.957815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3f16342-8167-4f76-b356-fd75d69a3f4f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.438021 Aug 30 16:33:14.962641 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3074/5730] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:14 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:15.067942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e769322-0a09-49fb-9241-714b3eab2947", "tag": "4d795eed-2216-4784-8206-69b22ccb9424"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:15.080074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:15.105626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:15.106123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:15.106869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:15.114183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:15.127032 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bfdff999-eecb-436c-b205-e8aa46cec170 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1278 microversion: 2.1 time: 0.249775 Aug 30 16:33:15.128731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2657/5731] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:14 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:15.133311 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] Creating event network-changed:4d795eed-2216-4784-8206-69b22ccb9424 for instance 4e769322-0a09-49fb-9241-714b3eab2947 on n-h1-830883-28 Aug 30 16:33:15.149057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e7be937d-5452-434e-9318-c18111a66190 req-825ed69e-f779-4826-9d5a-070b5f86d9b7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088992 Aug 30 16:33:15.155495 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3075/5732] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:15.243863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "name": "network-vif-plugged", "status": "completed", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:15.246918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:15.249318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:15.278728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:15.280601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:15.281080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:15.286769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:15.288322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:15.288950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:15.289417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:15.303123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:15.303658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:15.365132 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] Creating event network-vif-plugged:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h2-830883-28 Aug 30 16:33:15.377432 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-03bd65e8-a889-4526-a971-88a17567115a req-924451e2-7569-4c62-ab44-0b2f4dbdcc80 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150472 Aug 30 16:33:15.378397 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2658/5733] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:15.815727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:15.835310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:15.840238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:15.845073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd394358-3183-4618-af83-9012e186ca11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.612148 Aug 30 16:33:15.851280 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3076/5734] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:15 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:15.982585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:15.983330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:15.993500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:15.993991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:15.994452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:16.007338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:16.008079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:16.008679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:16.150492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:16.151233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:16.162170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:16.163539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:16.165863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:16.166740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:16.167465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:16.170079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:16.324209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:16.327481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:16.335211 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa122aa2-f3fd-42b9-8f9b-c91fe6e665ae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.358492 Aug 30 16:33:16.335793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2659/5735] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:15 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:16.339485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2ff3d17-7af8-4205-be6e-c9efe385c2b0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1278 microversion: 2.1 time: 0.194056 Aug 30 16:33:16.356542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3077/5736] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:16 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:16.874379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:16.883097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:16.887340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:16.900204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:16.900993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:16.902006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:16.903179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:16.906812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:16.907409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.358706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:17.360264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:17.380098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:17.381133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:17.383002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.384049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:17.385906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:17.389897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.561706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:17.575443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:17.577971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:17.579898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13c11fba-741d-4360-92b3-6e763522d018 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.713834 Aug 30 16:33:17.581197 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2660/5737] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:16 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:17.586054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:17.587327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:17.610577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:17.611855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:17.616700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.618797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:17.619600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:17.620546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.874858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:17.886983 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7a635f9-a8d7-42b0-ad16-b756aa459fe5 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1278 microversion: 2.1 time: 0.302431 Aug 30 16:33:17.887754 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2661/5738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:17 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:17.899133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7", "name": "network-vif-plugged", "status": "completed", "tag": "f36995dc-3ec4-480a-9746-ff6149548c57"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:17.927398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:17.930662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:17.931852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:17.965305 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] Creating event network-vif-plugged:f36995dc-3ec4-480a-9746-ff6149548c57 for instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 on n-h1-830883-28 Aug 30 16:33:17.982920 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e2bfc8e8-5b84-4952-a93f-da7f3a7fff37 req-f58017b0-182c-41b8-9e89-e34555507d9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082526 Aug 30 16:33:17.983807 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2662/5739] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:18.098012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:18.110447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25baf9d1-3ae7-4a36-8259-f6b3829dfaae tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.755761 Aug 30 16:33:18.113660 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3078/5740] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:17 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:18.604596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:18.605298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:18.623092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:18.623595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:18.624031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:18.624734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:18.625190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:18.625607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:18.920392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:18.921031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:18.938722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:18.939225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:18.940134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:18.941006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:18.941621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:18.942207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:19.231367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:19.286159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:19.309799 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22a88840-99d0-4b36-adea-4d4275f40180 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.396507 Aug 30 16:33:19.330584 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3079/5741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:18 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:19.340282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:19.343613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:19.353535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:19.354268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:19.354971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:19.355939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:19.358086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:19.358896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:19.445114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:19.467913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:19.474954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:19.477556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef992442-e688-4fd6-9b14-1d9b66545b32 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1808 microversion: 2.20 time: 0.876914 Aug 30 16:33:19.490342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2663/5742] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:18 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1808 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:33:19.801528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:19.813037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3625b1e-e46d-46f9-9619-ffe3e98d9f28 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1314 microversion: 2.1 time: 0.480309 Aug 30 16:33:19.813840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3080/5743] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:19 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:20.000876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e769322-0a09-49fb-9241-714b3eab2947", "name": "network-vif-plugged", "status": "completed", "tag": "4d795eed-2216-4784-8206-69b22ccb9424"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:20.017834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.018703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.019867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.039013 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] Creating event network-vif-plugged:4d795eed-2216-4784-8206-69b22ccb9424 for instance 4e769322-0a09-49fb-9241-714b3eab2947 on n-h1-830883-28 Aug 30 16:33:20.048566 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a191890f-e385-4895-9cd1-57f0c0cdcf23 req-fe739d42-74be-4beb-8574-12f96b4d8c26 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053742 Aug 30 16:33:20.056416 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2664/5744] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:20.342958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:20.349065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:20.358723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.359324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.359946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.360854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.361387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.361837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.384008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:20.507663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:20.508546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:20.510917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:20.520387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.521253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.521896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.522924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.523774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.524449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.855757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:20.865162 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04c53595-8519-4d0e-a376-de3d49b0117e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.530681 Aug 30 16:33:20.865760 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3081/5745] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:20 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:20.870918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:20.871904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:20.879149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.879765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.880292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.881158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:20.881729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:20.882244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:20.978209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:20.994418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:20.996509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:20.998754 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef357699-c656-4fa0-a339-36a12f9d2ac9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1795 microversion: 2.20 time: 0.496806 Aug 30 16:33:21.001411 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2665/5746] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:33:20 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1795 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:33:21.031395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef", "tag": "b9c4abfc-3ba8-4216-834a-302bab5eb58d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:21.047426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.048330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.048994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.062501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] Creating event network-changed:b9c4abfc-3ba8-4216-834a-302bab5eb58d for instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef on n-h2-830883-28 Aug 30 16:33:21.068953 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6cb43f09-bdc7-40e6-af5e-01bc54c94767 req-25a73013-3a4b-4bca-b6c7-80df7d807d0d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042553 Aug 30 16:33:21.070192 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2666/5747] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:21.231232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:21.241010 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef306056-a1f8-4742-af48-00e7d84b4a49 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1500 microversion: 2.1 time: 0.373760 Aug 30 16:33:21.248175 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3082/5748] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:20 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1500 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:21.270894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:21.276345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:21.291568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.295184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.298414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.299269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.300014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.300654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.329605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lazy-loading 'flavor' on Instance uuid 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:33:21.334741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:21.431029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b419d22-5699-44d7-a657-00513481322c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "POST /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7/action" status: 200 len: 32 microversion: 2.1 time: 0.164469 Aug 30 16:33:21.432426 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2667/5749] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:33:21 2022] POST /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:33:21.444727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:21.445367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:21.459175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:21.462248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.471136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.471744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.472588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.473710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.474268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.899327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:21.904734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:21.920584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.921283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.922658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:21.923955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:21.924734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:21.925673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:22.067561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:22.078929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9324ce6-2f73-4e2a-87fb-1a55f754829d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.638847 Aug 30 16:33:22.095233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3083/5750] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:21 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:22.553285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:22.562144 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51d68145-03d2-48b9-bb64-f8980dcea332 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.678153 Aug 30 16:33:22.566369 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2668/5751] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:21 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:23.112016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:23.112654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:23.121612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=20 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:23.126400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:23.131715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:23.132249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:23.133014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:23.133496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:23.133951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:23.265913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a068a7-2d33-49ce-a194-8541f9dbed0b", "tag": "01e1893a-3235-4fde-aea7-bb28190312d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:23.296395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:23.299515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:23.303196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:23.331775 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] Creating event network-changed:01e1893a-3235-4fde-aea7-bb28190312d0 for instance 16a068a7-2d33-49ce-a194-8541f9dbed0b on n-h2-830883-28 Aug 30 16:33:23.344497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-960831e9-2b2e-42ca-8a44-73218d29696b req-5aa61c59-4c0c-4e99-9770-6f149cf187cb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083807 Aug 30 16:33:23.347461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2669/5752] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:23.588770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:23.591282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:23.637636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:23.640391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:23.652080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:23.655417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:23.656229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:23.663257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:23.680844 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-575582d6-292f-45af-97ca-d6de51d96422 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.573598 Aug 30 16:33:23.681435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3084/5753] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:23 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:23.689345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:24.393498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:24.405806 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d493e8c6-5b75-4330-8800-17f992cba3d6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.823347 Aug 30 16:33:24.418758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2670/5754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:23 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:24.706633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:24.707415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:24.722104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:24.723341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:24.724017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:24.724959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:24.725716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:24.726505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:25.125188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:25.154974 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61bc8edc-a2c9-47f3-a42f-f62c627e1143 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.450231 Aug 30 16:33:25.172670 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3085/5755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:24 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:25.428095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:25.428811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:25.447110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:25.451694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:25.454171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:25.454981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:25.455457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:25.455895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:25.958353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:25.967589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3424bb88-ab29-43bb-8443-5a1c360d06b4 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.543358 Aug 30 16:33:25.968882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2671/5756] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:25 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:26.179181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:26.180626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:26.189300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:26.190462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:26.190994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:26.191866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:26.192543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:26.193106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:26.469745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:26.483555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6afd881-d9c8-4610-acd4-35e2304d0606 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.308917 Aug 30 16:33:26.485994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3086/5757] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:26 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:26.989336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:26.989954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:27.000979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:27.001742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:27.002416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:27.006357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:27.007233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:27.007698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:27.396273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:27.409347 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-848ea175-76f4-4990-8db8-f505bc1b72e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.423775 Aug 30 16:33:27.409946 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2672/5758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:26 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:27.510622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:27.511262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:27.531741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:27.534618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:27.535257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:27.536453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:27.539459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:27.542820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:28.322870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:28.333573 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93660005-195d-4491-968b-cf2ce95db94d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.829191 Aug 30 16:33:28.336333 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3087/5759] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:27 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:28.434549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:28.436035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:28.451567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:28.452474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:28.453320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:28.457220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:28.458233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:28.459053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:28.803677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:28.822604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-912f5a41-4560-4902-8569-a06155e5034b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.392936 Aug 30 16:33:28.826868 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2673/5760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:28 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:29.362088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:29.362994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:29.393431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:29.393919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:29.396967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:29.402715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:29.405119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:29.410556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:29.846411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:29.848375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:29.858713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:29.859828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:29.860702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:29.861635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:29.864131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:29.864817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:29.992958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:30.035785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a779c0bb-040a-4257-84fa-868a8469e3db tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.668439 Aug 30 16:33:30.038042 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3088/5761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:29 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:30.146638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef", "name": "network-vif-plugged", "status": "completed", "tag": "b9c4abfc-3ba8-4216-834a-302bab5eb58d"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:30.177387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:30.178333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:30.179896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:30.227313 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] Creating event network-vif-plugged:b9c4abfc-3ba8-4216-834a-302bab5eb58d for instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef on n-h2-830883-28 Aug 30 16:33:30.265463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f34be234-80b7-49e4-95d2-76032e1e24e7 req-e51b91ab-ab57-4e36-a1f8-04f9c3688ab2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108201 Aug 30 16:33:30.280539 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3089/5762] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:30.297931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:30.308826 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-207bd29a-4561-4a2b-bfba-23926cc04757 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.467822 Aug 30 16:33:30.309417 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2674/5763] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:29 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:31.062755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:31.064152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:31.082650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:31.083418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:31.084572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:31.085500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:31.086212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:31.086887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:31.339465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:31.342212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:31.365565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:31.367061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:31.369346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:31.371196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:31.371904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:31.373497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:31.638780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:31.650542 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b11acb1e-7c25-49ee-ad7e-e857936bfec6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.325306 Aug 30 16:33:31.651711 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2675/5764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:31 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:31.723279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:31.736396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-980b455f-3495-4405-aeaf-315be16b8b9c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.678850 Aug 30 16:33:31.737006 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3090/5765] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:31 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:32.324579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a068a7-2d33-49ce-a194-8541f9dbed0b", "name": "network-vif-plugged", "status": "completed", "tag": "01e1893a-3235-4fde-aea7-bb28190312d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:32.339629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:32.340231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:32.340542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:32.355207 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] Creating event network-vif-plugged:01e1893a-3235-4fde-aea7-bb28190312d0 for instance 16a068a7-2d33-49ce-a194-8541f9dbed0b on n-h2-830883-28 Aug 30 16:33:32.364096 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-14a1d0d1-6ece-4c65-8294-9cebf8118130 req-6c81cc72-88eb-4feb-a25b-3327acbe0fc1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044784 Aug 30 16:33:32.368814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2676/5766] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:32.674333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:32.675684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:32.691954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:32.692729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:32.694944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:32.696030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:32.696514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:32.697016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:32.766965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:32.769090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:32.783779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:32.784647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:32.785364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:32.786578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:32.787269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:32.788716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:33.126450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:33.142991 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38532b5c-ed2f-499e-ae54-f58c7c482b1d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.387478 Aug 30 16:33:33.156031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2677/5767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:32 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:33.281537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:33.307586 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9efad8f5-1ccb-401c-a886-3fa4e3da3159 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1320 microversion: 2.1 time: 0.633364 Aug 30 16:33:33.308659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3091/5768] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:32 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:34.175131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:34.176560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:34.194230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.195476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.196845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:34.198948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.202863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.203576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:34.331797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:34.333268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:34.348514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.349841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.352369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:34.353566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.354701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.360586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:34.543966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:34.563012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0d10d4e-6e76-4cb2-a70c-553e65c9f7e0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.391383 Aug 30 16:33:34.568663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2678/5769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:34 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:34.823343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:34.838427 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c5167851-1749-4a04-af74-0b2f2b7f1cc9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1511 microversion: 2.1 time: 0.511747 Aug 30 16:33:34.839502 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3092/5770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:34 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:34.860008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:34.861470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:34.867756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.868470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.869108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:34.870104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:34.870760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:34.871223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.056819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.070010 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d3885753-2cb4-4338-afe2-94fda3ce80cd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1511 microversion: 2.1 time: 0.214446 Aug 30 16:33:35.070894 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2679/5771] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:34 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:35.092790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:35.093690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:35.100842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.101742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.102194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.102935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.103606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.104047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.292730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.301309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4c74727-f37a-4072-a278-d2840b13ac42 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1509 microversion: 2.1 time: 0.213472 Aug 30 16:33:35.302566 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3093/5772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:35 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:35.324914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:35.332008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.333075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:35.350124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.350950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.351617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.352521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.352979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.353570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.464127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:35.539291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.545949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.546522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.546976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.588585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:35.589916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:35.602702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.604458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.604930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.607324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.610113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.610892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.707297 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b373702-c407-48eb-8401-3852f63735eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.387109 Aug 30 16:33:35.708616 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2680/5773] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:33:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:35.731624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:35.739102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.740509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1125762182', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:35.746710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.747654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.748388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.749316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.750097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.750791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:35.803684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.813141 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38e312ad-5f35-4a7f-abcc-2c1ea4201be5 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.228689 Aug 30 16:33:35.815219 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3094/5774] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:35 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:35.882227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:35.973746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:35.980969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:35.983020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:35.983586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.133986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-051ef55d-8b50-4cab-894e-3b0bb1b222f6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1125762182" status: 200 len: 1514 microversion: 2.1 time: 0.406148 Aug 30 16:33:36.134906 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2681/5775] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:33:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1125762182 => generated 1514 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:36.158499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:36.166405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:36.167410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:36.173717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.174543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.175465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.176658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.177715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.178418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.316466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:36.399757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:36.412462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.412964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.413584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.707082 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b1ae5aa7-e8ca-4936-87d8-61241defe9ee tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 0.552461 Aug 30 16:33:36.709070 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3095/5776] 10.222.0.47 () {58 vars in 1173 bytes} [Tue Aug 30 16:33:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:36.744734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:36.752759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:36.753542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.servers [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Removing options 'limit' from query {{(pid=122352) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1518}} Aug 30 16:33:36.755230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:36.763234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.764058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.764789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.765729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.767101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.767759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.823403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:36.832866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.833510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.834190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.835209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7d8c104-9c76-48af-b611-468238aa0a00 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: .version_select at 0x7fd360feeb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-465535839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqmyD2rcuQjkUNdqPXK/eVFeCKxzf5IhX+aF55A6UzsVNaIb7M9CnJNxT0qa0hkkymScuxQAFKoXs1QuPN39VctsrB8Ln89GZK+R7pJ/mA4wJrTGMIuPQ8MO5HzeRcCaA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:36.858046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b7d8c104-9c76-48af-b611-468238aa0a00 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:36.864799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-b7d8c104-9c76-48af-b611-468238aa0a00 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:36.898134 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7d8c104-9c76-48af-b611-468238aa0a00 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.533998 Aug 30 16:33:36.898963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2682/5777] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:33:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:36.910246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:36.910896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:36.917599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.918090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.918572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.920025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:36.927054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:36.927594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:36.955700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:37.115264 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-941ed4fa-90aa-45f4-806e-6f18f5aa5888 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.375520 Aug 30 16:33:37.116119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3096/5778] 10.222.0.47 () {58 vars in 1161 bytes} [Tue Aug 30 16:33:36 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:37.124924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.130798 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8a37bed-7811-424e-808d-0d4a17ade770 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.223774 Aug 30 16:33:37.140808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.142483 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2683/5779] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:36 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:37.150768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.151758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.161178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.162064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.162768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.163756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.164479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.165272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.297391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:37.365636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:37.387520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f97c135-3cc8-4ae0-ba0d-b7cdff28ded2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.251111 Aug 30 16:33:37.388714 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3097/5780] 10.222.0.47 () {58 vars in 1152 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:37.402931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.411943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.412496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.compute.servers [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Removing options 'limit' from query {{(pid=122351) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1518}} Aug 30 16:33:37.413699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.423398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.424430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.425093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.426070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.426795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.428591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.469072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:37.513370 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c57aa111-43f1-4c60-af49-1f4aa37d4112 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.115130 Aug 30 16:33:37.516124 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2684/5781] 10.222.0.47 () {58 vars in 1150 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:37.526910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.532325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.533145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.539162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.539900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.540551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.541507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.542174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.542845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.577392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:37.611420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9743a4c8-2905-4abe-9351-a814ea6d807a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.088562 Aug 30 16:33:37.621825 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3098/5782] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers => generated 1009 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:37.628115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.630742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.631603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.645414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.646100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.646732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.647610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.648245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.648826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.753336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:37.853321 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4dfbff4-8b7c-4fce-a560-27f973d828c3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.231868 Aug 30 16:33:37.854206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2685/5783] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:37.870007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.877038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.877536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.servers [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Removing options 'limit' from query {{(pid=122352) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1518}} Aug 30 16:33:37.878335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.884946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.885624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.886527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.887825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.888935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.889597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.933323 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac8b0f90-c3ad-425d-8306-76f3b14a582a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.067887 Aug 30 16:33:37.948526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:37.954088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:37.954741 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3099/5784] 10.222.0.47 () {58 vars in 1140 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:37.955684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1125762182', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:37.968873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.970480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.971184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:37.972099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:37.972750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:37.973369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.119706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:38.159809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:38.161822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:38.191510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:38.194885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:38.195761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.197753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:38.201830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:38.202640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.261418 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-554d7262-f0a9-4215-856c-6240188fe1e3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1125762182" status: 200 len: 346 microversion: 2.1 time: 0.316605 Aug 30 16:33:38.269864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2686/5785] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:33:37 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1125762182 => generated 346 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:38.277851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:38.293615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:38.294934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:38.295517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.330003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Going to try to stop instance {{(pid=122351) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:33:38.389167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-91b909e2-e90c-467b-b9fd-c1923ae1767b tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "POST /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947/action" status: 202 len: 0 microversion: 2.1 time: 0.116513 Aug 30 16:33:38.390674 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2687/5786] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:33:38 2022] POST /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:33:38.413315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:38.414181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:38.427814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:38.428647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:38.429306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.430077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:38.430899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:38.431338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:38.800790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:38.810259 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6d0b555a-1e74-428a-8509-deff0121b92e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.657254 Aug 30 16:33:38.811497 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3100/5787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:38 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:39.016643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:39.024800 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9188b746-5026-4cf9-8a48-1c94bc3b47fc tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.620218 Aug 30 16:33:39.025785 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2688/5788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:38 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:39.832966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:39.834327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:39.843085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:39.843907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:39.844590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:39.845564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:39.846401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:39.847329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:40.048532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:40.049162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:40.062473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:40.063133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:40.063579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:40.064290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:40.065007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:40.065431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:40.072546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:40.083496 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-545e2ea5-551c-4a73-8274-4956e2ffd657 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.255323 Aug 30 16:33:40.088809 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3101/5789] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:39 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:40.602439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:40.618788 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ace21503-87c1-4ed0-a8ce-f7b4244e80eb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.575004 Aug 30 16:33:40.620074 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2689/5790] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:40 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:41.121641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:41.129033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:41.150651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:41.151169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:41.151641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:41.152480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:41.152831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:41.161404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:41.644467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:41.645681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:41.659551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:41.660225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:41.660775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:41.661609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:41.664266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:41.664955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:42.088646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:42.101096 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85d4f517-97c8-45b7-ba71-7a4f5df322e6 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.990393 Aug 30 16:33:42.103681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3102/5791] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:41 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:42.670122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:42.703212 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83131216-61e0-47c5-a50f-ae54655a119a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 1.065790 Aug 30 16:33:42.707295 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2690/5792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:41 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:43.125627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:43.126902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:43.140176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:43.141042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:43.141942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:43.143614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:43.146936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:43.147614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:43.527455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:43.537980 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d5dfc6b-5f81-4a2e-8472-c39abaa9dc4a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.416616 Aug 30 16:33:43.540762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3103/5793] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:43 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:43.726611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:43.727610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:43.739974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:43.740467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:43.740903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:43.741599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:43.742826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:43.746975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:44.093195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:44.114060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf1add77-5c9f-4192-a981-d97df00d5fbd tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.391420 Aug 30 16:33:44.115051 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2691/5794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:43 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:44.561170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:44.562404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:44.569159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:44.569882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:44.570547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:44.571454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:44.572081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:44.572676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:45.066674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:45.075950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3158b66d-7d50-4347-ada1-a4c883506f68 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.519250 Aug 30 16:33:45.085511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3104/5795] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:44 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:45.136686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:45.137431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:45.151361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:45.151871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:45.152311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:45.153592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:45.154112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:45.159465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:45.433349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:45.448529 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e148d560-f3f6-46c9-a601-2bc93742b2c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.316433 Aug 30 16:33:45.450494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2692/5796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:45 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:46.116894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:46.119894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:46.124198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=64 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:46.136332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:46.140198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:46.140552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:46.141288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:46.141755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:46.142408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:46.475386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:46.478109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:46.491980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:46.492737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:46.493558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:46.494465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:46.504735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:46.505394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:46.606843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:46.623925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d0e04e10-1c79-45b6-8a37-41f49622dad4 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.519700 Aug 30 16:33:46.626247 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3105/5797] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:46 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:46.705550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:46.721083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2244f74a-9b92-46e2-93de-22be75eebc37 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.253390 Aug 30 16:33:46.722860 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2693/5798] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:46 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:47.652400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:47.654244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:47.667359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:47.674462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:47.675044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:47.680453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:47.681381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:47.683278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:47.683856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:47.744999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:47.746804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:47.756737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:47.760840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:47.766525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:47.767408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:47.768085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:47.769194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:47.775346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:47.775991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:47.896460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:48.028718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:48.072406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:48.083612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec626c8a-f492-44dc-bf34-e5f808e478ec tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1521 microversion: 2.1 time: 0.342547 Aug 30 16:33:48.088675 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2694/5799] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:47 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:48.345181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:48.358610 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9afebe74-b7c5-4994-b87b-5ced01ee637f tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.711305 Aug 30 16:33:48.360292 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3106/5800] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:47 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:49.120134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:49.120761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:49.140006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.140872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.141484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.142456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.143201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.143959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.382083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:49.383489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:49.391043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.391553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.392004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.392729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.394876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.395344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.546501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:49.555509 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5bc8c0e4-4e37-4db4-9f0c-40da9cd8e548 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1498 microversion: 2.1 time: 0.438938 Aug 30 16:33:49.560788 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2695/5801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:49 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:49.582922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:49.588183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:49.589260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:49.595844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.596533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.597157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.598047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.598874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.599453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.637603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:49.733053 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49f1bc59-d73f-4e4a-bdb8-dd888fcefb29 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.154505 Aug 30 16:33:49.734260 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2696/5802] 10.222.0.47 () {58 vars in 1154 bytes} [Tue Aug 30 16:33:49 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:33:49.749327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:49.778586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.778796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.779246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.808583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Going to try to start instance {{(pid=122351) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:33:49.813204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:49.886204 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1d84db5a-7fcc-4457-be7e-11d66d4392ea tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "POST /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947/action" status: 202 len: 0 microversion: 2.1 time: 0.143867 Aug 30 16:33:49.886973 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2697/5803] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:33:49 2022] POST /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:33:49.901402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:49.902166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:49.917567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.918069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.918751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:49.919772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:49.920234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:49.920665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:50.097800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:50.115682 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9542ded7-9688-48c2-983b-fbdb43bcc3d2 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.737363 Aug 30 16:33:50.117489 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3107/5804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:49 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:50.332323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:50.348996 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-842c3854-ddfe-4993-9fca-2bfdfdc25491 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1507 microversion: 2.1 time: 0.451453 Aug 30 16:33:50.350252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2698/5805] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:49 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:51.023591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-123074153", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "d75d2e97-cbb3-4257-bbcf-6e9784582e9e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-465535839", "security_groups": [{"name": "tempest-secgroup-smoke-384700778"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:51.142798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:51.143424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:51.152606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:51.153178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:51.154119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:51.155039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:51.155657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:51.157041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:51.369766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] validate_networks() for [('d75d2e97-cbb3-4257-bbcf-6e9784582e9e', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:33:51.594723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:51.612061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ccd8249c-420a-4975-8396-158f713e3fa0 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.475894 Aug 30 16:33:51.613602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2699/5806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:51 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:51.631762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:51.632540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:51.640689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:51.644063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:51.644629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:51.645452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:51.647075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:51.648971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:51.884257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:51.893146 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aea22b7a-186e-492d-b700-0ce08ce9578d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1507 microversion: 2.1 time: 0.278344 Aug 30 16:33:51.908743 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2700/5807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:51 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:52.519581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:33:52.520057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:33:52.520499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:33:52.521471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:33:52.521471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:33:52.542529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.543037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.544063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.544841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.545282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.545722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.589542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:33:52.603805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:33:52.639963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:52.640588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:52.640750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:33:52.648463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.648600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:33:52.649237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.650058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.651080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.651684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.652292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.737172 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7325241c-d696-440b-901a-fc81f944bc7e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.724839 Aug 30 16:33:52.743791 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3108/5808] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:33:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:33:52.756291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08b2f37a-ef58-4b54-a532-82596176003c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:52.758427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08b2f37a-ef58-4b54-a532-82596176003c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:52.866685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:52.869180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08b2f37a-ef58-4b54-a532-82596176003c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:52.880357 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3f405931-bd51-47f6-af86-e80714e9893c tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1486 microversion: 2.1 time: 0.244935 Aug 30 16:33:52.882070 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08b2f37a-ef58-4b54-a532-82596176003c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1265 microversion: 2.1 time: 0.134928 Aug 30 16:33:52.884352 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3109/5809] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:52 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:52.896681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2701/5810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:52 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:52.905587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:52.906710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:52.919890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.920863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.921358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:52.922151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:52.927027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.927720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.928202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.928972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.938526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.939562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.951310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:52.953150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:52.954173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:52.954709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.101836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d82416b-3776-4f95-8493-c5deac75a6fe tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "POST /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7/action" status: 202 len: 0 microversion: 2.1 time: 0.200356 Aug 30 16:33:53.105372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3110/5811] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:33:52 2022] POST /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:33:53.140665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:53.141595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:53.161309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.162029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.164273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.165454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.166884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.167745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.520238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:53.537985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2cf61ce-69d3-4374-be41-60be0c59783e tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1494 microversion: 2.1 time: 0.412244 Aug 30 16:33:53.547365 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3111/5812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:53 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1494 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:53.797925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:53.829757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cef9a873-612f-47d4-90a3-c44388d8ed27 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1511 microversion: 2.1 time: 0.914491 Aug 30 16:33:53.833831 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2702/5813] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:52 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1511 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:53.860727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:53.869446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:53.870176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.servers [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Removing options 'limit' from query {{(pid=122352) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1518}} Aug 30 16:33:53.872333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:53.873768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.874520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.875214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.876168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.876871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.877996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.880599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37f137cd-f421-4704-90d9-7974afd623b6 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.023907 Aug 30 16:33:53.895782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:53.896795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:53.905836 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3112/5814] 10.222.0.47 () {58 vars in 1140 bytes} [Tue Aug 30 16:33:53 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:33:53.912135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.913070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.914916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:53.916360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.917312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.918010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.919865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:53.920638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.954656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.955167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.957813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:53.958854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:53.959351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:53.959795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.121340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:54.135279 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f5eda06-e86e-4170-a957-7e899c442123 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1261 microversion: 2.1 time: 0.227161 Aug 30 16:33:54.146332 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3113/5815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:53 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:54.561507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:54.562204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:54.577008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.577522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.577977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.583113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.584006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.585072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.812505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:54.828128 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d440978-8d34-4afb-bb4e-5cf8f70ded45 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1511 microversion: 2.1 time: 0.936328 Aug 30 16:33:54.832609 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2703/5816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:53 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1511 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:54.861349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:54.862359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:54.870515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.871062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.871922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:54.873100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:54.873862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:54.875197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:55.328715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:55.339853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b36bdfb-4346-44bb-b932-0eb07eb6a545 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1509 microversion: 2.1 time: 0.489727 Aug 30 16:33:55.341963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2704/5817] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:54 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1509 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:55.365457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:55.366495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:55.387606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:55.388315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:55.388769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:55.389434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:55.389899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:55.390357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:55.512603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:55.533456 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ea521937-bd10-4c63-8c22-fb1408f76308 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1494 microversion: 2.1 time: 0.977576 Aug 30 16:33:55.535432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:55.536378 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3114/5818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:54 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1494 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:55.547943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:55.549428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:55.551994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-01b2feba-9d0a-4b46-a817-16db2ac5cac7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1323 microversion: 2.1 time: 0.191396 Aug 30 16:33:55.552615 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2705/5819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:55 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:55.563212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:55.564746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:55.565654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:55.566678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:55.567529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:55.568371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.020195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:56.030865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6987c1be-a810-47e1-8558-ddacafbb28f3 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1511 microversion: 2.1 time: 0.491495 Aug 30 16:33:56.032448 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3115/5820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:55 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:56.054153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:56.059021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:56.063036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:56.263779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.265186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.265867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.266697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.268032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.268537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.391478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:56.488481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e91fff55-2840-4458-9d99-897c21f05a8d tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.439007 Aug 30 16:33:56.502614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:56.503234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:56.507217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2706/5821] 10.222.0.47 () {58 vars in 1154 bytes} [Tue Aug 30 16:33:56 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:56.514157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.514831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.515290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.516014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.516485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.517102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.536488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:56.560043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:56.560880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:56.572445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.572954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.573401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.574116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.575835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.576404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.747879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:56.756159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32cb3e43-18c2-42cc-ad52-1c8f865e7f52 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1511 microversion: 2.1 time: 0.257842 Aug 30 16:33:56.757033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3116/5822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:56 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:56.763404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:56.764034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:56.774261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.775006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.776495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:56.776495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:56.776739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:56.777376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:57.018859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:57.029473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3391b7c4-6ae6-42c5-adc9-22d0c972e19c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.270698 Aug 30 16:33:57.042764 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3117/5823] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:56 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:57.050489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:57.051500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:57.058053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:57.058655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:57.059160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:57.059873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:57.060337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:57.060967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:57.074801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:57.110578 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-28d737ea-f1a7-4d6e-872a-3afd2881e711 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1494 microversion: 2.1 time: 0.530990 Aug 30 16:33:57.110578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2707/5824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:56 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1494 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:57.404941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:57.423305 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc2710cb-e73d-42d7-bd77-a06b4bae9008 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1509 microversion: 2.1 time: 0.373530 Aug 30 16:33:57.440117 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3118/5825] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:57 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:57.448319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:57.448851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:57.470758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:57.471389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:57.472074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:57.474039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:57.474719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:57.475172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:57.980220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:33:57.997416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:57.998548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:57.999016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.011700 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] Creating event network-changed:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h1-830883-28 Aug 30 16:33:58.026780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4a2c0e10-17a4-4d93-9cd5-0f48433d8a83 req-d6d0d57a-f769-400d-b4ad-ec554ca2ee41 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050579 Aug 30 16:33:58.029800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3119/5826] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:33:58.056698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:58.057428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:58.064471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.064975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.065427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.066154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.066684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.067126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.181828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.194216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96954fa3-6c25-49d7-ace0-1da673ba1ee9 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1511 microversion: 2.1 time: 0.752680 Aug 30 16:33:58.195141 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2708/5827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:57 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1511 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:58.234295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:58.235032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:58.243188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.243708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.244356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.245253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.245722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.246274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.329867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.343279 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eb0d937f-4b32-49f0-9390-06602b790f9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.288985 Aug 30 16:33:58.367795 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3120/5828] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:58 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:58.376660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:58.385115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.387114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:58.396259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.397771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.399127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.401603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.403177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.403857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.463960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:58.524908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.536603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:58.537108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:58.537844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:58.787461 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e420dc43-42a4-4866-9772-38592ea67cf7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.417839 Aug 30 16:33:58.788079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3121/5829] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:33:58 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:58.819614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:58.824711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:58.825449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:59.044125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.044903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.045187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.046469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.050592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.051364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.080242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:59.093513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7fd2daa-62e2-45eb-a626-da6d9eca457a tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1500 microversion: 2.1 time: 0.897060 Aug 30 16:33:59.094104 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2709/5830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:58 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1500 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:59.122215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.123538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:59.142516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.143511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.144261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.146339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.147017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.147898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.195858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:33:59.229547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:59.312949 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-614b63c7-7546-4c8b-90c5-9b1b5cdd3a2e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.497240 Aug 30 16:33:59.314146 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3122/5831] 10.222.0.47 () {58 vars in 1150 bytes} [Tue Aug 30 16:33:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:59.333187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.340372 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc0809af-e9d3-4dae-9883-be2fd842392d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 204 len: 0 microversion: 2.1 time: 0.222785 Aug 30 16:33:59.340838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:59.341797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2710/5832] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:33:59 2022] DELETE /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:33:59.341962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:59.348045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.349072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.349678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.350657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.351297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.351886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.360091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.360824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:59.384070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.384704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.385083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.389664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.390172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.390705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.431900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:33:59.539108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:59.607063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-346b0e8f-0b00-4f25-9455-1a61d71d8665 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.279562 Aug 30 16:33:59.607665 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3123/5833] 10.222.0.47 () {58 vars in 1212 bytes} [Tue Aug 30 16:33:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:33:59.619994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.620681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:33:59.634852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.635869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.636597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.639351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.640984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.641681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.668512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:59.678860 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c03b2ef3-baeb-43fe-9053-fb376753f634 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.332271 Aug 30 16:33:59.685671 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2711/5834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:59 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:33:59.712181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:33:59.722239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:33:59.727017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:33:59.742356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.746908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.753750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.755044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:33:59.757118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:33:59.757780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:33:59.909410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:33:59.989419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2abaa90-5c1b-431f-9586-8af81996c677 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.301816 Aug 30 16:33:59.990559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2712/5835] 10.222.0.47 () {58 vars in 1196 bytes} [Tue Aug 30 16:33:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:00.006501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:00.012163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:00.012361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': '1125762182', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:34:00.046743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.047624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.048295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.049247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.049924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.050599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.129604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:00.138519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9bc5667e-8393-4ab5-89c3-e9f02f6df077 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.529601 Aug 30 16:34:00.139620 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3124/5836] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:33:59 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:00.193627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:34:00.688289 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-915c56f0-bc94-4f71-a33e-30a603785ffe tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=1125762182" status: 200 len: 346 microversion: 2.1 time: 0.685514 Aug 30 16:34:00.694841 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2713/5837] 10.222.0.47 () {58 vars in 1156 bytes} [Tue Aug 30 16:34:00 2022] GET /compute/v2.1/servers?name=1125762182 => generated 346 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:00.706848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:00.721948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:00.729166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:34:00.729686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:00.731259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:00.739888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.740496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.741584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.742140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.742621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.742908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.743462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.743798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.744194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.747355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:00.747872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:00.750647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:00.921410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:34:01.016232 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75b04c4f-5d52-4eb1-84b7-272bcdf5452c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.316479 Aug 30 16:34:01.023056 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3125/5838] 10.222.0.47 () {58 vars in 1154 bytes} [Tue Aug 30 16:34:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:01.036445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:01.036712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:01.046911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:01.050900 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92ccdb68-c6bf-4bd0-b98f-0073f4cbf783 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.327237 Aug 30 16:34:01.052220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2714/5839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:00 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:01.060317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-112576218', 'deleted': False, 'project_id': 'cd2c7e48560a41ae95461e297734c48f'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:34:01.067772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.068483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.069415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.070562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.071214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.071832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.175441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:01.177919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:01.194046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.195043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.195653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.196565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.208722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.209475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.227458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:34:01.316609 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae94b221-6adf-4c58-b613-d174869d6d6c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-112576218" status: 200 len: 346 microversion: 2.1 time: 0.284709 Aug 30 16:34:01.317420 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3126/5840] 10.222.0.47 () {58 vars in 1228 bytes} [Tue Aug 30 16:34:01 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-112576218 => generated 346 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:01.331291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:01.331958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:01.350064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.350618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.351069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.351923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.352391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.352828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.394916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:01.490531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45f11f5d-a444-404b-b3d9-9e0e2f9a45e7 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 204 len: 0 microversion: 2.1 time: 0.162665 Aug 30 16:34:01.494679 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3127/5841] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:01 2022] DELETE /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:01.503018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:01.503815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:01.505274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:01.511992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.512868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.513614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.514416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:01.514888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:01.515323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:01.519668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-54fc4f9d-2e89-4414-ae1f-d6041e6c0b2b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.354046 Aug 30 16:34:01.520352 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2715/5842] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:01 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:02.072536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:02.073228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:02.080116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.080622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.081072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:02.081811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.082257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.082733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:02.326655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:02.336825 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-256dd62f-64d1-4d6d-949e-863915ad2e66 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1517 microversion: 2.1 time: 0.840635 Aug 30 16:34:02.337959 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3128/5843] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:01 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1517 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:02.435372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:02.451551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-51d46bec-162f-4148-a789-d462e5018873 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.382891 Aug 30 16:34:02.464820 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2716/5844] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:02 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:02.540999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:02.548863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:02.561331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.571276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.571767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:02.572623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:02.573043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:02.573622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:02.863849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:02.879468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-35300da3-a876-44bb-828c-c505c2878852 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.342208 Aug 30 16:34:02.880153 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3129/5845] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:02 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:03.359406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:03.359971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:03.367250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.367810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.368457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.369171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.369705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.370143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.476031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:03.477389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:03.488408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.489139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.489758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.492085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.492728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.494625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.500509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:03.704770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:03.717838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ea6c729-5d1e-4707-9d8e-58d639527f91 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1506 microversion: 2.1 time: 0.249287 Aug 30 16:34:03.733668 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3130/5846] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:03 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:03.905500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:03.906342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:03.927442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.929526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.931283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:03.934108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:03.934916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:03.937581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.114111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:04.137780 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dc3f13e7-25ac-40f5-a3a6-4b79ffdee6c0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1517 microversion: 2.1 time: 0.782173 Aug 30 16:34:04.138740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2717/5847] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:03 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1517 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:04.151997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "name": "network-vif-plugged", "status": "completed", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:04.174330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.177248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.177903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.193429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] Creating event network-vif-plugged:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h1-830883-28 Aug 30 16:34:04.200566 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-da6cd332-6a5f-4682-8830-18567d91f5ec req-99ec65fd-f1fb-44d1-8b96-23921ef04266 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059133 Aug 30 16:34:04.202139 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2718/5848] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:04.420532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:04.437463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c5b0eda7-b3ff-4e84-a338-e02493dceb9c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.538347 Aug 30 16:34:04.440703 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3131/5849] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:03 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:04.569507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7", "name": "network-vif-deleted", "tag": "f36995dc-3ec4-480a-9746-ff6149548c57"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:04.580164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.580552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.580978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.593088 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] Creating event network-vif-deleted:f36995dc-3ec4-480a-9746-ff6149548c57 for instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 on n-h1-830883-28 Aug 30 16:34:04.599085 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f55b6d25-2925-421a-9bd5-d38db231089d req-04521017-64ca-4b89-9de4-982f7ea9d99f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035319 Aug 30 16:34:04.599901 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2719/5850] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:04.759550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:04.763516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:04.780922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.782769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.784907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.786197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:04.787090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:04.787684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:04.878021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:04.887363 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f39abe9a-6f10-4bb3-a562-d46d5946faa8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1464 microversion: 2.1 time: 0.147785 Aug 30 16:34:04.889897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3132/5851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:04 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:05.172544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:05.173535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:05.182626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.183371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.185284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.186563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.187564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.188154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.327015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:05.351927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf336d11-f72c-4f34-bcdb-b30076a6854a tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 200 len: 1475 microversion: 2.1 time: 0.186694 Aug 30 16:34:05.369217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2720/5852] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:05 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:05.459837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:05.460965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:05.473091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.473927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.483022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.483803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.484361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.485665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.857720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:05.873165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6ded7c9-dae8-4cb6-857d-4ab61373c309 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1390 microversion: 2.1 time: 0.410272 Aug 30 16:34:05.874203 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3133/5853] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:05 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1390 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:05.911316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:05.912044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:05.932349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.942573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.943243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:05.944015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:05.944493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:05.946883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.066174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.066718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.067181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.067628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lazy-loading 'fault' on Instance uuid 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:06.384794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:06.387435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 16a068a7-2d33-49ce-a194-8541f9dbed0b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:06.410612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.414636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.415098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.420500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.421238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.424206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.463031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] HTTP exception thrown: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Request method failure captured: Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b HTTP/1.1 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjvB-QTHRVS7OOgeQ2y0KquJVR8Fx0WPm_BqQ4r_u9HJ-zAt07UrhIUYA9hky2k6EzU69fh5HZA_3OECMGgoa-EdMO3tSfPjYjaxNZRr0GRuT9FKGFQ7iq1Kc1wmHlNio5GDJQMt8F9M4lr9b6Pf5-LHHrLxUceZUmmZUKTIcGk4XHU Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}] Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 2e08e32144fd4c3995c2baa753856031 Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '16a068a7-2d33-49ce-a194-8541f9dbed0b'} Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:06.465232 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. Aug 30 16:34:06.469999 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:06.471430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Returning 404 to user: Instance 16a068a7-2d33-49ce-a194-8541f9dbed0b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:06.472460 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a04da520-9534-45a0-8685-a968de7987fb tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b" status: 404 len: 111 microversion: 2.1 time: 0.098154 Aug 30 16:34:06.473678 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3134/5854] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:06 2022] GET /compute/v2.1/servers/16a068a7-2d33-49ce-a194-8541f9dbed0b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:34:06.482988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:06.483741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:06.490133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.490909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.491510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.492406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.493038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.493685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.525305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:06.695174 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd042a60-381f-4a41-b4c8-37140762e5b1 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 204 len: 0 microversion: 2.1 time: 0.217251 Aug 30 16:34:06.696520 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3135/5855] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:06 2022] DELETE /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:06.708266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:06.709310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:06.719352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.721381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.722496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.724941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.726729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.727435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.804989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:06.815566 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da4f51a1-0299-4c13-880d-1eae0ee461f3 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 200 len: 1304 microversion: 2.1 time: 0.909057 Aug 30 16:34:06.816635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2721/5856] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:05 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 1304 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:06.836314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a068a7-2d33-49ce-a194-8541f9dbed0b", "name": "network-vif-deleted", "tag": "01e1893a-3235-4fde-aea7-bb28190312d0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:06.847309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.848182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.848843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.866651 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] Creating event network-vif-deleted:01e1893a-3235-4fde-aea7-bb28190312d0 for instance 16a068a7-2d33-49ce-a194-8541f9dbed0b on n-h2-830883-28 Aug 30 16:34:06.873940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-36b7bf73-003b-4f6d-b0f3-a654ee273454 req-ef834f27-5194-4431-a003-be7ad7b3e86d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040728 Aug 30 16:34:06.875575 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2722/5857] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:06.902040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:06.903121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:06.918199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.918944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.919430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:06.923336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:06.923937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:06.924487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.088883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:07.103156 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3e8c8388-e51d-41cf-b4b9-dbe9ba0f46f0 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1515 microversion: 2.1 time: 0.401349 Aug 30 16:34:07.104066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3136/5858] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:06 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:07.205439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:07.225016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a84caf50-207d-4a26-ad96-ad210267b7bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1562 microversion: 2.1 time: 0.327499 Aug 30 16:34:07.225986 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2723/5859] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:06 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1562 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:07.247741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:07.248376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:07.259953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.260468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.260866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.263162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.266204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.267164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.652992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:07.674485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-454780c5-5bd7-4dce-9f57-aeb546b37d24 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1562 microversion: 2.1 time: 0.423677 Aug 30 16:34:07.675198 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3137/5860] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:07 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1562 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:07.838101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:07.838759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:07.845725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.846664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.847266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.848185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.848622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.849224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.864820 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] HTTP exception thrown: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Request method failure captured: Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 HTTP/1.1 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjt7F8mNIv8rtJouQI64lrQhPWzA-R1Xxtv7D45Qgctvlcd6rZsXl-ippd-ZQnnP-LYeNHqPuOhCvPqxSAvCYSUjvOnVHxc6JmNMsqf8PDYl4MYSRr-zIWr0mvPLOWf7AGW6OsH_YoISiftRC3OrIcPXUPlOk3OAb8qenPQfmxnTNtc Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2a61bed1f18b4dde9c5deec22ede5b63 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2a61bed1f18b4dde9c5deec22ede5b63"}]}] Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2a61bed1f18b4dde9c5deec22ede5b63 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueTestJSON-2066927263-project Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d10c6bd2028d46aab9d3bec26b7b73c2 Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueTestJSON-2066927263-project Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7'} Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:07.866558 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Returning 404 to user: Instance 8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:07.870335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7346551-462f-4615-9637-b70ce7e11fab tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7" status: 404 len: 111 microversion: 2.1 time: 0.033954 Aug 30 16:34:07.872869 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2724/5861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:07 2022] GET /compute/v2.1/servers/8a305cfb-7d5e-4aa4-aae2-62ef1ae3ccf7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:07.881414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:07.881929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:07.889541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.890035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.890537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.891424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:07.891885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:07.892316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:07.923977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:08.009012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:08.021434 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7eedde7c-009a-4994-8019-dbb6c09caa9d tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 204 len: 0 microversion: 2.1 time: 0.147359 Aug 30 16:34:08.022573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3138/5862] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:07 2022] DELETE /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:08.031511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:08.032646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:08.042102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.042633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.043603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.044303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.044758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.045184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.132423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:08.134450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:08.144095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.145013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.145678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.147184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:08.147912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:08.148647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:08.366128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:08.383758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-676a2af8-9df6-46be-a86a-da217132ebc8 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1493 microversion: 2.1 time: 0.356480 Aug 30 16:34:08.385284 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2725/5863] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:08 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1493 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:08.392980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-979892944", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "17d598af-0316-49ff-9919-2ad780280d43"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:08.467586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] validate_networks() for [('17d598af-0316-49ff-9919-2ad780280d43', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:34:08.482584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:08.495143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3421c72-cdf2-4c79-9936-a7842c78278e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1515 microversion: 2.1 time: 0.370949 Aug 30 16:34:08.497372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3139/5864] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:08 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1515 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:09.203864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:09.205627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:09.206960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:09.208170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:09.209447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:09.220622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.221457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.222135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.223216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.223928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.224590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.247850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Getting quotas for project 983c5bbb2f584ac19d0e70a22428efdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:09.255307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Getting quotas for user 36318839f45e47bf89e511fbfcd31d62 and project 983c5bbb2f584ac19d0e70a22428efdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:09.274043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:09.278935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:09.343136 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6085fbe5-1146-4669-b668-87c50f9b7ad0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956567 Aug 30 16:34:09.344038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2726/5865] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:34:09.356061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c318ffcb-30c9-43f8-bc76-22275c56774b tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:09.356763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c318ffcb-30c9-43f8-bc76-22275c56774b tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:09.358748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:09.408737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:09.409368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:09.416366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.416862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.417302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.418053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.418603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.419032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.513986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c318ffcb-30c9-43f8-bc76-22275c56774b tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:09.525780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c318ffcb-30c9-43f8-bc76-22275c56774b tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1213 microversion: 2.1 time: 0.174282 Aug 30 16:34:09.529433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3140/5866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:09 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:09.537106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:09.538598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:09.547956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.548769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.549550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.550613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:09.551312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:09.551931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:09.975603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:09.987005 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-35a67108-9681-4e56-9dcc-54839ab40fd7 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1493 microversion: 2.1 time: 0.582962 Aug 30 16:34:09.998071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:10.003394 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2727/5867] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:09 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1493 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:10.010996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99dc385c-3443-4da5-b79c-3d3c8b16823e tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1515 microversion: 2.1 time: 0.478628 Aug 30 16:34:10.033009 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3141/5868] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:09 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1515 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:10.551555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:10.553564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:10.565594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:10.566098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:10.566600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:10.567998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:10.569353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:10.569945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:10.665647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:10.679446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-11f6e9c0-7040-4fc4-a0e2-16e2aca420e0 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1209 microversion: 2.1 time: 0.132542 Aug 30 16:34:10.680633 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2728/5869] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:10 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1209 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:11.012588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.013819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.026331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.027273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.030473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.033185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.033930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.035265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.035911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.036233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.046036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.047759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.047759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.047759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.047999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.055472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.118647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:11.250621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:11.270009 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5872d031-1c52-4abd-97ea-e5850e0f156f tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 200 len: 1473 microversion: 2.1 time: 0.238752 Aug 30 16:34:11.287923 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2729/5870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:11 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 1473 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:11.300927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef", "name": "network-vif-deleted", "tag": "b9c4abfc-3ba8-4216-834a-302bab5eb58d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:11.338874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.339415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.340751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.357511 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] Creating event network-vif-deleted:b9c4abfc-3ba8-4216-834a-302bab5eb58d for instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef on n-h2-830883-28 Aug 30 16:34:11.365162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3ee7d1fd-dc8d-4514-b602-2c3e7a9817a3 req-a59fed76-5072-4eee-acb0-b2398ca556bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075745 Aug 30 16:34:11.366243 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2730/5871] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:11.687136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10c6bd2028d46aab9d3bec26b7b73c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a61bed1f18b4dde9c5deec22ede5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:11.702727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:11.704388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:11.709847 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29aef2cc-1d8c-4bda-93e1-c6344508b919 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 200 len: 1493 microversion: 2.1 time: 0.702558 Aug 30 16:34:11.716592 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3142/5872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:11 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 1493 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:11.718734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.719390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.720094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.721138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:11.722059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:11.722608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:11.728117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:11.807864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:11.817738 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e856fe3a-b1a4-4c72-916b-e9242663802a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1271 microversion: 2.1 time: 0.120376 Aug 30 16:34:11.818467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2731/5873] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:11 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:12.302948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:12.304122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:12.332028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.332534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.332988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.333713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.334177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.338661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.357787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] HTTP exception thrown: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Request method failure captured: Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef HTTP/1.1 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjvB-QTHRVS7OOgeQ2y0KquJVR8Fx0WPm_BqQ4r_u9HJ-zAt07UrhIUYA9hky2k6EzU69fh5HZA_3OECMGgoa-EdMO3tSfPjYjaxNZRr0GRuT9FKGFQ7iq1Kc1wmHlNio5GDJQMt8F9M4lr9b6Pf5-LHHrLxUceZUmmZUKTIcGk4XHU Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}] Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 2e08e32144fd4c3995c2baa753856031 Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef'} Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:12.360154 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Returning 404 to user: Instance 82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:12.364635 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-95de474d-62bb-43e7-ae09-b3a7f3b3cf83 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef" status: 404 len: 111 microversion: 2.1 time: 0.064697 Aug 30 16:34:12.373094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:12.373598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:12.379600 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3143/5874] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:12 2022] GET /compute/v2.1/servers/82d8d1f7-510d-41dd-ab8b-f60b5ea4d1ef => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:12.380976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.381465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.381906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.382642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.383097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.383524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.428269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:12.555759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:12.578595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-06b9760d-47b0-44d4-908a-a84c20ec58f2 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 204 len: 0 microversion: 2.1 time: 0.209509 Aug 30 16:34:12.584849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2732/5875] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:12 2022] DELETE /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:12.592914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:12.593979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:12.628614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.632928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.633824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.635275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.635904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.636627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.737374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:12.738345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] [instance: 8f8433fb-1d5f-45d0-9019-8f2d03e83989] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:12.745858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.752770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.753781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.754893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.755512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.756223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.780792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] HTTP exception thrown: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Request method failure captured: Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 HTTP/1.1 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjt7F8mNIv8rtJouQI64lrQhPWzA-R1Xxtv7D45Qgctvlcd6rZsXl-ippd-ZQnnP-LYeNHqPuOhCvPqxSAvCYSUjvOnVHxc6JmNMsqf8PDYl4MYSRr-zIWr0mvPLOWf7AGW6OsH_YoISiftRC3OrIcPXUPlOk3OAb8qenPQfmxnTNtc Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 2a61bed1f18b4dde9c5deec22ede5b63 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/2a61bed1f18b4dde9c5deec22ede5b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/2a61bed1f18b4dde9c5deec22ede5b63"}]}] Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 2a61bed1f18b4dde9c5deec22ede5b63 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerRescueTestJSON-2066927263 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerRescueTestJSON-2066927263-project Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: d10c6bd2028d46aab9d3bec26b7b73c2 Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerRescueTestJSON-2066927263-project Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '8f8433fb-1d5f-45d0-9019-8f2d03e83989'} Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:12.782808 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. Aug 30 16:34:12.788250 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:12.790201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] Returning 404 to user: Instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:12.791261 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8cb38da4-9b32-48e3-bedf-6515ba5ed286 tempest-ServerRescueTestJSON-2066927263 tempest-ServerRescueTestJSON-2066927263-project] 10.222.0.47 "GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989" status: 404 len: 111 microversion: 2.1 time: 0.058534 Aug 30 16:34:12.792161 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2733/5876] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:12 2022] GET /compute/v2.1/servers/8f8433fb-1d5f-45d0-9019-8f2d03e83989 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:12.840419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:12.841483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:12.847930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.848742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.849343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:12.850247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:12.851199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:12.851780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.068686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:13.079537 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6eafff47-085e-4344-8fc7-317895674863 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1517 microversion: 2.1 time: 0.492867 Aug 30 16:34:13.080340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3144/5877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:12 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1517 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:13.085974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:13.093486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:13.100214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.100968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.101418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.102134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.102634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.103135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.303401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:13.306862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:13.315549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e2f0187-cc22-4ef2-be0a-d00743665064 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1562 microversion: 2.1 time: 0.233924 Aug 30 16:34:13.316681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3145/5878] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:13 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:13.520937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:13.531898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.532508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.533040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.544509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] Creating event network-changed:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h1-830883-28 Aug 30 16:34:13.549680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-3e5e916c-a04d-4e7b-8c01-f375992b91b6 req-e107f246-2f68-4b1c-93ea-cf53ef3d6d48 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215293 Aug 30 16:34:13.550627 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3146/5879] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:13.556309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8433fb-1d5f-45d0-9019-8f2d03e83989", "name": "network-vif-deleted", "tag": "49d01b64-2dbe-4b5a-9f48-9e66e88a649b"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:13.567459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:13.568058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:13.568493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:13.580570 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] Creating event network-vif-deleted:49d01b64-2dbe-4b5a-9f48-9e66e88a649b for instance 8f8433fb-1d5f-45d0-9019-8f2d03e83989 on n-h2-830883-28 Aug 30 16:34:13.586099 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6100cafc-44ce-45dc-a089-9a8f23d33384 req-127d0111-de3e-47f7-882e-3332e6f92431 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033994 Aug 30 16:34:13.587258 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3147/5880] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:13.613423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:13.623196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-350f8426-215a-4a3e-93d1-204e36928d08 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.787575 Aug 30 16:34:13.623785 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2734/5881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:12 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:14.103777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:14.104480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:14.114286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.115429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.116119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.117783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.120376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.123654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.411097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:14.419487 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c4f56df-76fe-4029-a08f-970582701569 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1517 microversion: 2.1 time: 0.321387 Aug 30 16:34:14.420367 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3148/5882] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:14 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1517 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:14.644656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:14.646080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:14.655315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.655927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.656446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:14.657394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:14.658091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:14.658710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.258121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:15.266925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-10acf342-f836-46c7-9ff1-d2e9267f5c66 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.626348 Aug 30 16:34:15.267797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2735/5883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:14 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:15.442327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:15.442968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:15.450832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.451327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.451781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.452484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.452936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.453362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.626552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a8b030-cb62-49c3-9f5c-7c3c6bf1d199", "tag": "8600cdec-2394-47b6-9d7e-870a59c614fd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:15.637159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:15.645812 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5e46de6-18a8-4864-879d-5ac4ab556b57 tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1517 microversion: 2.1 time: 0.207730 Aug 30 16:34:15.646664 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3149/5884] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:15 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:15.660485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:15.660485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:15.660485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:15.675484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] Creating event network-changed:8600cdec-2394-47b6-9d7e-870a59c614fd for instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 on n-h2-830883-28 Aug 30 16:34:15.681338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1d8a330c-4fc4-460a-9bb6-ed11a22039dc req-cd418ca0-49f0-4192-8a78-4c61662b766e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061512 Aug 30 16:34:15.685486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2736/5885] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:16.289843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:16.290877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:16.299383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:16.300251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:16.300769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:16.301701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:16.302259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:16.302947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:16.629323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:16.644527 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37c7a692-8112-4f36-a403-25bb526e8ba2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.358997 Aug 30 16:34:16.647468 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3150/5886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:16 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:16.668642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:16.669353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:16.676237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:16.676994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:16.677586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:16.678471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:16.679282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:16.679861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:16.848742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e08e32144fd4c3995c2baa753856031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c7e48560a41ae95461e297734c48f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:16.859914 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2ee81b7a-fccc-4b39-baa1-1e485bfdb03c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 200 len: 1475 microversion: 2.1 time: 0.196536 Aug 30 16:34:16.877626 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2737/5887] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:16 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:17.669995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:17.670646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:17.678081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.678838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.679278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.679973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.680427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.680848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.732326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e769322-0a09-49fb-9241-714b3eab2947", "name": "network-vif-deleted", "tag": "4d795eed-2216-4784-8206-69b22ccb9424"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:17.744405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.744982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.745488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.757584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] Creating event network-vif-deleted:4d795eed-2216-4784-8206-69b22ccb9424 for instance 4e769322-0a09-49fb-9241-714b3eab2947 on n-h1-830883-28 Aug 30 16:34:17.763399 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-bd3e8929-7e79-43d8-814d-3f33af6b5fd4 req-dbc4bd27-977d-4d81-b65f-b8e3def7278d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Aug 30 16:34:17.764216 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2738/5888] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:17.821039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:17.829165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce1d2b4c-f35e-4bf6-a408-4f91ffc991eb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.164037 Aug 30 16:34:17.829742 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3151/5889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:17 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:17.882681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:17.883438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] [instance: 4e769322-0a09-49fb-9241-714b3eab2947] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:17.891469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.891982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.892649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.893834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:17.894225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:17.895025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:17.909944 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] HTTP exception thrown: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Request method failure captured: Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 HTTP/1.1 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjvB-QTHRVS7OOgeQ2y0KquJVR8Fx0WPm_BqQ4r_u9HJ-zAt07UrhIUYA9hky2k6EzU69fh5HZA_3OECMGgoa-EdMO3tSfPjYjaxNZRr0GRuT9FKGFQ7iq1Kc1wmHlNio5GDJQMt8F9M4lr9b6Pf5-LHHrLxUceZUmmZUKTIcGk4XHU Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cd2c7e48560a41ae95461e297734c48f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cd2c7e48560a41ae95461e297734c48f"}]}] Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: cd2c7e48560a41ae95461e297734c48f Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-311325535 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 2e08e32144fd4c3995c2baa753856031 Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ListServerFiltersTestJSON-311325535-project Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '4e769322-0a09-49fb-9241-714b3eab2947'} Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:17.912178 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] Returning 404 to user: Instance 4e769322-0a09-49fb-9241-714b3eab2947 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffc4e28a-820e-4bd0-93a2-191cdd0cf21c tempest-ListServerFiltersTestJSON-311325535 tempest-ListServerFiltersTestJSON-311325535-project] 10.222.0.47 "GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947" status: 404 len: 111 microversion: 2.1 time: 0.036345 Aug 30 16:34:17.915959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2739/5890] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:17 2022] GET /compute/v2.1/servers/4e769322-0a09-49fb-9241-714b3eab2947 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:34:18.851944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:18.852667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:18.865294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:18.865886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:18.868219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:18.869031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:18.869580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:18.871743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:19.128880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:19.141841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab73ec96-5770-43f1-a800-9b3fab7061a1 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.293690 Aug 30 16:34:19.178560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3152/5891] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:18 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:20.170825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:20.171443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:20.175041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:20.176952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:20.192972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:20.193477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:20.193921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:20.194670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:20.195128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:20.195552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:20.837097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:20.854452 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-339fce3d-e153-477f-9bac-e37bb7fa1d35 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.691427 Aug 30 16:34:20.855263 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2740/5892] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:20 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:21.881761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:21.883101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:21.893899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:21.901239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:21.903134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:21.904686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:21.905449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:21.907315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:21.910099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:22.270435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:22.286148 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-37d1964c-7567-4c67-94f3-310f0a5dfdcb tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.406808 Aug 30 16:34:22.287174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3153/5893] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:21 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:23.314059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:23.315226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:23.328808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:23.329420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:23.331284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:23.333662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:23.334144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:23.334634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:23.457995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0debd38a-6e5e-4f16-b110-fc60cc2dbb74 tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-449552044", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:23.461417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0debd38a-6e5e-4f16-b110-fc60cc2dbb74 tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] HTTP exception thrown: min_count must be <= max_count Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0debd38a-6e5e-4f16-b110-fc60cc2dbb74 tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Request method failure captured: Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 183 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwPNvQnQPbB6D-c3lwhTQzCB5VCD3Bx0y7_tzq2_F-by8axkFVUrTgxC6v4_P4PU6P72OzitI18sJOriaOGoShd_HMdA-VBJi-bpvxwaaP1d0p2oWYaPoL0vSi8uxyEJLrj6NXMCFoveACbpCT4t8jiXppPHUcrNVXpO2zLQ3dkWLI Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}] Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b06da4173f6a4e7da3d6f21b549e5c9c Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-449552044", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: exception: min_count must be <= max_count Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-449552044', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 30 16:34:23.463573 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.469689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0debd38a-6e5e-4f16-b110-fc60cc2dbb74 tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Returning 400 to user: min_count must be <= max_count {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:23.469689 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0debd38a-6e5e-4f16-b110-fc60cc2dbb74 tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.223383 Aug 30 16:34:23.472562 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2741/5894] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:23 2022] POST /compute/v2.1/servers => generated 74 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 16:34:23.599354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a304b8e2-4c25-4eab-a73f-3632d2a14f4c tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1173030159", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "max_count": 0}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a304b8e2-4c25-4eab-a73f-3632d2a14f4c tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Request method failure captured: Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 168 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwPNvQnQPbB6D-c3lwhTQzCB5VCD3Bx0y7_tzq2_F-by8axkFVUrTgxC6v4_P4PU6P72OzitI18sJOriaOGoShd_HMdA-VBJi-bpvxwaaP1d0p2oWYaPoL0vSi8uxyEJLrj6NXMCFoveACbpCT4t8jiXppPHUcrNVXpO2zLQ3dkWLI Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}] Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b06da4173f6a4e7da3d6f21b549e5c9c Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1173030159", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "max_count": 0}} Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1173030159', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'max_count': 0}}} Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 0 Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:34:23.603707 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.608624 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.622428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a304b8e2-4c25-4eab-a73f-3632d2a14f4c tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:23.622428 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a304b8e2-4c25-4eab-a73f-3632d2a14f4c tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015761 Aug 30 16:34:23.622793 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2742/5895] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:23.712223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:23.726018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-256fd7b0-880d-4ef4-91f6-fc1b4263e45f tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.418898 Aug 30 16:34:23.729118 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3154/5896] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:23 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:23.836840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffaf9001-9df9-454e-b28f-2088a49cf0ea tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-482910593", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "max_count": 2.5}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffaf9001-9df9-454e-b28f-2088a49cf0ea tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Request method failure captured: Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 169 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwPNvQnQPbB6D-c3lwhTQzCB5VCD3Bx0y7_tzq2_F-by8axkFVUrTgxC6v4_P4PU6P72OzitI18sJOriaOGoShd_HMdA-VBJi-bpvxwaaP1d0p2oWYaPoL0vSi8uxyEJLrj6NXMCFoveACbpCT4t8jiXppPHUcrNVXpO2zLQ3dkWLI Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}] Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b06da4173f6a4e7da3d6f21b549e5c9c Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-482910593", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "max_count": 2.5}} Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-482910593', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'max_count': 2.5}}} Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:34:23.847226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:23.852180 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.857924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffaf9001-9df9-454e-b28f-2088a49cf0ea tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:23.860055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffaf9001-9df9-454e-b28f-2088a49cf0ea tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036419 Aug 30 16:34:23.861191 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2743/5897] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:23.940450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8e03a70-b49b-40e8-be14-50de36d0e53b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-212403318", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 0}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8e03a70-b49b-40e8-be14-50de36d0e53b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Request method failure captured: Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 167 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjwPNvQnQPbB6D-c3lwhTQzCB5VCD3Bx0y7_tzq2_F-by8axkFVUrTgxC6v4_P4PU6P72OzitI18sJOriaOGoShd_HMdA-VBJi-bpvxwaaP1d0p2oWYaPoL0vSi8uxyEJLrj6NXMCFoveACbpCT4t8jiXppPHUcrNVXpO2zLQ3dkWLI Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}] Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b06da4173f6a4e7da3d6f21b549e5c9c Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-212403318", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 0}} Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-212403318', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'min_count': 0}}} Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi 0 Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:34:23.945175 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 16:34:23.951212 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:23.954047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8e03a70-b49b-40e8-be14-50de36d0e53b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:23.955166 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8e03a70-b49b-40e8-be14-50de36d0e53b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021202 Aug 30 16:34:23.957058 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3155/5898] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:24.024921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f0766ce-d1da-4202-a845-a3495c992a8b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1441428991", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 2.5}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f0766ce-d1da-4202-a845-a3495c992a8b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Request method failure captured: Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 170 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwPNvQnQPbB6D-c3lwhTQzCB5VCD3Bx0y7_tzq2_F-by8axkFVUrTgxC6v4_P4PU6P72OzitI18sJOriaOGoShd_HMdA-VBJi-bpvxwaaP1d0p2oWYaPoL0vSi8uxyEJLrj6NXMCFoveACbpCT4t8jiXppPHUcrNVXpO2zLQ3dkWLI Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5b12c666f904e06bc8dea52084c2394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5b12c666f904e06bc8dea52084c2394"}]}] Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a5b12c666f904e06bc8dea52084c2394 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-349256567 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b06da4173f6a4e7da3d6f21b549e5c9c Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-349256567-project Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1441428991", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "min_count": 2.5}} Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1441428991', 'imageRef': 'fa129e8e-aca8-4a84-86f6-93dc1b487325', 'flavorRef': '452', 'min_count': 2.5}}} Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 16:34:24.030156 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f0766ce-d1da-4202-a845-a3495c992a8b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f0766ce-d1da-4202-a845-a3495c992a8b tempest-MultipleCreateNegativeTestJSON-349256567 tempest-MultipleCreateNegativeTestJSON-349256567-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010819 Aug 30 16:34:24.036110 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2744/5899] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:24.120210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a8b030-cb62-49c3-9f5c-7c3c6bf1d199", "name": "network-vif-plugged", "status": "completed", "tag": "8600cdec-2394-47b6-9d7e-870a59c614fd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:24.145753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:24.149918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:24.150494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:24.191900 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] Creating event network-vif-plugged:8600cdec-2394-47b6-9d7e-870a59c614fd for instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 on n-h2-830883-28 Aug 30 16:34:24.200440 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f5225934-e1f6-445d-95f7-ac72a446394f req-4d214e03-5564-4d4c-a155-2f239ee8267c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082035 Aug 30 16:34:24.205176 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3156/5900] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:24.751727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:24.753057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:24.761642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:24.762472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:24.763435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:24.764366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:24.765046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:24.765685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:24.948187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-224446726", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:25.023028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:25.023467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:25.023951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:25.024369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:25.024793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:25.037141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.037649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.038773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.039581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.040060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.040505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.063366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Getting quotas for project f5d53cb3d9934d0ab39c770310d2cfe4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:25.070940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Getting quotas for user 215c0da4ba81427f828636830c787c0b and project f5d53cb3d9934d0ab39c770310d2cfe4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:25.088446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:25.092507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:25.141100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:25.154238 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f03f5e53-fc55-4a23-a468-e8ffe6c3332a tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1313 microversion: 2.1 time: 0.409207 Aug 30 16:34:25.154871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2745/5901] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:24 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:25.172217 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-13905c4b-657a-4c10-9589-76b178230e7d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.386815 Aug 30 16:34:25.175089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3157/5902] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:34:25.186593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:25.187236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:25.330765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:25.354546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:25.371480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:25.382398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4328e9cf-1e0c-4f8d-94ad-cf63d699b875 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 200 len: 1277 microversion: 2.47 time: 0.190700 Aug 30 16:34:25.383847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2746/5903] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:25 2022] GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:25.480542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1906473166", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:25.556950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:25.557451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:25.558083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:25.558716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:25.559147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:25.573631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.574499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.574997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.576071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:25.576801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:25.577596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:25.598890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Getting quotas for project f5d53cb3d9934d0ab39c770310d2cfe4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:25.607340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Getting quotas for user 215c0da4ba81427f828636830c787c0b and project f5d53cb3d9934d0ab39c770310d2cfe4. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:25.632108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:25.635319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:25.718835 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2ed91af2-620f-4292-b043-821ceb82a166 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.242658 Aug 30 16:34:25.727590 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3158/5904] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:34:25.732863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-319e1042-9fb5-4740-922a-72f2bde4f9b0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:25.735521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-319e1042-9fb5-4740-922a-72f2bde4f9b0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:25.861355 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-319e1042-9fb5-4740-922a-72f2bde4f9b0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "PUT /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 992 microversion: 2.47 time: 0.127243 Aug 30 16:34:25.862881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2747/5905] 10.222.0.47 () {62 vars in 1297 bytes} [Tue Aug 30 16:34:25 2022] PUT /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 992 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:34:25.882059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:25.882737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:26.113764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:26.129708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:26.133179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:26.136433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa875b9d-5c05-4d18-82ac-b39899c6bf8a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1278 microversion: 2.47 time: 0.258075 Aug 30 16:34:26.139825 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3159/5906] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:25 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:26.175599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:26.176233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:26.192130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:26.192679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:26.193407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:26.194327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:26.194668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:26.207061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:26.697143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:26.707942 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5549fca3-c1d9-4344-a486-0fd65b16bf99 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1498 microversion: 2.1 time: 0.536833 Aug 30 16:34:26.711688 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2748/5907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:26 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:27.168816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.171428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:27.178384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.185263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.186134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.191960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.192746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.195890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.247300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1042486624", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": "none"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:27.391168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:27.391783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:27.392506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:27.394061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:27.396115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:27.416846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.419455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.424001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.425264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.425944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.426965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.455717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.459953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Getting quotas for project 59c2e1db987c407295d231495821eb74. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:27.470082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.471599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.475061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef5dbdbf-ee34-44b9-89a3-fb1983481b82 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1330 microversion: 2.47 time: 0.312321 Aug 30 16:34:27.486442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Getting quotas for user 4f317539512f473797b1c88adbc530ac and project 59c2e1db987c407295d231495821eb74. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:27.488364 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2749/5908] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:27 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1330 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:27.496064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:27.496064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:27.500545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.501225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:27.509784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.510644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.511508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.512392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.513010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.513612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.556716 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b5fdfa6-ec23-40a5-8cac-ca25d73750e8 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.662557 Aug 30 16:34:27.558731 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3160/5909] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:34:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:34:27.572424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.572587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:27.573590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:27.724273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-15adb6e0-3ad1-4835-ba49-c188b27fbaec tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 204 len: 0 microversion: 2.1 time: 0.233910 Aug 30 16:34:27.725661 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2750/5910] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:27 2022] DELETE /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:27.736194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.745108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.746704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:27.753159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-636713b4-6405-4423-9d3c-ab665229a5a2 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1281 microversion: 2.47 time: 0.187332 Aug 30 16:34:27.753782 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3161/5911] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:27 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:27.772619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.774587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:27.797132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.803796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.804942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.806950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:27.809444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:27.810584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:27.990863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:27.992082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.005533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.006351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.007112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.007900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.008563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.009066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.049294 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be46fc81-69ff-4693-a592-876f6db1e08f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments/43e44de3-deaf-4053-b7b5-7b202254b95f" status: 200 len: 194 microversion: 2.20 time: 0.064105 Aug 30 16:34:28.050734 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3162/5912] 10.222.0.47 () {60 vars in 1454 bytes} [Tue Aug 30 16:34:27 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments/43e44de3-deaf-4053-b7b5-7b202254b95f => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:34:28.073579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.086061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45382e91-3116-4a2c-9bd2-47b05f2bfc76 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1504 microversion: 2.1 time: 0.351595 Aug 30 16:34:28.088538 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2751/5913] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:27 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:28.128747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.130179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.137415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.138153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.138841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.139727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.140369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.140979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.271538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lazy-loading 'services' on Instance uuid 001c8996-5696-42df-9845-1d837dba1e0e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:28.367458 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f628470-968d-4803-9fab-b8b89e297e7f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments/43e44de3-deaf-4053-b7b5-7b202254b95f" status: 202 len: 0 microversion: 2.20 time: 0.243638 Aug 30 16:34:28.368691 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3163/5914] 10.222.0.47 () {60 vars in 1457 bytes} [Tue Aug 30 16:34:28 2022] DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments/43e44de3-deaf-4053-b7b5-7b202254b95f => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:28.378750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.381036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.388495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.389101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.389613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.390444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.390954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.391470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.425855 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a26cf867-561a-4827-ae27-5b64087802dc tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051565 Aug 30 16:34:28.426480 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2752/5915] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:28 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:28.504743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.506047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.512822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.513328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.513771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.514600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.515517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.516237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.778804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:28.779428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:28.788866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.789399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.789853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.792484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:28.793114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:28.793745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:28.815620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:28.832336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.850946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.853923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.856622 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-528a2318-9363-4fef-ae92-3086844a3139 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1338 microversion: 2.47 time: 0.355510 Aug 30 16:34:28.858236 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3164/5916] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:28 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1338 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:28.969035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.988240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:28.995890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:29.000816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-468e33c0-3696-44d7-b443-bc07856b3717 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1285 microversion: 2.47 time: 0.226307 Aug 30 16:34:29.001881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2753/5917] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:28 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:29.111290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:29.112055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:29.116042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:29.122128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.122901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.123350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.124069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.124530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.124960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.359383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:29.368772 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0dda5af-cf84-4842-ba2d-c062e983b44e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1504 microversion: 2.1 time: 0.261495 Aug 30 16:34:29.369369 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3165/5918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:29 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:29.439798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:29.442446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:29.450624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.451207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.451878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.452590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.453047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.453483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.491533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-045bbc5c-e3fc-431e-84d3-0e0528ed7555 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056055 Aug 30 16:34:29.497512 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2754/5919] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:29 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:29.885735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:29.887021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:29.895599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.898735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.899222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.899957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:29.900432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:29.900870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:29.989154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.002738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.005227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.007236 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61e18afa-0efb-4a4d-b942-bb899aeb5614 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1336 microversion: 2.47 time: 0.127002 Aug 30 16:34:30.022399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3166/5920] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:29 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:30.030136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:30.031181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:30.038818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.039766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.040465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.041627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.042914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.044623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.128435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.137111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.138942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.140411 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44c5f77b-1ea6-4c8e-8ce8-9eabbfecae70 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1333 microversion: 2.47 time: 0.116179 Aug 30 16:34:30.141500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2755/5921] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:30 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:30.391603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:30.392418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:30.407194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.408064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.408682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.409573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.410241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.412232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.505524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:30.507782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:30.516981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.517479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.517922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.518668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.519133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.519568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.565228 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2c483343-1de9-410a-ab81-3c9457bae630 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063577 Aug 30 16:34:30.572290 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2756/5922] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:30 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:30.795551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a8b030-cb62-49c3-9f5c-7c3c6bf1d199", "name": "network-vif-deleted", "tag": "8600cdec-2394-47b6-9d7e-870a59c614fd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:30.842359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:30.851522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:30.852935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:30.884378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:30.891804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] Creating event network-vif-deleted:8600cdec-2394-47b6-9d7e-870a59c614fd for instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 on n-h2-830883-28 Aug 30 16:34:30.897953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9fe5797-6e53-4560-84b4-b282a132f5da tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1504 microversion: 2.1 time: 0.510474 Aug 30 16:34:30.900254 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3167/5923] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:30 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:30.903272 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-32ac68ca-f614-4a7f-ae59-5bbb8117dab8 req-aa7ed78d-2f0c-4646-9521-de1e8568cdc2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112510 Aug 30 16:34:30.904584 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2757/5924] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:30.996035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:30.999114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.012492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.013092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.013604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.014988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.016793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.019029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.033798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:31.035439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.061629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.063615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.064794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.066235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.067299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.068627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.195145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.211893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.213202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.214832 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83616e91-c477-4813-9959-9809686a60f4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1336 microversion: 2.47 time: 0.185598 Aug 30 16:34:31.216577 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2758/5925] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:31 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:31.232104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:31.232737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.240262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.240758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.241196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.241925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.242405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.243424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.318079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.330792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.333045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:31.334491 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9200390c-c355-499c-a5b1-795ee247881d tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1339 microversion: 2.47 time: 0.116190 Aug 30 16:34:31.335292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2759/5926] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:31 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:31.397484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c1f27d1-1fe1-4438-9cda-f300ffc0787f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action" status: 200 len: 24571 microversion: 2.1 time: 0.405769 Aug 30 16:34:31.408781 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3168/5927] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:34:30 2022] POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action => generated 24571 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:34:31.578647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:31.580862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.597180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.597682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.598124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.598865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.599322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.600173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.668325 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-90e31f60-b14b-4b18-a2ee-516383982b58 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093684 Aug 30 16:34:31.669868 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2760/5928] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:31 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:31.926804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:31.927608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:31.938160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.939514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.940139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.940990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.941560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.942096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.950382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:31.990801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:31.991479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:31.992021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:31.992585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lazy-loading 'fault' on Instance uuid 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:32.213367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.234961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c94c8a87-1f07-4e6d-9a9d-2dc732a52a4d tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1303 microversion: 2.1 time: 0.308735 Aug 30 16:34:32.246321 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3169/5929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:31 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1303 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:32.255753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:32.256653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.264532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.265394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.265941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.268678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.269581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.269925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.361365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:32.363183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.363862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.373981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.374192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.374778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.375648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.376120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.376853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c685dcb0-a507-4cb7-8bf6-cf12e13a8b2b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1357 microversion: 2.47 time: 0.128052 Aug 30 16:34:32.386514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.386514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.386514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.386836 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2761/5930] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:32 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:32.400465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:32.408585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.437537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.438043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.438943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.439721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.440185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.440750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.500447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.514406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.517330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.522140 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-899351da-9132-45e7-a1b4-dcd96fd4a878 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1339 microversion: 2.47 time: 0.166787 Aug 30 16:34:32.522709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3170/5931] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:32 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1339 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:32.590957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:32.591503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:32.591869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:32.592290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:32.592713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:32.672519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.682215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:32.682748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.683381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.683837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.684612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.684779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.685081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.685625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.696767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.697276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.697726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.700651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.700966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.701410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.751332 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31d59c2c-78c8-4f3f-8bc4-df7f2975dc23 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "POST /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9/action" status: 202 len: 1079 microversion: 2.47 time: 0.354720 Aug 30 16:34:32.764782 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2762/5932] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:34:32 2022] POST /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9/action => generated 1079 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 30 16:34:32.770955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:32.771574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:32.776160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-879f6e88-1a82-4ec1-969d-6866a4a09b78 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098744 Aug 30 16:34:32.783821 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3171/5933] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:32 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:34:32.788556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.789080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.789520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.790262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:32.792770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:32.793328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:32.901849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.927461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.939182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:32.944004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-493ed601-4eec-498c-a066-d4859a42fa5b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.175353 Aug 30 16:34:32.946568 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2763/5934] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:32 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:33.262515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:33.263682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:33.272307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.272821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.273265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.274686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.274686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.274906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.338366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.339476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.340079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.340768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lazy-loading 'fault' on Instance uuid 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:33.414944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:33.430475 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a08d9b4-17ee-468c-82f7-651c7b5d8f00 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1303 microversion: 2.1 time: 0.173779 Aug 30 16:34:33.460380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3172/5935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:33 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:33.547564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:33.548504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:33.554972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.555466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.555903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.556603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.557083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.558770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.690429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:33.700741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:33.702598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:33.703825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88cb96b9-11b3-4d69-a5eb-d16d458ac9dd tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1339 microversion: 2.47 time: 0.160434 Aug 30 16:34:33.704789 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2764/5936] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:33 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:33.796895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:33.799115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:33.820122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.820612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.821062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.821786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.822254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.822718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.855937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3798e5c-16d6-4a09-8a0f-5e400a466fe3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063076 Aug 30 16:34:33.861939 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3173/5937] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:33 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:33.977452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:33.978078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:33.985994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.986604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.987053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:33.987760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:33.988218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:33.988807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.222031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.231515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.233232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.235039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3411196d-ea30-48a8-9203-d5d428a496a0 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.261721 Aug 30 16:34:34.235614 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2765/5938] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:33 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:34.454796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:34.455680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:34.462529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.463228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.463737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.465238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.465938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.466545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.502141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.503147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.503813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.504490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lazy-loading 'fault' on Instance uuid 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:34.566028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.582227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0168bc6-2ce7-4de6-8a9b-d303b7e3a0ce tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 200 len: 1303 microversion: 2.1 time: 0.130757 Aug 30 16:34:34.583816 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3174/5939] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:34 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:34.730353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:34.731757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:34.742619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.743815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.744515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.746506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.747659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.748463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.870119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:34.873367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:34.880948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.882374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.882374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.883230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:34.883910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:34.884597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:34.905673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.915403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.919180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:34.922197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f60f0937-915a-4a15-b8de-1e35a9e57590 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1339 microversion: 2.47 time: 0.196874 Aug 30 16:34:34.940402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2766/5940] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:34 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1339 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:34.959271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7609e722-0cc9-422e-8253-d0703e30c4fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.093904 Aug 30 16:34:34.960137 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3175/5941] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:34:34 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:35.059853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:35.060547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:35.075184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.077720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.082727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.083794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.084502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.085173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.143765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:35.176103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:35.259827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:35.260650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:35.272841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.274754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.290030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.292781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.293976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.294146 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d4e82af-57ef-4a9e-9b7d-834da11775d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 204 len: 0 microversion: 2.20 time: 0.239051 Aug 30 16:34:35.294754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.294899 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2767/5942] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:34:35 2022] DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:34:35.309709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:35.312541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:35.325510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.326010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.326483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.327198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.327650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.328076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.345960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:35.403659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.413236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.415347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.416802 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74bc6b0a-5e7f-4e40-a48d-086a32d7acb7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.162088 Aug 30 16:34:35.435256 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3176/5943] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:35 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:35.605128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:35.605854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:35.617376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.623891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.624683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.625546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.626131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.626688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.652759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] HTTP exception thrown: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Request method failure captured: Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 HTTP/1.1 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjv8CCl8UEsCatWW_hhq5FissA1y-7J283xzNvZGYPPYkiW-rq4PVVDUoHiy4GJagvaibYXoenu73EPBSHusClSh2p1x1Kai6kEoyoMg7umN96yVT6jTS3rad_vCDuahW3rpfOIYqVtmhQISPGbpGsjb67_6adTLap4XLHGcnWNljx4 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 983c5bbb2f584ac19d0e70a22428efdf Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesActionsTest-604404350 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/983c5bbb2f584ac19d0e70a22428efdf"}]}] Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesActionsTest-604404350 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 983c5bbb2f584ac19d0e70a22428efdf Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesActionsTest-604404350 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesActionsTest-604404350-project Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 36318839f45e47bf89e511fbfcd31d62 Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesActionsTest-604404350-project Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '80a8b030-cb62-49c3-9f5c-7c3c6bf1d199'} Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:35.657667 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:35.662473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Returning 404 to user: Instance 80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:35.663643 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3126d60d-5edc-44a2-9bc9-92f021439be9 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199" status: 404 len: 111 microversion: 2.1 time: 0.063519 Aug 30 16:34:35.667807 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3177/5944] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:35 2022] GET /compute/v2.1/servers/80a8b030-cb62-49c3-9f5c-7c3c6bf1d199 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:34:35.686557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.702453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.703978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:35.705333 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b8a7056-d14a-4f74-9d4c-627bba6093c3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.403420 Aug 30 16:34:35.706285 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2768/5945] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:35 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:35.797766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1957356897", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "17d598af-0316-49ff-9919-2ad780280d43"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:35.868573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] validate_networks() for [('17d598af-0316-49ff-9919-2ad780280d43', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:34:35.950127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:35.950886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:35.960031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.961027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.961935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:35.963142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:35.964394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:35.965378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.078061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.092294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.093906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.098104 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c115b81-c3cb-40d9-8a02-c4fad0e38c6f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1360 microversion: 2.47 time: 0.152768 Aug 30 16:34:36.099118 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2769/5946] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:35 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:36.126219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-762123713"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:36.128915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:36.142137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.144628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.145180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.146668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.148488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.149572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.471173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d05b91a8-e3bb-4349-9b3f-c1bae6224097 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "POST /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e/action" status: 202 len: 52 microversion: 2.47 time: 0.348665 Aug 30 16:34:36.478792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2770/5947] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:34:36 2022] POST /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e/action => generated 52 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:34:36.485586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:36.487699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:36.496088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.496825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.497281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.498138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.499105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.499830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.627954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.662338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.677433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:36.679072 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19a43ab1-1b22-434f-bc82-b11cb5bc2a5c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.198114 Aug 30 16:34:36.682792 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2771/5948] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:36 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:36.697700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:36.700911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:36.716457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.718964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.719504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.722371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.723920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.725795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.795026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:36.897942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:36.912772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:36.913296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:36.913676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:36.914098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:36.915002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:36.925179 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd5c6ed3-cda8-4718-b47a-d947aefe5d4f tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "DELETE /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 204 len: 0 microversion: 2.47 time: 0.240094 Aug 30 16:34:36.925810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2772/5949] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:34:36 2022] DELETE /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:34:36.932750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:36.933975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:36.934487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.941562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.942057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.942557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.942692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.943138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.943936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.943936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.944120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:36.944308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:36.944431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:36.945005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:37.002956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Getting quotas for project 983c5bbb2f584ac19d0e70a22428efdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:37.009211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Getting quotas for user 36318839f45e47bf89e511fbfcd31d62 and project 983c5bbb2f584ac19d0e70a22428efdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:37.036665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:37.039151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:37.185175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a737a6d4-e0d7-49e2-ac2e-7727f1a2b7d8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391156 Aug 30 16:34:37.189602 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3178/5950] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:34:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:34:37.197316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:37.199181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:37.212678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:37.215519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:37.216185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:37.222338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:37.224023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:37.225887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:37.460053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.473395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.490352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.492367 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8427759-aaea-4066-a590-8c4a0b05bbaf tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1366 microversion: 2.47 time: 0.301488 Aug 30 16:34:37.493514 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3179/5951] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:37 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:37.499998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c7760ac-fa5d-4e7e-90d9-a83825fc1cd2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:37.501446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c7760ac-fa5d-4e7e-90d9-a83825fc1cd2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:37.559903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.576304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.577771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.582454 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f85ce9a-d164-42e7-bef2-61d2f6020e3c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.652040 Aug 30 16:34:37.583163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2773/5952] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:36 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:37.642348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c7760ac-fa5d-4e7e-90d9-a83825fc1cd2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.660502 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c7760ac-fa5d-4e7e-90d9-a83825fc1cd2 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1214 microversion: 2.1 time: 0.157984 Aug 30 16:34:37.661593 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3180/5953] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:37 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:37.705555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:37.706470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:37.713115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:37.714425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:37.715219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:37.716094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:37.716807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:37.717401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:37.947599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.959618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.961138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:37.962593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a209da52-13ac-4fa1-a4d5-1c04e8cf449d tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.260737 Aug 30 16:34:37.962872 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2774/5954] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:37 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:38.524572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:38.525122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:38.535291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.536613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.537373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:38.538258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.538905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.539500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:38.609279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:38.610185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:38.633568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.635381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.637679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:38.638794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.639364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.639896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:38.668597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:38.685132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:38.702288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:38.704295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cf8ed18-aaa3-4b0c-93ef-a944c134ba83 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1366 microversion: 2.47 time: 0.184033 Aug 30 16:34:38.705359 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3181/5955] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:38 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:38.715552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:38.716591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:38.751526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.752819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.754564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:38.756528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:38.757567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:38.759172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:39.206533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.223669 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b58e60f4-604b-4e44-82a7-dd4405aa8836 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1218 microversion: 2.1 time: 0.512573 Aug 30 16:34:39.224348 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3182/5956] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:38 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1218 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:39.237080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:39.240664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:39.259537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:39.260055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:39.260578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:39.261318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:39.267992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:39.268747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:39.484314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.504427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.509042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.511717 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e952c64-e7f6-4890-85eb-4f7b24357af5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1723 microversion: 2.20 time: 0.909443 Aug 30 16:34:39.514039 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2775/5957] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:38 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1723 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:39.527350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.545654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.549951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.552855 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a6063c55-a73e-4eec-8a10-1f968de53330 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.326768 Aug 30 16:34:39.556007 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3183/5958] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:39 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:39.734262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:39.736245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:39.749561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:39.750934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:39.754946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:39.756849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:39.760204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:39.760948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:39.857974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.869312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.872797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:39.875245 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7e2185ec-4caa-4e47-8822-7eb7d70cb672 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1366 microversion: 2.47 time: 0.150262 Aug 30 16:34:39.876802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2776/5959] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:39 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:40.248311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:40.250197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:40.264699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.265569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.266586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.267589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.268287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.268971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.406245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.425897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04ae3ce4-32a4-4b39-9a3f-dcee8f70c3e8 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1284 microversion: 2.1 time: 0.180858 Aug 30 16:34:40.441612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3184/5960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:40 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:40.518811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001c8996-5696-42df-9845-1d837dba1e0e", "name": "network-vif-deleted", "tag": "8dea96cf-f305-4614-a27f-56dfb9125265"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:40.539629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:40.540252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:40.555023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.555852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.556494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.557455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.558102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.558846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.567334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.567840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.568291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.606502 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] Creating event network-vif-deleted:8dea96cf-f305-4614-a27f-56dfb9125265 for instance 001c8996-5696-42df-9845-1d837dba1e0e on n-h2-830883-28 Aug 30 16:34:40.623618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-74d7c636-9822-4141-ad6a-3139ba381e92 req-5e73e836-55e4-4209-a900-b1add4c91657 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105222 Aug 30 16:34:40.627393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2777/5961] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:40.635045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:40.640512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:40.654376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.654893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.675867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.677159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.677674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.678110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.731695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.744427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.753011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.755598 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-efb8df6f-3710-408d-8a35-dc79d084d058 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 200 len: 1366 microversion: 2.20 time: 0.220269 Aug 30 16:34:40.759963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3185/5962] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:40 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:40.846154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.856826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.858556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:40.859761 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-54ece407-e31a-4c57-ae7c-0a0732234e67 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.231152 Aug 30 16:34:40.871694 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2778/5963] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:40 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:40.904195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:40.904742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:40.914918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.918104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.918597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:40.922213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:40.922743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:40.923715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.018393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.019160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.023221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.023935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lazy-loading 'fault' on Instance uuid be06a44c-71a9-4cc5-ae29-4207ef421a1e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:34:41.156519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:41.160714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:41.172974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:41.175282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f317539512f473797b1c88adbc530ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c2e1db987c407295d231495821eb74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:41.177351 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe057b44-8655-4cc4-8790-08bcb0240b53 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 200 len: 1371 microversion: 2.47 time: 0.279928 Aug 30 16:34:41.191769 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3186/5964] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:40 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:41.453187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:41.454225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:41.468521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.469406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.470429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.471440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.472160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.472769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.671342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:41.689494 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5bc426c2-c285-4620-b622-8af0b6f83c51 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1272 microversion: 2.1 time: 0.242711 Aug 30 16:34:41.706544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2779/5965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:41 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:41.786950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:41.788373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:41.814465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.816139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.817306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.820090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.820719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.821272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.843763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e HTTP/1.1 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '001c8996-5696-42df-9845-1d837dba1e0e'} Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:41.845745 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:34:41.849590 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:34:41.852211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:41.855408 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d169dda2-d146-4ab5-8ed7-9cc8ad58d3e8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 404 len: 111 microversion: 2.20 time: 0.073024 Aug 30 16:34:41.856572 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3187/5966] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:41 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:41.871740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73737c69-b59e-4e97-9e5a-8578bbeaae01 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '.version_select at 0x7fd35d4bd280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:41.884352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:41.884981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:41.902788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.903299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.903750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.904498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:41.904962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:41.905476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:41.922415 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73737c69-b59e-4e97-9e5a-8578bbeaae01 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450234330" status: 204 len: 0 microversion: 2.20 time: 0.060756 Aug 30 16:34:41.923327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2780/5967] 10.222.0.47 () {60 vars in 1259 bytes} [Tue Aug 30 16:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450234330 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:34:42.019947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:42.040642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:42.050932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:42.057635 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47e747f8-e056-495a-b732-383e3b436743 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.177195 Aug 30 16:34:42.061654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3188/5968] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:41 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:42.224099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:42.226212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] [instance: be06a44c-71a9-4cc5-ae29-4207ef421a1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:42.242954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.243174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.247448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:42.248211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.248728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.249168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:42.274021 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] HTTP exception thrown: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Request method failure captured: Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e HTTP/1.1 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwSBQ6l8dW5bTmbLWI9ymgZL0-j8HAWdCpjfZ1rCWs_8CJYO447eqfMrWWMbPaVdQd8f--czTYFxDnWXFLO__gZcTlH0YReL0Rr1NcMf3uwRqLubp_-3cVvTavFMXPg5GC2EjX54b9gUKJ34oubSIzQGSOKoJPe3N1tBM9EK-ciItw Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 59c2e1db987c407295d231495821eb74 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAaction247Test-1341279026 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/59c2e1db987c407295d231495821eb74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_59c2e1db987c407295d231495821eb74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/59c2e1db987c407295d231495821eb74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/59c2e1db987c407295d231495821eb74"}]}] Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAaction247Test-1341279026 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 59c2e1db987c407295d231495821eb74 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAaction247Test-1341279026 Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAaction247Test-1341279026-project Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 4f317539512f473797b1c88adbc530ac Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAaction247Test-1341279026-project Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'be06a44c-71a9-4cc5-ae29-4207ef421a1e'} Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:42.276150 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. Aug 30 16:34:42.280243 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:34:42.282100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] Returning 404 to user: Instance be06a44c-71a9-4cc5-ae29-4207ef421a1e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:34:42.283316 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47615caa-9cca-4f81-8601-667b88d32464 tempest-ServersAaction247Test-1341279026 tempest-ServersAaction247Test-1341279026-project] 10.222.0.47 "GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e" status: 404 len: 111 microversion: 2.47 time: 0.073986 Aug 30 16:34:42.284511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2781/5969] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:42 2022] GET /compute/v2.1/servers/be06a44c-71a9-4cc5-ae29-4207ef421a1e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:34:42.339740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:42.340698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:42.350484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.351322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.352007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:42.355969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.356458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.356894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:42.720031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:42.721559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:42.742403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.743258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.744029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:42.746665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:42.747361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:42.748369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.072198 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89e9367a-58c0-4ae8-8d98-5b03df6816e1 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1834 microversion: 2.1 time: 0.735938 Aug 30 16:34:43.086733 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3189/5970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:42 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1834 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:43.096959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:43.097876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:43.110241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.111117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.111712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.112600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.113221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.113808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.220457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:43.233220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:43.237771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:43.239068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-300518f8-3019-44f2-b6aa-2c6d69afa40b tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.150996 Aug 30 16:34:43.239658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3190/5971] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:43 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:43.258570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:43.259684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:43.268925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.269419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.274680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.276031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.279101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.281219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.618493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:43.623672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:43.625362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:43.629360 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b67a77a-7256-4f47-ba2d-781c41dc567c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1681 microversion: 2.1 time: 0.384725 Aug 30 16:34:43.646468 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-025f5b4d-6220-4481-b4d2-ecd0426ecc69 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.928343 Aug 30 16:34:43.647501 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3191/5972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:43 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1681 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:43.650707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2782/5973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:42 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:43.820469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:43.825923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:43.832845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.833660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.834361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.835068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:43.835682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:43.836117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:43.922255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33065a23-bd1b-4413-8df3-b0e151a95575 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action" status: 200 len: 32639 microversion: 2.1 time: 0.108383 Aug 30 16:34:43.929630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3192/5974] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:34:43 2022] POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action => generated 32639 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:34:44.072210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:44.073992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:44.085376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.086387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.087116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.088086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.089845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.091245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.163224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a4433ac51af84417a606c829a853ea41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5781dd6afafc47ba9449c8e6a04f6c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:44.164621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] flavor_id is None. Assuming migration. {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4206}} Aug 30 16:34:44.166724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:34:44.268087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:44.269785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:44.286591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.287270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.287904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.288615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.289079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.289503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.373352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bab3a579-5f30-4e90-b66f-891ebf1c1516 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action" status: 202 len: 0 microversion: 2.1 time: 0.304054 Aug 30 16:34:44.389132 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2783/5975] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:34:44 2022] POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:34:44.396490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:44.397345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:44.405119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.406108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.407656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.409008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.409833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.410645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.771758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:44.786319 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-676f5f4a-aa34-46fd-9e48-e14bea7de796 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1690 microversion: 2.1 time: 0.392021 Aug 30 16:34:44.789419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2784/5976] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:44 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1690 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:44.796461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:44.800900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:44.815656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.816163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.816631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.817344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:44.817785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:44.820989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:44.974160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:44.988421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:44.991835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:44.993350 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70b626a0-d450-40a3-a72d-c7baeb629b96 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.729312 Aug 30 16:34:45.007163 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3193/5977] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:44 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:45.007163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: .version_select at 0x7fd35c352af0>, body: {"keypair": {"name": "tempest-keypair-1641958650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVUKS6wtdjmcXdpwNWbfK3ebssj7lpxMBJsQjnD/ch6gDFCEOalB6WT+vL3xAxNI1KQPp5G/H3t+i5XSKUXsGnk9fgW+7xrUcM4Qzl91vkmSYytWkEvXPtvz2ZP+CeoXA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:45.024033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for project fe02a8ef9802492eb1451995202d3eb7. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:45.031158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for user f0510a99bf7f44958e978e7c9dba41ae and project fe02a8ef9802492eb1451995202d3eb7. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:45.080274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.084510 Aug 30 16:34:45.081592 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3194/5978] 10.222.0.47 () {62 vars in 1200 bytes} [Tue Aug 30 16:34:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:34:45.085236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:45.086827 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e57eb8b7-b7f8-46ff-93e8-bf74b5888c2a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001874 Aug 30 16:34:45.095907 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3195/5979] 10.222.0.47 () {56 vars in 886 bytes} [Tue Aug 30 16:34:45 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 16:34:45.103857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3237e3f-4cd7-41f7-9f9d-57678c58fde3", "tag": "7b399a01-6e4e-4f87-87bb-d088972a1191"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:45.127385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:45.127881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:45.129122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:45.153607 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] Creating event network-changed:7b399a01-6e4e-4f87-87bb-d088972a1191 for instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 on n-h2-830883-28 Aug 30 16:34:45.162686 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-dc6f64ad-ba72-4cef-b88e-890c1aadb68e req-48cd607f-5c76-477f-aa81-3118a5b3e42d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070201 Aug 30 16:34:45.165003 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3196/5980] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:45.292945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:45.308043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-655bb75b-6a4b-4ecb-9bc6-51fdc84a2b44 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.516030 Aug 30 16:34:45.310746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2785/5981] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:44 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:45.816478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:45.817185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:45.826756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:45.827258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:45.827700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:45.829186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:45.829817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:45.830253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:46.024561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:46.029203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:46.052780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:46.053541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:46.056449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:46.057677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:46.059127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:46.061862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:46.278107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:46.297852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:46.299867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:46.307566 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-06d2d2de-4a05-424d-bdfd-d565efbdf9ef tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.290976 Aug 30 16:34:46.309083 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2786/5982] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:46 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:46.333236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:46.334059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:46.341431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:46.342899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:46.343762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:46.344786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:46.345436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:46.346068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:46.347542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:46.363164 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-91659278-2d08-475a-8edb-eed65abcda23 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1690 microversion: 2.1 time: 0.552030 Aug 30 16:34:46.364398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3197/5983] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:45 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1690 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:46.676111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:46.703634 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ac60d94-e445-4c07-b322-1c0c6cde33a3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.374963 Aug 30 16:34:46.714284 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2787/5984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:46 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:47.334991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:47.336647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:47.340177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:47.352703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.357673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.358568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.359621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.360318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.361584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.392652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:47.394019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:47.403290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.403951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.404401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.405111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.405566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.406097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.544062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:47.555423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:47.559829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:47.561219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b287177e-a7cb-4fda-a6d6-9f9cb3e9586a tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.231614 Aug 30 16:34:47.570668 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3198/5985] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:47 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:47.704419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:47.718178 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec33f168-5528-414a-80e3-15263de246a2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1690 microversion: 2.1 time: 0.332293 Aug 30 16:34:47.725916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:47.726791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:47.729943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:47.734254 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2788/5986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:47 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1690 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:47.738761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.739253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.739783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.740376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:47.740830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:47.741258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:47.741471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-746916741", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6dd13832-f3aa-4b56-96ad-423786bd5f53"}], "security_groups": [{"name": "tempest-securitygroup--1468373326"}], "key_name": "tempest-keypair-1641958650", "user_data": "}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:47.977566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] validate_networks() for [('6dd13832-f3aa-4b56-96ad-423786bd5f53', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:34:48.154022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:48.168845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b69f538-ec6b-4cb5-bfec-feab183f2231 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.440453 Aug 30 16:34:48.169842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3199/5987] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:47 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:48.589909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:48.591518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:48.602446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:48.603316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:48.604755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:48.605731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:48.606587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:48.607439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:48.760084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:48.778944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:48.780513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:48.783043 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eda229ef-92a7-4cc5-9bca-e07893569e3c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.199152 Aug 30 16:34:48.783796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3200/5988] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:48 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:48.791002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:48.792638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:48.806478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:48.808137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:48.808842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:48.810532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:48.811334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:48.812154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.355443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.367884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c2cd969-6f25-4c28-8494-269e6df66a6f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1690 microversion: 2.1 time: 0.582861 Aug 30 16:34:49.369125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3201/5989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:48 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1690 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:49.398647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:49.399691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:49.407820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.408578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.409216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.410258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.411013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.411664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.435149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:34:49.435742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:34:49.436371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:34:49.436928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:34:49.437552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:34:49.449627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.450266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.450954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.451761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.452313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.452811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.472086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for project fe02a8ef9802492eb1451995202d3eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:34:49.477453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Getting quotas for user f0510a99bf7f44958e978e7c9dba41ae and project fe02a8ef9802492eb1451995202d3eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:34:49.490969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:34:49.493653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:34:49.545736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0afbbfe3-6f9d-48e7-a00c-823440d0e271 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.809485 Aug 30 16:34:49.546431 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2789/5990] 10.222.0.47 () {62 vars in 1188 bytes} [Tue Aug 30 16:34:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 16:34:49.558016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:49.559217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:49.619138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.629277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.630856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.632911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9bc3fd21-cec0-47e8-b08f-dfabd14fd2f4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1281 microversion: 2.20 time: 0.078671 Aug 30 16:34:49.633864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2790/5991] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:49 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:49.810163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:49.811038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:49.820661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.821148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.821764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.823315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:49.824004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:49.824621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:49.882758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.896365 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d20fce55-e541-4a61-9e2d-b879cd9572c4 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.524730 Aug 30 16:34:49.897230 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3202/5992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:49 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:49.919860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.935915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.937366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:49.938889 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6c99ca2-cbc7-4c55-965e-3abb593c9ea7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.134890 Aug 30 16:34:49.939420 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2791/5993] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:49 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:50.061341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2ce5f2a-8006-4f64-acf9-06690bad5793 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35c44e0d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:50.138919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2ce5f2a-8006-4f64-acf9-06690bad5793 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2fe862a6-6357-4c4b-8e3b-2b84c56e28a2" status: 200 len: 351 microversion: 2.1 time: 0.082159 Aug 30 16:34:50.139860 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3203/5994] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:34:50 2022] GET /compute/v2.1/os-volumes/2fe862a6-6357-4c4b-8e3b-2b84c56e28a2 => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:50.393255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:50.393899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:50.424662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.428592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.431697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.434923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.440824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.441383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.665228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:50.669775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:50.678130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.692908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.696086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.698225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.704542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.709850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.852291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:50.861371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:50.862852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:50.863987 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c522dd97-9e1f-4244-a28b-02157100831c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1333 microversion: 2.20 time: 0.210745 Aug 30 16:34:50.874728 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3204/5995] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:50 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1333 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:50.917388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:50.917953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:50.935928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.936572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.937325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.938274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:50.939268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:50.939948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:50.951148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:50.970620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80fa42cf-0488-46d9-a3bb-52bf417ea477 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1690 microversion: 2.1 time: 0.581725 Aug 30 16:34:50.971223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2792/5996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:50 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1690 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:50.981921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:50.982578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:50.996955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:51.006655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:51.007419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:51.009104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:51.009765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:51.011319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:51.236203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:51.248587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-972dbe32-8053-4fc0-b131-f1d5dc5299b3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.335235 Aug 30 16:34:51.251636 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3205/5997] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:50 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:51.365476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:51.377911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:51.379435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:51.380649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da9debe0-86f1-477c-ac6c-2b8623962d98 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.405310 Aug 30 16:34:51.381216 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2793/5998] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:50 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:51.891366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:51.893950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:51.910947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:51.911661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:51.912308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:51.913977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:51.918615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:51.919147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:51.992408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:51.993033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:52.005184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.009631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.010701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.011732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.012210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.012646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.086483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.095956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.100241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.103314 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee10dc2f-b789-44ca-8345-69c9f604639b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1339 microversion: 2.20 time: 0.219332 Aug 30 16:34:52.105244 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3206/5999] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:51 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1339 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:52.272903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:52.273713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:52.280123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.280918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.281527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.283225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.284055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.284658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.434959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.449352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e027a58-383d-470e-9085-5d9f5e1eab15 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.460643 Aug 30 16:34:52.450711 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2794/6000] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:51 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:52.456573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3237e3f-4cd7-41f7-9f9d-57678c58fde3", "name": "network-vif-plugged", "status": "completed", "tag": "7b399a01-6e4e-4f87-87bb-d088972a1191"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:52.469921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.470418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.470860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.483593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] Creating event network-vif-plugged:7b399a01-6e4e-4f87-87bb-d088972a1191 for instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 on n-h2-830883-28 Aug 30 16:34:52.489955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-af846acb-d4a6-4ba8-9074-b8fbfdf93f91 req-a6651e38-cdd5-433d-bc3a-272be6b19027 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037036 Aug 30 16:34:52.491534 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2795/6001] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:52.498076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:52.499035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:52.505574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.505980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.506656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.507363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:52.507820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:52.508253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:52.681571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.695588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.698782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.700777 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2a529ccb-bd35-476d-ba85-b40755b64874 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.207325 Aug 30 16:34:52.701729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2796/6002] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:52 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:52.858221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:52.871803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-93f2d2b1-2ec6-4bd3-83f6-7f109d55c362 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.603467 Aug 30 16:34:52.872945 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3207/6003] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:52 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:52.961792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94af5af6-85a6-4c7a-9595-7622a67d4358 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd360fee550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:53.062569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94af5af6-85a6-4c7a-9595-7622a67d4358 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ad502421-ab97-48bd-89e0-079ea9fc2ff4" status: 200 len: 351 microversion: 2.1 time: 0.104723 Aug 30 16:34:53.063187 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2797/6004] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:34:52 2022] GET /compute/v2.1/os-volumes/ad502421-ab97-48bd-89e0-079ea9fc2ff4 => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:53.130774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:53.131620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:53.143802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.148971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.151705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:53.152723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.153876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.157417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:53.196255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:53.443135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:53.456116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:53.468340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:53.470975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e24609b9-748c-4d68-b29d-14ded0b63e84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.342580 Aug 30 16:34:53.474185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:53.474956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:53.475191 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3208/6005] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:53 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:53.493050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.493572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.494026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:53.498141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.501288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.501699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:53.724936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:53.731440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:53.748584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.749093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.749535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:53.750436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:53.750897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:53.751326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:54.002620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:54.020648 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e1b19af-78e4-4c73-ab5c-5817bcc32c14 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.552430 Aug 30 16:34:54.026268 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2798/6006] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:53 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:54.042856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:54.046700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:54.061174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:54.061649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:54.062103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:54.062859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:54.063661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:54.069559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:54.085048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:54.100113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:54.101904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:54.103582 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eb156a18-abac-4463-aeef-b12d3e043f9f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.382830 Aug 30 16:34:54.104912 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3209/6007] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:53 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:54.501237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:54.502899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:54.512842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:54.514399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:54.515083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:54.515990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:54.516703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:54.517299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:54.669201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:54.694111 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30d74762-efb9-49da-a208-7afb68f772db tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1314 microversion: 2.1 time: 0.666613 Aug 30 16:34:54.701527 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2799/6008] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:54 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:55.047076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:55.047707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:55.049651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=34 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:55.068572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.069416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.069992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.071071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.071721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.073217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.089679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.109450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.113188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.114680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd0a1f6c-9c44-41d7-befa-702ad219409d tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.624295 Aug 30 16:34:55.116887 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3210/6009] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:54 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:55.149807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:55.150938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:55.173337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.173866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.178900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.181362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.185679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.188890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.302655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.322487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.333895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.337106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b2a5ba3-68c5-4b3a-a973-3ff7c486c7b2 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.201458 Aug 30 16:34:55.340232 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3211/6010] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:55 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:55.498248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:55.535109 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-45884e35-dacd-440b-bc99-c6a0d9cf84b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.490415 Aug 30 16:34:55.538647 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2800/6011] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:55 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:55.583663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:34:55.604506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.605975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.608156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.623637 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] Creating event network-changed:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:34:55.630849 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-79069f22-f150-4fab-8069-6175e63d85dd req-4fbf2b64-61e0-4018-b5a4-f50987f85169 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059212 Aug 30 16:34:55.632156 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3212/6012] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:55.725534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:55.726494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:55.746507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.748672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.750916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.751840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:55.754522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:55.754978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:55.771787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:55.824246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-44dba2c0-64cd-4aa5-bef7-5d9a34c44061 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35c4d6ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:55.882209 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-44dba2c0-64cd-4aa5-bef7-5d9a34c44061 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/b28c538c-241c-45b3-b2ca-30cdaa7b48d3" status: 200 len: 351 microversion: 2.1 time: 0.062299 Aug 30 16:34:55.885352 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3213/6013] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:34:55 2022] GET /compute/v2.1/os-volumes/b28c538c-241c-45b3-b2ca-30cdaa7b48d3 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:55.903712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-396f9500-a9e6-402a-b341-d7572c948b3b tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35cce4af0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.043887 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-396f9500-a9e6-402a-b341-d7572c948b3b tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.148355 Aug 30 16:34:56.044471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3214/6014] 10.222.0.47 () {58 vars in 1134 bytes} [Tue Aug 30 16:34:55 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:56.060774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3257a5bd-0f3d-498e-a321-03400aa17524 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35c4d4c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.175194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3257a5bd-0f3d-498e-a321-03400aa17524 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.119006 Aug 30 16:34:56.186666 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3215/6015] 10.222.0.47 () {58 vars in 1149 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:34:56.193804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.197196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:56.205908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.207888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.208535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.209457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.210118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.210929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.250964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.259642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0926257-968b-4118-a3de-784409e196b7 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1499 microversion: 2.1 time: 0.539477 Aug 30 16:34:56.278590 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2801/6016] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:55 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1499 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:56.298090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f70b82f9-b68c-45a6-bf61-c041aa6d6d50 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35d735e50>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.464812 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f70b82f9-b68c-45a6-bf61-c041aa6d6d50 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.184586 Aug 30 16:34:56.465414 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2802/6017] 10.222.0.47 () {58 vars in 1134 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:56.478590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.480290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:56.487070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.487960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.488609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.489545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.490163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.490792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.633952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.652367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.654665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.660529 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-932325d3-6a70-4fea-a396-45170857f07e tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.182481 Aug 30 16:34:56.661388 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2803/6018] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:56.676204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5838b307-0493-4e46-9730-5d2dd003988d tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35d547a60>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.712598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.733649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.735216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:56.736950 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e063558-1ab4-4f1e-bf6a-8d40297543c4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.548883 Aug 30 16:34:56.746400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3216/6019] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:56.747735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.749277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:56.777382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.778133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.778819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.779890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:56.780565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:56.782055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:56.828383 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5838b307-0493-4e46-9730-5d2dd003988d tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165212 Aug 30 16:34:56.829260 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2804/6020] 10.222.0.47 () {58 vars in 1167 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:56.843578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f4933aaf-146f-43db-8dc8-b0145b178b05 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35cd78310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:56.962523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f4933aaf-146f-43db-8dc8-b0145b178b05 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.122663 Aug 30 16:34:56.963899 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2805/6021] 10.222.0.47 () {58 vars in 1170 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:34:56.976721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4200d34d-eb61-4d35-a3f6-125fbbb0e9e4 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd360f7b280>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.092392 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4200d34d-eb61-4d35-a3f6-125fbbb0e9e4 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.119371 Aug 30 16:34:57.093643 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2806/6022] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:57.107620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.108397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:57.115849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.116578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.117877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.118825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.120024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.120692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.170229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:34:57.178462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:57.190481 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd558e9a-bb0e-4c1d-be6f-7e0fde939663 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.450821 Aug 30 16:34:57.192377 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3217/6023] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:56 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:57.198991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d881187-b722-457d-b9b4-776aad470000 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35cc531f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.315566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d881187-b722-457d-b9b4-776aad470000 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.121830 Aug 30 16:34:57.316334 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3218/6024] 10.222.0.47 () {58 vars in 1188 bytes} [Tue Aug 30 16:34:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:34:57.332881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a137886c-5ae9-4801-9a7e-e7cfbf7bd835 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] Calling method '.version_select at 0x7fd35cda8820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.339810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16db5f09-afe6-4ab7-be55-efd028ec7b3e tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 204 len: 0 microversion: 2.1 time: 0.233821 Aug 30 16:34:57.342365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2807/6025] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:34:57 2022] DELETE /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:34:57.355268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.358445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:57.368711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.375426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.376080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.376974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.377602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.380732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.504029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a137886c-5ae9-4801-9a7e-e7cfbf7bd835 tempest-VolumesTestJSON-1878381196 tempest-VolumesTestJSON-1878381196-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.175122 Aug 30 16:34:57.504983 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3219/6026] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:34:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:57.677134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:57.687737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.688766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:57.696020 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0383880c-bb9b-417e-a449-088230dd6521 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1505 microversion: 2.1 time: 0.348610 Aug 30 16:34:57.696978 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2808/6027] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:57 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:57.711277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.712080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.712779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.714896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.715602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.716238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.770656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:57.772700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:57.800935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.800935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.800935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:57.801631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:57.802059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:57.802786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.146984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.148763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.158746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.161599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.168309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a5be1c3-46a9-4da3-821f-9fb1ce083db6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.479925 Aug 30 16:34:58.169496 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3220/6028] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:57 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:58.194271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.198884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.208311 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-55a9f115-db79-4c25-94d7-f3801e3700b1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.445924 Aug 30 16:34:58.209069 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2809/6029] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:57 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:58.215776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:58.216679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:58.230904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.231868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.237998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.241567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.242074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.242550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.583982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:58.593892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc841814-ab34-42d3-a778-5c9d6c38231c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.382836 Aug 30 16:34:58.606350 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3221/6030] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:58 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:34:58.717843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:58.718515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:58.729715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.730533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.732268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:58.733192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:58.735368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:58.739117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.104948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.122795 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a0d25e0-fe6a-44b0-8a98-bea5cab104a5 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1505 microversion: 2.1 time: 0.409258 Aug 30 16:34:59.123610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2810/6031] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:58 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:34:59.195749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:59.196386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:59.205437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.211089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.214082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.215091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.215731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.219324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.236731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:59.237355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:59.247995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:59.249933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.250876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.256891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.257761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.258249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.258746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.411255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.421192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.427153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.431479 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-092373b5-6713-4eae-8296-5e334cbfb5d4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.239637 Aug 30 16:34:59.445612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3222/6032] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:59 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:34:59.461831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:34:59.595501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.605002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.606350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.607521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4dcae7d-65d7-4012-80b8-528fe8f8b343 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.374774 Aug 30 16:34:59.628661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:34:59.629296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:34:59.638016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.638559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.639013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.639737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:34:59.640220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:34:59.640643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:34:59.643849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2811/6033] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:34:59 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:34:59.935579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:34:59.945544 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fe4f742-9766-4a0d-b3e1-0ce63cd8b502 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.325879 Aug 30 16:34:59.946152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3223/6034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:34:59 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:00.149683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:00.150897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:00.168319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:00.177848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.178447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.178974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.179738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.180206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.180650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.457627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:00.458594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:00.473969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.474613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.475638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.477675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.478450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.482456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.646530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:00.663512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:00.668469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:00.679560 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b41eeaf1-4063-47a4-bf89-35ebf200ed50 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.226129 Aug 30 16:35:00.694325 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3224/6035] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:00 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:35:00.694325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:00.695464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:00.716249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.721147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.722643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:00.725428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:00.730806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:00.731544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.178916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:01.209397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:01.220945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:01.222382 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38e03ea5-6cd4-435d-8a1e-72636e1d592a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.540730 Aug 30 16:35:01.223211 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3225/6036] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:00 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:01.233804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:01.239581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:01.254177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.255034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.255729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.256708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.257399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.258991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.440423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:01.466498 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c92db64e-fcd6-4e65-9368-93d1a17e55be tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1505 microversion: 2.1 time: 1.319882 Aug 30 16:35:01.468863 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2812/6037] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:00 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1505 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:01.694271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:01.710925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:01.711551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:01.712122 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8475aa0-9032-45eb-a917-fcdfc7abc81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.484965 Aug 30 16:35:01.712741 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3226/6038] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:01 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:01.726847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.726847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.726847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:01.744873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:01.746438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:01.748531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.250938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:02.253465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:02.265266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.272289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.274969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.276696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.279762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.282618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.585057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:02.599089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:02.603566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:02.605376 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e84ee5e8-78b0-44d1-ace3-63c480566f88 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.358293 Aug 30 16:35:02.606729 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3227/6039] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:02 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:02.612969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:02.614095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:02.635329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.636307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.636987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.642787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.643445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.644013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.905659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:02.914846 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e20de30e-6f2c-4c77-bc75-4c32dbb1d1c3 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1505 microversion: 2.1 time: 0.306684 Aug 30 16:35:02.915567 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3228/6040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:02 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:02.924052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:02.925044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:02.932433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.933426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.934151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:02.935267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:02.936056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:02.936813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.011446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:03.033293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:03.043767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:03.045047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a42c0f2-5e4d-472e-8b52-6201bdc5edf7 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 1.338234 Aug 30 16:35:03.045624 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2813/6041] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:01 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:35:03.115063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:03.124542 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c9a3827d-150b-47b1-a695-fcbee9812491 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1695 microversion: 2.1 time: 0.206995 Aug 30 16:35:03.126394 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3229/6042] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:02 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:03.630976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:03.631595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:03.653729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.654595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.655128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.655890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.656352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.660779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.939159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:03.939883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:03.969045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.969881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.970606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:03.972353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:03.973000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:03.973907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.000596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:04.138433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.153857 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe1c677e-662d-4b4b-9a8d-4b6384609659 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1463 microversion: 2.1 time: 0.219753 Aug 30 16:35:04.166346 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3230/6043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:03 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:04.167037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:04.167893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:04.183476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.184349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.187358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.188755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.190412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.192845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.421661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.433638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.435584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.439194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff2d6d86-1e2c-4818-981b-10f4d2adf09c tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1366 microversion: 2.47 time: 0.281590 Aug 30 16:35:04.457215 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3231/6044] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:04 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:04.464944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:04.466649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:04.475626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.476556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.477831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.479003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.479902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.480983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.482909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.499924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.507824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:04.519674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f976fc6-41ab-4b73-a5e0-fdd4c11d2e99 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.888825 Aug 30 16:35:04.523383 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2814/6045] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:03 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:04.545140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "name": "network-vif-unplugged", "status": "completed", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:04.579201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:04.580142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:04.580809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:04.608053 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Creating event network-vif-unplugged:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h2-830883-28 Aug 30 16:35:04.624084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] Instance ba3264d4-774d-4b7b-996a-1f64c949d70e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:35:04.655038 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9b7a616d-2ed8-4ec9-8e32-182a90f6d8ea req-c8407c53-dbdf-4e42-9bc1-10d2fcd5354d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120343 Aug 30 16:35:04.656469 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2815/6046] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:05.096763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.114829 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-240f9968-1695-43e2-bbcb-b0f57c3aa015 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1694 microversion: 2.1 time: 0.655823 Aug 30 16:35:05.125002 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3232/6047] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:04 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1694 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:05.177946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:05.179005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:05.195137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.195686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.196469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.197564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.200189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.200964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.284682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.285621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.286337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.287037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lazy-loading 'fault' on Instance uuid f3237e3f-4cd7-41f7-9f9d-57678c58fde3 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:35:05.370742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36318839f45e47bf89e511fbfcd31d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983c5bbb2f584ac19d0e70a22428efdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.381975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab6a4ac6-01d8-4231-a374-b74ad931b991 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 200 len: 1304 microversion: 2.1 time: 0.208763 Aug 30 16:35:05.383025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2816/6048] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:05 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:05.463340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:05.464351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:05.476285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.477139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.477851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.479221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.480079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.490832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.547640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:05.549222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:05.562442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.563467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.564263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.565367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:05.566018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:05.566987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:05.598820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.612665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.614223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:05.623713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a898a379-9288-4f11-a12a-24737b6280c3 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1372 microversion: 2.47 time: 0.164186 Aug 30 16:35:05.624762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3233/6049] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:05 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:06.031095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "name": "network-vif-plugged", "status": "completed", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:06.072182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.080214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.080995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.122933 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] Creating event network-vif-plugged:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:35:06.129136 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-869b45cf-be42-4811-92bf-aa2a9a14b9a9 req-38ca6a6e-b585-4645-a58d-bce958f3edfe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121812 Aug 30 16:35:06.129889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3234/6050] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:35:06.140172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:06.141329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:06.156560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.163301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.164127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.165115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.165811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.167411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.575577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:06.591536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:06.593112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:06.594256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0d0637b-f17b-4e4f-b94c-3ded60418e60 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 1.052698 Aug 30 16:35:06.594871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2817/6051] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:05 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:06.611348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:06.611997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] [instance: f3237e3f-4cd7-41f7-9f9d-57678c58fde3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:06.623198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.623705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.625030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.625783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.631730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.632619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.641579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:06.656189 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6aef0085-ec1a-442e-85c5-000090240e9b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1694 microversion: 2.1 time: 0.519854 Aug 30 16:35:06.667378 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] HTTP exception thrown: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. Aug 30 16:35:06.678441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3235/6052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:06 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1694 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:06.678441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:06.678441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Request method failure captured: Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 HTTP/1.1 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjv8CCl8UEsCatWW_hhq5FissA1y-7J283xzNvZGYPPYkiW-rq4PVVDUoHiy4GJagvaibYXoenu73EPBSHusClSh2p1x1Kai6kEoyoMg7umN96yVT6jTS3rad_vCDuahW3rpfOIYqVtmhQISPGbpGsjb67_6adTLap4XLHGcnWNljx4 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 983c5bbb2f584ac19d0e70a22428efdf Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesActionsTest-604404350 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/983c5bbb2f584ac19d0e70a22428efdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/983c5bbb2f584ac19d0e70a22428efdf"}]}] Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesActionsTest-604404350 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 983c5bbb2f584ac19d0e70a22428efdf Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesActionsTest-604404350 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesActionsTest-604404350-project Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 36318839f45e47bf89e511fbfcd31d62 Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesActionsTest-604404350-project Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f3237e3f-4cd7-41f7-9f9d-57678c58fde3'} Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:06.687054 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. Aug 30 16:35:06.692257 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:06.693299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.693991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.694921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.696673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] Returning 404 to user: Instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:35:06.696808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.696808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.696999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.698693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3699ff31-8882-4085-8d60-0b0646adc112 tempest-VolumesActionsTest-604404350 tempest-VolumesActionsTest-604404350-project] 10.222.0.47 "GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3" status: 404 len: 111 microversion: 2.1 time: 0.102520 Aug 30 16:35:06.700849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2818/6053] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:06 2022] GET /compute/v2.1/servers/f3237e3f-4cd7-41f7-9f9d-57678c58fde3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:35:06.739457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3237e3f-4cd7-41f7-9f9d-57678c58fde3", "name": "network-vif-deleted", "tag": "7b399a01-6e4e-4f87-87bb-d088972a1191"}, {"name": "network-changed", "server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:06.762659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:06.765771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:06.776502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:06.804566 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Creating event network-vif-deleted:7b399a01-6e4e-4f87-87bb-d088972a1191 for instance f3237e3f-4cd7-41f7-9f9d-57678c58fde3 on n-h2-830883-28 Aug 30 16:35:06.808626 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Creating event network-changed:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h2-830883-28 Aug 30 16:35:06.832097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] Instance ba3264d4-774d-4b7b-996a-1f64c949d70e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:35:06.871214 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-164ba2c0-2ebe-4ead-88e1-abff42c3d70f req-68c0350d-ddc6-4089-9508-f0f1bdd18dc2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139187 Aug 30 16:35:06.873420 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2819/6054] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 16:35:06.994206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:07.002969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:07.005283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:07.013955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b0ad5ee2-9d01-4129-b61a-038142eabe02 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1372 microversion: 2.47 time: 0.338691 Aug 30 16:35:07.015237 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3236/6055] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:06 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:07.624196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:07.625049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:07.640423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.642986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.644365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:07.647997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.649058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.653237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:07.691956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:07.692600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:07.722292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.723045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.723661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:07.724614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:07.725244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:07.725953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.409980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.421213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.427846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.429439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2a2fc6c9-1b1b-405b-86af-53d5e00d328b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1407 microversion: 2.20 time: 0.811616 Aug 30 16:35:08.434277 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2820/6056] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:07 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1407 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:08.439849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:08.452261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:08.468902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:08.471912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:08.475481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.476558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:08.481915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:08.482787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.499622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:08.729976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.744029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.747884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.756677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-809030e5-e34e-4513-aff0-be39319a40e4 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1357 microversion: 2.47 time: 0.320127 Aug 30 16:35:08.759159 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2821/6057] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:08 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:08.791346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:08.800909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.801814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Searching by: {'deleted': False, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:35:08.809987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:08.810526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:08.810961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.811686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:08.812324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:08.813785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:08.867283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:08.881457 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9bc7615-0963-4faf-b429-0466a6d5bd4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1694 microversion: 2.1 time: 1.193535 Aug 30 16:35:08.887247 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3237/6058] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:07 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1694 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:08.990000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:35:09.206846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.223660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.224262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.224863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.249438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.255983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.347139 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33bba182-beca-4bb7-ba15-f5ce56ff814f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.565179 Aug 30 16:35:09.366214 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2822/6059] 10.222.0.47 () {60 vars in 1187 bytes} [Tue Aug 30 16:35:08 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:09.382405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:09.382879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:09.390525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.391036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.391486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.392204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.392670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.393115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.445305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:35:09.456380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:09.457016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:09.472263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.472779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.473225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.474136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.474862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.475456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.654503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6303f5f-1e0d-48bd-a8ba-8d04ce5fa3b6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 204 len: 0 microversion: 2.47 time: 0.278200 Aug 30 16:35:09.662634 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3238/6060] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:35:09 2022] DELETE /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:35:09.677286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:09.678212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:09.698617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.699603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.700552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.701505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.702182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.705888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.867778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.877047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.878554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:09.887520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e98c1fc-e585-4d8b-b118-3bf930f57ed1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1363 microversion: 2.47 time: 0.215748 Aug 30 16:35:09.889065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3239/6061] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:09 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:35:09.914324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:09.915246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:09.928526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.929029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.932607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:09.936871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:09.939391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:09.940032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.139561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:10.147614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-689b8752-282f-42fa-86b8-c8af4778ba84 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1692 microversion: 2.1 time: 0.237989 Aug 30 16:35:10.164638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3240/6062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:09 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:10.221226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:10.249984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:10.255346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:10.260934 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72065751-6438-4ea1-9999-8f4465c131d3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1600 microversion: 2.20 time: 0.808130 Aug 30 16:35:10.263269 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2823/6063] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:09 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1600 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:10.289237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:10.289821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:10.307403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.307873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.308320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.309034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.309495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.309923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.510472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-57430428-6269-4352-b7ff-b3853977877a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.225586 Aug 30 16:35:10.511608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3241/6064] 10.222.0.47 () {60 vars in 1316 bytes} [Tue Aug 30 16:35:10 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-interface => generated 285 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:35:10.911209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:10.911837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:10.941219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.945116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.945780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:10.952386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:10.955393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:10.956244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:11.171830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:11.173170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:11.185104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:11.185980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:11.187451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:11.189514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:11.191313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:11.191929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:11.341037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:11.356724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:11.366268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:11.374831 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09e45378-0b90-492e-9b1b-7b5f6acb10ea tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1363 microversion: 2.47 time: 0.467358 Aug 30 16:35:11.375444 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2824/6065] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:10 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:12.373139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:12.389655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4fbb4476-01e0-4f48-ba45-93a50051ed69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1692 microversion: 2.1 time: 1.216652 Aug 30 16:35:12.399884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:12.402743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:12.408310 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3242/6066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:11 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1692 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:12.419461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:12.420019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:12.420466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:12.421184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:12.421648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:12.439279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:12.851140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:12.860924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:12.875817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:12.877741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8519e5f-0ad1-4b7e-8d76-d997ce876eeb tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 200 len: 1363 microversion: 2.47 time: 0.481343 Aug 30 16:35:12.891271 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2825/6067] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:12 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:13.415278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:13.417294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:13.432274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.433163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.433851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.435043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.435798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.436444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.462210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:13.485291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.493912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.497535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.545724 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] Creating event network-changed:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:35:13.564046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-26cb401d-0702-4513-90e1-73737c8edf66 req-f7d76fa0-ced5-4ea9-8da2-b55d0bf4f519 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099705 Aug 30 16:35:13.566370 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2826/6068] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:35:13.905955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:13.906975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: 7d8c30b5-b308-4a6a-924f-13928b894ef9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:13.927000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.928042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.930158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:13.931898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:13.940067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:13.941014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.000107 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] HTTP exception thrown: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Request method failure captured: Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 HTTP/1.1 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwQ7KDBVlqZ5dGFQMTmlVjQSZKj1cC0vv6h8PuVGjL2lSd94GZNYkMZwCmEUmDiz_XnZUxpAVMSOseCrkcfEP5oj4St9N0edh69R0AG11sUSjFK9mFAIJ6Yl8d3S3cSujYn_8FUILSYEitogUGLo6Y4gsrqutgbKc_GbINeYBeb3cA Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f5d53cb3d9934d0ab39c770310d2cfe4 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerShowV247Test-559126797 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5d53cb3d9934d0ab39c770310d2cfe4"}]}] Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerShowV247Test-559126797 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f5d53cb3d9934d0ab39c770310d2cfe4 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerShowV247Test-559126797 Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerShowV247Test-559126797-project Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 215c0da4ba81427f828636830c787c0b Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerShowV247Test-559126797-project Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7d8c30b5-b308-4a6a-924f-13928b894ef9'} Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:14.006731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. Aug 30 16:35:14.012081 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:14.019152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Returning 404 to user: Instance 7d8c30b5-b308-4a6a-924f-13928b894ef9 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:35:14.023075 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3b761a21-a40d-4a0e-a1ce-40e764daac43 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9" status: 404 len: 111 microversion: 2.47 time: 0.124678 Aug 30 16:35:14.024251 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2827/6069] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:13 2022] GET /compute/v2.1/servers/7d8c30b5-b308-4a6a-924f-13928b894ef9 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:35:14.045112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:14.047503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:14.075152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.075992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.077030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.079430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.080125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.081767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.155742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:14.168464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:35:14.171783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3d158d3-e2a0-482b-ad77-31691812aae2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1689 microversion: 2.1 time: 0.757181 Aug 30 16:35:14.175732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3243/6070] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:13 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1689 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:14.200138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:14.200860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:14.216816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.217941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.218827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.220954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.221737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.222430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.333617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75409b21-20f7-42ee-8e2f-2188b469921a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action" status: 204 len: 0 microversion: 2.1 time: 0.138408 Aug 30 16:35:14.335085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3244/6071] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:35:14 2022] POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:35:14.348974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:14.350057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:14.360163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.361048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.362008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.363054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.364017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.364742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.397842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:14.473057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5b96c78-a610-4abc-ae02-395880eff2c1 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 204 len: 0 microversion: 2.47 time: 0.435818 Aug 30 16:35:14.475721 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2828/6072] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:35:14 2022] DELETE /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:35:14.490360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:14.492223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:14.504560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.505305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.505889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:14.506848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:14.507503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:14.508230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:15.517571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:15.538865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:15.542557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:15.549105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:15.559487 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-600721cc-b126-474d-a89f-b8b9a594cdb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1689 microversion: 2.1 time: 1.214887 Aug 30 16:35:15.563173 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18790377-969c-46b9-a8ef-c4ca103252a8 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 200 len: 1362 microversion: 2.47 time: 1.067306 Aug 30 16:35:15.564014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2829/6073] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:14 2022] GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 1362 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:15.565534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3245/6074] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:14 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1689 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:16.601576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:16.603743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:16.605493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:16.606092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:16.614772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.615893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.616660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.617884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.619776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.620618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.634390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.635085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.635538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.636263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:16.636718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:16.637149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:16.798398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:16.819858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:16.826691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:16.828982 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-315b6aca-9aeb-4734-bc8a-849e17de7be6 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 200 len: 1362 microversion: 2.47 time: 0.233492 Aug 30 16:35:16.831797 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3246/6075] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:16 2022] GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:17.109340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:17.119568 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3bae992b-529a-4c37-af38-9a0f1acf8386 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1689 microversion: 2.1 time: 0.517795 Aug 30 16:35:17.142408 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2830/6076] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:16 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1689 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:35:17.856878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:17.859139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:17.873666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:17.887919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:17.889906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:17.890988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:17.896332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:17.898589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:17.902967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:18.015074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:18.021061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:18.021573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:18.022059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lazy-loading 'fault' on Instance uuid fda86933-6329-464f-ba8b-b0f6336785a6 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:35:18.146022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:18.147326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:18.160934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:18.164955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:18.166572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:18.167896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:18.170390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:18.172193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:18.191028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:18.229160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:18.281655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '215c0da4ba81427f828636830c787c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d53cb3d9934d0ab39c770310d2cfe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:18.283401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d24cb34-ad34-4b83-9f1e-7162e8ceb15f tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 200 len: 1367 microversion: 2.47 time: 0.432004 Aug 30 16:35:18.288724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3247/6077] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:17 2022] GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:35:18.551728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:18.572911 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6e19661-6b5d-420c-ab41-5c8238039464 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1689 microversion: 2.1 time: 0.427044 Aug 30 16:35:18.578727 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2831/6078] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:18 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1689 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:19.310724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:19.311368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] [instance: fda86933-6329-464f-ba8b-b0f6336785a6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:19.315254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:19.321927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:19.341538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:19.345664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:19.347616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:19.348673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:19.349371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:19.349813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:19.403228 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] HTTP exception thrown: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Request method failure captured: Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 HTTP/1.1 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjwQ7KDBVlqZ5dGFQMTmlVjQSZKj1cC0vv6h8PuVGjL2lSd94GZNYkMZwCmEUmDiz_XnZUxpAVMSOseCrkcfEP5oj4St9N0edh69R0AG11sUSjFK9mFAIJ6Yl8d3S3cSujYn_8FUILSYEitogUGLo6Y4gsrqutgbKc_GbINeYBeb3cA Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: f5d53cb3d9934d0ab39c770310d2cfe4 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerShowV247Test-559126797 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5d53cb3d9934d0ab39c770310d2cfe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5d53cb3d9934d0ab39c770310d2cfe4"}]}] Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerShowV247Test-559126797 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: f5d53cb3d9934d0ab39c770310d2cfe4 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerShowV247Test-559126797 Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerShowV247Test-559126797-project Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 215c0da4ba81427f828636830c787c0b Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerShowV247Test-559126797-project Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'fda86933-6329-464f-ba8b-b0f6336785a6'} Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:35:19.414044 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:35:19.419337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] Returning 404 to user: Instance fda86933-6329-464f-ba8b-b0f6336785a6 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:35:19.420307 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0e54220-2640-448b-8fda-0155a12d6a89 tempest-ServerShowV247Test-559126797 tempest-ServerShowV247Test-559126797-project] 10.222.0.47 "GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6" status: 404 len: 111 microversion: 2.47 time: 0.112930 Aug 30 16:35:19.437448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2832/6079] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:35:19 2022] GET /compute/v2.1/servers/fda86933-6329-464f-ba8b-b0f6336785a6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:35:19.596500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:19.597397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:19.608317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:19.610548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:19.611059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:19.611768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:19.612227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:19.612658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:19.781023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "name": "network-vif-plugged", "status": "completed", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:19.815199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:19.820118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:19.820577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:19.886979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] Creating event network-vif-plugged:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h2-830883-28 Aug 30 16:35:19.907560 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2a5ad01b-776d-4a66-b160-e7d4972aade1 req-b182fc4d-3e10-494e-b8f7-d9c964ed189e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.627958 Aug 30 16:35:19.912667 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3248/6080] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:20.948447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:20.962731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cfdcca54-1b1d-4111-bc18-1ad80703895d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1689 microversion: 2.1 time: 1.369337 Aug 30 16:35:20.984561 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2833/6081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:19 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1689 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:21.993142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:21.994381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:22.013463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:22.013972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:22.014444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:22.015155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:22.027704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:22.028424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:22.435589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:35:22.498558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fcab928d-0788-4739-87d0-3a39e1ca7a97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1681 microversion: 2.1 time: 0.509587 Aug 30 16:35:22.518635 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3249/6082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:35:21 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1681 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:35:25.564768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af110be0-1692-4e63-a519-6933e6989a7f tempest-ComputeTenantNetworksTest-1209938995 tempest-ComputeTenantNetworksTest-1209938995-project] Calling method '.version_select at 0x7fd35d4fdaf0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:26.474637 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af110be0-1692-4e63-a519-6933e6989a7f tempest-ComputeTenantNetworksTest-1209938995 tempest-ComputeTenantNetworksTest-1209938995-project] 10.222.0.47 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.150631 Aug 30 16:35:26.475817 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2834/6083] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:35:25 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:26.489499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1a77ed9-e3c5-4613-8a88-6e7b817ba181 tempest-ComputeTenantNetworksTest-1209938995 tempest-ComputeTenantNetworksTest-1209938995-project] Calling method '.version_select at 0x7fd360f959d0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:35:27.223280 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1a77ed9-e3c5-4613-8a88-6e7b817ba181 tempest-ComputeTenantNetworksTest-1209938995 tempest-ComputeTenantNetworksTest-1209938995-project] 10.222.0.47 "GET /compute/v2.1/os-tenant-networks/5aa081bc-141e-4331-9066-a515c9cc43ef" status: 200 len: 140 microversion: 2.1 time: 0.738441 Aug 30 16:35:27.224262 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3250/6084] 10.222.0.47 () {58 vars in 1269 bytes} [Tue Aug 30 16:35:26 2022] GET /compute/v2.1/os-tenant-networks/5aa081bc-141e-4331-9066-a515c9cc43ef => generated 140 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:35:46.967588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:46.971737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:35:46.997506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:35:47.008003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:35:47.038489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:47.043333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:47.043982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:47.058539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:35:47.059351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:35:47.065486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:35:47.243910 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-198a17a5-83d1-48d3-8f44-80e5e23aef39 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action" status: 200 len: 24577 microversion: 2.1 time: 0.281438 Aug 30 16:35:47.253467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2835/6085] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:35:46 2022] POST /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e/action => generated 24577 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:36:10.205113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:10.206032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:10.223116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:10.224369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=26 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:10.231010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:10.232982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:10.234253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:10.236084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:10.237229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:10.238794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:11.201646 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d5d1b6a-60ca-4997-ad80-e3fb73c247ca tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1834 microversion: 2.1 time: 0.998676 Aug 30 16:36:11.202798 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3251/6086] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:10 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1834 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:36:15.425363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:15.429962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:15.430502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:15.439894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:15.467432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:15.487981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:15.497190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:15.498837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:15.499404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:15.501016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:15.505122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:15.506200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:15.509901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:15.511355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:15.550893 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] Creating event network-changed:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h2-830883-28 Aug 30 16:36:15.581518 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-78f6d4be-907d-4d35-b066-27df2bfd7cc9 req-4f5b4253-1a48-49ce-bd14-25c86dc14008 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152224 Aug 30 16:36:15.585029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3252/6087] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:36:15.624642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:36:15.876974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0fb38d4-5628-47be-ba2c-8447ba40b041 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 204 len: 0 microversion: 2.1 time: 0.460121 Aug 30 16:36:15.879270 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2836/6088] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:36:15 2022] DELETE /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:36:15.891566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:15.892480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:15.911552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:15.912686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:15.913425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:15.916120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:15.916842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:15.917507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:16.423227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:16.449823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-882e8947-7f57-441d-ab1a-51d2ce92ec1c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1687 microversion: 2.1 time: 0.565181 Aug 30 16:36:16.454085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3253/6089] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:15 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1687 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:36:17.478620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:17.480318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:17.508631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:17.517583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:17.518293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:17.520239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:17.522035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:17.524604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:18.281463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:18.295702 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3677057a-f65c-4d66-a292-a0ee81ebf672 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1687 microversion: 2.1 time: 0.819357 Aug 30 16:36:18.296828 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2837/6090] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:17 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1687 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:36:19.319062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:19.321715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:19.337821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:19.339582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:19.340742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:19.342611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:19.344931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:19.347599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:19.440110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3264d4-774d-4b7b-996a-1f64c949d70e", "name": "network-vif-deleted", "tag": "7bf01b7c-27bd-4bf2-8d13-a852c3526d03"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:19.447761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:19.448263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:19.448713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:19.457110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lazy-loading 'fault' on Instance uuid ba3264d4-774d-4b7b-996a-1f64c949d70e {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:36:19.467852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:19.469862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:19.470348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:19.503446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] Creating event network-vif-deleted:7bf01b7c-27bd-4bf2-8d13-a852c3526d03 for instance ba3264d4-774d-4b7b-996a-1f64c949d70e on n-h2-830883-28 Aug 30 16:36:19.529350 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7f003030-2d47-4203-9b7a-d8f503de52cd req-5c2a54c9-ff4b-48eb-8e71-0686188811b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.585614 Aug 30 16:36:19.530220 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3254/6091] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:36:19.541202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:19.567533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ca5d932-1223-4537-97b3-7fe06a22c99c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 200 len: 1355 microversion: 2.1 time: 0.252804 Aug 30 16:36:19.578681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2838/6092] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:19 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 1355 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:36:20.593022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:20.593603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: ba3264d4-774d-4b7b-996a-1f64c949d70e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:20.604139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:20.604641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:20.605087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:20.605791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:20.608586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:20.611954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:20.649932 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] HTTP exception thrown: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Request method failure captured: Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e HTTP/1.1 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjvfa4TbGMD0AzTWRHg5GAAcH2s1jHgIUfTkgWn9KGgA3VCoFY-lBY7E3L_A8k-GG9JGi42RnJsvxbNArleNZfWmZpVjAHeeuJWH2zgYitlC9RCaZOwdgcu0BR8vS28h2b4DGTUiSCO_Em0U73Jg_E9MBEQWO4VKHtZgexE9gwJjkWs Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b9801e8110649beb6683e701536b207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b9801e8110649beb6683e701536b207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}] Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 41f1684f44264fdcb3e07f501ac6da6a Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'ba3264d4-774d-4b7b-996a-1f64c949d70e'} Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:36:20.655542 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Returning 404 to user: Instance ba3264d4-774d-4b7b-996a-1f64c949d70e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:36:20.660791 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b77f16d1-0e7e-40bc-b3c7-a2bf8822def8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e" status: 404 len: 111 microversion: 2.1 time: 0.069877 Aug 30 16:36:20.662823 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3255/6093] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:20 2022] GET /compute/v2.1/servers/ba3264d4-774d-4b7b-996a-1f64c949d70e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:36:26.774319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:26.775260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:26.785882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:26.787593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:26.788380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:26.790604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:26.791248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:26.792621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:26.823474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-076b4cab-1723-491c-96b8-97247a29f9fe tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/ips" status: 200 len: 153 microversion: 2.20 time: 0.400680 Aug 30 16:36:26.824329 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2839/6094] 10.222.0.47 () {60 vars in 1289 bytes} [Tue Aug 30 16:36:26 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/ips => generated 153 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:36:29.977232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:29.978946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:29.990381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:29.991605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:29.992469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:29.993957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:29.994771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:29.995717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:30.027729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lazy-loading 'flavor' on Instance uuid 72a255ec-3d07-4369-b7ca-20900264fcd8 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:36:30.443478 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bd6803df-f26c-4055-b4cb-c85b76e49c67 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/action" status: 202 len: 0 microversion: 2.20 time: 0.472199 Aug 30 16:36:30.447612 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3256/6095] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:36:29 2022] POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:36:30.456174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:30.456686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:30.470022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:30.470798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:30.471454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:30.472386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:30.476581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:30.477231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:31.354890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:31.368783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:31.370356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:31.371611 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dc8727da-1380-403a-b7e5-8230d4f6e089 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.919675 Aug 30 16:36:31.386898 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2840/6096] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:30 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:31.684847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc6f5d17-9b03-4652-a10d-4efa7e3fa88d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '.version_select at 0x7fd360fd64c0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:31.740291 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc6f5d17-9b03-4652-a10d-4efa7e3fa88d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-465535839" status: 202 len: 0 microversion: 2.1 time: 0.059746 Aug 30 16:36:31.744835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3257/6097] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 16:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-465535839 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:36:31.781508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e25f1e41-a0bf-45c6-9b4c-e6bef2f1c948 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: .version_select at 0x7fd35cd9b700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1886900762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO289DhEx3HGKGPnhEPz5XqotKS2KZ+1FvEjktYok7ESk3gjzY9KgY4d8ZWO5bupcZK/jhvWsaIT53yI3PXuAqDDUsK1wj+0kMOZSoW7aDSeedXRULvFV3Zq+CE+wjVCog=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:31.799798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e25f1e41-a0bf-45c6-9b4c-e6bef2f1c948 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:36:31.810844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e25f1e41-a0bf-45c6-9b4c-e6bef2f1c948 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:36:31.848030 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e25f1e41-a0bf-45c6-9b4c-e6bef2f1c948 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.069671 Aug 30 16:36:31.857517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2841/6098] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:36:31 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:36:32.395992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:32.403887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:32.426063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:32.428173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:32.435280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:32.436536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:32.437743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:32.438457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:32.855331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:32.865145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:32.867233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:32.873953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df3f2222-62d4-48ce-bb32-8d927fc7b4eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.481761 Aug 30 16:36:32.874679 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3258/6099] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:32 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:33.906958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:33.908964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:33.925999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:33.931042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:33.932835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:33.935571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:33.937694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:33.939765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:34.367052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:34.378698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:34.382761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:34.385051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c74135f4-12cb-4cae-831b-0f0708b1a462 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.486136 Aug 30 16:36:34.400139 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2842/6100] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:33 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:35.414822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:35.417187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:35.428027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:35.430656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:35.431516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:35.432392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:35.433138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:35.435428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:35.914088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:35.931259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:35.935611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:35.941904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8db8d084-ec64-4b24-99b9-cb2c0163d8bd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.532721 Aug 30 16:36:35.943852 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3259/6101] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:35 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:36.979891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:36.982337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:37.008168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:37.008783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:37.010773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:37.018649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:37.026158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:37.031687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:37.648932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:37.667907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:37.669387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:37.670819 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c28f335d-e455-4bb2-a33c-9d5443113005 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.705624 Aug 30 16:36:37.671394 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2843/6102] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:36 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:38.695385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:38.696152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:38.709092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:38.714739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:38.715470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:38.716420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:38.717119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:38.717787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:39.125702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:39.137215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:39.139168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:39.141213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-56f42372-c309-4c61-bbe4-f9f6304817b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.450122 Aug 30 16:36:39.158143 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3260/6103] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:38 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:40.170036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:40.171450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:40.191608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:40.192109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:40.192556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:40.214757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:40.215372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:40.215830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:40.992944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:41.004658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:41.011413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:41.031050 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09735ce8-5327-4ed4-84b2-057d84fbd234 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.867027 Aug 30 16:36:41.035799 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2844/6104] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:40 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:42.064436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:42.067017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:42.073972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:42.086161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:42.093319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:42.094249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:42.096165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:42.098203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:42.098956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:42.171720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:43.362842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:43.375247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:43.383857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:43.391014 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef316df0-e625-40ab-8a63-ac6d642ea834 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1746 microversion: 2.20 time: 1.339818 Aug 30 16:36:43.418361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3261/6105] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:42 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1746 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:44.441440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:44.442182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:44.450911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:44.470251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:44.471605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:44.473328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:44.475639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:44.477608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:44.478077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:45.130027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:45.150035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:45.157591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:45.161877 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0bd7aa14-cda0-4c3d-a1e5-484ed065681c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1746 microversion: 2.20 time: 0.725610 Aug 30 16:36:45.163498 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2845/6106] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:44 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1746 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:45.898706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "name": "network-vif-plugged", "status": "completed", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:45.922742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:45.924670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:45.926980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:45.947771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] Creating event network-vif-plugged:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:36:45.964629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4753e597-2ee2-45d4-9ee3-3f41edf18b38 req-b93460b1-313f-494a-bcb6-0c3c960b36f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071434 Aug 30 16:36:45.966203 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3262/6107] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:36:46.193738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:46.195309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:46.231228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:46.233687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:46.235212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:46.241238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:46.243434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:46.245125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:46.248367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:46.266215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:36:46.925968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:46.979340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:47.001852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:47.003265 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bae61d3f-0deb-42d9-a198-56bdf21f5e4a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1746 microversion: 2.20 time: 0.814852 Aug 30 16:36:47.012260 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2846/6108] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:46 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1746 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:48.035905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:48.036876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:48.066228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:48.066764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:48.067310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:48.068031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:48.068494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:48.069483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:49.872236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:49.881806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:49.889721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:49.893749 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5d410fe-cb6d-40d8-b21a-47b8ab08be40 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 1.863216 Aug 30 16:36:49.898539 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3263/6109] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:48 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:50.922361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:50.923062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:50.931070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:50.932235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:50.939582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:50.950587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:50.951318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:50.954812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:51.706547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:51.724104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:51.726696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:51.736974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d242ced-aaab-4dca-b0a9-52587bd7a629 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.818627 Aug 30 16:36:51.740099 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2847/6110] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:50 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:52.618889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1401687966", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c9163934-d9de-4dad-bc89-bfa132bdf070"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1886900762", "security_groups": [{"name": "tempest-secgroup-smoke-668863852"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:36:52.766139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:52.767869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:52.785090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:52.786113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:52.788951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:52.791216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:52.796110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:52.796818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:53.170777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] validate_networks() for [('c9163934-d9de-4dad-bc89-bfa132bdf070', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:36:53.388916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:53.416623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:53.423865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:53.429536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c872bbde-93a5-4605-bcdd-e2daa85a74b5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.668388 Aug 30 16:36:53.456759 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2848/6111] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:52 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:36:54.463414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:54.464737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:54.481492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:54.482579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:54.483605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:54.485057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:54.486884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:54.487907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:54.884536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:54.900928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:54.903089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:54.906864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00ea8a5c-a2e4-4c6e-b0e9-c42cb7a6ea80 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.448971 Aug 30 16:36:54.911085 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2849/6112] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:54 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:55.562111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:36:55.562658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:36:55.563096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:36:55.563578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:36:55.564005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:36:55.577982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:55.588966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:55.588966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:55.588966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:55.588966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:55.590274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:55.690778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:36:55.725534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:36:55.773251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:36:55.776259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:36:55.872503 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 16:36:55.941347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:55.942576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:55.966363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:55.967510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:55.968176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:55.971358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:55.973810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:55.978168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:56.883207 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 56688. Aug 30 16:36:56.888114 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc27c772-b807-424d-bc2d-38db44bbe038 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.273895 Aug 30 16:36:56.895103 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3264/6113] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:36:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 4282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:36:56.900492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03a6c44a-3135-432e-a7a4-5e4809383211 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:56.917648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03a6c44a-3135-432e-a7a4-5e4809383211 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:57.273922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03a6c44a-3135-432e-a7a4-5e4809383211 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:57.284447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03a6c44a-3135-432e-a7a4-5e4809383211 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1267 microversion: 2.1 time: 0.387849 Aug 30 16:36:57.285049 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3265/6114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:56 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:36:58.274144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:58.299547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:58.306051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5825a225-dd89-4071-950c-10448180950e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:58.308072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5825a225-dd89-4071-950c-10448180950e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:58.317736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:58.327919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-527a34b0-724d-4316-863a-246c57dbbc52 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 2.393194 Aug 30 16:36:58.335663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2850/6115] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:55 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:36:58.740128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5825a225-dd89-4071-950c-10448180950e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:36:58.751192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5825a225-dd89-4071-950c-10448180950e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1267 microversion: 2.1 time: 0.449837 Aug 30 16:36:58.757246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3266/6116] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:58 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1267 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:36:59.363218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:59.364482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:36:59.401573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:59.408254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:59.408791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:59.415291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:36:59.419945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:36:59.420420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:36:59.779388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e60b907-ce30-4775-9a2c-81c55502d0e1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:36:59.780024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e60b907-ce30-4775-9a2c-81c55502d0e1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:00.658111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e60b907-ce30-4775-9a2c-81c55502d0e1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:00.672439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e60b907-ce30-4775-9a2c-81c55502d0e1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1267 microversion: 2.1 time: 0.892646 Aug 30 16:37:00.673295 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3267/6117] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:36:59 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1267 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:00.749414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:00.775198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:00.783884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:00.789258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02516cb8-e135-44a7-b4a3-100af2754c63 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 1.428528 Aug 30 16:37:00.791156 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2851/6118] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:36:59 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:37:01.700906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:01.702162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:01.726354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:01.727434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:01.732725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:01.735013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:01.738533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:01.739294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:01.828007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:01.830993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:01.855127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:01.857346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:01.868765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:01.872008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:01.875483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:01.878497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:02.029625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:02.041354 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f0ea554-b827-4df1-8052-5571314c044a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1263 microversion: 2.1 time: 0.344761 Aug 30 16:37:02.071014 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3268/6119] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:01 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1263 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:03.086658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:03.088182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:03.125542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:03.126938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:03.127560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:03.130063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:03.135026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:03.137486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:03.316136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:03.339869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:03.344916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:03.352205 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93e8eb08-54a6-40bf-a329-98b2b268fae1 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 1.540875 Aug 30 16:37:03.373141 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2852/6120] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:01 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:03.775805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:03.816778 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9cea1e53-2a4d-47c7-842d-c38e4d626b3f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1325 microversion: 2.1 time: 0.735408 Aug 30 16:37:03.832192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3269/6121] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:03 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1325 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:04.384609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:04.385238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:04.400978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:04.407454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:04.409615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:04.411746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:04.419054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:04.421299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:04.840766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:04.842598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:04.859000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:04.865688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:04.866201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:04.874869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:04.880770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:04.882326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:04.882842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:04.883298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:04.886959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:04.888974 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-77805382-845d-42a4-9228-5640c2cc69f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.509543 Aug 30 16:37:04.916973 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2853/6122] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:04 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:05.268371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:05.282463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23dc9c0f-07a5-4723-99c4-00b4c8088999 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1325 microversion: 2.1 time: 0.441001 Aug 30 16:37:05.284234 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3270/6123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:04 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:05.920348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:05.921267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:05.950201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:05.953957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:05.956204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:05.964091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:05.964714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:05.965280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:06.304520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:06.305146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:06.314192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:06.327975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:06.334663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:06.336915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:06.345221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:06.352158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:06.352687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:06.858485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:06.878201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:06.892182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:06.901124 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dbbbe19-636b-441d-a0e5-f706527b6716 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.982055 Aug 30 16:37:06.924160 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2854/6124] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:05 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:07.523777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:07.533252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2f5651d-3fd7-4257-912a-05b6570a7cbc tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 1.233808 Aug 30 16:37:07.533847 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3271/6125] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:06 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:07.932272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:07.932887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:07.953957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:07.954487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:07.954926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:07.955627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:07.956082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:07.956501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.566000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:08.566669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:08.601770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.609157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.609697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.614029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:08.618874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:08.619394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:08.977116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:08.986010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:08.999863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:09.002419 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f562e1b5-d0c8-45db-9903-c597661164e2 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 1.074603 Aug 30 16:37:09.003014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2855/6126] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:07 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:37:10.036533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:10.038357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:10.047434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:10.051555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:10.053229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:10.059689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:10.060602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:10.061478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:10.062001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:10.064221 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2eba82d4-17ac-44f1-8194-d7e8b103f955 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 1.506658 Aug 30 16:37:10.075904 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3272/6127] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:08 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:10.752869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:10.762203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:10.768511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:10.776434 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-085b2f78-94ef-4c65-ae72-d5bf6d71ecb6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.747675 Aug 30 16:37:10.796427 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2856/6128] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:10 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:11.087596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:11.088988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:11.100205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:11.105561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.106790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.108165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.111013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.111762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.114393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.416932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:11.437670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.438574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.439279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.453749 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] Creating event network-changed:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:37:11.459873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-11b3de7b-1f5c-4485-9b1e-5f5559c5ae57 req-65c22f26-e0e4-46f9-b9a7-c5dda3a6bc6d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046873 Aug 30 16:37:11.461231 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2857/6129] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:37:11.578874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:11.593886 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ee77c9d-54f5-47fd-ac46-2711d8dab4e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.510736 Aug 30 16:37:11.595835 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3273/6130] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:11 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:11.821829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:11.823024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:11.835453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.836252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.836843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:11.837944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:11.840833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:11.841504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:12.620597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:12.621215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:12.624548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:12.636371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:12.637758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:12.642702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:12.643858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:12.644514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:12.645126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:12.649899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:12.665990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:12.668640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=52 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:12.674966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:12.681806 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a17b05cd-70f7-4228-aa3c-da667b754384 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.861310 Aug 30 16:37:12.683046 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2858/6131] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:11 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:37:13.519420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:13.534670 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7368daa0-7536-4176-9c4c-2434d72c2111 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.917582 Aug 30 16:37:13.541105 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3274/6132] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:12 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:13.709730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:13.711441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:13.718497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:13.728358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:13.732936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:13.734241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:13.740616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:13.741123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:14.210328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:14.232639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:14.239808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:14.241968 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-36de2f22-769d-45c6-b83d-72427701a0fd tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.536844 Aug 30 16:37:14.244669 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2859/6133] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:13 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:14.559029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:14.559674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:14.574775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:14.575293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:14.575749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:14.576470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:14.576940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:14.577380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.270830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:15.272052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:15.286636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.288051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.288749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.289645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:15.292714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:15.293379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:15.660175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:15.700802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:15.707978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:15.714064 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db44fe0c-ed24-4cc0-928c-296c929502a9 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.447511 Aug 30 16:37:15.723708 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2860/6134] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:15 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:16.230990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:16.251510 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1741a41a-8da3-41b8-8da3-93e0359afeb9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 1.696065 Aug 30 16:37:16.258067 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3275/6135] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:14 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:16.750427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:16.751048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:16.754083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:16.767631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:16.788398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:16.789299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:16.792913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:16.795858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:16.798244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:16.804471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=86 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:17.301235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:17.316590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:17.336280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:17.337200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:17.338101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:17.339471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:17.340177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:17.341066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:17.591420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:17.606646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:17.608026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:17.611146 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94e6230f-a580-4b72-86c3-9f175916f625 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.862740 Aug 30 16:37:17.622631 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2861/6136] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:16 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:17.784930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:17.795463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d626580f-851a-40ae-8294-c95b6e4905ab tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.520487 Aug 30 16:37:17.799143 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3276/6137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:17 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:18.638545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:18.639725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:18.654862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.655514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.657953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.659040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.659623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.660655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.823471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:18.824748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:18.844612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.848695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.850940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.856630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:18.857501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:18.858144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:18.921888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:18.931267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:18.935291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:18.937282 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1b7dbdc9-4cbd-47ab-8d40-8c4910256253 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.303378 Aug 30 16:37:18.938621 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2862/6138] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:18 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:19.688854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:19.719274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eb28779f-cd57-403b-83aa-68f517fe0293 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.899721 Aug 30 16:37:19.721856 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3277/6139] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:18 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:19.962736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:19.963639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:19.978493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.979354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.979937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:19.986663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:19.987602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:19.988828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:20.669850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:20.686902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:20.692332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:20.697093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46eb31b9-87e4-4242-afe1-086258bdcbae tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 0.739198 Aug 30 16:37:20.712029 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2863/6140] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:19 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:20.756816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:20.757458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:20.797836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:20.808892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:20.822057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:20.826607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:20.827180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:20.831801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:21.727318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:21.727936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:21.745986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:21.746513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:21.746958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:21.758982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:21.759491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:21.759933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:21.792131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:21.800877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f94433c8-84da-4681-8578-607b3c1b3712 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 1.048551 Aug 30 16:37:21.813297 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3278/6141] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:20 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:22.830918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:22.831581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:22.851754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:22.860893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:22.868045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:22.869498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:22.869968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:22.870803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:22.872975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:22.874983 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9158aca0-9472-43fc-96be-9a6be02e0d96 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1741 microversion: 2.20 time: 1.152347 Aug 30 16:37:22.877890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:22.878375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:22.892892 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2864/6142] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:21 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1741 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:22.913750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-plugged", "status": "completed", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:22.940278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:22.942363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:22.944037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:22.977477 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] Creating event network-vif-plugged:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:37:22.988762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f1a539f9-f012-4438-bfcc-0556b82e8151 req-2ab91df9-b389-4ce5-875b-fdb528d40756 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094125 Aug 30 16:37:22.992685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2865/6143] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:23.560085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:23.574512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b908f0ab-1c61-4488-8e5b-d562a08c96e8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.750733 Aug 30 16:37:23.575444 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3279/6144] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:22 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:23.902765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:23.903465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:23.929693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:23.930211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:23.940202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:23.940975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:23.941456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:23.941892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:24.387042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:24.397384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:24.399227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:24.400758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c30e6530-a3dd-47ea-a4b3-9cb40d50ec11 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1723 microversion: 2.20 time: 0.503320 Aug 30 16:37:24.415406 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2866/6145] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:23 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1723 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:24.596194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:24.596825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:24.604802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:24.605381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:24.606098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:24.608305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:24.608792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:24.609234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:24.862599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:24.878910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f6a8ccd-5a70-4114-b957-1d2a2708c3f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1392 microversion: 2.1 time: 0.286739 Aug 30 16:37:24.879509 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3280/6146] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:24 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1392 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:25.425398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:25.426726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:25.442048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:25.451947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:25.452515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:25.453477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:25.454000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:25.454510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:25.900820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:25.901465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:25.909629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:25.910129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:25.910603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:25.911620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:25.912950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:25.913598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:26.074527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:26.083741 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3532bf7e-ab03-4c01-a9ae-ebfce9d93f48 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1565 microversion: 2.1 time: 0.186157 Aug 30 16:37:26.084353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3281/6147] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:25 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:26.104788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:26.105418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:26.112350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:26.113100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:26.113727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:26.115270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:26.115899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:26.116525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:26.305707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:26.318996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3f57dcd-1226-4ae2-82c7-2e0993ac478b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1565 microversion: 2.1 time: 0.217932 Aug 30 16:37:26.320482 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3282/6148] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:26 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:37:26.366819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:26.386181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:26.392201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:26.393522 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-422fe330-dc05-4cf8-b5a7-2494fd4ed230 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1723 microversion: 2.20 time: 0.972265 Aug 30 16:37:26.394483 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2867/6149] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:25 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1723 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:27.420186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:27.420706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:27.431652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:27.432295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:27.432568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:27.433273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:27.436821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:27.437276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:27.570100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "name": "network-vif-unplugged", "status": "completed", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:27.581528 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:37:27.582010 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 16:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 16:37:27.585310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:27.586024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:27.586696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:27.603018 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] Creating event network-vif-unplugged:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:37:27.616952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-7e55d52c-ee8f-448c-909c-a1fe82778bac req-c70482e8-982b-48b1-aff3-c63ef21552a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050936 Aug 30 16:37:27.618283 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2868/6150] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:27.719615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:27.733725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:27.735976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:27.737451 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-940d7de2-4545-44e7-8d38-6cc0cf14d71f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1723 microversion: 2.20 time: 0.321698 Aug 30 16:37:27.742342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3283/6151] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:27 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:28.774563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:28.775276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:28.790598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:28.811211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:28.812337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:28.813265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:28.813914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:28.822998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:29.852667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:29.861257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:29.873260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:29.875018 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93a09454-0bb4-4f4e-a690-e9ccf418fcb5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1666 microversion: 2.20 time: 1.107641 Aug 30 16:37:29.890709 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2869/6152] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:28 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1666 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:29.906196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddf3cd1b-0482-4b1e-98f8-f2e440e5d432"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:29.908749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:29.926578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:29.927343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:29.927897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:29.928633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:29.929102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:29.929541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:30.410553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:30.412255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:30.436954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:30.443458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:30.445979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:30.447185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:30.452624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:30.453088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:30.692281 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2bdf2c0-40a5-4748-865e-035c78da1195 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.789804 Aug 30 16:37:30.715242 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3284/6153] 10.222.0.47 () {62 vars in 1364 bytes} [Tue Aug 30 16:37:29 2022] POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments => generated 188 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:37:30.732379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:30.781533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:30.787946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:30.789161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:30.845750 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] Creating event network-changed:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:37:30.863726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8f68adcd-aa94-48af-a36e-b0b88c4d1f45 req-0abf7640-ab66-4bd3-8327-801c6624b1f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146784 Aug 30 16:37:30.878192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3285/6154] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:37:31.183036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:31.198822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1d5c2be8-0fcb-4e59-9bd6-1a9246e419c2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1565 microversion: 2.1 time: 0.792769 Aug 30 16:37:31.200588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2870/6155] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:30 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1565 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:37:31.234258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:31.234873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:31.253858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:31.254530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:31.254941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:31.259605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:31.264045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:31.264497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:31.945826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:32.029865 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc6c23e8-9629-45bf-aa3e-4a902f2944b4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments/ddf3cd1b-0482-4b1e-98f8-f2e440e5d432" status: 202 len: 0 microversion: 2.20 time: 0.810636 Aug 30 16:37:32.033674 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3286/6156] 10.222.0.47 () {60 vars in 1457 bytes} [Tue Aug 30 16:37:31 2022] DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments/ddf3cd1b-0482-4b1e-98f8-f2e440e5d432 => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:37:32.115021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:32.116032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:32.127842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:32.128521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:32.129146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:32.130702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:32.131857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:32.132455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:32.230197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122351) unshelve /opt/stack/nova/nova/compute/api.py:4603}} Aug 30 16:37:32.423508 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fde4c949-d90a-4e99-9576-6c646818ff3f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/action" status: 202 len: 0 microversion: 2.20 time: 0.313847 Aug 30 16:37:32.424487 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2871/6157] 10.222.0.47 () {62 vars in 1319 bytes} [Tue Aug 30 16:37:32 2022] POST /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:37:32.440680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:32.448175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:32.487562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:32.497878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:32.500588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:32.503293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:32.510794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:32.524651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:32.975344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:32.999462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:33.011642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:33.013295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef72776d-2ca8-4241-af7a-e858764a2cee tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1674 microversion: 2.20 time: 0.582700 Aug 30 16:37:33.017410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3287/6158] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:32 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1674 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:34.066336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:34.067599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:34.089388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:34.090328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:34.094212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:34.095255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:34.095877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:34.097424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:34.702526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:34.716952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:34.724249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:34.734154 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb389104-8734-4a1c-8a10-319e957158cb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1674 microversion: 2.20 time: 0.679641 Aug 30 16:37:34.734800 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2872/6159] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:34 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1674 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:35.781473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:35.783455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:35.796169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:35.798182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:35.800210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:35.806772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:35.812316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:35.813147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:36.132284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:36.146187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:36.155734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:36.158337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c67d1186-fcac-4d33-aefe-fa247c459b5b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.383384 Aug 30 16:37:36.161820 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3288/6160] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:35 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:37.200571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:37.201929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:37.219284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:37.220358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:37.221004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:37.226334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:37.227218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:37.231847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:37.599717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:37.612457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:37.618754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:37.624933 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f93ccc34-92bb-4f3c-a83e-f99c13dd9d6a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.427091 Aug 30 16:37:37.625740 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2873/6161] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:37 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:38.651148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:38.652252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:38.672266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:38.672770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:38.673221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:38.673949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:38.674448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:38.679830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:39.486377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:39.496197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:39.504433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:39.510564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf871e4f-91ef-419d-8526-d8da87d99355 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.865083 Aug 30 16:37:39.511260 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3289/6162] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:38 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:40.542045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:40.543595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:40.563579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:40.564245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:40.564728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:40.565476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:40.565944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:40.570735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:40.848659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:40.867092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:40.870212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:40.871701 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43884640-6fc9-44fb-9013-0e2e4c76c1d5 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.333534 Aug 30 16:37:40.873578 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2874/6163] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:40 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:41.897125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:41.897749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:41.913861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:41.914386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:41.914867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:41.915573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:41.918866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:41.919690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:42.319591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:42.332090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:42.335652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:42.339722 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1de5a3e1-36a5-49b7-8999-308c3bc9acf3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.447299 Aug 30 16:37:42.347089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3290/6164] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:41 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:43.376565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:43.377909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:43.399131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:43.405171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:43.405977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:43.407079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:43.408087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:43.409659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:44.440769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:44.458566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:44.466440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:44.475830 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aca9770f-4f79-46c7-9de6-82f17aaf80f3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 1.103179 Aug 30 16:37:44.480050 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2875/6165] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:43 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:45.511459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:45.512439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:45.550388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=34 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:45.555222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:45.567225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:45.573354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:45.580324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:45.581575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:45.583220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:46.492617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:46.508491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:46.510538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:46.511937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f6eed109-8e7d-4259-ab99-07b91e056f84 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 1.004632 Aug 30 16:37:46.516117 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3291/6166] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:45 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:47.542649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:47.543332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:47.548310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:47.561559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:47.566375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:47.568237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:47.572842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:47.574607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:47.577547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:47.674418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:37:48.153075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:48.171171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:48.199353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:48.206196 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f90cfdeb-44b3-4dc7-b504-81f71122b962 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.667717 Aug 30 16:37:48.206689 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2876/6167] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:47 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:48.463660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:48.467608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:48.513359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:48.518816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:48.519309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:48.520103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:48.520589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:48.521120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:48.681538 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3a87ebb-107c-442f-93a9-3d59a3ff6b73 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action" status: 200 len: 24572 microversion: 2.1 time: 0.224533 Aug 30 16:37:48.689533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3292/6168] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:37:48 2022] POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action => generated 24572 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:37:49.247896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:49.248631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:49.281313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:49.294442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:49.297400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:49.298259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:49.299097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:49.302170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:49.689322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:49.701850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:49.704305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:49.706232 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7bf3e82-bdd7-4eae-9e5d-8bba9d41583f tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.470464 Aug 30 16:37:49.718904 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2877/6169] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:49 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:50.733686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:50.734489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:50.745811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:50.759220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:50.760018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:50.761013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:50.761522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:50.762017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:51.654268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:51.668931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:51.670506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:51.678674 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b0e0521-776b-403b-8a19-bdd1d8e5b00c tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.949115 Aug 30 16:37:51.679616 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3293/6170] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:50 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:52.707941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:52.709440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:52.725149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:52.727475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:52.728135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:52.732522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:52.733538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:52.735543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:53.123343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:53.133102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:53.134637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:53.135833 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-654f5ef7-0239-4dbb-883a-986c49a1ad62 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.434862 Aug 30 16:37:53.143655 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2878/6171] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:52 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:54.160709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:54.161337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:54.180787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:54.181370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:54.182191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:54.183058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:54.184078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:54.185502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:54.895166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:54.907874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:54.915048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:54.916580 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80017ec1-c283-4bbf-a25b-6f94ef809032 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.760856 Aug 30 16:37:54.918608 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3294/6172] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:54 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:55.944241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:55.949252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:55.985968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:55.987275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:55.989680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:55.993252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:55.995154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:55.996943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:56.353507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:56.363060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:56.365147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:56.375937 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a42b43ba-cdc1-4403-a2da-58805446e830 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.435495 Aug 30 16:37:56.388440 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2879/6173] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:55 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:57.403452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:57.404784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:57.433190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:57.437558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:57.439398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:57.441034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:57.444492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:57.449706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:58.097558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:58.117400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:58.119606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:58.123871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-187c509c-887f-46b0-9dce-6a0a12daf7b0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.724370 Aug 30 16:37:58.124667 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3295/6174] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:57 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:59.158245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:59.159042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:59.174192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:59.175016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:59.177499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:59.179486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:59.181230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:59.181765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:59.429268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:59.442033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:59.443957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:37:59.445367 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f12878b7-69e7-4de4-b012-a3531003fdeb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.292148 Aug 30 16:37:59.447314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2880/6175] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:37:59 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:37:59.690710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:37:59.692877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:37:59.708772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:59.709539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:59.715175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:59.716424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:59.717075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:59.717748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:59.889393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "name": "network-vif-plugged", "status": "completed", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:37:59.923934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:37:59.930540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:37:59.932824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:37:59.965813 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] Creating event network-vif-plugged:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:37:59.974830 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-25c2e9bc-abc6-42ac-bcf2-3682736e8c97 req-6d5e9ce4-9493-48a1-a95f-2ec8e114f9ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088317 Aug 30 16:37:59.976545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2881/6176] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:38:00.495402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:00.496723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:00.519189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:00.520831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:00.525035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:00.525976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:00.526630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:00.527225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:00.807642 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b10a1ff-cea5-4daa-b1f6-3b33c46e9b04 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1837 microversion: 2.1 time: 1.120560 Aug 30 16:38:00.808273 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3296/6177] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:37:59 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1837 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:00.838762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:00.839394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:00.859896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:00.871441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:00.876272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:00.878394 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f7e9139-6e6c-4790-b8ea-e0712d5bacf4 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.408186 Aug 30 16:38:00.880587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:00.881177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:00.881707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2882/6178] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:38:00 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:38:00.899268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:00.900102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:00.900599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:00.901047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.319502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:01.348404 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5779e41-0b88-4bab-a53b-a0331636a412 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1684 microversion: 2.1 time: 0.498919 Aug 30 16:38:01.349187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3297/6179] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:00 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1684 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:01.591901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:01.594349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:01.605729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.621754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.623087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.624823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.630647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.631378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.724793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-656be072-a9e2-4b33-8f11-513e5e0178e5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action" status: 200 len: 32645 microversion: 2.1 time: 0.136990 Aug 30 16:38:01.725878 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2883/6180] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:38:01 2022] POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action => generated 32645 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:38:01.885092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:01.886203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:01.895570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.897644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.898274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.899198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.900008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.900614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.919130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:01.920087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:01.936858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.940589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.941379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:01.942556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:01.945187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:01.963031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:02.301795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a4433ac51af84417a606c829a853ea41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5781dd6afafc47ba9449c8e6a04f6c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:02.302529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] flavor_id is None. Assuming migration. {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4206}} Aug 30 16:38:02.303082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:38:02.306811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:02.428497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:02.443086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:02.444619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:02.446006 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c5543f3-0127-47cb-a054-26d72b3f43da tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.534028 Aug 30 16:38:02.447969 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2884/6181] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:38:01 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:38:03.277621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f4d3b6dc-ba89-4f4b-98cb-cfabc5b1ed59 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action" status: 202 len: 0 microversion: 2.1 time: 1.400134 Aug 30 16:38:03.281366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3298/6182] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:38:01 2022] POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:38:03.288202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:03.289541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:03.311118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:03.313518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:03.317085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:03.320078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:03.320825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:03.323858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:03.478459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:03.478459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:03.494102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:03.494650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:03.497466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:03.498210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:03.498717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:03.499157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:03.823615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:03.839197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:03.843707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:03.846531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2785c5bc-0d50-4b00-9049-ed239a698346 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1732 microversion: 2.20 time: 0.377498 Aug 30 16:38:03.868290 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3299/6183] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:38:03 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1732 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:38:03.884669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:03.901516 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6b8d7e7-f0a7-45ff-acfc-55e417766d42 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1693 microversion: 2.1 time: 0.618264 Aug 30 16:38:03.906988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2885/6184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:03 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1693 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:04.873577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:04.874461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:04.898945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:04.899456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:04.899903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:04.900631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:04.901242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:04.901587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:04.930109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:04.930874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:04.948094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:04.949768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:04.950678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:04.953358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:04.954077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:04.956242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:05.335001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:05.338672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:05.347976 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b62ab07-473c-4caf-a853-cd914d6562bf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1693 microversion: 2.1 time: 0.422282 Aug 30 16:38:05.362333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:05.362333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:05.362333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2111defc-cd38-4f58-b39b-0621c7743c59 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1719 microversion: 2.20 time: 0.491481 Aug 30 16:38:05.362333 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3300/6185] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:38:04 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1719 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:38:05.364110 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2886/6186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:04 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1693 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:06.373131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:06.374498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:06.388766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:06.389425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:06.390267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:06.391053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:06.391991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:06.392648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:06.679594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:06.694020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7eb7fdf4-d03d-48a5-8b5f-4db634014b83 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1693 microversion: 2.1 time: 0.325279 Aug 30 16:38:06.725154 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3301/6187] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:06 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1693 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:07.719115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:07.719914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:07.732142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:07.734646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:07.735429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:07.736469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:07.738935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:07.740529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:08.045298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:08.054652 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21cfc594-6337-49f1-96bd-1f2aa93fdefb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.339386 Aug 30 16:38:08.067635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2887/6188] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:07 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:09.090172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:09.093597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:09.104380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:09.106149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:09.108444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:09.109414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:09.110898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:09.113596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:09.581326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:09.605139 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c5ee98d-4a28-4dfd-a25e-63d03496a8d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.519907 Aug 30 16:38:09.613475 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3302/6189] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:09 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:10.638098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:10.639440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:10.658536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:10.659340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:10.661466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:10.664117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:10.664843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:10.665459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:11.114636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:11.124654 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7387f82c-983b-40b1-838e-0bad7786f164 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.491160 Aug 30 16:38:11.126155 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2888/6190] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:10 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:12.148529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:12.149156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:12.157173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:12.157678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:12.158123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:12.158871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:12.159330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:12.160425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:12.854547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:12.863918 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b8646de2-1c0c-4117-a96e-03f90372d013 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.719126 Aug 30 16:38:12.877719 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3303/6191] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:12 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:13.901593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:13.903332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:13.916109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:13.920645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:13.921210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:13.922836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:13.924557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:13.925871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:14.292522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:14.307086 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-81a4f9a8-ca7b-4406-bd0f-2bd2b644ca20 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.409369 Aug 30 16:38:14.312972 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2889/6192] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:13 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:15.340342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:15.341170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:15.373642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:15.375113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:15.376848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:15.378044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:15.379400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:15.380968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:15.822176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:15.831996 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b2ea6c28-0660-4b83-b4d1-a8f64bbb8383 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.495922 Aug 30 16:38:15.836084 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3304/6193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:15 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:16.857005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:16.858580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:16.874419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:16.877276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:16.882369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:16.883653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:16.887019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:16.887783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:17.553325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:17.564997 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd8a7a3e-7824-4d88-9b71-037bc823e487 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.711807 Aug 30 16:38:17.568059 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2890/6194] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:16 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:18.589336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:18.590044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:18.595598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=30 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:18.600870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:18.603811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:18.606649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:18.611138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:18.611719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:18.612235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:19.061305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:19.096030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2319a47e-a1ff-4b18-b17c-531aff0dc1b2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1698 microversion: 2.1 time: 0.498047 Aug 30 16:38:19.107759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3305/6195] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:18 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1698 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:20.130054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:20.130819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:20.145427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:20.146929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:20.147423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:20.147862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:20.148566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:20.149017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:20.149441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:20.198257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=84 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:21.343396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:21.362103 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3d759b50-dbd2-4dd6-b968-0aaa28c143d8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1697 microversion: 2.1 time: 1.236750 Aug 30 16:38:21.366624 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2891/6196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:20 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1697 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:22.283636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-unplugged", "status": "completed", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:22.305671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:22.307026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:22.307855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:22.351948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Creating event network-vif-unplugged:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h2-830883-28 Aug 30 16:38:22.358418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:38:22.384926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fcc9ab5a-4392-4a60-9794-8e00b9366a36 req-5b3df520-0549-4872-a7c5-88603c30fc44 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104823 Aug 30 16:38:22.391111 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3306/6197] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:22.395767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:22.397365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:22.421086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:22.422954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:22.424080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:22.426416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:22.427112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:22.436297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:23.025982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:23.035490 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-630a9ce6-9cec-424e-8f2b-4a21fdd82cc7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1697 microversion: 2.1 time: 0.649192 Aug 30 16:38:23.036742 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2892/6198] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:22 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1697 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:24.060235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:24.061004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:24.072764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:24.073707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:24.074367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:24.075295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:24.075935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:24.076542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:24.287428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:24.302768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de97c2ae-4a1d-489b-81ac-612e9aa3f163 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1697 microversion: 2.1 time: 0.247143 Aug 30 16:38:24.303638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3307/6199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:24 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1697 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:24.447977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:24.460197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:24.460973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:24.461598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:24.474872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Creating event network-changed:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h2-830883-28 Aug 30 16:38:24.488446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:38:24.502459 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3d5ef63c-2e60-42e2-bdce-f1183bb0a115 req-f791af4f-d6ff-4d36-b017-b808f31d1308 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058186 Aug 30 16:38:24.503924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2893/6200] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:25.328993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:25.329625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:25.339909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:25.345187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:25.346131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:25.347948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:25.348601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:25.349225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:25.934132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:25.946766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36ec0329-f2db-44c3-924f-738c6e0c0fe6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1697 microversion: 2.1 time: 0.622302 Aug 30 16:38:25.948644 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3308/6201] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:25 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1697 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:26.973581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:26.974994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:26.981898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:26.983202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:26.983921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:26.984912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:26.985604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:26.986624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:27.340971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:27.367540 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9baffde-59cc-411b-8860-5fbe5c1d0cee tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1695 microversion: 2.1 time: 0.401757 Aug 30 16:38:27.378784 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2894/6202] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:26 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1695 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:28.402168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:28.403474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:28.415345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:28.416089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:28.418212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:28.429390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:28.430399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:28.433258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:28.577502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1852539168", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:28.686970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:38:28.830576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:28.840638 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06a415c5-2f5a-4465-8288-fb4370f8d38f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1695 microversion: 2.1 time: 0.442182 Aug 30 16:38:28.846557 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3309/6203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:28 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1695 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:29.870239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:29.871581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:29.883543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:29.889448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:29.891010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:29.896887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:29.902200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:29.904341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.187731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:30.209075 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5938164-5ebd-4eee-8af9-bc8d3ff2affa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1692 microversion: 2.1 time: 0.343282 Aug 30 16:38:30.212182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3310/6204] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:29 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1692 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:30.240401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:30.240956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:30.265345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.270978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.275813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.276838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.277484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.278105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.544435 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-361a36ac-44d8-485b-a8d4-9e384f710969 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action" status: 202 len: 0 microversion: 2.1 time: 0.312336 Aug 30 16:38:30.545421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3311/6205] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:38:30 2022] POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:38:30.556342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:30.557064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:30.580222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.581057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.581817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.583212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.583857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.584477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.613605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:30.842548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:38:30.844747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:38:30.846278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:38:30.847722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:38:30.850611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:38:30.878998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.879910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.881609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.882884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:30.883877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:30.884588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:30.919595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Getting quotas for project 3cb971c398514c7c87156498a11046a1. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:38:30.938209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Getting quotas for user 1d40374265534539966623e4c8fbcd0d and project 3cb971c398514c7c87156498a11046a1. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:38:30.958650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:38:30.962703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:38:31.080199 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-770a9846-c4d4-4541-8c6e-1ceb6b62631e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.506223 Aug 30 16:38:31.082172 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2895/6206] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:38:31.110411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4298d9cb-2764-4d88-bbe0-83743579f93a tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:31.111711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4298d9cb-2764-4d88-bbe0-83743579f93a tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:31.460589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4298d9cb-2764-4d88-bbe0-83743579f93a tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:31.475286 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4298d9cb-2764-4d88-bbe0-83743579f93a tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1214 microversion: 2.1 time: 0.377717 Aug 30 16:38:31.489080 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2896/6207] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:31 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1214 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:31.605850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:31.616324 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fef959e7-b237-4586-8be5-98fce9279d60 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 1.066382 Aug 30 16:38:31.619066 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3312/6208] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:30 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:32.497198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:32.497825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:32.528506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:32.529012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:32.536014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:32.539112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:32.540107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:32.542514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:32.641485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:32.642117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:32.676823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:32.684105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:32.684992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:32.686938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:32.691695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:32.692252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:33.493476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:33.511087 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1b44e0d-2a57-4275-9f67-a81acce45c75 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.870766 Aug 30 16:38:33.514051 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3313/6209] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:32 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:33.541310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-plugged", "status": "completed", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:33.576126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:33.582078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:33.582819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:33.633968 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Creating event network-vif-plugged:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h2-830883-28 Aug 30 16:38:33.662625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:38:33.696959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ffd5e9c9-e756-405f-9312-ba29abf77397 req-24895e38-e047-4ac1-a1e5-11f0a939eaf9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173094 Aug 30 16:38:33.703382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3314/6210] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:33.896815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:33.906123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-42a6dd33-4fca-4e21-8bfb-1fae43bdf226 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1218 microversion: 2.1 time: 1.413317 Aug 30 16:38:33.916634 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2897/6211] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:32 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1218 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:34.544389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:34.545566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:34.554471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:34.555421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:34.556153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:34.557622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:34.558074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:34.559011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:34.816439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:34.830109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-436035de-218e-47d8-a1a0-aef131e99fd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.288558 Aug 30 16:38:34.853050 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3315/6212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:34 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:34.945484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:34.946816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:34.960807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:34.961641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:34.963877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:34.964845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:34.968195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:34.968899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:35.207812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:35.232703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb755b24-c833-4442-9a6c-e54e52d4cfe9 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1272 microversion: 2.1 time: 0.290938 Aug 30 16:38:35.233746 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2898/6213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:34 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:35.866342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:35.866342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:35.896549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:35.897099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:35.902390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:35.903597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:35.904090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:35.907971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:36.261271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:36.262234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:36.288007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:36.288568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:36.289060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:36.289841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:36.290331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:36.300090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:36.620801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:36.634907 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ca73559-3099-49da-80cc-8b3a6eaac46c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1272 microversion: 2.1 time: 0.378918 Aug 30 16:38:36.639165 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2899/6214] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:36 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1272 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:36.653625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:36.664655 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3c84f37-325e-40d5-8691-5743ea65dd8d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.807411 Aug 30 16:38:36.666033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3316/6215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:35 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:37.671080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:37.673915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:37.686120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:37.686681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:37.687997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:37.694831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:37.696246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:37.696871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:37.698017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:37.698821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:37.720310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:37.720838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:37.721826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:37.722579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:37.723042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:37.723467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:38.211774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:38.227220 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b1b4cbcc-16d4-4b85-baea-98d9f8d22e29 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.559087 Aug 30 16:38:38.228842 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2900/6216] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:37 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:38.737438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:38.752039 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3c7f4bf-c3c7-493a-9f7d-d277f4c35a16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 1.059516 Aug 30 16:38:38.755051 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3317/6217] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:37 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:39.176027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3ca4784-e6d5-4ffc-95cf-f676a4d4a9bb tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: .version_select at 0x7fd35c2c34c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1294772867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlh2BYH50a+Pm1/b/n9HU0FRrEHeirgxrCPYkZlZP3aPVqJAu52hCD6wF5CfL6R8Uu0uJB9XnqKRkiQfhRJv5mTKEjXGZK7eDD8ysY5orJNzaBphZq9Z1iXXVHiX+igLg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:39.218070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c3ca4784-e6d5-4ffc-95cf-f676a4d4a9bb tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:38:39.231618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c3ca4784-e6d5-4ffc-95cf-f676a4d4a9bb tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:38:39.253430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:39.254638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:39.267375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:39.268425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:39.270437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:39.271178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:39.274269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:39.274961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:39.296843 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3ca4784-e6d5-4ffc-95cf-f676a4d4a9bb tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.126030 Aug 30 16:38:39.305083 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2901/6218] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:38:39 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:39.515871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-unplugged", "status": "completed", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:39.545964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:39.548000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:39.548477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:39.597258 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Creating event network-vif-unplugged:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:38:39.616514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:38:39.654284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:39.655562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-be866f57-27ee-49b1-b931-42c8feec61b1 req-3d7d3483-d47c-40e8-9b8a-1e3e4089dce5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145895 Aug 30 16:38:39.660196 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2902/6219] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:38:39.667534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b0e81c6-80c9-4464-8acf-38d141ab2b2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.418344 Aug 30 16:38:39.677141 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3318/6220] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:39 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:39.778092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:39.778925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:39.822827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:39.823593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:39.824740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:39.828540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:39.830242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:39.831264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:40.516421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:40.531054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8737def9-dbd0-4aac-9cba-37ad5d44395d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.758404 Aug 30 16:38:40.531921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2903/6221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:39 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:40.699063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:40.699701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:40.714560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:40.715069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:40.715522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:40.716316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:40.716698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:40.717138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:41.568843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:41.570534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:41.573833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:41.581769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:41.582555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:41.583245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:41.586398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:41.599956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:41.600817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:41.860036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:41.871901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e00e3bc5-bf73-40f0-a555-cd33ac6c3526 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 1.176726 Aug 30 16:38:41.874927 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3319/6222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:40 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:41.880843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}, {"name": "network-changed", "server_uuid": "d8658a3a-b176-4f45-abeb-35ad83578fc9", "tag": "a4fec3a5-5099-4b85-9914-91baacb90ca0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:41.909640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:41.915433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:41.916148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:41.942809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Creating event network-changed:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:38:41.951929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Creating event network-changed:a4fec3a5-5099-4b85-9914-91baacb90ca0 for instance d8658a3a-b176-4f45-abeb-35ad83578fc9 on n-h2-830883-28 Aug 30 16:38:41.962531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:38:42.000215 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-00084b9d-691d-44de-a48e-236c656d1147 req-5221521a-2f50-48ba-b35d-75effc345ff1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123574 Aug 30 16:38:42.001495 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3320/6223] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:42.909615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:42.910422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:42.916930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:42.917424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:42.917861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:42.918594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:42.919246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:42.919673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:43.024732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:43.038231 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dfe74aaa-b48e-4824-93e1-bc6806c9bfdf tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 1.483046 Aug 30 16:38:43.040083 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2904/6224] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:41 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:43.303819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:43.328915 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3389e1e-8fee-4fa4-9446-86aa80a3c48f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.432539 Aug 30 16:38:43.330480 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3321/6225] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:42 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:44.061490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:44.062883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:44.083407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:44.086990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:44.087724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:44.090550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:44.091918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:44.094644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:44.351174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:44.352433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:44.375212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:44.375940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:44.378364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:44.380263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:44.381710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:44.388279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:44.586540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:44.601565 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e891a7d-1402-4bc2-aa0d-f3451eb10018 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.540609 Aug 30 16:38:44.604057 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2905/6226] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:44 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:44.625871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-114737628", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "3d9bf16d-e6b5-4203-8d26-f4ad8670379a"}], "key_name": "tempest-TestNetworkBasicOps-1294772867", "security_groups": [{"name": "tempest-secgroup-smoke-1552426493"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:44.728482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:44.746079 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ae242c0-306a-4cdc-ad3f-16900b9d74ab tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.398898 Aug 30 16:38:44.746718 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3322/6227] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:44 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:44.943740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] validate_networks() for [('3d9bf16d-e6b5-4203-8d26-f4ad8670379a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:38:45.631385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:45.632103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:45.650220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:45.650967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:45.656508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:45.657700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:45.658218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:45.659800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:46.078450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:46.103386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-61c58224-dfe8-48ee-8a95-46dfad304897 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1691 microversion: 2.1 time: 0.478025 Aug 30 16:38:46.104342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3323/6228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:45 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1691 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:46.109937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:46.115279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:46.135878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:46.136672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:46.137818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:46.139459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:46.139911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:46.140580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:46.531921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:46.556874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aa958aa3-1160-4e98-af57-acbb836b509d tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.451368 Aug 30 16:38:46.558150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3324/6229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:46 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:47.125826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:47.126538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:47.139423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.139927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.140374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.141088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.141553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.141986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.157505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:38:47.159580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:38:47.160240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:38:47.160845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:38:47.161454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:38:47.185010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.186542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.189225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.191652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.195045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.195711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.250096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:38:47.257658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:38:47.275225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:38:47.277923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:38:47.398224 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5f50e95-9096-4fa6-8a08-3c83e457cd05 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.781593 Aug 30 16:38:47.399229 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2906/6230] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:38:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:38:47.413349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fede43f1-e821-42b2-8d1d-3a136b30604a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:47.413951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fede43f1-e821-42b2-8d1d-3a136b30604a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:47.525426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:47.542977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7e02877-7b1f-45dc-9af4-8352dff8a6eb tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1684 microversion: 2.1 time: 0.422036 Aug 30 16:38:47.543583 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3325/6231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:47 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1684 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:47.580485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:47.581711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:47.595522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.596862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.597550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.598770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:47.599412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:47.600039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:47.759695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fede43f1-e821-42b2-8d1d-3a136b30604a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:47.770748 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fede43f1-e821-42b2-8d1d-3a136b30604a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1248 microversion: 2.1 time: 0.363574 Aug 30 16:38:47.782583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2907/6232] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:47 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1248 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:48.145783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:48.155560 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f7bec62-47d2-4990-8e84-fb3d0ad4bc2f tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.579133 Aug 30 16:38:48.158611 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3326/6233] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:47 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:48.793287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:48.794879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:48.807179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:48.815176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:48.815863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:48.819177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:48.820511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:48.821771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:48.967030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:48.982758 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fb08821c-00a6-4d4d-ab3d-96a804154e44 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1300 microversion: 2.1 time: 0.193229 Aug 30 16:38:48.996475 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2908/6234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:48 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:49.184462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:49.185105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:49.196280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=48 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:49.208181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:49.208895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:49.241329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:49.242358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:49.243162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:49.243800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:49.854209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:49.872354 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b93731ef-d89f-40db-87c7-e17ed70a8707 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.691053 Aug 30 16:38:49.873732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3327/6235] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:49 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:50.016474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:50.018656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:50.032098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:50.035035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:50.035767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:50.036753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:50.040852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:50.041726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:50.293288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:50.295650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=82 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:50.311534 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58a1645b-2ad8-4f50-9c01-22544ae817f6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1306 microversion: 2.1 time: 0.299040 Aug 30 16:38:50.312296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2909/6236] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:50 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1306 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:50.896526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:50.897154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:50.917246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:50.918500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:50.919143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:50.924933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:50.925830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:50.926510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:51.334184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:51.335820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:51.352053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:51.353934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:51.354855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:51.355916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:51.356818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:51.357448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:51.358074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:51.495075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:51.506166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00fe52be-fb1e-4161-8646-a2ea8ac2b9ad tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1306 microversion: 2.1 time: 0.176761 Aug 30 16:38:51.507561 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2910/6237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:51 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:51.780427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:51.793744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8c0aff4b-0ae7-4265-b6f4-e9e689b1d9a6 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.902014 Aug 30 16:38:51.806291 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3328/6238] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:50 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:52.489529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-plugged", "status": "completed", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:52.521472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:52.527069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:52.528500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:52.528679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:52.530075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:52.552088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:52.552925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:52.556675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:52.557854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:52.560553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:52.561108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:52.561624 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] Creating event network-vif-plugged:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:38:52.573602 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6861dd0a-1608-407a-88e4-a7006a49b9ed req-2da7044c-da53-4bf8-b7f5-e05a7a9a44b7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088828 Aug 30 16:38:52.574875 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2911/6239] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:52.620546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:52.826720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:52.829306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:52.841750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:52.845411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:52.848400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:52.850965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:52.851817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:52.853223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:53.164868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:53.193329 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a636f786-fcbc-46f9-8335-2529943f7bc6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.668577 Aug 30 16:38:53.194150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3329/6240] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:52 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:53.639463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:53.652532 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58b2ea48-97f8-4fbc-8c13-fc206354f649 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.830381 Aug 30 16:38:53.653613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2912/6241] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:52 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:38:53.950870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98e596-43c6-4933-9d94-486b1ff1bafb", "tag": "b576f856-818f-4aca-8770-10ad0325fda9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:53.973756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:53.974256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:53.975023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.005437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] Creating event network-changed:b576f856-818f-4aca-8770-10ad0325fda9 for instance 3b98e596-43c6-4933-9d94-486b1ff1bafb on n-h1-830883-28 Aug 30 16:38:54.018810 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9502d1a7-dbd5-4c45-8a17-4ebac77814b6 req-b2b0091b-0911-4b4b-9785-2097a2fab2d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072541 Aug 30 16:38:54.022523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3330/6242] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:54.219990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:54.221699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:54.232049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:54.232906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:54.233590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.234509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:54.235204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:54.235863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.605867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8658a3a-b176-4f45-abeb-35ad83578fc9", "name": "network-vif-plugged", "status": "completed", "tag": "a4fec3a5-5099-4b85-9914-91baacb90ca0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:54.615045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:54.630463 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-81c1e7fb-f856-4235-b815-ba2326121692 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.420003 Aug 30 16:38:54.635728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2913/6243] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:54 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:54.648605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:54.649469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:54.650158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.687855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:54.689334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:54.702479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:54.703330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:54.704008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.706270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:54.707748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:54.710507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:54.725338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] Creating event network-vif-plugged:a4fec3a5-5099-4b85-9914-91baacb90ca0 for instance d8658a3a-b176-4f45-abeb-35ad83578fc9 on n-h2-830883-28 Aug 30 16:38:54.753977 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9f2134a0-fd75-4cb5-8344-408a0a91fc92 req-3f6ff847-2354-4feb-90a3-7e7a5bbf2091 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147376 Aug 30 16:38:54.757585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3331/6244] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:55.125849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:55.140787 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2454b051-ec8f-4e10-83e2-da2a74a15813 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.470837 Aug 30 16:38:55.144127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2914/6245] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:54 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:55.672159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:55.673539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:55.731281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:55.732194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:55.732912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:55.733924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:55.734871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:55.737273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:56.037567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:56.045457 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16785b20-ff83-4034-a1a5-13a30dd1732a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.378530 Aug 30 16:38:56.046051 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3332/6246] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:55 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:56.165536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:56.167246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:56.177879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:56.182561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:56.183307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:56.187702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:56.188454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:56.190640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:56.456163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:56.466839 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-800ec071-d267-4edf-a895-6c82c42f891e tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1314 microversion: 2.1 time: 0.305527 Aug 30 16:38:56.467891 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2915/6247] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:56 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:57.067183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:57.067840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:57.075247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.075839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.076361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:57.077081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.077748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.078393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:57.396679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:57.419337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-235defb5-bb66-4b1c-bb7b-5097b963cc0e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.356569 Aug 30 16:38:57.419942 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3333/6248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:57 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:57.488741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:57.489360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:57.504914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:57.506588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.507057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.507491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:57.508198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.508645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.510981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:57.769579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=20 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:38:57.775237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:57.799176 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7f7dcdc-f63b-40c5-a785-67a3d36f4c44 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1463 microversion: 2.1 time: 0.314457 Aug 30 16:38:57.802645 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2916/6249] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:57 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:38:57.821928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "415505d1-cbae-4cd7-8df0-7312686af9b0", "device": "/dev/sdb"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:38:57.824402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:57.831915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.832414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.832856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:57.833757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:57.834220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:57.834957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:58.176413 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-735b9810-9d0c-45f8-a64b-304e6041476c tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "POST /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357983 Aug 30 16:38:58.178500 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3334/6250] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 16:38:57 2022] POST /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:38:58.440015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:38:58.440646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:38:58.457997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:58.458536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:58.458978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:58.459690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:38:58.460149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:38:58.460576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:38:59.007587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:38:59.020355 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5fafcd7d-0ebd-41b3-a6cd-d239a332da3f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.584267 Aug 30 16:38:59.023301 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2917/6251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:38:58 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:00.048064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:00.049990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:00.065871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:00.066704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:00.067407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:00.068694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:00.069726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:00.070841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:00.552950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:00.565927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80716267-0566-4125-a015-1b3d87607fd0 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.522320 Aug 30 16:39:00.567283 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3335/6252] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:00 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:01.136297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:01.143774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:01.189819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.190504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.191039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.195841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.196380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.196835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.260604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b217ff67-196b-44c7-858e-37b5263a218b tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.134941 Aug 30 16:39:01.263396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2918/6253] 10.222.0.47 () {60 vars in 1343 bytes} [Tue Aug 30 16:39:01 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:01.425356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:01.427288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:01.436527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.437291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.440621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.445838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.446593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.447208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.501556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:39:01.590590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:01.591387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:01.608939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.609620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.610752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.612824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.616721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.617435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.699790 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9fa48cc4-2f3a-4b2a-b4a3-9e92c16cf221 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 204 len: 0 microversion: 2.20 time: 0.282275 Aug 30 16:39:01.703903 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3336/6254] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:39:01 2022] DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:39:01.721691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:01.722449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:01.744999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.745513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.745957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.747930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:01.755216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:01.755957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:01.950171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:01.971263 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-659fbe60-1435-4898-b69d-909dd3e633f2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.375859 Aug 30 16:39:01.972796 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2919/6255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:01 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:02.154567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:02.166214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:02.174062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:02.177498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d49fcef-1e9d-4ac5-8384-8fe9db655ff8 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.472112 Aug 30 16:39:02.186990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3337/6256] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:01 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:39:02.995151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:02.995693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:03.012624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:03.016243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:03.016701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:03.019908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:03.020427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:03.022872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:03.203790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:03.206588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:03.242198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:03.280204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:03.280909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:03.284752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:03.285851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:03.290567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:03.803504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:03.824931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:03.828169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:03.831366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89e6e1b8-d876-4812-8b12-31777b5005f0 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.631267 Aug 30 16:39:03.835406 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3338/6257] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:03 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:39:03.890521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:03.906823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02bf6ea5-e96e-4ab2-810d-3ffec13c35f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.916622 Aug 30 16:39:03.907421 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2920/6258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:02 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:39:04.859524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:04.860164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:04.869834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:04.870635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:04.871251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:04.872167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:04.873482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:04.874115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:04.934987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:04.935654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:04.950873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:04.951635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:04.952309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:04.955953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:04.956671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:04.957528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:05.130602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:05.152253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:05.162659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:05.164608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9a2cb6c-15e5-4565-842b-b505057c0714 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1725 microversion: 2.20 time: 0.310498 Aug 30 16:39:05.165382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3339/6259] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:04 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:39:05.464199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:05.488214 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a62bd84c-9ba9-40d0-b3a0-e643e123f5e7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.557814 Aug 30 16:39:05.489403 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2921/6260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:04 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:39:06.200634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:06.204220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:06.228666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.236993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.240851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.243187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.244802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.245748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.441662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:06.453182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:06.460350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:06.461580 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-860f4180-505e-4d90-95a2-ed254445e077 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1657 microversion: 2.20 time: 0.271513 Aug 30 16:39:06.462152 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3340/6261] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:06 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1657 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:39:06.509031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:06.509639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:06.521932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.522710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.523319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.526729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.531168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.531844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.763255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a255ec-3d07-4369-b7ca-20900264fcd8", "name": "network-vif-deleted", "tag": "8b1e97dc-39ae-4071-a676-3867c2c76757"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:06.786895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.787317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.788106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.834862 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] Creating event network-vif-deleted:8b1e97dc-39ae-4071-a676-3867c2c76757 for instance 72a255ec-3d07-4369-b7ca-20900264fcd8 on n-h2-830883-28 Aug 30 16:39:06.841383 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-87192632-2387-42e9-9e85-364e22b8b2e5 req-3e87cc63-7a4c-4474-a3c5-2c267ef93ca9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081597 Aug 30 16:39:06.842580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3341/6262] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:06.902878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98e596-43c6-4933-9d94-486b1ff1bafb", "name": "network-vif-plugged", "status": "completed", "tag": "b576f856-818f-4aca-8770-10ad0325fda9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:06.916768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:06.917243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:06.917676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:06.945981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] Creating event network-vif-plugged:b576f856-818f-4aca-8770-10ad0325fda9 for instance 3b98e596-43c6-4933-9d94-486b1ff1bafb on n-h1-830883-28 Aug 30 16:39:06.971504 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-202b91d9-9610-4ba1-b670-ed2b97abb3e2 req-ac47f338-abaa-4e32-8dc9-7234ee2fbf9d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082010 Aug 30 16:39:06.973023 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3342/6263] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:39:07.041093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:07.076243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-adcf020c-ce7d-4e78-89a0-ee9bb6e5266a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.570917 Aug 30 16:39:07.083719 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2922/6264] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:06 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:07.491029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:07.492352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:07.510995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:07.511566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:07.514504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:07.528294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:07.529278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:07.529918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:07.658695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:07.660035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:07.661009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:07.662096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lazy-loading 'fault' on Instance uuid 72a255ec-3d07-4369-b7ca-20900264fcd8 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:39:07.787783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:07.803072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:07.811350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0510a99bf7f44958e978e7c9dba41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe02a8ef9802492eb1451995202d3eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:07.812860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c02ad27e-4c7d-47ee-9111-1a5c1fb0cd8e tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 200 len: 1371 microversion: 2.20 time: 0.331775 Aug 30 16:39:07.813620 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3343/6265] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:07 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:39:08.105642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:08.106264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:08.116194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:08.116688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:08.117131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:08.117840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:08.118314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:08.122952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:08.378776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:08.387957 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1370a5cb-a72e-4475-8d9e-46d91a37e793 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1374 microversion: 2.1 time: 0.286487 Aug 30 16:39:08.407388 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2923/6266] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:08 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1374 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:08.839544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:08.841089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:08.865270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:08.868132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:08.870275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:08.874844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:08.875502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:08.876103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:08.915468 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 HTTP/1.1 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '72a255ec-3d07-4369-b7ca-20900264fcd8'} Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:08.919598 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:08.924768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6aa0ac28-891b-4250-9c6e-93f2208f57f6 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 404 len: 111 microversion: 2.20 time: 0.085755 Aug 30 16:39:08.932065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-543c8bf2-dded-4d7c-a5cc-08aa512cc31a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '.version_select at 0x7fd35d2f95e0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:08.954886 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3344/6267] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:08 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:39:08.976539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-543c8bf2-dded-4d7c-a5cc-08aa512cc31a tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641958650" status: 204 len: 0 microversion: 2.20 time: 0.048228 Aug 30 16:39:08.981765 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2924/6268] 10.222.0.47 () {60 vars in 1262 bytes} [Tue Aug 30 16:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1641958650 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 16:39:09.412953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:09.414360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:09.430470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:09.431519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:09.433132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:09.435003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:09.437696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:09.440933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:09.820205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:09.833425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-de2aeb59-3b6b-471d-b1dc-69bae9b40c7b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1546 microversion: 2.1 time: 0.423690 Aug 30 16:39:09.834023 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3345/6269] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:09 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1546 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:09.861564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:09.862226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:09.885818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:09.886850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:09.888446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:09.889477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:09.890162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:09.890891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:10.189555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:10.195806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:10.205112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:10.208864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:10.209642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:10.210972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:10.211695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:10.212373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:10.228417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:10.308330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5217872-b9f2-4d29-acd6-d08f1cbcd263 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action" status: 200 len: 63131 microversion: 2.1 time: 0.127469 Aug 30 16:39:10.310164 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3346/6270] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:39:10 2022] POST /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74/action => generated 63131 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:39:10.487379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:10.506199 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6986b3f8-079c-4930-993b-d153e5b31162 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1546 microversion: 2.1 time: 0.646246 Aug 30 16:39:10.507299 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2925/6271] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:09 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1546 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:15.075898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:15.078409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:15.115330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:15.118272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:15.119048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:15.120909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:15.123860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:15.124540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:15.161036 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 HTTP/1.1 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '72a255ec-3d07-4369-b7ca-20900264fcd8'} Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:15.170923 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.176522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.178683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:15.179910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6deb8cbe-6a6f-467d-992f-46a5a4871d86 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 404 len: 111 microversion: 2.20 time: 0.111273 Aug 30 16:39:15.180992 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3347/6272] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:39:15 2022] DELETE /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:39:15.190190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:15.191756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 72a255ec-3d07-4369-b7ca-20900264fcd8] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:15.202587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:15.207199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:15.207773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:15.208630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:15.210313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:15.211380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:15.243522 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 HTTP/1.1 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '72a255ec-3d07-4369-b7ca-20900264fcd8'} Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.245372 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:15.250745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 72a255ec-3d07-4369-b7ca-20900264fcd8 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:15.256940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80e0cf27-18aa-4f5a-a874-31605b1d15eb tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8" status: 404 len: 111 microversion: 2.20 time: 0.064499 Aug 30 16:39:15.256940 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2926/6273] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:15 2022] GET /compute/v2.1/servers/72a255ec-3d07-4369-b7ca-20900264fcd8 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 16:39:15.885962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b98e596-43c6-4933-9d94-486b1ff1bafb", "tag": "b576f856-818f-4aca-8770-10ad0325fda9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:15.909897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:15.910330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:15.910784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:15.962224 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] Creating event network-changed:b576f856-818f-4aca-8770-10ad0325fda9 for instance 3b98e596-43c6-4933-9d94-486b1ff1bafb on n-h1-830883-28 Aug 30 16:39:15.972283 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f96fb348-0b9d-4571-83eb-88a5224f5cae req-c5ace23f-40d7-495a-b814-080464397951 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090581 Aug 30 16:39:15.976203 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3348/6274] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:16.871083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:16.871868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:16.894226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:16.895023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:16.895676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:16.899759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:16.900484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:16.901778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:17.943055 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8690d630-14c9-49ed-aada-61bcab51bc48 tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1837 microversion: 2.1 time: 1.398475 Aug 30 16:39:17.943767 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2927/6275] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:16 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1837 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:22.208727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:22.209259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:22.214536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:22.244220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.248308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.248891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.261346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.263110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.265368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.312814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e HTTP/1.1 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '001c8996-5696-42df-9845-1d837dba1e0e'} Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:22.319612 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.324986 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.326880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:22.328174 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0acd2881-8367-455e-89fd-43509e655aed tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 404 len: 111 microversion: 2.20 time: 0.124527 Aug 30 16:39:22.336045 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3349/6276] 10.222.0.47 () {60 vars in 1280 bytes} [Tue Aug 30 16:39:22 2022] DELETE /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:39:22.340722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:22.341364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] [instance: 001c8996-5696-42df-9845-1d837dba1e0e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:22.344527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:22.366895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.367408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.367855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.368584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.369043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.369488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.389280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:22.417244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] HTTP exception thrown: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Request method failure captured: Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e HTTP/1.1 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjsi_SNIWLJZS8vSznI6t0gQHd0_USMru9QsHU_o9Gqoy9pOGvXMsn5yy_uh4gZAguJ5WNDPC3ODHRS6QPv_xGL9M8Xc_kZOqG3Jvu8xTrLf1xoJkBI2z_smwhkQMdHwrizbrAq5bwdmyKdEajAXQyFM2vr-jbZ0QSczCf1uuDenrLI Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fe02a8ef9802492eb1451995202d3eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fe02a8ef9802492eb1451995202d3eb7"}]}] Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: fe02a8ef9802492eb1451995202d3eb7 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1743887819 Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f0510a99bf7f44958e978e7c9dba41ae Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1743887819-project Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '001c8996-5696-42df-9845-1d837dba1e0e'} Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.446877 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] Returning 404 to user: Instance 001c8996-5696-42df-9845-1d837dba1e0e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:22.455576 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8abef73d-67a5-4b35-b37c-562bb0c05ed3 tempest-AttachVolumeShelveTestJSON-1743887819 tempest-AttachVolumeShelveTestJSON-1743887819-project] 10.222.0.47 "GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e" status: 404 len: 111 microversion: 2.20 time: 0.112142 Aug 30 16:39:22.463001 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2928/6277] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Aug 30 16:39:22 2022] GET /compute/v2.1/servers/001c8996-5696-42df-9845-1d837dba1e0e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:39:22.468440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:22.469162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:22.479326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.480665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.481698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.483465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.484599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.487055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.567326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:39:22.757475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:22.778663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.779146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.784171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.853573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] Creating event network-changed:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:39:22.878011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-63a8054e-6b97-4a15-8966-6c314a054a25 req-9f40e986-59dc-42c1-bc4b-3974c9b9176e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336118 Aug 30 16:39:22.878771 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2929/6278] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:22.884641 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-89a11f06-744b-4078-acad-968b2e0a683a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 204 len: 0 microversion: 2.1 time: 0.419991 Aug 30 16:39:22.889249 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3350/6279] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:39:22 2022] DELETE /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:39:22.901771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:22.902523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:22.931125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.931647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.939709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:22.940642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:22.941139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:22.941587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:23.410853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:23.422236 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d20e443-08af-499d-8386-24b07cd71c6c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1571 microversion: 2.1 time: 0.531786 Aug 30 16:39:23.431026 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2930/6280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:22 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1571 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:39:24.448403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:24.449440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:24.469129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:24.472157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:24.472982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:24.479219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:24.480690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:24.480690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:25.247711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:25.265057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1b66c58-1c37-4882-b1fd-464ffceff4dd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1571 microversion: 2.1 time: 0.820665 Aug 30 16:39:25.267591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3351/6281] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:24 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1571 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:26.204278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a887cf2-2c99-4a49-a635-bda556c22c74", "name": "network-vif-deleted", "tag": "ef5152c0-7ab2-4714-a96e-06c0be8da22f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:26.229809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:26.230679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:26.231311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:26.261218 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] Creating event network-vif-deleted:ef5152c0-7ab2-4714-a96e-06c0be8da22f for instance 0a887cf2-2c99-4a49-a635-bda556c22c74 on n-h1-830883-28 Aug 30 16:39:26.267828 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-31723135-0974-42c6-a845-17f1fee821f6 req-a6232d8f-0dcd-4773-a936-530617374133 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067682 Aug 30 16:39:26.269648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2931/6282] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:26.292823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:26.294293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:26.308381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:26.309848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:26.314841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:26.315914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:26.316694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:26.317369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:26.384666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:26.385191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:26.385635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:26.386100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lazy-loading 'fault' on Instance uuid 0a887cf2-2c99-4a49-a635-bda556c22c74 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:39:26.518715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:26.527306 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11724581-0c64-41ab-8c5e-0a277b04351d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 200 len: 1357 microversion: 2.1 time: 0.238774 Aug 30 16:39:26.532381 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3352/6283] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:26 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:39:27.559902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:27.560537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 0a887cf2-2c99-4a49-a635-bda556c22c74] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:27.587017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:27.594289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:27.595096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:27.600515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:27.601238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:27.601860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:27.635095 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] HTTP exception thrown: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Request method failure captured: Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 HTTP/1.1 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjvfa4TbGMD0AzTWRHg5GAAcH2s1jHgIUfTkgWn9KGgA3VCoFY-lBY7E3L_A8k-GG9JGi42RnJsvxbNArleNZfWmZpVjAHeeuJWH2zgYitlC9RCaZOwdgcu0BR8vS28h2b4DGTUiSCO_Em0U73Jg_E9MBEQWO4VKHtZgexE9gwJjkWs Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b9801e8110649beb6683e701536b207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b9801e8110649beb6683e701536b207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}] Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 41f1684f44264fdcb3e07f501ac6da6a Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '0a887cf2-2c99-4a49-a635-bda556c22c74'} Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:27.641956 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. Aug 30 16:39:27.647710 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:27.649669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Returning 404 to user: Instance 0a887cf2-2c99-4a49-a635-bda556c22c74 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:27.650802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a55830d-511a-4183-860a-7dabc0d409d5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74" status: 404 len: 111 microversion: 2.1 time: 0.096422 Aug 30 16:39:27.658261 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2932/6284] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:27 2022] GET /compute/v2.1/servers/0a887cf2-2c99-4a49-a635-bda556c22c74 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:39:33.660421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:33.668088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:33.712848 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:39:33.713350 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 16:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb/action (ip 10.222.0.47) !!! Aug 30 16:39:33.737299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:33.738173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:33.739200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:33.740272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:33.743527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:33.745755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:33.886712 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a73c982-be26-4ee9-9220-02280278afbc tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb/action" status: 200 len: 24567 microversion: 2.1 time: 0.232836 Aug 30 16:39:33.887355 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3353/6285] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:39:33 2022] POST /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb/action => generated 24567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:39:36.429257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e404a739-8666-4301-b0e2-c966c06ba4e3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '.version_select at 0x7fd35cd9b310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:36.489357 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e404a739-8666-4301-b0e2-c966c06ba4e3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1886900762" status: 202 len: 0 microversion: 2.1 time: 0.066244 Aug 30 16:39:36.491137 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2933/6286] 10.222.0.47 () {58 vars in 1284 bytes} [Tue Aug 30 16:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1886900762 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:39:36.539656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5a2772e-adea-4e11-aa5d-db3603d8480b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: .version_select at 0x7fd357fced30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-826267104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFIhpKfYpLPiOLKq9889s4Vv1W7bvUUGtVjeE3EMyTd/6R4ZM78QyqipJZp+2mFk5xJwRSzcYDgm5TxuHCxRwxesa4tGH58w66gFMDbcBN57OP6FUadR6U56DGBouyovA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:36.612013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b5a2772e-adea-4e11-aa5d-db3603d8480b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:39:36.619545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-b5a2772e-adea-4e11-aa5d-db3603d8480b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:39:36.686037 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5a2772e-adea-4e11-aa5d-db3603d8480b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.151216 Aug 30 16:39:36.689554 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3354/6287] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:39:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:39:37.990454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=13 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:38.301949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb2fd7c9-13d7-4816-9270-794f4495a9bf tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Action: 'create', calling method: .version_select at 0x7fd35c2eea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-310944331", "metadata": {"Type": "work"}}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:39.067199 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb2fd7c9-13d7-4816-9270-794f4495a9bf tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.083904 Aug 30 16:39:39.068692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2934/6288] 10.222.0.47 () {60 vars in 1156 bytes} [Tue Aug 30 16:39:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1085 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 16:39:39.081552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77a2a4ff-c47b-453b-a37c-5e574d482d99 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35c0cac10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:39.211781 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77a2a4ff-c47b-453b-a37c-5e574d482d99 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.135319 Aug 30 16:39:39.212921 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3355/6289] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:39 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:40.230114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-769973aa-6778-403b-8e21-673f18e58c87 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35c203dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:40.324247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-769973aa-6778-403b-8e21-673f18e58c87 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.100779 Aug 30 16:39:40.326133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2935/6290] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:40 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:41.343368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e958d78a-ddcb-48b7-9d95-dfe0567fd443 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd357833f70>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:41.450155 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e958d78a-ddcb-48b7-9d95-dfe0567fd443 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 353 microversion: 2.1 time: 0.113269 Aug 30 16:39:41.451077 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3356/6291] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:41 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:41.464503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0104f07d-a4b1-4dc4-a6f1-f82ec61a1905 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35c203b80>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:41.534832 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0104f07d-a4b1-4dc4-a6f1-f82ec61a1905 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 353 microversion: 2.1 time: 0.074117 Aug 30 16:39:41.549209 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2936/6292] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:41 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:41.550815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9c326bd-9089-4c8e-9a56-15ca40a44511 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35782ce50>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:41.687427 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9c326bd-9089-4c8e-9a56-15ca40a44511 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 202 len: 0 microversion: 2.1 time: 0.141951 Aug 30 16:39:41.689772 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3357/6293] 10.222.0.47 () {58 vars in 1248 bytes} [Tue Aug 30 16:39:41 2022] DELETE /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:39:41.700387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46fd23ef-c3b0-4b6e-9999-e04349219c7e tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35da773a0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:41.788090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46fd23ef-c3b0-4b6e-9999-e04349219c7e tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.092977 Aug 30 16:39:41.789212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2937/6294] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:41 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:42.802380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-78be9e23-e81e-4288-a824-7372258f6bf9 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd3578278b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:42.895859 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-78be9e23-e81e-4288-a824-7372258f6bf9 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.098071 Aug 30 16:39:42.903145 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3358/6295] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:42 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:43.909947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f09f5bfe-c275-4979-9a17-181b59872c75 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35cad3670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:44.028818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f09f5bfe-c275-4979-9a17-181b59872c75 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.122767 Aug 30 16:39:44.037248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2938/6296] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:43 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:45.042051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:45.049630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5ccf114-5f84-4e56-aa7f-ac1a82cfa93c tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd3578278b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:45.206476 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5ccf114-5f84-4e56-aa7f-ac1a82cfa93c tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 200 len: 352 microversion: 2.1 time: 0.166068 Aug 30 16:39:45.207965 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3359/6297] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:45 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:46.224982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5396e838-b2b1-40a4-8b12-6cf649977375 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Calling method '.version_select at 0x7fd35cc76940>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:46.291148 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5396e838-b2b1-40a4-8b12-6cf649977375 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] HTTP exception thrown: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5396e838-b2b1-40a4-8b12-6cf649977375 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Request method failure captured: Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 HTTP/1.1 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj1J1gBDfjvi2SjILcIJmpWbWzFchufFP6bPthKuJbhui2cXk9a7npCuzjxkkzfleHBTAwjjyaSQSlp2AO8eJY7ClVW6SmeX69fzP0GCxqMviAXUhBcxPf-d1uf1pX3_kcFHU5zmL1UKuQndu2nPGwpBxiJEYhD3KjSda_9f-oQzo-4 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 7fa486ee74c74d9ca2b5823fe8a28d4f Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-VolumesGetTestJSON-2123313036 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7fa486ee74c74d9ca2b5823fe8a28d4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7fa486ee74c74d9ca2b5823fe8a28d4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7fa486ee74c74d9ca2b5823fe8a28d4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7fa486ee74c74d9ca2b5823fe8a28d4f"}]}] Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-VolumesGetTestJSON-2123313036 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 7fa486ee74c74d9ca2b5823fe8a28d4f Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-VolumesGetTestJSON-2123313036 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-VolumesGetTestJSON-2123313036-project Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: ee1977557b1a409cae2de4b4fd432c51 Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-VolumesGetTestJSON-2123313036-project Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: method: Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: exception: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '2b8715a4-cb7e-409e-9016-6143aa4d3006'} Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. (HTTP 404) (Request-ID: req-9a2835f5-bbd2-45cc-90f8-b44825a08f74) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:39:46.293116 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5396e838-b2b1-40a4-8b12-6cf649977375 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] Returning 404 to user: Volume 2b8715a4-cb7e-409e-9016-6143aa4d3006 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:39:46.299300 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5396e838-b2b1-40a4-8b12-6cf649977375 tempest-VolumesGetTestJSON-2123313036 tempest-VolumesGetTestJSON-2123313036-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006" status: 404 len: 109 microversion: 2.1 time: 0.078820 Aug 30 16:39:46.307857 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2939/6298] 10.222.0.47 () {58 vars in 1245 bytes} [Tue Aug 30 16:39:46 2022] GET /compute/v2.1/os-volumes/2b8715a4-cb7e-409e-9016-6143aa4d3006 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:39:51.624558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:51.625985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:51.632120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f330bb78-063b-4130-bff7-23db1edf0444 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: .version_select at 0x7fd35782cc10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2129902882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Pl+GDFnvETbSFdlpjJDQm/qs+IbTJJBmUwqt9Sc4xCB/qO72gywXSCIbkG3czHTEcQM545R0+sbWIRyjFF6/1gUyQxbZdf0m4lMY1sVEOdydAYjFT9ertcLYKmgblNA=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:51.744035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f330bb78-063b-4130-bff7-23db1edf0444 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:39:51.761057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f330bb78-063b-4130-bff7-23db1edf0444 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:39:51.845762 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f330bb78-063b-4130-bff7-23db1edf0444 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.221371 Aug 30 16:39:51.849135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3360/6299] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:39:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:39:55.737176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:39:55.744121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-216056092", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "9feaf677-c7d9-4142-9d53-2c7cf0b36946"}], "key_name": "tempest-TestNetworkBasicOps-2129902882", "security_groups": [{"name": "tempest-secgroup-smoke-446511497"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:39:56.267744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] validate_networks() for [('9feaf677-c7d9-4142-9d53-2c7cf0b36946', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:39:58.715722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:39:58.717194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:39:58.717789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:39:58.718328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:39:58.718920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:39:58.740411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:58.740825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:58.741320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:58.742035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:39:58.742620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:39:58.742956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:39:58.791552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:39:58.806210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:39:58.851629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:39:58.852779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:39:59.003057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d56a660f-08a8-4de5-ad54-3398791d496d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.263366 Aug 30 16:39:59.011593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2940/6300] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:39:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 3272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:39:59.021343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c80679b-93f1-4a3d-ba1f-93c9a49322f9 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:39:59.021749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c80679b-93f1-4a3d-ba1f-93c9a49322f9 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:39:59.238181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c80679b-93f1-4a3d-ba1f-93c9a49322f9 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:39:59.253251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c80679b-93f1-4a3d-ba1f-93c9a49322f9 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1248 microversion: 2.1 time: 0.235995 Aug 30 16:39:59.256721 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3361/6301] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:39:59 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1248 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:00.275013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4d97ea8a-044a-4a0b-b231-4c9abb45ecb5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:00.276478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4d97ea8a-044a-4a0b-b231-4c9abb45ecb5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:00.723818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4d97ea8a-044a-4a0b-b231-4c9abb45ecb5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:00.738739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4d97ea8a-044a-4a0b-b231-4c9abb45ecb5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1248 microversion: 2.1 time: 0.465830 Aug 30 16:40:00.741655 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2941/6302] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:00 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1248 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:01.771003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:01.771620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:01.804757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:01.806360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:01.806823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:01.809209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:01.810866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:01.811318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:02.271925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:02.290284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e69cf229-1f70-461a-9dda-b4d57143e24d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1300 microversion: 2.1 time: 0.527451 Aug 30 16:40:02.291937 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3362/6303] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:01 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1300 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:03.314088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:03.315108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:03.341945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:03.344733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:03.345209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:03.351900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:03.352742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:03.353260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:03.607747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-643752824", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "7f0918a1-f8ca-40e1-96d6-53907ac69045"}], "key_name": "tempest-TestNetworkAdvancedServerOps-826267104", "security_groups": [{"name": "tempest-secgroup-smoke-1098361761"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:03.686376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:03.730925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ba34ce17-0fbe-4af8-a78d-f5cf4da137aa tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1306 microversion: 2.1 time: 0.421638 Aug 30 16:40:03.742521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2942/6304] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:03 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1306 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:04.145081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] validate_networks() for [('7f0918a1-f8ca-40e1-96d6-53907ac69045', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:40:04.760452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:04.763979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:04.797088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:04.797891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:04.799412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:04.801720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:04.805217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:04.806612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:05.249041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:05.270788 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cdcea8c2-5555-4eb6-88ff-197edff0ed09 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1306 microversion: 2.1 time: 0.517661 Aug 30 16:40:05.279078 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2943/6305] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:04 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1306 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:05.873637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:40:05.875419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:40:05.876135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:40:05.876939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:40:05.877862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:40:05.899557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:05.902530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:05.903730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:05.904730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:05.906996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:05.907674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:05.986438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:40:06.011445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:40:06.048652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:40:06.071581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:40:06.212880 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f32aa101-36ca-42f5-bc65-3bd2ca95c343 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.605751 Aug 30 16:40:06.217409 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3363/6306] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:40:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:40:06.227746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1d7963c-8771-4b39-a72a-07c57fa25835 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:06.228583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a1d7963c-8771-4b39-a72a-07c57fa25835 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:06.301401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:06.302236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:06.317055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:06.317595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:06.318060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:06.318840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:06.319315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:06.347475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:06.505555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a1d7963c-8771-4b39-a72a-07c57fa25835 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:06.516439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1d7963c-8771-4b39-a72a-07c57fa25835 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1265 microversion: 2.1 time: 0.289914 Aug 30 16:40:06.517894 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2944/6307] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:06 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:07.541095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:07.541783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:07.558604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:07.559110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:07.563623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:07.564689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:07.567157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:07.567848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:07.901021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:07.912239 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8950d0da-d06a-4f8c-b420-739ab932dca5 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1269 microversion: 2.1 time: 0.374979 Aug 30 16:40:07.913752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2945/6308] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:07 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1269 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:08.485700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:08.498531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d43f4f11-8def-4808-a68f-d5faaa794050 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 2.202086 Aug 30 16:40:08.500923 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3364/6309] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:06 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:08.937161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:08.940526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:09.012167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e510e5c6-6308-4adf-a5ee-e4ae303eaa6c", "tag": "056baed7-5fd1-46f2-ac3e-7d7cb9d2177c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:09.050576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:09.070143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:09.073028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:09.078988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:09.083867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:09.086252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:09.086866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:09.111839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:09.115709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:09.118061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:09.162140 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] Creating event network-changed:056baed7-5fd1-46f2-ac3e-7d7cb9d2177c for instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c on n-h2-830883-28 Aug 30 16:40:09.173619 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ea568080-9b4f-4a19-9780-58a1e2321031 req-525fb7db-cfcc-49d9-9ed0-f235aa6bc727 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172022 Aug 30 16:40:09.179081 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3365/6310] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:40:09.549403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:09.559846 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94f5e4b5-553d-4bc9-8027-925913707e16 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1335 microversion: 2.1 time: 0.628749 Aug 30 16:40:09.581546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2946/6311] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:08 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1335 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:09.595185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:09.596420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:09.626828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:09.627404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:09.627859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:09.628606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:09.629074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:09.642528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:09.804589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27ed8e3c-4fb1-4524-910b-1487bf7621bc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Action: 'create', calling method: .version_select at 0x7fd357801e50>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1784247190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ+Up7prJkM/saacYf42sIK4jNxuRRY/1UBZF7LuycBEqdXSZaaLuL8vrYyLCibsF2YRNfdtr/h08vyvFp2Rt5YccltaXiwqOlFsAyizgGVCJ/xnSJJ4BSICxAOTq4vWg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:09.868878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-27ed8e3c-4fb1-4524-910b-1487bf7621bc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for project c61d73a07bcd4590a590b63149891678. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:40:09.894501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-27ed8e3c-4fb1-4524-910b-1487bf7621bc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for user 871f68120d0343a597b2d95ba9f959de and project c61d73a07bcd4590a590b63149891678. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:40:09.957979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27ed8e3c-4fb1-4524-910b-1487bf7621bc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.776130 Aug 30 16:40:09.964793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3366/6312] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:40:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:10.289481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:10.304144 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d1e55d2-0251-4137-a934-f3d3ccb54fda tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 0.719587 Aug 30 16:40:10.306531 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2947/6313] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:09 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:10.590115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:10.591357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:10.609925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:10.612420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:10.613482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:10.617079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:10.617627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:10.618088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:10.872781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:10.885341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee4eac66-8d79-455f-88dd-c51e49d651c1 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1323 microversion: 2.1 time: 0.301580 Aug 30 16:40:10.886531 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3367/6314] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:10 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:11.328512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:11.331124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:11.348014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:11.348910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:11.352132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:11.354539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:11.355268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:11.357752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:11.909819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:11.911220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:11.919361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:11.919924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:11.920884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:11.924353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:11.935017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:11.935611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:12.077380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:12.091273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be12856a-4981-48f6-a5ab-ab0368d6a97b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 0.766773 Aug 30 16:40:12.102426 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2948/6315] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:11 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:12.592554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:12.619160 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23f9d6e1-153b-4e47-b66b-a44c60cbbce3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.714605 Aug 30 16:40:12.622523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3368/6316] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:11 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:13.116479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:13.119555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:13.129023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:13.129820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:13.130881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:13.131790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:13.132857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:13.133506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:13.641833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:13.642494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:13.659195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:13.659708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:13.660151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:13.660878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:13.661336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:13.661770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:14.235805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:14.247314 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-adb498ef-2e51-420b-8100-eabcdf88f3f8 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 1.134732 Aug 30 16:40:14.248462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2949/6317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:13 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:14.271101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:14.298634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:14.299282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:14.299915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:14.322683 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] Creating event network-changed:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h1-830883-28 Aug 30 16:40:14.328687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-407c04ee-fa66-42b0-b0aa-7bd4559086e0 req-1be63d82-2001-410b-aa18-cc09c0e84b0e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078173 Aug 30 16:40:14.340038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2950/6318] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:14.413679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:14.427143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e702d7a5-121f-47e6-9f87-edcf29ffaae3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.789943 Aug 30 16:40:14.446451 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3369/6319] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:13 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:15.275389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:15.276851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:15.296777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:15.302948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:15.307302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:15.308490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:15.309190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:15.309756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:15.453633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:15.454264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:15.478656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:15.479244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:15.481159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:15.482185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:15.486017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:15.486645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:15.872368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:15.883424 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7729849-8152-4093-b0b7-a79c69108388 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 0.618378 Aug 30 16:40:15.908627 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2951/6320] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:15 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:15.957112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:15.979916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e510e5c6-6308-4adf-a5ee-e4ae303eaa6c", "name": "network-vif-plugged", "status": "completed", "tag": "056baed7-5fd1-46f2-ac3e-7d7cb9d2177c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:16.005209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:16.006422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:16.007048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:16.034548 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] Creating event network-vif-plugged:056baed7-5fd1-46f2-ac3e-7d7cb9d2177c for instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c on n-h2-830883-28 Aug 30 16:40:16.042354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-fd8afc54-3c59-4762-ac06-49e6d50217d0 req-7e86b257-1e52-45d7-9bd1-35016326e3b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083638 Aug 30 16:40:16.043675 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2952/6321] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:16.914632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:16.921340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:16.927756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:16.938774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:16.939280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:16.939724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:16.951281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:16.951937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:16.956376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:17.087380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:17.100472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6259a1bc-ed67-411a-9fe6-1140825bf189 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 1.651079 Aug 30 16:40:17.115498 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3370/6322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:15 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:17.501143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:17.511281 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4c7f5584-f807-4c0d-aa27-957dbd409a1a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1373 microversion: 2.1 time: 0.598749 Aug 30 16:40:17.516705 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2953/6323] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:16 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1373 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:18.121203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:18.121831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:18.138436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:18.139018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:18.139391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:18.140490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:18.147121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:18.147939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:18.537197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:18.537808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:18.565158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:18.565678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:18.566080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:18.574960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:18.575456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:18.582614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:18.721754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:18.735634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71dd7aaf-cea5-4846-86da-6dc6a9bbbf78 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.618260 Aug 30 16:40:18.748858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3371/6324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:18 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:19.144301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:19.154769 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-61907a77-76db-4bbf-9a34-1098194dd4a4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1546 microversion: 2.1 time: 0.621650 Aug 30 16:40:19.158763 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2954/6325] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:18 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1546 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:19.184823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:19.186215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:19.195646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:19.196485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:19.197121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:19.198181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:19.198876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:19.199495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:19.758199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:19.758853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:19.769534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:19.770686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:19.771333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:19.773437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:19.775141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:19.775786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:19.915095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:19.920149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=16 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:19.946393 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f0b4aa4-0f8f-4ad9-9107-ca02bd08d40a tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1546 microversion: 2.1 time: 0.766025 Aug 30 16:40:19.947478 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3372/6326] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:19 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1546 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:20.769830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:20.800234 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-985676e6-0929-4ebe-a45d-37816d1b3065 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 1.047467 Aug 30 16:40:20.800854 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2955/6327] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:19 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:40:21.824534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:21.825157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:21.828897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=5 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:21.840091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:21.840541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:21.841200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:21.841911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:21.842393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:21.849854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:22.330209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:22.339527 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-836c258e-bc87-42d3-a7a3-89befdacc05f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.518715 Aug 30 16:40:22.345349 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3373/6328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:21 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:23.365943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:23.366608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:23.378608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:23.379137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:23.387069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:23.389009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:23.389564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:23.393060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:24.335246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:24.361321 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7250c5c1-9a27-40f3-b7b8-49e4d1b53832 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.993957 Aug 30 16:40:24.362690 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2956/6329] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:23 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:25.385591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:25.387704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:25.397539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:25.398202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:25.398961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:25.400212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:25.400832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:25.401421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:26.070070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:26.085368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8734ee66-beb5-4352-add1-0aa277869edd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.701033 Aug 30 16:40:26.086205 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3374/6330] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:25 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:26.570279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "name": "network-vif-plugged", "status": "completed", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:26.585588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:26.595919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:26.597710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:26.598332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:26.613949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=79 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:26.630986 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] Creating event network-vif-plugged:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h1-830883-28 Aug 30 16:40:26.641160 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0ac80174-be6b-4ae7-8b4e-914dfaf24432 req-0a5a95c6-95b5-43ab-970d-a6554d501f2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362148 Aug 30 16:40:26.642614 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2957/6331] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:27.111963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:27.113030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:27.130708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:27.131450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:27.136225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:27.138577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:27.162003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:27.168293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:27.735097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:27.744547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6b13561-1e1c-41da-8a24-080c45a39cf9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1391 microversion: 2.1 time: 0.637718 Aug 30 16:40:27.748468 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3375/6332] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:27 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1391 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:28.770720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:28.771971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:28.784018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:28.784542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:28.784950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:28.785657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:28.792377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:28.792837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:29.623155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:29.646241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8069b439-7617-437b-9617-1ae6c94adeaa tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1562 microversion: 2.1 time: 0.879531 Aug 30 16:40:29.648344 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2958/6333] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:28 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1562 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:29.672393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:29.674050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:29.697903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:29.698567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:29.701554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:29.703143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:29.706057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:29.708677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:29.752972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=71 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:30.074576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:30.095396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d212327b-d15e-48cc-a5dd-cd4acbc1126c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1562 microversion: 2.1 time: 0.429565 Aug 30 16:40:30.103798 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3376/6334] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:29 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1562 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:32.503933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-889846579-access_point-1518797891", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "9f0b9d30-ef09-4c3c-b96d-2299f565b31f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1784247190", "security_groups": [{"name": "tempest-secgroup_access--222975210"}, {"name": "tempest-secgroup_general--1305977925"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:33.621500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] validate_networks() for [('9f0b9d30-ef09-4c3c-b96d-2299f565b31f', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:40:35.002046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:40:35.002660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:40:35.002980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:40:35.003395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:40:35.003811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:40:35.019059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:35.020944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:35.021598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:35.024466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:35.025163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:35.026533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:35.082175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for project c61d73a07bcd4590a590b63149891678. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:40:35.094735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for user 871f68120d0343a597b2d95ba9f959de and project c61d73a07bcd4590a590b63149891678. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:40:35.131338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:40:35.133651 n-d-830883-28 devstack@n-api.service[122351]: WARNING nova.utils [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-889846579-access_point-1518797891 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-889846579-acc Aug 30 16:40:35.134628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:40:35.266088 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6871a6df-bc78-48e0-99c6-12b490b0e629 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.771717 Aug 30 16:40:35.285330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b9975c8-f684-4dc5-be72-97d14bb40a25 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:35.294223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b9975c8-f684-4dc5-be72-97d14bb40a25 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:35.294417 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2959/6335] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:40:32 2022] POST /compute/v2.1/servers => generated 457 bytes in 2798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:40:35.494208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b9975c8-f684-4dc5-be72-97d14bb40a25 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:35.502635 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b9975c8-f684-4dc5-be72-97d14bb40a25 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1294 microversion: 2.1 time: 0.227664 Aug 30 16:40:35.505343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3377/6336] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:35 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1294 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:36.187068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:36.187763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:36.193263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:36.213417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:36.213914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:36.214394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:36.226344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:36.230678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:36.231117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:36.235222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:36.238685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:36.241283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:36.280985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] Creating event network-changed:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h1-830883-28 Aug 30 16:40:36.290029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-df27be6e-9ef2-493e-8ba5-ae9b14d5e871 req-72d99644-2164-4616-8b4c-64fba1aabd3d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106265 Aug 30 16:40:36.291909 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3378/6337] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:36.562176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:36.564734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:36.586399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:36.602906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:36.603658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:36.606700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:36.609650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:36.621825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:36.758210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:36.769667 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-768acd89-9a36-45a8-9ce0-9084533a2147 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1562 microversion: 2.1 time: 0.595576 Aug 30 16:40:36.772979 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2960/6338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:36 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1562 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:37.044778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:37.064031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79cdb510-0a8c-4485-8af1-a0eb92b58482 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1290 microversion: 2.1 time: 0.531645 Aug 30 16:40:37.067054 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3379/6339] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:36 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1290 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:38.099959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:38.101656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:38.129253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:38.129768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:38.130212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:38.143281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:38.143793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:38.144245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:38.536391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:38.557043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-897f0c3a-fa7a-491a-bcd2-f7dc8a18f13a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1352 microversion: 2.1 time: 0.463505 Aug 30 16:40:38.577824 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2961/6340] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:38 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1352 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:39.583372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:39.584337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:39.624418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:39.626320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:39.629768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:39.633162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:39.634858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:39.635320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:39.885800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:39.902509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7020aa4d-257b-476e-a3e3-1c5f96707e16 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1352 microversion: 2.1 time: 0.324544 Aug 30 16:40:39.903629 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3380/6341] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:39 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1352 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:40.925773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:40.926522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:40.951732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:40.956968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:40.958095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:40.959210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:40.959839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:40.962220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:42.011202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:42.028011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e68251ea-032c-4d5b-98eb-19d54ead5599 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 1.107590 Aug 30 16:40:42.028629 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2962/6342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:40 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:42.434108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e35cdf2-8c87-4977-a780-8c384f6540a1", "tag": "372ad459-136e-4df2-ae5a-6d356b8c8b1c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:42.485834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:42.486612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:42.487206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:42.505923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] Creating event network-changed:372ad459-136e-4df2-ae5a-6d356b8c8b1c for instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 on n-h2-830883-28 Aug 30 16:40:42.513656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-58b887ea-fa71-487e-a688-2634a2e6a526 req-724eff60-fb00-4ecf-b985-b864a47e3402 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083225 Aug 30 16:40:42.516813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3381/6343] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:40:43.054996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:43.055632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:43.069079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:43.069585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:43.070025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:43.070773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:43.071235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:43.071675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:43.519738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:43.529890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a2d991ef-cd51-442e-aa92-e2c7f7ef8eab tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.480196 Aug 30 16:40:43.530707 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2963/6344] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:43 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:44.553295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:44.554096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:44.574272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:44.574817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:44.575271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:44.576011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:44.576522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:44.577076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:45.070346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:45.086244 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1b44aae-c78b-4f83-95dc-ba00f851ed74 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.537261 Aug 30 16:40:45.088622 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3382/6345] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:44 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:46.112135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:46.113558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:46.133558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:46.135539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:46.145463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:46.146549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:46.147952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:46.149538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:46.151298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:46.156252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:46.767135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:46.775551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-708ba833-e076-4215-8381-8d09f5307b94 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.671288 Aug 30 16:40:46.778278 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2964/6346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:46 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:47.798964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:47.799574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:47.807663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:47.814113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:47.827142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:47.827848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:47.828614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:47.829180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:47.829517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:48.245758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:48.287086 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c130b40-acb5-4510-848d-fa90da641305 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.491019 Aug 30 16:40:48.292258 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3383/6347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:47 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:49.314809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:49.315579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:49.325787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:49.326957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:49.327655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:49.328652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:49.329396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:49.330245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:49.594126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:49.607688 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03a6e31f-1caa-4fdf-a4bf-8c66a554c5eb tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.297361 Aug 30 16:40:49.612939 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2965/6348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:49 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:49.908812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e35cdf2-8c87-4977-a780-8c384f6540a1", "name": "network-vif-plugged", "status": "completed", "tag": "372ad459-136e-4df2-ae5a-6d356b8c8b1c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:49.937952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:49.940569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:49.941851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:49.984706 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] Creating event network-vif-plugged:372ad459-136e-4df2-ae5a-6d356b8c8b1c for instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 on n-h2-830883-28 Aug 30 16:40:50.003340 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-93891ae9-23cd-48c1-9694-c57ede92868f req-2922302f-109f-454d-bc86-8666c35106ff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100581 Aug 30 16:40:50.004636 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3384/6349] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:40:50.633777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:50.635112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:50.650025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:50.652029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:50.653482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:50.657186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:50.657883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:50.660979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:50.994087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:51.009141 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4acd4b1e-0aa1-4f4d-9e1f-bd4cd9fa64fa tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1471 microversion: 2.1 time: 0.379741 Aug 30 16:40:51.010378 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2966/6350] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:50 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:52.034174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:52.035067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:52.054652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=26 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:52.057626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.058132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.058903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:52.059887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.061299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.062121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:52.447415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:52.459845 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40092f13-fdc2-41da-97e1-9ab949939100 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1642 microversion: 2.1 time: 0.430394 Aug 30 16:40:52.462588 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3385/6351] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:52 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1642 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:52.486468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:52.488348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:52.505331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.507200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.508731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:52.509741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.517064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.518100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:52.927468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:40:52.942002 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82a998a9-ee2f-4484-8ee3-c0cb1471c40c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1642 microversion: 2.1 time: 0.461391 Aug 30 16:40:52.942960 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2967/6352] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:52 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1642 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:52.963271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:52.963920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:52.975687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.977538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.978123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:52.980159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:52.981532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:52.983404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:53.697769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:53.707142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:53.730193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:53.730908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:53.734754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:53.735705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:53.736325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:53.738069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:53.865684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c66a9ee-19dd-42b0-929e-52b0ca0c3d0c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action" status: 200 len: 24571 microversion: 2.1 time: 0.175985 Aug 30 16:40:53.871154 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2968/6353] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:40:53 2022] POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action => generated 24571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:40:54.199176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f3f5ffc-5012-4d98-8380-14dd8b90be39 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1795 microversion: 2.1 time: 1.240269 Aug 30 16:40:54.210329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3386/6354] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:52 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1795 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:40:57.351490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:57.352067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:57.363266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:57.368172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:57.368646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:57.369391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:57.371279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:57.372554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:57.407202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=62 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:57.545158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lazy-loading 'services' on Instance uuid d8658a3a-b176-4f45-abeb-35ad83578fc9 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:40:57.718465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84de9fab-eab1-41f9-9c6f-12b9fec59681 tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9/os-volume_attachments/415505d1-cbae-4cd7-8df0-7312686af9b0" status: 202 len: 0 microversion: 2.1 time: 0.370899 Aug 30 16:40:57.723780 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2969/6355] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 16:40:57 2022] DELETE /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9/os-volume_attachments/415505d1-cbae-4cd7-8df0-7312686af9b0 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:40:59.322240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:59.322820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:59.334419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:59.338123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:59.340254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:59.343199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:59.343923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:59.344588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:59.402254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:40:59.559119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e35cdf2-8c87-4977-a780-8c384f6540a1", "tag": "372ad459-136e-4df2-ae5a-6d356b8c8b1c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:40:59.599472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-245df97a-26d3-4537-966b-ff4d7203570c tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 204 len: 0 microversion: 2.1 time: 0.282259 Aug 30 16:40:59.601965 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3387/6356] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:40:59 2022] DELETE /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:40:59.615022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:40:59.616138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:40:59.629347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:40:59.630421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:59.631966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:59.632709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:59.634199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:59.635850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:40:59.637123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:59.637711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:59.637947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:40:59.639263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:40:59.677779 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] Creating event network-changed:372ad459-136e-4df2-ae5a-6d356b8c8b1c for instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 on n-h2-830883-28 Aug 30 16:40:59.690069 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6bee9faf-4089-4df8-90cb-4a4693aef661 req-1a626f9a-6934-40d7-97f0-6f60e903e424 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136248 Aug 30 16:40:59.691083 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2970/6357] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:00.256516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:00.259779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:00.290509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:00.294218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:00.296388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:00.297506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:00.299619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:00.303765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:00.399625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:00.401922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:00.409749 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1ce7cdf-aaac-4dff-8bb0-471f0a0c71f7 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1552 microversion: 2.1 time: 0.801708 Aug 30 16:41:00.410595 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3388/6358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:40:59 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1552 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:00.821466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:00.834518 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3733ac77-6335-4598-8cf2-59d3161de591 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1681 microversion: 2.1 time: 0.586132 Aug 30 16:41:00.855668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2971/6359] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:00 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1681 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:01.085880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:01.088157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:01.105136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.105393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.106289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:01.114139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.114931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.115581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:01.239713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14eea89a-5ea7-4286-89cf-b9c240412724 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action" status: 200 len: 32643 microversion: 2.1 time: 0.157857 Aug 30 16:41:01.240537 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3389/6360] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:41:01 2022] POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action => generated 32643 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:41:01.431989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:01.432615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:01.440225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:01.440950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:01.469789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.470609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.471071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:01.471825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.473759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.475882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.477146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:01.478799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.479283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:01.483632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:01.488005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:01.489117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:02.484640 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6fd54b90-9615-46c3-a429-33e88ee5eb4e tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1834 microversion: 2.1 time: 1.049476 Aug 30 16:41:02.498764 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3390/6361] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:01 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1834 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:02.530472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:02.533362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:02.541105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:02.541616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:02.542063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:02.542809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:02.543370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:02.543751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:02.597592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lazy-loading 'flavor' on Instance uuid 7475276e-e243-474a-9d61-8e68041d8a15 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:41:02.620109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Going to try to live migrate instance to another host {{(pid=122352) live_migrate /opt/stack/nova/nova/compute/api.py:5492}} Aug 30 16:41:03.121995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:03.131731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c40c13b-8c53-4a2d-8e10-1f9d638fc261 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1552 microversion: 2.1 time: 1.704015 Aug 30 16:41:03.152457 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2972/6362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:01 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1552 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:03.643637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e510e5c6-6308-4adf-a5ee-e4ae303eaa6c", "name": "network-vif-deleted", "tag": "056baed7-5fd1-46f2-ac3e-7d7cb9d2177c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:03.677151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:03.677863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:03.678338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:03.705554 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] Creating event network-vif-deleted:056baed7-5fd1-46f2-ac3e-7d7cb9d2177c for instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c on n-h2-830883-28 Aug 30 16:41:03.719294 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3b9c1446-4753-448a-8b82-5535288adcf3 req-90940afd-8173-4239-8e5e-0d11e39d31c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081549 Aug 30 16:41:03.722665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2973/6363] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:41:04.172772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:04.173492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:04.197712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:04.199089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:04.200879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:04.202681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:04.205333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:04.206907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:04.288501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:04.289633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:04.291389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:04.292010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lazy-loading 'fault' on Instance uuid e510e5c6-6308-4adf-a5ee-e4ae303eaa6c {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:41:04.409274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:04.424213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c7a4e32-154f-4385-8ae4-f5a2cd0dc8f5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 200 len: 1338 microversion: 2.1 time: 0.266616 Aug 30 16:41:04.447123 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2974/6364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:04 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 1338 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:41:05.454835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:05.455560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: e510e5c6-6308-4adf-a5ee-e4ae303eaa6c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:05.472184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:05.474572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:05.478805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:05.479775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:05.480471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:05.481192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:05.526905 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] HTTP exception thrown: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Request method failure captured: Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c HTTP/1.1 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjz3PATDV0LZZscJdwChgt06wUOdIMJqnx-Yb1hrGrmKHZqmMFovrCQKTMQJdRTi8SR8fyQX_JBHwP9_f16J2BG3rL2Ok0SM8PeK-HIiJoFpzFVx-rRM4rfRzQszviZq-jJsTo0cpuBpY4LV3rqfYOmtoGusMlF7jj8TWvKGPy0Oc0M Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}] Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: bfb8fd0a68ae4a939a8f877ed9504d6a Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'e510e5c6-6308-4adf-a5ee-e4ae303eaa6c'} Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:05.529208 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. Aug 30 16:41:05.532963 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:05.534845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Returning 404 to user: Instance e510e5c6-6308-4adf-a5ee-e4ae303eaa6c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:41:05.535933 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bfab5dac-49f8-4f1e-a298-39eb546e6630 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c" status: 404 len: 111 microversion: 2.1 time: 0.086606 Aug 30 16:41:05.537517 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2975/6365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:05 2022] GET /compute/v2.1/servers/e510e5c6-6308-4adf-a5ee-e4ae303eaa6c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:41:06.256904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3235374e-4ca2-4a8c-97de-b23690088242 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '.version_select at 0x7fd357a1a4c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:06.307620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3235374e-4ca2-4a8c-97de-b23690088242 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2129902882" status: 202 len: 0 microversion: 2.1 time: 0.057432 Aug 30 16:41:06.308243 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2976/6366] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:41:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2129902882 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:41:06.571722 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9834b887-f105-42a4-adf5-05d3e44f8cdc tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action" status: 202 len: 0 microversion: 2.1 time: 4.055996 Aug 30 16:41:06.575296 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3391/6367] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:41:02 2022] POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action => generated 0 bytes in 4060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:41:06.589468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:06.591120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:06.636366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:06.644313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:06.648003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:06.655269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:06.659219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:06.659827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:06.912805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:06.914257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:06.930544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:06.931159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:06.931877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:06.932607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:06.933076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:06.933515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:06.991074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:41:07.238528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e317417d-bdd4-40d2-95b9-adc15dde9bdd tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 204 len: 0 microversion: 2.1 time: 0.332213 Aug 30 16:41:07.244536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3392/6368] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:41:06 2022] DELETE /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:41:07.263360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:07.270281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:07.289977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:07.290896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:07.291708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:07.293848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:07.305614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:07.307161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:07.434202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:07.445067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd0613e8-7858-4e5a-96ee-4007499eaea2 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.864417 Aug 30 16:41:07.445668 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2977/6369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:06 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:07.652906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:07.668058 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ff79fb8-7c53-40fc-969e-cf65be5d6edb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1469 microversion: 2.1 time: 0.421540 Aug 30 16:41:07.672145 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3393/6370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:07 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1469 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:08.473490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:08.474121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:08.490562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:08.495603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:08.496952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:08.500013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:08.502002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:08.503068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:08.713384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:08.717607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:08.745187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:08.746584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:08.749275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:08.751306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:08.753642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:08.754201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:08.998661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:09.015635 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-26d3760e-bba6-450e-9a66-1b8bc476e9e9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.547045 Aug 30 16:41:09.019566 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2978/6371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:08 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:09.169641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:09.184353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a73b0df-80a7-4bc7-a3da-0d2f1cc456eb tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1469 microversion: 2.1 time: 0.485557 Aug 30 16:41:09.206033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3394/6372] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:08 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:10.040959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:10.041584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:10.057789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:10.065140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:10.065898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:10.066866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:10.071833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:10.072574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:10.213588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:10.214914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:10.226359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:10.227217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:10.227812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:10.228869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:10.229479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:10.230056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:10.506834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:10.517927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-752a07af-d1f6-4dd6-835e-e10fb43776ad tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1469 microversion: 2.1 time: 0.308523 Aug 30 16:41:10.530961 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3395/6373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:10 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:41:10.888749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:10.902965 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d202d64d-3158-4200-9c69-a332d97d3cd7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.865613 Aug 30 16:41:10.904583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2979/6374] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:10 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:11.540712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:11.541414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:11.554985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:11.555907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:11.557436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:11.558646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:11.559336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:11.563855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:11.932725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:11.934048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:11.953890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:11.954903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:11.958364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:11.960489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:11.961364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:11.962036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:12.260055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d40374265534539966623e4c8fbcd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cb971c398514c7c87156498a11046a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:12.282534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c16f07fd-46ec-4c7d-ab79-efe6d041b9cc tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 200 len: 1469 microversion: 2.1 time: 0.743273 Aug 30 16:41:12.285949 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3396/6375] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:11 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 1469 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:12.294919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8658a3a-b176-4f45-abeb-35ad83578fc9", "name": "network-vif-deleted", "tag": "a4fec3a5-5099-4b85-9914-91baacb90ca0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:12.332201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:12.334958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:12.337227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:12.358269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] Creating event network-vif-deleted:a4fec3a5-5099-4b85-9914-91baacb90ca0 for instance d8658a3a-b176-4f45-abeb-35ad83578fc9 on n-h2-830883-28 Aug 30 16:41:12.377979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f10c8f46-0b53-4b12-8aa2-306b665bdda8 req-57b8ccc4-2d05-4f43-86ef-febd113f6b11 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090392 Aug 30 16:41:12.378652 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3397/6376] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:12.910950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:12.925692 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7aadc377-0533-426c-811f-1134708056ca tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.999768 Aug 30 16:41:12.946292 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2980/6377] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:11 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:13.309000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:13.310256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] [instance: d8658a3a-b176-4f45-abeb-35ad83578fc9] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:13.330820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:13.332505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:13.333661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:13.334697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:13.335538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:13.336202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:13.361971 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] HTTP exception thrown: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Request method failure captured: Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 HTTP/1.1 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj0A__dzEjkf9gcMbSuAaKiKUfklyspy5qIDOajyiuLiGzQmoEJDwd5W_sqCdjPzOLNQQughvhg36XPZ5K47YqG0_JtIDgu4O-wylgZgbZhDZI4OCS6zx2L-RQqidyc4pJEaPTlaM9VZuruPOJuwV0InaGt25fQxB7u1H_rLxryvtak Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 3cb971c398514c7c87156498a11046a1 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-VolumesBackupsTest-62361959 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3cb971c398514c7c87156498a11046a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3cb971c398514c7c87156498a11046a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3cb971c398514c7c87156498a11046a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3cb971c398514c7c87156498a11046a1"}]}] Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-VolumesBackupsTest-62361959 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 3cb971c398514c7c87156498a11046a1 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-VolumesBackupsTest-62361959 Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-VolumesBackupsTest-62361959-project Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 1d40374265534539966623e4c8fbcd0d Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-VolumesBackupsTest-62361959-project Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd8658a3a-b176-4f45-abeb-35ad83578fc9'} Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:13.373042 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. Aug 30 16:41:13.380109 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:41:13.382733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] Returning 404 to user: Instance d8658a3a-b176-4f45-abeb-35ad83578fc9 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:41:13.389230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfe7bcba-a4ee-40fa-8ada-e9eb930f983b tempest-VolumesBackupsTest-62361959 tempest-VolumesBackupsTest-62361959-project] 10.222.0.47 "GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9" status: 404 len: 111 microversion: 2.1 time: 0.081262 Aug 30 16:41:13.390808 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3398/6378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:13 2022] GET /compute/v2.1/servers/d8658a3a-b176-4f45-abeb-35ad83578fc9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:41:13.949193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:13.951179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:13.968479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:13.969388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:13.970210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:13.971453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:13.972719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:13.975129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:13.986619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:13.987432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:14.006414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:14.008731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:14.010600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:14.011540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:14.012024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:14.013121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:14.072372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:41:14.303056 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-baea9cc6-df2b-4862-9a11-767bb4f0196b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 204 len: 0 microversion: 2.1 time: 0.321476 Aug 30 16:41:14.305048 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3399/6379] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:41:13 2022] DELETE /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:41:14.333916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:14.336451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:14.365134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:14.366829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:14.367308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:14.372785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:14.373851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:14.374353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:14.465374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:14.477927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-076223a7-2aa7-4200-ad54-89fbd33731f3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.532719 Aug 30 16:41:14.489375 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2981/6380] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:13 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:14.895369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "name": "network-vif-unplugged", "status": "completed", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}, {"name": "network-changed", "server_uuid": "3b98e596-43c6-4933-9d94-486b1ff1bafb", "tag": "b576f856-818f-4aca-8770-10ad0325fda9"}, {"name": "network-changed", "server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:14.929697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:14.930183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:14.930816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:14.950746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Creating event network-vif-unplugged:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h1-830883-28 Aug 30 16:41:14.952043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Creating event network-changed:b576f856-818f-4aca-8770-10ad0325fda9 for instance 3b98e596-43c6-4933-9d94-486b1ff1bafb on n-h1-830883-28 Aug 30 16:41:14.952689 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] Creating event network-changed:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h1-830883-28 Aug 30 16:41:14.978577 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9fd17f47-1f4f-478e-b078-b4cb129852f2 req-c07c8b92-7a0f-4955-acc8-b5c5298ded58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.076490 Aug 30 16:41:14.979608 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2982/6381] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:41:14.991797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:15.008774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6530a35-9244-414c-9e83-7606be0c74a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1670 microversion: 2.1 time: 0.696002 Aug 30 16:41:15.015043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3400/6382] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:14 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1670 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:15.507196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:15.508014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:15.526266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:15.526867 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:15.527571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:15.528584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:15.529250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:15.529882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:15.932117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:15.947068 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bcdac5d0-15f4-4935-a5a2-b94a698af9bd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.444417 Aug 30 16:41:15.947795 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2983/6383] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:15 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:16.040203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:16.040928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:16.054185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:16.054811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:16.055370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:16.056222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:16.058979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:16.059787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:16.607161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:16.616068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daa2eb26-ef77-48d5-8a85-3ec42bae057f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1670 microversion: 2.1 time: 0.579915 Aug 30 16:41:16.621150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3401/6384] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:16 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1670 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:16.970994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:16.972783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:17.008827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:17.015220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:17.015990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:17.017108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:17.018044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:17.018751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:17.646033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:17.646690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:17.655180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:17.655691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:17.656132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:17.656931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:17.672742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:17.676326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:17.738167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:18.023634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:18.047705 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cbf98951-82fc-4b8a-9282-4bb0b2128b2f tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1602 microversion: 2.1 time: 0.405332 Aug 30 16:41:18.048325 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3402/6385] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:17 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1602 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:41:18.365166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:18.391550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b98e596-43c6-4933-9d94-486b1ff1bafb", "name": "network-vif-deleted", "tag": "b576f856-818f-4aca-8770-10ad0325fda9"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:18.423614 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1fdaa352-145b-4dc0-84c2-140f12bb15e0 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 1.456932 Aug 30 16:41:18.426240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2984/6386] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:16 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:18.434241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:18.435821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:18.436447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:18.477204 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] Creating event network-vif-deleted:b576f856-818f-4aca-8770-10ad0325fda9 for instance 3b98e596-43c6-4933-9d94-486b1ff1bafb on n-h1-830883-28 Aug 30 16:41:18.486956 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-72d8d6a4-7c7d-4be7-bfee-1362bd1d3f16 req-6f0166c8-6f3a-4bf5-89af-f3539d485f7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101387 Aug 30 16:41:18.488431 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3403/6387] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:19.085880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:19.086986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:19.111160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:19.111672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:19.124094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:19.126321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:19.132309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:19.133569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:19.295891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:19.303189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:19.306897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:19.308426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lazy-loading 'fault' on Instance uuid 3b98e596-43c6-4933-9d94-486b1ff1bafb {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:41:19.459115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:19.460071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:19.461912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:19.475183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c491c739-c2e3-4e21-985f-563c978f3262 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 200 len: 1338 microversion: 2.1 time: 0.400444 Aug 30 16:41:19.475834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2985/6388] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:19 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 1338 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:19.485159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:19.486610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:19.489094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:19.490207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:19.493579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:19.506208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:20.498605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:20.499228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: 3b98e596-43c6-4933-9d94-486b1ff1bafb] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:20.514138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:20.516480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:20.517135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:20.519735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:20.520398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:20.520979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:20.583251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] HTTP exception thrown: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Request method failure captured: Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb HTTP/1.1 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjz3PATDV0LZZscJdwChgt06wUOdIMJqnx-Yb1hrGrmKHZqmMFovrCQKTMQJdRTi8SR8fyQX_JBHwP9_f16J2BG3rL2Ok0SM8PeK-HIiJoFpzFVx-rRM4rfRzQszviZq-jJsTo0cpuBpY4LV3rqfYOmtoGusMlF7jj8TWvKGPy0Oc0M Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}] Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: bfb8fd0a68ae4a939a8f877ed9504d6a Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '3b98e596-43c6-4933-9d94-486b1ff1bafb'} Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:20.589341 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Returning 404 to user: Instance 3b98e596-43c6-4933-9d94-486b1ff1bafb could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:41:20.598828 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85bd4177-c028-4d4c-81c8-27a5659b2a39 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb" status: 404 len: 111 microversion: 2.1 time: 0.097712 Aug 30 16:41:20.600063 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2986/6389] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:20 2022] GET /compute/v2.1/servers/3b98e596-43c6-4933-9d94-486b1ff1bafb => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:41:21.136914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:21.162677 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b220149-74a3-479d-9054-390a3eb481e4 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 1.710860 Aug 30 16:41:21.163853 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3404/6390] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:19 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:41:22.020623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5c75d657-73bd-4b77-9ff0-0138da0349d4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '.version_select at 0x7fd35ce7dc10>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:22.080730 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5c75d657-73bd-4b77-9ff0-0138da0349d4 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1294772867" status: 202 len: 0 microversion: 2.1 time: 0.067570 Aug 30 16:41:22.081365 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2987/6391] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1294772867 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:41:22.185156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:22.185952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:22.194121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:22.209762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:22.210345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:22.229201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:22.229998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:22.230516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:22.237372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:23.078391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:23.088932 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9f8a6b9-c7ea-40ac-8ad5-c5d45a4ada76 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.908025 Aug 30 16:41:23.095374 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3405/6392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:22 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:24.111989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:24.113188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:24.128089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:24.129656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:24.131021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:24.137078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:24.137953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:24.138439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:24.789035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:24.804398 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08b6a901-65a6-4824-a006-2736d801dfc6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.696532 Aug 30 16:41:24.805266 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2988/6393] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:24 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:25.831273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:25.832392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:25.874910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:25.877545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:25.881043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:25.885844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:25.886533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:25.891036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:26.295457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:26.308620 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edfbd8fb-d585-4c69-922f-8bbafa133cfd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 0.482959 Aug 30 16:41:26.311304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3406/6394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:25 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:27.334567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:27.338798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:27.348488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:27.349388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:27.350038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:27.351082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:27.351720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:27.354897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:28.585617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:28.588744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:28.603583 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53a165c7-eed4-44d5-a2fb-4c8a61e5723e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1691 microversion: 2.1 time: 1.273886 Aug 30 16:41:28.616223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2989/6395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:27 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1691 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:29.645356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:29.647262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:29.658563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:29.659502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:29.660141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:29.661387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:29.662217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:29.663875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:30.770373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:30.786896 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-48c9245a-ecd8-4b49-b833-ad488f0962f7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1681 microversion: 2.1 time: 1.155456 Aug 30 16:41:30.787683 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3407/6396] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:29 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1681 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:30.834976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:30.837476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:30.856553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:30.897252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:30.901163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:30.905078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:30.908850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:30.910563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:30.911470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:31.418184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34029a13-4095-4f85-aaa5-6a27c9c3e60d tempest-TestNetworkAdvancedServerOps-2047512751 tempest-TestNetworkAdvancedServerOps-2047512751-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1834 microversion: 2.1 time: 0.602256 Aug 30 16:41:31.419442 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2990/6397] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:30 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1834 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:31.441820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:31.442807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:31.459418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:31.459923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:31.460367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:31.461276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:31.461884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:31.463451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:32.528915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:32.545073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd2849f3-2c4a-47aa-b65a-bdbab801bc4a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1681 microversion: 2.1 time: 1.108171 Aug 30 16:41:32.551269 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3408/6398] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:31 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1681 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:32.943962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:32.946143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:32.972449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:32.972949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:32.973397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:32.976634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:32.977156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:32.977543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:33.048853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ea2f1a7e-359d-4d20-8f83-8fd4e616fb69 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action" status: 200 len: 38664 microversion: 2.1 time: 0.108936 Aug 30 16:41:33.050474 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2991/6399] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:41:32 2022] POST /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15/action => generated 38664 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:41:35.852810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:35.853896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:35.893294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:35.899153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:35.908778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:35.910909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:35.914029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:35.915394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:36.010496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:41:36.236003 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-328bd3b8-6ac7-48d1-bae7-d6f38931455f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 204 len: 0 microversion: 2.1 time: 0.385504 Aug 30 16:41:36.237595 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3409/6400] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:41:35 2022] DELETE /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:41:36.248048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:36.251962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:36.275073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:36.275608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:36.279182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:36.280576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:36.282946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:36.284852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:36.317239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:36.360750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:36.361257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:36.362640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:36.389237 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] Creating event network-changed:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h2-830883-28 Aug 30 16:41:36.411109 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-767414c2-3de5-4602-b9f1-ef00f4ebc0f3 req-8fa6b82d-53b1-4a7c-aac8-e9f7dd94e161 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.546621 Aug 30 16:41:36.413758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2992/6401] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:41:36.823106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:36.835738 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d420e618-04fe-4157-9959-93cc5515f96d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1687 microversion: 2.1 time: 0.593503 Aug 30 16:41:36.841958 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3410/6402] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:36 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1687 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:41:37.878335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:37.878335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:37.889802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:37.890547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:37.890997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:37.891834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:37.892300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:37.892718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:39.501915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:39.514208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac60aa22-36ed-4011-9c36-5f39e48fef82 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 200 len: 1687 microversion: 2.1 time: 1.652524 Aug 30 16:41:39.515743 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2993/6403] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:37 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 1687 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:39.645600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7475276e-e243-474a-9d61-8e68041d8a15", "name": "network-vif-deleted", "tag": "f8da9414-5ef4-4137-ad02-eca513762c20"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:39.685694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:39.689173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:39.689680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:39.722651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] Creating event network-vif-deleted:f8da9414-5ef4-4137-ad02-eca513762c20 for instance 7475276e-e243-474a-9d61-8e68041d8a15 on n-h2-830883-28 Aug 30 16:41:39.729199 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e94e71dc-a48e-4181-83fd-822f60a18e3f req-2f6a5f31-10e1-4263-abbd-5180b01a065c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089954 Aug 30 16:41:39.730528 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3411/6404] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:40.536501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:40.537114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 7475276e-e243-474a-9d61-8e68041d8a15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:40.553330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:40.553841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:40.554281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:40.555014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:40.555835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:40.556203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:40.595124 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] HTTP exception thrown: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Request method failure captured: Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 HTTP/1.1 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjvfa4TbGMD0AzTWRHg5GAAcH2s1jHgIUfTkgWn9KGgA3VCoFY-lBY7E3L_A8k-GG9JGi42RnJsvxbNArleNZfWmZpVjAHeeuJWH2zgYitlC9RCaZOwdgcu0BR8vS28h2b4DGTUiSCO_Em0U73Jg_E9MBEQWO4VKHtZgexE9gwJjkWs Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b9801e8110649beb6683e701536b207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b9801e8110649beb6683e701536b207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}] Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 41f1684f44264fdcb3e07f501ac6da6a Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7475276e-e243-474a-9d61-8e68041d8a15'} Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:40.598004 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. Aug 30 16:41:40.602684 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:41:40.608230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Returning 404 to user: Instance 7475276e-e243-474a-9d61-8e68041d8a15 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:41:40.609327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82f5c187-1922-4628-a466-50dd6984c49b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15" status: 404 len: 111 microversion: 2.1 time: 0.076720 Aug 30 16:41:40.610468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2994/6405] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:40 2022] GET /compute/v2.1/servers/7475276e-e243-474a-9d61-8e68041d8a15 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:41:51.103541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:51.104920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:51.109805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc25edd6-46f6-4f68-9397-5679d3fb25ba tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: .version_select at 0x7fd35ce47a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1789573323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlB++V7ukj5dQ38v05hUv63Th7TBeRgE5aHg8e8o10pOVodQDG9ihsZ/KNURfaC7hSuPNm1iu4ftiQcCJecqQbYuZllekY5W2dq2vqb6qgXa4kGQ+xlPeAqF4KX7TEVNg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:51.163872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fc25edd6-46f6-4f68-9397-5679d3fb25ba tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:41:51.188602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-fc25edd6-46f6-4f68-9397-5679d3fb25ba tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:41:51.295855 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc25edd6-46f6-4f68-9397-5679d3fb25ba tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.194047 Aug 30 16:41:51.302791 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3412/6406] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:41:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:52.510829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c90eca7d-3fde-44b1-945c-4bcd58256fda tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '.version_select at 0x7fd35c273670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:52.516992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=9 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:52.523579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=21 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:41:52.555985 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c90eca7d-3fde-44b1-945c-4bcd58256fda tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826267104" status: 202 len: 0 microversion: 2.1 time: 0.048660 Aug 30 16:41:52.557886 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2995/6407] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 16:41:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-826267104 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:41:52.596507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-beab92eb-0d61-4db7-bc96-43ebf6dd33a8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: .version_select at 0x7fd357f3c5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-201766932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpY27mwT47qHeN1Iz3c5VSCn6n8wAh55M+dyZ3IHbOj7eJorRQotitAQ6689RXd+WAM9ysHrhe510pXb93ZFMd5ufrQfvDoe1nVPWTPdHWuvL+iT7RXMhK3QHOs5dhA8g=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:52.651026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-beab92eb-0d61-4db7-bc96-43ebf6dd33a8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:41:52.663190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-beab92eb-0d61-4db7-bc96-43ebf6dd33a8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:41:52.757136 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-beab92eb-0d61-4db7-bc96-43ebf6dd33a8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.172210 Aug 30 16:41:52.764335 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3413/6408] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:41:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:41:56.176239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1146380925", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "fc99994d-6d5a-4297-bfc0-70495e44589c"}], "key_name": "tempest-TestNetworkBasicOps-1789573323", "security_groups": [{"name": "tempest-secgroup-smoke-550588915"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:41:56.543989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] validate_networks() for [('fc99994d-6d5a-4297-bfc0-70495e44589c', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:41:57.300549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:41:57.301932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:41:57.302837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:41:57.307120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:41:57.307120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:41:57.316449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:57.317198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:57.317826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:57.319222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:57.320023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:57.320616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:57.344483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:41:57.352552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Getting quotas for user bfb8fd0a68ae4a939a8f877ed9504d6a and project e37b71614c5545838941c58ed3c9842e. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:41:57.369533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:41:57.380893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:41:57.506150 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6a57c11-504b-4c6a-aacf-3093995ec558 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.335612 Aug 30 16:41:57.509625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2996/6409] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:41:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:41:57.523447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f3ba4dc-ae06-4b4c-ac10-4314e5277be1 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:57.524221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f3ba4dc-ae06-4b4c-ac10-4314e5277be1 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:57.674919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f3ba4dc-ae06-4b4c-ac10-4314e5277be1 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:57.685417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f3ba4dc-ae06-4b4c-ac10-4314e5277be1 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1249 microversion: 2.1 time: 0.167921 Aug 30 16:41:57.695555 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3414/6410] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:57 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1249 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:41:58.719334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:41:58.720660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:41:58.773433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:58.774952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:58.776879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:58.781364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:41:58.783150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:41:58.783861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:41:59.069037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:41:59.078117 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25097f00-4557-407f-be4d-94222c165d82 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1253 microversion: 2.1 time: 0.365839 Aug 30 16:41:59.101816 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2997/6411] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:41:58 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1253 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:00.107208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:00.107851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:00.124214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:00.125021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:00.127586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:00.128602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:00.131005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:00.131682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:00.336161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:00.351929 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ce301f44-a4bc-4220-9659-1d577ec421e2 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1319 microversion: 2.1 time: 0.241950 Aug 30 16:42:00.352630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3415/6412] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:00 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:01.379597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:01.384358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:01.404843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:01.406129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:01.408387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:01.409810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:01.411156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:01.412221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:01.674944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:01.686857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b661976d-0eeb-4d08-ae28-a6ab16f94e0d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1307 microversion: 2.1 time: 0.317109 Aug 30 16:42:01.687468 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2998/6413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:01 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:02.715434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:02.716082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:02.733696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:02.734216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:02.734706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:02.735436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:02.735909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:02.736350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:03.348222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:03.379650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a60bcab-53f9-4b9d-9d5a-427fb606c4a6 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.652635 Aug 30 16:42:03.382013 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3416/6414] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:02 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:04.404417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:04.405606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:04.428035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:04.431228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:04.433257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:04.435939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:04.437863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:04.438533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:05.031828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:05.048585 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe4ee1f6-026d-4ebe-b737-f84318b29a11 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.651143 Aug 30 16:42:05.052047 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 2999/6415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:04 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:06.078659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:06.079292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:06.097761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:06.098486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:06.099088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:06.100000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:06.100620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:06.101378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:06.154288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc", "tag": "b8c96690-6683-4207-a615-3e67378ab374"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:06.169120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:06.169951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:06.170596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:06.188893 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] Creating event network-changed:b8c96690-6683-4207-a615-3e67378ab374 for instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc on n-h1-830883-28 Aug 30 16:42:06.213210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f4a59f05-16b5-4204-8adf-311876cb82eb req-ba75fb34-2a7c-42da-bd82-943cec6693d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067964 Aug 30 16:42:06.215078 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3000/6416] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:42:06.543894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:06.565028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-618dcea0-14a4-4490-83c4-8c948c24f5ae tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.491020 Aug 30 16:42:06.576217 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3417/6417] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:06 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:07.592023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:07.593373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:07.604064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:07.607523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:07.613564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:07.615095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:07.615751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:07.620740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:07.622109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:07.622768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:07.962018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:07.980034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-068f29f4-e7eb-48ff-977c-838ae26bf276 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.395472 Aug 30 16:42:07.980629 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3001/6418] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:07 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:08.998679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=10 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:09.002890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:09.003667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:09.013864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:09.014533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:09.015086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:09.018981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:09.019703 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:09.026025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:09.452478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:09.467783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12391976-0a9a-4ab5-803c-56333682ef87 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.471020 Aug 30 16:42:09.470747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3418/6419] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:08 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:10.499446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:10.503896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:10.522060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:10.523600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:10.524074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:10.524824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:10.525373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:10.525738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:11.639797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:11.655448 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d518b85-a407-4e67-a989-fde52e0deefe tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 1.168497 Aug 30 16:42:11.658117 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3002/6420] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:10 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:12.680841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:12.683563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:12.695369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:12.696279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:12.697066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:12.698845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:12.699651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:12.700478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:15.048627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:15.065305 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a819a23-46de-4479-9afb-d8e1a28ad8de tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 2.389808 Aug 30 16:42:15.069943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3419/6421] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:12 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:15.099205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc", "name": "network-vif-plugged", "status": "completed", "tag": "b8c96690-6683-4207-a615-3e67378ab374"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:15.138333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:15.146287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:15.147049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:15.164990 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] Creating event network-vif-plugged:b8c96690-6683-4207-a615-3e67378ab374 for instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc on n-h1-830883-28 Aug 30 16:42:15.202496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e1ba5b90-7baa-4f85-be97-fa2c7dc658df req-9a1583c9-c9ae-4189-b6fe-13e68f8b91a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103852 Aug 30 16:42:15.203258 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3003/6422] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:16.091588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:16.092235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:16.101090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:16.101596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:16.102768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:16.103925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:16.105271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:16.106202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:16.874996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:16.891435 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94988e59-aff6-423f-ad55-ce18cc55f33d tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1374 microversion: 2.1 time: 0.805341 Aug 30 16:42:16.892069 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3420/6423] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:16 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1374 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:17.915850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:17.918747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:17.931805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:17.937234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:17.938000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:17.939011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:17.944005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:17.944764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:18.936922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:18.946273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a3833cb-7e30-4ac1-9c3e-83734a40d782 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1545 microversion: 2.1 time: 1.037224 Aug 30 16:42:18.960518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3004/6424] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:17 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1545 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:18.975937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:18.977993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:18.993619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:18.996766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:18.997549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:18.998590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:19.000094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:19.001865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:20.555975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:20.577332 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-194db77c-ee55-4c7f-aa2a-e7d7bd896b90 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1545 microversion: 2.1 time: 1.607208 Aug 30 16:42:20.578044 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3421/6425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:18 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1545 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:22.210262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-92082312", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "f1e1e28d-b478-4047-bc78-71697ac72f82"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1784247190", "security_groups": []}, "os:scheduler_hints": {"different_host": ["2e35cdf2-8c87-4977-a780-8c384f6540a1"]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:22.335953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] validate_networks() for [('f1e1e28d-b478-4047-bc78-71697ac72f82', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:42:22.897157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:23.197350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1345051767", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "3c85f6e5-2254-47cf-b7c6-a36d9d8e15f0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-201766932", "security_groups": [{"name": "tempest-secgroup-smoke-628040722"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:23.216180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:23.239130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:42:23.239663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:42:23.240179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:42:23.240435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:42:23.240849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:42:23.261527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:23.262099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:23.262576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:23.270196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:23.270906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:23.271494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:23.350659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=43 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:23.371680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for project c61d73a07bcd4590a590b63149891678. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:42:23.379683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Getting quotas for user 871f68120d0343a597b2d95ba9f959de and project c61d73a07bcd4590a590b63149891678. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:42:23.402357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:42:23.405222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:42:23.484356 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a4d82d26-f5c9-420a-b731-53689f3cc182 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.291874 Aug 30 16:42:23.486351 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3005/6426] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:42:22 2022] POST /compute/v2.1/servers => generated 361 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:42:23.499006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eeff671c-37b6-459f-9dd6-afd2d6e6061c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:23.500116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eeff671c-37b6-459f-9dd6-afd2d6e6061c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:23.627332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-eeff671c-37b6-459f-9dd6-afd2d6e6061c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:23.639752 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eeff671c-37b6-459f-9dd6-afd2d6e6061c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1240 microversion: 2.1 time: 0.144463 Aug 30 16:42:23.639752 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3006/6427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:23 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:24.047346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] validate_networks() for [('3c85f6e5-2254-47cf-b7c6-a36d9d8e15f0', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:42:24.663051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:24.665407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:24.683401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:24.684491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:24.685463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:24.687355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:24.687972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:24.688573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:24.891976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:24.907269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d07b8ddc-6a5c-4ffd-9514-a6d9377e803e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1236 microversion: 2.1 time: 0.249227 Aug 30 16:42:24.910933 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3007/6428] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:24 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1236 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:25.931864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:25.933473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:25.954746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:25.955649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:25.956436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:25.957343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:25.961103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:25.961603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:26.321785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:26.339728 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a8f98839-b61e-4500-a77b-5344527865f9 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.407671 Aug 30 16:42:26.339728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3008/6429] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:25 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:27.363551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:27.365136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:27.381233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:27.391491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:27.395190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:27.397265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:27.397905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:27.402784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:27.570845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:27.586703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e47b41c-4f87-4b96-9e0d-1a9d11f4a5f1 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.230132 Aug 30 16:42:27.600104 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3009/6430] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:27 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:27.881673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:42:27.882235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:42:27.882984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:42:27.883088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:42:27.883536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:42:27.913808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:27.913997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:27.914550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:27.918214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:27.922376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:27.922869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:27.972380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=43 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:27.999126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:42:28.014295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Getting quotas for user 41f1684f44264fdcb3e07f501ac6da6a and project 5b9801e8110649beb6683e701536b207. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:42:28.044117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:42:28.048393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:42:28.200547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdc621f7-8eb7-4fe8-b931-6e0131b0581c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.976220 Aug 30 16:42:28.211562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3422/6431] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:42:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 5020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:42:28.213897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-98545039-1273-4c56-9aa7-40e78c906523 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:28.214671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-98545039-1273-4c56-9aa7-40e78c906523 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:28.531120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-98545039-1273-4c56-9aa7-40e78c906523 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:28.538586 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-98545039-1273-4c56-9aa7-40e78c906523 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1266 microversion: 2.1 time: 0.329023 Aug 30 16:42:28.543696 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3010/6432] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:28 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:28.609946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:28.610947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:28.655588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:28.657775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:28.660248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:28.662249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:28.669788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:28.673059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:29.081662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:29.099104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-414b0363-9296-4417-8ced-cd1a22bf9201 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.493163 Aug 30 16:42:29.101789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3423/6433] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:28 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:29.560142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:29.561689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:29.576961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:29.580241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:29.580911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:29.584916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:29.590264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:29.590942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:30.125939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:30.126745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:30.143106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:30.143723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:30.144414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:30.151586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:30.152315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:30.153071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:30.368708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:30.382247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ae0208fd-6048-4615-bc77-f848b220ed12 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1262 microversion: 2.1 time: 0.827123 Aug 30 16:42:30.383906 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3011/6434] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:29 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1262 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:30.557918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:30.566666 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ceed865-a06a-49db-94bd-73d9c3bccd50 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.447152 Aug 30 16:42:30.571686 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3424/6435] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:30 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:31.410104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:31.411539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:31.439129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.440031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.473081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:31.475093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.477020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.477715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:31.563398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc", "tag": "b8c96690-6683-4207-a615-3e67378ab374"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:31.585173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.585667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.591386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:31.643937 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] Creating event network-changed:b8c96690-6683-4207-a615-3e67378ab374 for instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc on n-h1-830883-28 Aug 30 16:42:31.659389 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fd02a1da-202e-4e6c-94ad-1a75b4a908fc req-807bfff2-8b7b-4922-a212-58b732efa200 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106087 Aug 30 16:42:31.668161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3425/6436] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:42:31.683590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:31.685906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:31.738053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.739331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.739957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:31.740845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.743899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.744807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:31.899411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:31.915440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b0f929b-9552-42c7-aa91-54850abed1b9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1324 microversion: 2.1 time: 0.511731 Aug 30 16:42:31.930708 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3012/6437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:31 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:31.938801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67d0cbeb-a7e0-4965-bb49-b929afc5810e", "tag": "9543844c-1b7b-4a67-a496-1bec3aabd75d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:31.980835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:31.981326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:31.981767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:32.020981 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] Creating event network-changed:9543844c-1b7b-4a67-a496-1bec3aabd75d for instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e on n-h1-830883-28 Aug 30 16:42:32.037359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-84d9704f-cdee-4d6b-a894-13f906ee5a34 req-a3c49063-b49b-4ec7-9f04-9770359f5867 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104998 Aug 30 16:42:32.040908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3013/6438] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:32.950430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:32.951174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:32.965332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:32.966509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:32.969147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:32.971799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:32.974619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:32.975253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:33.059788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:33.070531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-443abf4b-2922-4f3d-88a8-5dbf32a6b13e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 1.400088 Aug 30 16:42:33.077200 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3426/6439] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:31 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:33.322265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:33.339933 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc86443b-db8d-4d5f-9bb1-5b13dd06b079 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1324 microversion: 2.1 time: 0.395027 Aug 30 16:42:33.350967 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3014/6440] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:32 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:34.097395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:34.098031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:34.111234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:34.111807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:34.126996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:34.128050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:34.128242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:34.128753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:34.378627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:34.379244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:34.383259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:34.423958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:34.427411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:34.430416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:34.433416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:34.436142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:34.436872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:34.634040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:34.647336 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2354d9a9-b393-464b-8d92-918a980643ff tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.549732 Aug 30 16:42:34.649236 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3427/6441] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:34 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:35.357379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:35.368197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00eddfb9-e514-4943-9026-fabdd063a141 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.995561 Aug 30 16:42:35.375779 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3015/6442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:34 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:35.674049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:35.675445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:35.725248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:35.727733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:35.732119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:35.733395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:35.734231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:35.735557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:36.069534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:36.085566 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-95600b08-c1a6-467f-8376-c176aafe6781 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.415608 Aug 30 16:42:36.141045 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3428/6443] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:35 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:36.396544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:36.397168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:36.406196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:36.410204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:36.410743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:36.411489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:36.422091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:36.423091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:37.142263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:37.142992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:37.161157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:37.166727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:37.168146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:37.171538 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:37.172206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:37.172847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:37.302524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:37.312052 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92c8c060-ec42-4628-ac45-a4cad1a21d86 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.919462 Aug 30 16:42:37.312653 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3016/6444] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:36 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:37.366622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:37.387216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:37.388844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:37.389500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:37.422397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] Creating event network-changed:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:42:37.438593 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c4bb93c4-b12a-4c6d-95f3-801936d5acd2 req-e5d46dd2-2b47-401d-ab80-601f6867fbd5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075530 Aug 30 16:42:37.439881 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3017/6445] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:42:37.477017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:37.487184 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-490b2957-d526-4697-93d3-56c55bb2470b tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.348155 Aug 30 16:42:37.488178 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3429/6446] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:37 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:38.338485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:38.342039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:38.361430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:38.362218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:38.362943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:38.364193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:38.364845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:38.365534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:38.512257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:38.512885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:38.514931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:38.515969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:38.527399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:38.539874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:38.540902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:38.542380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=10 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:38.550608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:38.553188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:38.553896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:38.716727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:38.738219 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e45a3036-6cf1-4f72-a9c8-b16017d8aa0b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.402624 Aug 30 16:42:38.740473 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3018/6447] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:38 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:38.780746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:38.788633 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f38d9bc8-f19e-4bc2-b745-a04d45e6b09c tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.281003 Aug 30 16:42:38.789203 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3430/6448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:38 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:38.914583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d0cbeb-a7e0-4965-bb49-b929afc5810e", "name": "network-vif-plugged", "status": "completed", "tag": "9543844c-1b7b-4a67-a496-1bec3aabd75d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:38.930917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:38.932587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:38.933478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:38.949513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] Creating event network-vif-plugged:9543844c-1b7b-4a67-a496-1bec3aabd75d for instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e on n-h1-830883-28 Aug 30 16:42:38.955821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c9b5aa39-3ee9-4950-b955-67ec28f8f786 req-83af5d9d-0dce-4bc8-bf4b-6f73729358b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045560 Aug 30 16:42:38.957262 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3019/6449] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:39.765896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:39.766560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:39.792771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:39.793315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:39.793834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:39.796176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:39.797418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:39.813232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:39.814412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:39.815222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:39.836960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:39.836960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:39.836960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:39.846740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:39.847240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:39.847686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:40.095757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:40.107930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6575131d-9678-4c1b-801d-d5f0cca05026 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.346149 Aug 30 16:42:40.109368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:40.113535 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3431/6450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:39 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:40.122157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-453149de-219e-403d-817b-2a0b0cb771da tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1298 microversion: 2.1 time: 0.313690 Aug 30 16:42:40.135280 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3020/6451] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:39 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:41.133051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:41.133931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:41.145196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:41.145762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.146617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:41.146913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.147448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.149205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.155384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.156243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.161715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.165152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.167298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.168250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.170599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.171967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.488772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:41.498560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9068f657-9d51-4be3-aa8f-5d628d3c8b20 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1470 microversion: 2.1 time: 0.357713 Aug 30 16:42:41.504437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3021/6452] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:41 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1470 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:41.526013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:41.527106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:41.543028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.543567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.544104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.556470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.557835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.561034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.617822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:41.637368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8e0db44-a48d-43dd-adea-ff87f86e836c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.508192 Aug 30 16:42:41.640922 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3432/6453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:41 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:41.766962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:41.778804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd3bdd6a-88a5-4b0c-93c4-177ad6d36147 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1470 microversion: 2.1 time: 0.257879 Aug 30 16:42:41.779885 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3022/6454] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:41 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:41.800490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:41.801350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:41.810375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.810966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.811488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.812985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:41.814027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:41.815600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:41.976406 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3e724aa-f0d0-4e28-bd7d-235b98cc9045 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1623 microversion: 2.1 time: 0.180513 Aug 30 16:42:41.978827 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3433/6455] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:41 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1623 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:42.000933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:42.001559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:42.009761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.010476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.013610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.015332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.015837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.016283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.345742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fedc51bd-0404-483c-b410-13eb6bd879c2 tempest-TestSecurityGroupsBasicOps-1464880722 tempest-TestSecurityGroupsBasicOps-1464880722-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1913 microversion: 2.1 time: 0.348597 Aug 30 16:42:42.358820 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3023/6456] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:41 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1913 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:42.498791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:42.499379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:42.518327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.521201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.522814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.524217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.527162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.528181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.569755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:42.574807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:42.577607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:42:42.592401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.592917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.593367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.594083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.594573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.595009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.723384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acff091f-c1cc-487c-961c-781a91441205 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc/action" status: 200 len: 24572 microversion: 2.1 time: 0.157293 Aug 30 16:42:42.724064 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3024/6457] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:42:42 2022] POST /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc/action => generated 24572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:42:42.738995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:42.739722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:42.758946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.759472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.763686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.764617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.765539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.767660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.774480 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f53a395-659c-4012-a279-97ab4d8b7b5e tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "DELETE /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 204 len: 0 microversion: 2.1 time: 0.281359 Aug 30 16:42:42.778625 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3434/6458] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:42:42 2022] DELETE /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:42:42.786025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:42.792052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:42.803011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.803513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.803951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:42.810343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:42.811108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:42.812780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:43.082683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:43.091052 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5f557f4-b8b2-40dd-8bb7-15493502cb7c tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.365688 Aug 30 16:42:43.091949 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3025/6459] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:42 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:43.104991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:43.121112 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07d5f42c-89b0-4364-b86d-7fe6d2dfd09a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1476 microversion: 2.1 time: 0.336992 Aug 30 16:42:43.125479 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3435/6460] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:42 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1476 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:44.112977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:44.113717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:44.126439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:44.126965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:44.127497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:44.128086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:44.128535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:44.128963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:44.145185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:44.145819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:44.172553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:44.173062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:44.173526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:44.174229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:44.174736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:44.175154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:44.493591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:44.517326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-968df8e5-38be-4e30-bdd9-d37ec8e45ddf tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1476 microversion: 2.1 time: 0.371449 Aug 30 16:42:44.518282 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3436/6461] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:44 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:44.533245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:44.534721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "name": "network-vif-plugged", "status": "completed", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:44.536072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:44.553033 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8689c737-7655-423e-a64a-9a260707d9a7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.440191 Aug 30 16:42:44.563501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3026/6462] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:44 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:44.573643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:44.574141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:44.574619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:44.605890 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] Creating event network-vif-plugged:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:42:44.618240 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a9a69c17-48f3-4a6f-a1e5-332b63ac9eb6 req-456beaf2-e61e-4c67-9388-aacf7194d3e3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090625 Aug 30 16:42:44.623383 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3437/6463] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:45.313677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67d0cbeb-a7e0-4965-bb49-b929afc5810e", "name": "network-vif-deleted", "tag": "9543844c-1b7b-4a67-a496-1bec3aabd75d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:45.332681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.333557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.335828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.354938 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] Creating event network-vif-deleted:9543844c-1b7b-4a67-a496-1bec3aabd75d for instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e on n-h1-830883-28 Aug 30 16:42:45.364609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8c5f2ae7-f031-4523-9dd1-66221bddb64f req-57765700-9825-4177-8193-5c22cc7f5997 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065470 Aug 30 16:42:45.365531 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3027/6464] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:45.540460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:45.542052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:45.569867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.570517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.571176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.571987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.572738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.573296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:45.573455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.574596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:45.587710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.588437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.589098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.590487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.591514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.592812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.665812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:45.666617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:45.667545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:45.669259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lazy-loading 'fault' on Instance uuid 67d0cbeb-a7e0-4965-bb49-b929afc5810e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:42:45.749672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:45.749672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:45.753386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-867fc6bc-918c-4d4e-a48f-98d530563c77 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 200 len: 1330 microversion: 2.1 time: 0.217449 Aug 30 16:42:45.761843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3438/6465] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:45 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 1330 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:45.811203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:45.821960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2ef4f60f-4994-40c2-8c0c-86c3868e0262 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1391 microversion: 2.1 time: 0.253340 Aug 30 16:42:45.823142 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3028/6466] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:45 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1391 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:42:46.777357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:46.778652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 67d0cbeb-a7e0-4965-bb49-b929afc5810e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:46.787297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:46.788031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:46.788683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:46.789595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:46.798114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:46.800362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:46.828617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] HTTP exception thrown: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Request method failure captured: Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e HTTP/1.1 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj1kI4SqHHqUFXljYDqgqQWQRKRvaAo8UMto2Yo5Iu--Bm9AvUf5zhEQw2eXuTfuwbYVuxxzy66zZBEjQrj0DSUmBdhyL16jUp2CgGdmf7JNSM29X1_UMuPpm_ULbG6j9pEFHAmL4O8t8l6LahMEek3rIlC6oqIh68hZy7t1MKdbL_Q Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c61d73a07bcd4590a590b63149891678 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c61d73a07bcd4590a590b63149891678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c61d73a07bcd4590a590b63149891678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c61d73a07bcd4590a590b63149891678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c61d73a07bcd4590a590b63149891678"}]}] Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c61d73a07bcd4590a590b63149891678 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestSecurityGroupsBasicOps-889846579-project Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 871f68120d0343a597b2d95ba9f959de Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestSecurityGroupsBasicOps-889846579-project Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '67d0cbeb-a7e0-4965-bb49-b929afc5810e'} Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:42:46.831024 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. Aug 30 16:42:46.837746 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:42:46.848235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:46.850466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:46.856790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Returning 404 to user: Instance 67d0cbeb-a7e0-4965-bb49-b929afc5810e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:42:46.857989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9350ba1f-440a-465d-92d9-cf3187d6c7b6 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e" status: 404 len: 111 microversion: 2.1 time: 0.087706 Aug 30 16:42:46.863649 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3439/6467] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:46 2022] GET /compute/v2.1/servers/67d0cbeb-a7e0-4965-bb49-b929afc5810e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:42:46.865966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:46.866818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:46.867849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:46.870101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:46.870803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:46.871512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:47.128731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:47.138017 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1e437d1-fa94-4a84-b98f-33ac7e764bd3 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1563 microversion: 2.1 time: 0.294195 Aug 30 16:42:47.141285 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3029/6468] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:46 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1563 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:47.164923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:47.165653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:47.183516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:47.183963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:47.186908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:47.187786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:47.188267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:47.188696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:47.517218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:47.526171 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7c8e7f9-74b2-464a-b454-f19900eda67a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1563 microversion: 2.1 time: 0.365957 Aug 30 16:42:47.542392 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3440/6469] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:47 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1563 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:49.423668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:49.426570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:49.439667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:49.440503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:49.441877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:49.443327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:49.443953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:49.444876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:49.544605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e7c8eed8-e2de-41dc-b9ac-4c3b5d863ab5 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "POST /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc/action" status: 200 len: 32651 microversion: 2.1 time: 0.125410 Aug 30 16:42:49.556013 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3030/6470] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:42:49 2022] POST /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc/action => generated 32651 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:42:52.657228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:52.658326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:52.682971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:52.683529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:52.708938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:52.709784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:52.710847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:52.715229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:52.897769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:52.978500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:52.983907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:52.987665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:53.038004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] Creating event network-changed:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:42:53.049433 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f83c748c-93e1-4dec-ac5e-7d90d404f3f6 req-7b3114ed-948c-425f-80b6-6446c6b060f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161084 Aug 30 16:42:53.051588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3031/6471] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:42:53.567475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:53.583420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f486ce94-fafa-47aa-b4a0-fd9b1eff2f4f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1563 microversion: 2.1 time: 0.930815 Aug 30 16:42:53.584542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3441/6472] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:52 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1563 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:54.621060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:54.622432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:54.639883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:54.647521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:54.651003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:54.652287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:54.654889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:54.656300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:54.657479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:54.733310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:42:54.873014 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5deb3239-0adb-45b3-b8a4-f1607e87c9db tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 204 len: 0 microversion: 2.1 time: 0.258581 Aug 30 16:42:54.873613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3032/6473] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:42:54 2022] DELETE /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:42:54.882883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:54.884205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:54.891928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:42:54.894085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:54.894853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:54.895531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:54.896430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:54.897432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:54.898078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:55.117432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc", "tag": "b8c96690-6683-4207-a615-3e67378ab374"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:55.131213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:55.131915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:55.132549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:55.158035 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] Creating event network-changed:b8c96690-6683-4207-a615-3e67378ab374 for instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc on n-h1-830883-28 Aug 30 16:42:55.163926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-58183f9c-1ed2-4a1d-8034-fb7fab8bfcf4 req-a864b686-38a5-48e3-929c-8faed641dec0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051939 Aug 30 16:42:55.165959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3033/6474] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:55.393609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:55.406206 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-655c3fbb-bf93-4fc9-8ee3-122782ecaa2e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1669 microversion: 2.1 time: 0.528002 Aug 30 16:42:55.410631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3442/6475] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:54 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1669 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:56.436190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:56.436884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:56.454268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:56.466242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:56.466971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:56.468597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:56.473963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:56.479982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:57.287021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb8fd0a68ae4a939a8f877ed9504d6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37b71614c5545838941c58ed3c9842e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:42:57.300584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-698aa1f4-e762-4981-af9c-9a99a271e17b tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 200 len: 1669 microversion: 2.1 time: 0.869893 Aug 30 16:42:57.301854 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3034/6476] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:56 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 1669 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:42:57.367183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc", "name": "network-vif-deleted", "tag": "b8c96690-6683-4207-a615-3e67378ab374"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:57.423522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:57.424086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:57.425722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:57.481431 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] Creating event network-vif-deleted:b8c96690-6683-4207-a615-3e67378ab374 for instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc on n-h1-830883-28 Aug 30 16:42:57.509992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7794829d-fc5b-46e2-bde9-d0cdc385e679 req-a85f3917-8674-45b6-901f-0ae09cb9e710 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154920 Aug 30 16:42:57.511256 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3443/6477] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:42:58.336140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:58.336832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] [instance: d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:58.368057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:58.370752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:58.371271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:58.378040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:58.379872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:58.381950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:58.414779 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] HTTP exception thrown: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Request method failure captured: Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc HTTP/1.1 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDjz3PATDV0LZZscJdwChgt06wUOdIMJqnx-Yb1hrGrmKHZqmMFovrCQKTMQJdRTi8SR8fyQX_JBHwP9_f16J2BG3rL2Ok0SM8PeK-HIiJoFpzFVx-rRM4rfRzQszviZq-jJsTo0cpuBpY4LV3rqfYOmtoGusMlF7jj8TWvKGPy0Oc0M Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e37b71614c5545838941c58ed3c9842e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e37b71614c5545838941c58ed3c9842e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e37b71614c5545838941c58ed3c9842e"}]}] Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e37b71614c5545838941c58ed3c9842e Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkBasicOps-1277009711 Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: bfb8fd0a68ae4a939a8f877ed9504d6a Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkBasicOps-1277009711-project Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'd39d1cb0-80bc-4f11-8f29-b62f0df8d3bc'} Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:42:58.419527 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. Aug 30 16:42:58.424302 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:42:58.433847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Returning 404 to user: Instance d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:42:58.435323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0158440a-460c-43df-a7ff-479be51aaa9e tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc" status: 404 len: 111 microversion: 2.1 time: 0.109222 Aug 30 16:42:58.436396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3035/6478] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:42:58 2022] GET /compute/v2.1/servers/d39d1cb0-80bc-4f11-8f29-b62f0df8d3bc => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:42:59.016217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3f5bf6b-9d6e-457c-adac-89d71a9d4e18 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] Calling method '.version_select at 0x7fd357f3cdc0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:59.108927 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3f5bf6b-9d6e-457c-adac-89d71a9d4e18 tempest-TestNetworkBasicOps-1277009711 tempest-TestNetworkBasicOps-1277009711-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1789573323" status: 202 len: 0 microversion: 2.1 time: 0.097588 Aug 30 16:42:59.110842 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3444/6479] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 16:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1789573323 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:42:59.635192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:42:59.635798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:42:59.646837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:59.653631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:59.655439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:59.660884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:59.662162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:59.664688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:59.741579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e35cdf2-8c87-4977-a780-8c384f6540a1", "tag": "372ad459-136e-4df2-ae5a-6d356b8c8b1c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:42:59.763472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:42:59.765432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:42:59.766041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:42:59.789848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:42:59.793129 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] Creating event network-changed:372ad459-136e-4df2-ae5a-6d356b8c8b1c for instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 on n-h2-830883-28 Aug 30 16:42:59.804138 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c5e5f5cf-a2fe-4e03-8195-c0bfb4d28908 req-071853ac-a595-4cd0-b67b-c78eb02bb5c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067171 Aug 30 16:42:59.811738 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3445/6480] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:43:00.062501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9053e44b-ac3f-4912-9a19-bc3ea84d3772 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 204 len: 0 microversion: 2.1 time: 0.431622 Aug 30 16:43:00.063400 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3036/6481] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:42:59 2022] DELETE /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:43:00.075145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:00.076136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:00.092767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:00.093283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:00.093735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:00.106165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:00.107955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:00.108440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:00.592032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:00.610528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8017536b-9dc1-4bba-9f12-90e6707ce9cc tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1766 microversion: 2.1 time: 0.542344 Aug 30 16:43:00.617890 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3446/6482] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:00 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1766 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:01.643045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:01.644130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:01.661241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:01.662875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:01.664106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:01.668525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:01.670619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:01.671070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:03.578956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:03.602264 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09f12285-1a20-425b-adc8-fd7edd26c60d tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1766 microversion: 2.1 time: 1.965430 Aug 30 16:43:03.607002 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3037/6483] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:01 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1766 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:04.635467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:04.636086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:04.659920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:04.661681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:04.662141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:04.672076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:04.675594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:04.676189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:04.745100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e35cdf2-8c87-4977-a780-8c384f6540a1", "name": "network-vif-deleted", "tag": "372ad459-136e-4df2-ae5a-6d356b8c8b1c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:04.789130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:04.789615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:04.802930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:04.830466 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] Creating event network-vif-deleted:372ad459-136e-4df2-ae5a-6d356b8c8b1c for instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 on n-h2-830883-28 Aug 30 16:43:04.848200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9f41cff1-4096-47c1-95b6-949dd9dd368a req-5c8e42d4-2e98-4bcf-a4a6-fa502baa213f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107328 Aug 30 16:43:04.849437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3038/6484] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:43:04.998072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871f68120d0343a597b2d95ba9f959de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c61d73a07bcd4590a590b63149891678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:05.013298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e574842-1372-4717-956e-4106d0f0098a tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 200 len: 1529 microversion: 2.1 time: 0.380570 Aug 30 16:43:05.016504 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3447/6485] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:04 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 1529 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:06.048965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:06.053251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] [instance: 2e35cdf2-8c87-4977-a780-8c384f6540a1] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:06.096026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:06.096529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:06.097033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:06.097703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:06.098159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:06.098618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:06.132057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] HTTP exception thrown: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Request method failure captured: Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 HTTP/1.1 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj1kI4SqHHqUFXljYDqgqQWQRKRvaAo8UMto2Yo5Iu--Bm9AvUf5zhEQw2eXuTfuwbYVuxxzy66zZBEjQrj0DSUmBdhyL16jUp2CgGdmf7JNSM29X1_UMuPpm_ULbG6j9pEFHAmL4O8t8l6LahMEek3rIlC6oqIh68hZy7t1MKdbL_Q Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c61d73a07bcd4590a590b63149891678 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c61d73a07bcd4590a590b63149891678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c61d73a07bcd4590a590b63149891678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c61d73a07bcd4590a590b63149891678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c61d73a07bcd4590a590b63149891678"}]}] Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c61d73a07bcd4590a590b63149891678 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-889846579 Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestSecurityGroupsBasicOps-889846579-project Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 871f68120d0343a597b2d95ba9f959de Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestSecurityGroupsBasicOps-889846579-project Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '2e35cdf2-8c87-4977-a780-8c384f6540a1'} Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:43:06.133889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Returning 404 to user: Instance 2e35cdf2-8c87-4977-a780-8c384f6540a1 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ff19db77-b050-4f8c-b549-73ef2ad02390 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1" status: 404 len: 111 microversion: 2.1 time: 0.102219 Aug 30 16:43:06.138693 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3039/6486] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:06 2022] GET /compute/v2.1/servers/2e35cdf2-8c87-4977-a780-8c384f6540a1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:43:15.386683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:15.388473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=37 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:15.393711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a0db3d3-b386-4269-b5cc-fc5a9ee0ce55 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] Calling method '.version_select at 0x7fd357fce670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:15.448894 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a0db3d3-b386-4269-b5cc-fc5a9ee0ce55 tempest-TestSecurityGroupsBasicOps-889846579 tempest-TestSecurityGroupsBasicOps-889846579-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1784247190" status: 202 len: 0 microversion: 2.1 time: 0.064274 Aug 30 16:43:15.449789 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3448/6487] 10.222.0.47 () {58 vars in 1278 bytes} [Tue Aug 30 16:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1784247190 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:43:21.861678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:21.864350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:21.887623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:21.892446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:21.894588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:21.900132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:21.900681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:21.901797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:21.902515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:21.903825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:22.077842 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-136fc0d7-3f4d-4faf-8354-725f42c213e7 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action" status: 200 len: 24574 microversion: 2.1 time: 0.219635 Aug 30 16:43:22.079118 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3040/6488] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:21 2022] POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action => generated 24574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:43:22.457241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-216055107", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "db3bbba9-2f4f-40ee-806a-e282c2d6c4d3"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:22.590403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] validate_networks() for [('db3bbba9-2f4f-40ee-806a-e282c2d6c4d3', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:43:23.490136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:43:23.491297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:43:23.492480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:43:23.493371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:43:23.494065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:43:23.515499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:23.516239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:23.517080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:23.518067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:23.518965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:23.519562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:23.548331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Getting quotas for project 49f3d8264eb84f5b9e8240276f221ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:43:23.558806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Getting quotas for user e192fb7593d344e1b7bdb6c6a8db2b7b and project 49f3d8264eb84f5b9e8240276f221ca8. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:43:23.576132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:43:23.579571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:43:23.669705 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-893006cb-6fd8-4d3d-9a35-09091ffe0a06 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644822 Aug 30 16:43:23.671474 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3449/6489] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:43:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:43:23.684469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a90ff9aa-b403-473d-bed6-288b0ada9639 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:23.688443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a90ff9aa-b403-473d-bed6-288b0ada9639 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:23.877254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a90ff9aa-b403-473d-bed6-288b0ada9639 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:23.890364 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a90ff9aa-b403-473d-bed6-288b0ada9639 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1214 microversion: 2.1 time: 0.211222 Aug 30 16:43:23.894866 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3041/6490] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:23 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:24.925766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:24.927323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:24.949832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:24.951613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:24.952927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:24.955037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:24.955780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:24.957842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:25.114699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:25.133742 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b83fc6d-9631-4c0b-b383-2effe042fd5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1210 microversion: 2.1 time: 0.212976 Aug 30 16:43:25.148055 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3450/6491] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:24 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1210 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:26.160226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:26.162579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:26.181630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:26.182141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:26.193948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:26.194857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:26.195347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:26.223467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:26.786148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:26.795589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a6b7b5b-0b75-472c-acb7-8dda58096041 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1272 microversion: 2.1 time: 0.640758 Aug 30 16:43:26.798602 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3042/6492] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:26 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1272 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:27.818480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:27.819139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:27.853607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:27.857811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:27.861126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:27.863360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:27.865401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:27.866449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:28.681597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:28.697212 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f597692-8d6a-4029-8a63-7d7077a560fc tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 0.883788 Aug 30 16:43:28.700036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3451/6493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:27 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:29.721364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:29.723751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:29.739316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:29.744550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:29.747041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:29.748702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:29.750826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:29.754739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:29.907869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92187d11-5817-4119-91d8-3f58fb45f292", "tag": "e24ed538-9e51-4403-bdde-9488cd72b483"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:29.937927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:29.939267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:29.940113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:29.995503 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] Creating event network-changed:e24ed538-9e51-4403-bdde-9488cd72b483 for instance 92187d11-5817-4119-91d8-3f58fb45f292 on n-h1-830883-28 Aug 30 16:43:30.028384 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5c682713-676b-457a-b4d9-3fdd4f7730f1 req-9e84a86c-fef4-4e18-a68a-cee0cc4c409d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126398 Aug 30 16:43:30.040029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3452/6494] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:43:30.616783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:30.627256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ee574cc-dca6-49a8-935a-a04cf80b7d5e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 0.911324 Aug 30 16:43:30.632845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3043/6495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:29 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:31.684137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:31.685497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:31.720067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:31.722445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:31.724897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:31.728398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:31.729217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:31.729897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:32.744762 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:32.755268 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-003dcd43-1a19-49c9-a2e2-f0237e5cce6d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 1.102796 Aug 30 16:43:32.759124 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3453/6496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:31 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:33.785297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:33.785974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:33.827339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:33.827851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:33.833264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:33.834086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:33.834608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:33.835044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:33.942764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:34.473579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:34.482893 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-01645caa-534c-4d47-92f2-59aba21f8b68 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 0.704056 Aug 30 16:43:34.495560 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3044/6497] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:33 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:35.515350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:35.516226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:35.530087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:35.538659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:35.546231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:35.546827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:35.547280 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:35.551110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:35.551604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:35.552086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:36.041369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:36.057471 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d911787b-ba75-4886-9e3f-57b9883187c0 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 0.545872 Aug 30 16:43:36.058267 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3454/6498] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:35 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:36.511030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92187d11-5817-4119-91d8-3f58fb45f292", "name": "network-vif-plugged", "status": "completed", "tag": "e24ed538-9e51-4403-bdde-9488cd72b483"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:36.535594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:36.536307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:36.540558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:36.573114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] Creating event network-vif-plugged:e24ed538-9e51-4403-bdde-9488cd72b483 for instance 92187d11-5817-4119-91d8-3f58fb45f292 on n-h1-830883-28 Aug 30 16:43:36.591376 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-61557933-6f87-43f8-a33a-7b822db078a4 req-21153fc1-12c5-46b9-8d13-6ec68667932c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079847 Aug 30 16:43:36.594368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3045/6499] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:43:37.083905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:37.089968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:37.112798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:37.117074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:37.118061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:37.119544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:37.120314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:37.121849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:37.742150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:37.758208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22165d0c-cd03-460a-8fd5-094e0468e8e4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1314 microversion: 2.1 time: 0.677549 Aug 30 16:43:37.774343 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3455/6500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:37 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:38.790740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:38.792120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:38.801298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:38.802062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:38.802877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:38.804164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:38.805056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:38.805971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.030487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:39.039249 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dca3b847-b82d-43c5-a072-91fd14671d8e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1502 microversion: 2.1 time: 0.254066 Aug 30 16:43:39.040176 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3046/6501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:38 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:39.061312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:39.062185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:39.069052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.069806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.072941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.077130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.080044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.082891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.220180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6996d9f9-0bda-46a1-b328-0140bb82a6c8 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Action: 'create', calling method: .version_select at 0x7fd35cbcd040>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1512725491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYxZysu0LVqb7An0pGlPEr0zSY6qJ6c6JAFSNI9ccvBBsep+crmDPkOglu0pNB2uL6i2EmDujUiwzZFTi5L4QECV2Fz/bTUdRuMJGNGV6jpWPYTTLXB1DVtj7a0r44RLg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:39.260577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6996d9f9-0bda-46a1-b328-0140bb82a6c8 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for project 41168af3efc64d3b81b35b9b35ab344f. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:43:39.270637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6996d9f9-0bda-46a1-b328-0140bb82a6c8 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for user 67e0c82a4c524c1397d37f3eaa9c4280 and project 41168af3efc64d3b81b35b9b35ab344f. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:43:39.322420 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6996d9f9-0bda-46a1-b328-0140bb82a6c8 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.463393 Aug 30 16:43:39.328740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:39.329421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3456/6502] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:43:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:43:39.338390 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e4f2dd25-3df5-45fa-9ff0-19d40b1d562e tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1502 microversion: 2.1 time: 0.281698 Aug 30 16:43:39.356291 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3047/6503] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:39 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:39.361323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:39.362421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:39.371327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.372564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.373353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.374463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.375839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.376549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.404824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lazy-loading 'flavor' on Instance uuid 92187d11-5817-4119-91d8-3f58fb45f292 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:43:39.513546 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bddf31e4-c1ad-42c2-97cb-87559746d197 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action" status: 202 len: 0 microversion: 2.1 time: 0.156483 Aug 30 16:43:39.516090 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3457/6504] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:39 2022] POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:43:39.522832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:39.523559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:39.534678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.535180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.535626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.536336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:39.537285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:39.537285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:39.880501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:39.890546 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c3b3646-88ec-4381-8b7a-35074213f99b tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1510 microversion: 2.1 time: 0.371581 Aug 30 16:43:39.891476 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3048/6505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:39 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:40.925873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:40.927785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:40.943359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:40.945875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:40.946808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:40.950914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:40.951812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:40.952461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:41.346397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:41.357411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1226bf2f-c0db-4f4c-a000-2dbe185f1db4 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1493 microversion: 2.1 time: 0.447620 Aug 30 16:43:41.364838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3458/6506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:40 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1493 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:41.393910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:41.395236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:41.406158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:41.406842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:41.407607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:41.408660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:41.409428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:41.410015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:41.557027 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-956b3b9a-fe3f-483a-9ad5-cd19c967beef tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action" status: 202 len: 0 microversion: 2.1 time: 0.171758 Aug 30 16:43:41.563625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3049/6507] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:41 2022] POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:43:41.575315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:41.576189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:41.595928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:41.613851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:41.619038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:41.620799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:41.622029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:41.622669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:41.793401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1144739490", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1512725491", "security_groups": [{"name": "tempest-secgroup-smoke-900951612"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "88dfcdef-5e2b-4ce8-bb41-d1f6b052310a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:41.931279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:41.943823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd34ce3d-6b02-4aa1-8235-eefd90e91f31 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1499 microversion: 2.1 time: 0.380188 Aug 30 16:43:41.957964 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3459/6508] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:41 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1499 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:42.060076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] validate_networks() for [('88dfcdef-5e2b-4ce8-bb41-d1f6b052310a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:43:42.962582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for project 41168af3efc64d3b81b35b9b35ab344f. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:43:42.966067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:42.967501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:42.969931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for user 67e0c82a4c524c1397d37f3eaa9c4280 and project 41168af3efc64d3b81b35b9b35ab344f. Resources: dict_keys(['metadata_items']) {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:43:42.978722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:42.979485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:42.980877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:42.982022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:42.982722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:42.983562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:42.988277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:43:42.989563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:43:42.990068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:43:42.990586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:43:42.991174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:43:43.003877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:43.004563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:43.005581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:43.006556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:43.007194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:43.009013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:43.033415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for project 41168af3efc64d3b81b35b9b35ab344f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:43:43.039994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Getting quotas for user 67e0c82a4c524c1397d37f3eaa9c4280 and project 41168af3efc64d3b81b35b9b35ab344f. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:43:43.056839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:43:43.059692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:43:43.158212 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ddc8560-c093-4a9a-b836-2d036dd687b9 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.369462 Aug 30 16:43:43.158912 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3050/6509] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:43:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:43:43.170899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-564dc62a-8d86-4784-b9c3-84eb37c1390b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:43.171818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-564dc62a-8d86-4784-b9c3-84eb37c1390b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:43.308405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-564dc62a-8d86-4784-b9c3-84eb37c1390b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:43.330782 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-564dc62a-8d86-4784-b9c3-84eb37c1390b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1303 microversion: 2.1 time: 0.164414 Aug 30 16:43:43.342350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:43.349266 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3051/6510] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:43 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:43.356059 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-22bb5d33-9a80-46c0-a463-d0e3897a85f9 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1499 microversion: 2.1 time: 0.394806 Aug 30 16:43:43.356796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3460/6511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:42 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1499 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:44.353702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:44.354360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:44.369511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.370353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.372619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.374092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.374618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.375053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.379940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:44.380649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:44.396430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.402862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.404477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.405252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.405720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.409230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.580532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:44.593185 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3a6306c-828a-48ea-baf9-dd4e4e777d38 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1355 microversion: 2.1 time: 0.244203 Aug 30 16:43:44.609061 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3052/6512] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:44 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1355 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:44.691698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:44.700756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06410666-6649-4648-901b-403608d05d45 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1502 microversion: 2.1 time: 0.326086 Aug 30 16:43:44.703433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3461/6513] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:44 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1502 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:44.724791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:44.725334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:44.735915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.739046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.739606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.740648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.743145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.743974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.785461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lazy-loading 'flavor' on Instance uuid 92187d11-5817-4119-91d8-3f58fb45f292 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:43:44.925898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9b3814d-880c-4fac-b70f-e1c8051c8263 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action" status: 202 len: 0 microversion: 2.1 time: 0.204457 Aug 30 16:43:44.933945 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3053/6514] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:44 2022] POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:43:44.939748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:44.940357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:44.960031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.974740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.975373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:44.976137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:44.977133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:44.977566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:45.207223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:45.221084 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bec83e07-5c65-4535-bce6-219d1eddc61d tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1510 microversion: 2.1 time: 0.288746 Aug 30 16:43:45.223331 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3462/6515] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:44 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:45.616731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:45.617782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:45.631862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:45.632394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:45.632841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:45.635800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:45.636276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:45.636706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:45.780039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:45.793564 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37382677-03dc-40c3-93cb-747c781876f2 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1361 microversion: 2.1 time: 0.181647 Aug 30 16:43:45.795080 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3054/6516] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:45 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:46.250815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:46.252278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:46.261539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:46.263659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.265617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.266388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.267572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.270435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.272745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.285872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:46.542880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:46.551348 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54079960-1593-4ef9-b995-37f77e9f46ec tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1493 microversion: 2.1 time: 0.305785 Aug 30 16:43:46.558172 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3463/6517] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:46 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1493 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:46.588084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:46.589128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:46.597097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.597607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.599523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.600263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.600730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.605526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.718966 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ac89726-23f2-4329-93be-d4abac327f20 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action" status: 202 len: 0 microversion: 2.1 time: 0.140978 Aug 30 16:43:46.721213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3055/6518] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:46 2022] POST /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:43:46.729438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:46.730397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:46.745207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.746899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.747773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.752485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.754382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.755040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.824729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:46.825675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:46.840518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.841273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.843143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.843898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:46.846980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:46.847446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:46.893944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:47.009237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:47.021061 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10532c96-ae98-462a-b84e-632967696aa8 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1499 microversion: 2.1 time: 0.295956 Aug 30 16:43:47.021657 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3464/6519] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:46 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1499 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:47.289837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:47.312885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb29b2ae-5be8-4223-bc0a-213e0bd67424 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.494700 Aug 30 16:43:47.315619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3056/6520] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:46 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:47.860259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f777430b-29a4-40d0-a8ae-c113607bcb1e", "tag": "22c7b00a-5ac5-4494-9577-d41dc05f1eee"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:47.878071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:47.879827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:47.883873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:47.927558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] Creating event network-changed:22c7b00a-5ac5-4494-9577-d41dc05f1eee for instance f777430b-29a4-40d0-a8ae-c113607bcb1e on n-h2-830883-28 Aug 30 16:43:47.936269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bc3c27ca-59fc-4d64-98f4-dfa7f53776f6 req-a3b3e52a-9648-4754-a3b7-887a3bfa636f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080995 Aug 30 16:43:47.936898 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3465/6521] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:43:48.042684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:48.043420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:48.058170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:48.058993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:48.059539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:48.060471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:48.060999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:48.061499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:48.340637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:48.341861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:48.352095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:48.352998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:48.353655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:48.355093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:48.355571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:48.356010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:48.412740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:48.422095 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e981953-54a6-4564-83cf-030310394f37 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1499 microversion: 2.1 time: 0.383281 Aug 30 16:43:48.425148 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3057/6522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:48 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1499 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:48.597244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:48.608144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94bbd389-27dd-40ab-a92b-e56823154031 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.274915 Aug 30 16:43:48.609486 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3466/6523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:48 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:49.452308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:49.452923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:49.462188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.463060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.463500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.464204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.464852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.465269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.622947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:49.630010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:49.630845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:49.632626 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b284d27-7cb5-43c0-a9ac-db91ab1795cd tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1502 microversion: 2.1 time: 0.185486 Aug 30 16:43:49.633449 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3058/6524] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:49 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.646450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.656648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:49.669904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:49.683692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.684191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.684622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.685319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.685769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.686191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.719687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:43:49.845848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:49.853321 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e25a7d7-d679-4f5a-9d85-b5a977757a7f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "DELETE /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 204 len: 0 microversion: 2.1 time: 0.201674 Aug 30 16:43:49.857990 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3059/6525] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:43:49 2022] DELETE /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:43:49.862047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff56919f-5070-4360-bdcf-d2697c27fd2c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.236620 Aug 30 16:43:49.862994 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3467/6526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:49 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:49.874512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:49.875419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:49.884783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.885458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.885909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:49.886634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:49.887593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:49.888138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:50.043165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:50.051167 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-66f35506-f107-4bdd-bc26-2e03c510e94f tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1508 microversion: 2.1 time: 0.191497 Aug 30 16:43:50.051750 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3060/6527] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:49 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:50.887024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:50.887858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:50.895215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:50.895827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:50.896375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:50.897218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:50.897832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:50.899072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:51.071064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:51.072962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:51.073582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:51.083260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:51.083755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:51.084189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:51.084765 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8b0c2c0-95a6-4af9-9cc8-3bb4ae5ed500 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.201950 Aug 30 16:43:51.084911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:51.087665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:51.088442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:51.103812 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3468/6528] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:50 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:51.249962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:51.260343 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef3e6a82-e713-43b5-b100-9163aeff9055 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1508 microversion: 2.1 time: 0.191010 Aug 30 16:43:51.260944 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3061/6529] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:51 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:52.113175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:52.114507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:52.123032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:52.125055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:52.125921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:52.127442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:52.129054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:52.129975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:52.283193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:52.284192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:52.300441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:52.333038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:52.341769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:52.344229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:52.349435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:52.361828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:52.364336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:52.636535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:52.645469 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7fbf499d-0523-451b-ac44-614c8fd6369a tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.537580 Aug 30 16:43:52.653694 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3469/6530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:52 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:52.993785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e192fb7593d344e1b7bdb6c6a8db2b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49f3d8264eb84f5b9e8240276f221ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:53.024133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:53.033493 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ae92842b-4419-4114-85f7-ca56314801e6 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 200 len: 1508 microversion: 2.1 time: 0.755409 Aug 30 16:43:53.048356 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3062/6531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:52 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 1508 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:53.075584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92187d11-5817-4119-91d8-3f58fb45f292", "name": "network-vif-deleted", "tag": "e24ed538-9e51-4403-bdde-9488cd72b483"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:53.126268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.126782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.133049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.183860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:53.188479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:53.191016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] Creating event network-vif-deleted:e24ed538-9e51-4403-bdde-9488cd72b483 for instance 92187d11-5817-4119-91d8-3f58fb45f292 on n-h1-830883-28 Aug 30 16:43:53.200213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cd75daab-0714-4c60-b5dc-71a33fc62e08 req-cd6f1eed-7756-4ac0-ad09-02671c164e6a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150130 Aug 30 16:43:53.203415 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3063/6532] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:43:53.215491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.218797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.220345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.223734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.225466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.226179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.388488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:43:53.390849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:43:53.392175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:43:53.393626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:43:53.394662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:43:53.495279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:53.510618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.511142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.511599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.512330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.516810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.518759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.573631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cee9ae71-21f9-4ba0-8477-f194bb4ba81f tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action" status: 202 len: 1137 microversion: 2.1 time: 0.918369 Aug 30 16:43:53.575034 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3470/6533] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:43:52 2022] POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action => generated 1137 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 16:43:53.593880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:43:53.598401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:53.599035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:53.612010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.612784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.613408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.614332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.614954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.615545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.676978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:53.677654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:53.691316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.691871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.694220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.696259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:53.696744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:53.698848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:53.860495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:53.914625 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-942b7a1f-2573-4531-999d-6a881ef69de9 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.320645 Aug 30 16:43:53.923399 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3064/6534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:53 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:54.005652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:54.019922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6fc76ae1-0939-4331-8bdf-d3a5dc4bb60b tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.347482 Aug 30 16:43:54.021250 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3471/6535] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:53 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:54.058787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:54.059420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] [instance: 92187d11-5817-4119-91d8-3f58fb45f292] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:54.067863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:54.068478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:54.070233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:54.070993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:54.071453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:54.071885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:54.090384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] HTTP exception thrown: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Request method failure captured: Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 HTTP/1.1 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj4mOpVr0r-dYvlvNPPIaQ5Q34G9yZO4yXX12QUDV7AhSvgRFBxD1dzOJNprkZSSh5pC8b1D80LaLBhKrDWzi_2m2uDSEa3uLqnYClFmcJNj1jp-oZR3dIod0wXeVgnrQGBLkCdktwpOwtcVH7XYiCJuNjRKIDGSDx4Y4DITSYctcpQ Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 49f3d8264eb84f5b9e8240276f221ca8 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestServerAdvancedOps-984543228 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49f3d8264eb84f5b9e8240276f221ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_49f3d8264eb84f5b9e8240276f221ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/49f3d8264eb84f5b9e8240276f221ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/49f3d8264eb84f5b9e8240276f221ca8"}]}] Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestServerAdvancedOps-984543228 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 49f3d8264eb84f5b9e8240276f221ca8 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestServerAdvancedOps-984543228 Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestServerAdvancedOps-984543228-project Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: e192fb7593d344e1b7bdb6c6a8db2b7b Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestServerAdvancedOps-984543228-project Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '92187d11-5817-4119-91d8-3f58fb45f292'} Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:43:54.092186 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] Returning 404 to user: Instance 92187d11-5817-4119-91d8-3f58fb45f292 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:43:54.097390 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-20060679-9c4c-46cb-95c3-8696061ea466 tempest-TestServerAdvancedOps-984543228 tempest-TestServerAdvancedOps-984543228-project] 10.222.0.47 "GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292" status: 404 len: 111 microversion: 2.1 time: 0.040937 Aug 30 16:43:54.099514 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3065/6536] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:54 2022] GET /compute/v2.1/servers/92187d11-5817-4119-91d8-3f58fb45f292 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:43:54.690079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f777430b-29a4-40d0-a8ae-c113607bcb1e", "name": "network-vif-plugged", "status": "completed", "tag": "22c7b00a-5ac5-4494-9577-d41dc05f1eee"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:43:54.719227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:54.721149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:54.721760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:54.754278 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] Creating event network-vif-plugged:22c7b00a-5ac5-4494-9577-d41dc05f1eee for instance f777430b-29a4-40d0-a8ae-c113607bcb1e on n-h2-830883-28 Aug 30 16:43:54.768338 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b0d3a4c9-3b83-4671-b25d-e2d2607952a5 req-6fcc4890-d81d-4a8b-a796-549895b10474 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082608 Aug 30 16:43:54.769400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3472/6537] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:43:54.941098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:54.942219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:54.956419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:54.957185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:54.957857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:54.959033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:54.961998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:54.962898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:55.065290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:55.066155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:55.073415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:55.076809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:55.077448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:55.078667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:55.079609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:55.086998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:55.332113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:55.341138 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-916ae06f-f02c-4348-ad66-b75c084c2353 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.404769 Aug 30 16:43:55.342226 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3066/6538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:54 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:55.402123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:55.418975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-99ac6197-f22e-4e8b-a7f7-8e1baa7f9ead tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.379057 Aug 30 16:43:55.430532 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3473/6539] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:55 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:56.364217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:56.365336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:56.373064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:56.373669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:56.374179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:56.379457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:56.380776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:56.381412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:56.443556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:56.445722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:56.467519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:56.468285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:56.468932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:56.470080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:56.470787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:56.472409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:56.591835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:56.600414 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e8df64e4-3302-4c8d-8e4e-7167a415474b tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.239986 Aug 30 16:43:56.617865 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3067/6540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:56 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:56.733601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:56.744742 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a049af35-1115-44c1-959d-5620c3240332 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1428 microversion: 2.1 time: 0.304929 Aug 30 16:43:56.749096 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3474/6541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:56 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1428 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:57.626467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:57.627071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:57.635608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:57.636392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:57.637071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:57.638051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:57.638878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:57.639531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:57.783213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:57.784986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:57.794747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:57.795370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:57.795893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:57.796643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:57.797189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:57.797639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:58.054278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:58.065096 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0ed58b9-118f-4132-bc03-f71bf6b11822 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1607 microversion: 2.1 time: 0.299860 Aug 30 16:43:58.066060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3475/6542] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:57 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1607 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:43:58.094784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:58.095422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:58.102657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:58.103413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:58.104048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:58.104945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:58.105572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:58.106164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:58.183911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:58.192804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e02e418f-2563-40bf-b1c5-0668869d7839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.570106 Aug 30 16:43:58.197155 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3068/6543] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:57 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:58.266713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:58.275352 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eca35373-b850-4518-99eb-e032abb1a17e tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1607 microversion: 2.1 time: 0.184510 Aug 30 16:43:58.275935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3476/6544] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:58 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1607 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:58.295280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:58.295879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:58.301915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:58.302441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:58.302880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:58.304523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:58.305164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:58.305780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:58.457914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:58.467940 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6d57ffe5-ce04-4c8b-a6a6-2633cc7dfc01 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1607 microversion: 2.1 time: 0.176403 Aug 30 16:43:58.468830 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3069/6545] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:58 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1607 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:43:59.238471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:43:59.240009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:43:59.250053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:59.250603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:59.251207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:59.252005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:43:59.252653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:43:59.253265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:43:59.495410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:43:59.508552 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1526b4b8-f65a-4c3f-874e-92af72bc5eb8 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.278002 Aug 30 16:43:59.524318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3477/6546] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:43:59 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:00.537839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:00.539467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:00.553427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:00.558999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:00.559688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:00.560521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:00.561390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:00.562250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:00.780553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f777430b-29a4-40d0-a8ae-c113607bcb1e", "tag": "22c7b00a-5ac5-4494-9577-d41dc05f1eee"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:44:00.812073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:00.812580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:00.813030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:00.852067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] Creating event network-changed:22c7b00a-5ac5-4494-9577-d41dc05f1eee for instance f777430b-29a4-40d0-a8ae-c113607bcb1e on n-h2-830883-28 Aug 30 16:44:00.861758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:00.869330 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b7c7707b-b4ac-4de6-9a44-6203a8d3f7bd req-bec7af3d-3801-4d4d-9fef-765a76759506 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092349 Aug 30 16:44:00.870858 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3478/6547] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:44:00.876534 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3da00d53-5e66-4cc7-9212-b01b30a60ccd tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.346778 Aug 30 16:44:00.877316 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3070/6548] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:00 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:01.907494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:01.908859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:01.922653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:01.923267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:01.923737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:01.924506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:01.924990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:01.925439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:02.158147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:02.160789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:44:02.169787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2cfc4f3b-939e-410d-a097-c26bfb9a0b3e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.265536 Aug 30 16:44:02.170025 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3479/6549] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:01 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:03.193851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:03.194658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:03.204512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:03.205112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:03.205673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:03.206591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:03.207143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:03.207664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:03.398828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:03.407530 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6354d347-18f1-4b2a-86b6-3d816ef47116 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.218206 Aug 30 16:44:03.423416 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3071/6550] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:03 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:04.431457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:04.432039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:04.447151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:04.609962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:04.619798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fcca4e64-495f-4dc9-9c36-f9a2f2c02715 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1690 microversion: 2.1 time: 0.194564 Aug 30 16:44:04.621425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3480/6551] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:04 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:05.642204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:05.643607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:05.651450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:05.652284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:05.652981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:05.654129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:05.654885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:05.655595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:05.837233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:05.840708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:44:05.849128 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-019ec07c-3e0a-4eaf-874f-2db02226da7a tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1696 microversion: 2.1 time: 0.210433 Aug 30 16:44:05.849840 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3072/6552] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:05 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1696 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:06.874000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:06.875338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:06.905074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:06.905380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:06.905909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:06.906975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:06.907446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:06.907886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:07.113807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:07.125656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e373a16e-a5ca-4f5e-9b13-9d44251e6226 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1696 microversion: 2.1 time: 0.255966 Aug 30 16:44:07.129114 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3481/6553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:06 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:44:08.156194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:08.158105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:08.214654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:08.215838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:08.219011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:08.219969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:08.220676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:08.221290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:08.435543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:08.458163 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecb785e6-dd9e-4b0d-a8ff-37fd4ddcf2be tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1696 microversion: 2.1 time: 0.297078 Aug 30 16:44:08.460210 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3073/6554] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:08 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1696 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:08.748049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "name": "network-vif-unplugged", "status": "completed", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:44:08.770213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:08.770731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:08.789828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:08.816327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] Creating event network-vif-unplugged:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:44:08.829832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1d2ab7aa-91f1-41f8-8dc3-ecf2836726f3 req-358c9266-6683-4e5d-8ee9-f02960a3da08 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086785 Aug 30 16:44:08.830936 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3482/6555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:44:09.483280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:09.484580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:09.493226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:09.493992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:09.494639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:09.495244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:09.495697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:09.496117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:09.697028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:09.712304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b2c40a88-e5f2-4ee1-8256-07c6cbae0544 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1696 microversion: 2.1 time: 0.232789 Aug 30 16:44:09.713220 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3074/6556] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:09 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1696 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:10.734738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:44:10.735574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:10.750242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:10.751281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:10.751742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:10.752490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:10.752955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:10.753464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:10.931686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:44:10.949853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d51d077-ffce-4e8d-9736-dba9c903b839 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1681 microversion: 2.1 time: 0.220198 Aug 30 16:44:10.976027 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3483/6557] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:44:10 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:44:12.794936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "name": "network-vif-plugged", "status": "completed", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:44:12.813342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:12.814973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:12.816171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:12.853351 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] Creating event network-vif-plugged:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:44:12.864049 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e1488075-ffaa-4269-b617-d97bf2151dee req-d9f5dec6-bc9f-40e2-a423-6fa978452317 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072857 Aug 30 16:44:12.865036 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3075/6558] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:44:47.288197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:44:47.290575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:44:47.292743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=45 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:44:47.293474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=21 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:44:47.302946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:47.303440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:47.303880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:47.304581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:44:47.305030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:44:47.305638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:44:47.375549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-66846881-2b88-411b-ab2b-0b7af0f2675d tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action" status: 200 len: 24563 microversion: 2.1 time: 0.091708 Aug 30 16:44:47.376346 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3484/6559] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:44:47 2022] POST /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f/action => generated 24563 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:45:18.543710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=27 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:45:18.545059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:45:18.551013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:18.552430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:18.561459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:18.561953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:18.562426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:18.563127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:18.563590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:18.564018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:18.589719 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf4e4982-7722-44d3-b096-ebd19fa660fb tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.048144 Aug 30 16:45:18.590337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3076/6560] 10.222.0.47 () {58 vars in 1293 bytes} [Tue Aug 30 16:45:18 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e/os-server-password => generated 116 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:45:27.344848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:27.346103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:27.350965 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 16:45:27.351753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:45:27.352653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:45:27.358569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:27.359238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:27.359854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:27.360685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:27.361251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:27.361792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:27.401451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:45:27.532618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:45:27.547441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:27.548174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:27.549662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:27.560924 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47d7b767-e3c7-4f3a-95ef-bfd10b091aa6 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 204 len: 0 microversion: 2.1 time: 0.220416 Aug 30 16:45:27.561521 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3485/6561] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:45:27 2022] DELETE /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:45:27.570406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:27.571360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:27.576028 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] Creating event network-changed:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:45:27.578374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:27.579173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:27.579801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:27.580691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:27.581325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:27.581933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:27.583006 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2cde4a00-c888-40e7-9c59-c660918f40ff req-f552687b-548e-43a7-af99-96a5799b0d56 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237192 Aug 30 16:45:27.588158 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3077/6562] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:45:27.758020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:45:27.767069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d23a087-a21f-4407-ba97-41e3b02a0186 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1687 microversion: 2.1 time: 0.200952 Aug 30 16:45:27.768438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3486/6563] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:45:27 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:45:28.790591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:28.792046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:28.801106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:28.802176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:28.803586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:28.805153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:28.805836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:28.806856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:28.988242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:45:29.007496 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3515ce8-8796-46ac-b938-3b92b52b6e6e tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1687 microversion: 2.1 time: 0.221762 Aug 30 16:45:29.008398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3078/6564] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:45:28 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:45:30.029021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:30.029831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:30.045979 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 42236. Aug 30 16:45:30.056679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:30.057383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:30.070851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:30.071697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:30.072191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:30.072644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:30.312830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f", "name": "network-vif-deleted", "tag": "3321dabe-8afc-4772-8937-c7730cf96fb0"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:45:30.326627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:30.327197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:30.327643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:30.346943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41f1684f44264fdcb3e07f501ac6da6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9801e8110649beb6683e701536b207', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:45:30.351847 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] Creating event network-vif-deleted:3321dabe-8afc-4772-8937-c7730cf96fb0 for instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f on n-h2-830883-28 Aug 30 16:45:30.359908 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-35a0bbc7-cb46-42ef-a892-a3746a21ebd1 req-8b4ea98d-42b0-4d4d-b854-3161d9425e76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050762 Aug 30 16:45:30.361564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8789d7da-0f73-4fb3-8f26-e8d2bed85e97 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 200 len: 1569 microversion: 2.1 time: 0.336304 Aug 30 16:45:30.362396 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3487/6565] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:45:30 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 1569 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:45:30.363980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3079/6566] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:45:31.383539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:31.384164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] [instance: 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:45:31.391720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:31.392259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:31.392896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:31.393618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:45:31.394089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:45:31.394797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:45:31.412867 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] HTTP exception thrown: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Request method failure captured: Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f HTTP/1.1 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDjvfa4TbGMD0AzTWRHg5GAAcH2s1jHgIUfTkgWn9KGgA3VCoFY-lBY7E3L_A8k-GG9JGi42RnJsvxbNArleNZfWmZpVjAHeeuJWH2zgYitlC9RCaZOwdgcu0BR8vS28h2b4DGTUiSCO_Em0U73Jg_E9MBEQWO4VKHtZgexE9gwJjkWs Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5b9801e8110649beb6683e701536b207"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5b9801e8110649beb6683e701536b207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5b9801e8110649beb6683e701536b207"}]}] Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5b9801e8110649beb6683e701536b207 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1174970186 Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 41f1684f44264fdcb3e07f501ac6da6a Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1174970186-project Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f'} Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:45:31.414602 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Returning 404 to user: Instance 2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3af451c4-b8fa-4ac6-b6d9-ceeb31d1b3ef tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f" status: 404 len: 111 microversion: 2.1 time: 0.036617 Aug 30 16:45:31.419624 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3488/6567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:45:31 2022] GET /compute/v2.1/servers/2e0d29c1-b79d-4cb1-a68e-0fcac8e3874f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:45:35.429283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6fed6c2b-fc2e-45d6-9f3a-450da4e19549 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] Calling method '.version_select at 0x7fd357a1a4c0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:45:35.464122 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6fed6c2b-fc2e-45d6-9f3a-450da4e19549 tempest-TestNetworkAdvancedServerOps-1174970186 tempest-TestNetworkAdvancedServerOps-1174970186-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-201766932" status: 202 len: 0 microversion: 2.1 time: 0.040837 Aug 30 16:45:35.468616 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3080/6568] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 16:45:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-201766932 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:46:30.761292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1864529431", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fee36d4a-8015-4ed7-8e1c-5d872ceeecea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:30.777447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:30.778496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:30.785379 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:46:30.785905 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 16:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 30 16:46:30.879544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:46:31.807789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:46:31.808425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:46:31.808701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:46:31.809122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:46:31.809548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:46:31.822921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:31.823461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:31.823907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:31.824650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:31.825298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:31.825742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:31.855791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:46:31.861953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:46:31.946914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:46:31.951901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fee36d4a-8015-4ed7-8e1c-5d872ceeecea',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:46:32.224621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-80b6e35c-3c04-4691-b988-c8f94cf16fe1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467380 Aug 30 16:46:32.226018 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3489/6569] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:46:32.235991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:32.236739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:32.238080 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:46:32.238675 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 16:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b (ip 10.222.0.47) !!! Aug 30 16:46:32.257981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2de23cfd-6b4e-4d1a-a31f-ffa779c583a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:32.258795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2de23cfd-6b4e-4d1a-a31f-ffa779c583a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:32.372321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2de23cfd-6b4e-4d1a-a31f-ffa779c583a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:32.382690 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2de23cfd-6b4e-4d1a-a31f-ffa779c583a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1057 microversion: 2.1 time: 0.149253 Aug 30 16:46:32.383127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3081/6570] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:32 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1057 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:33.405183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:33.406799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:33.416957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:33.417815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:33.418401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:33.420186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:33.420761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:33.421296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:33.507278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:33.515527 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-244ad447-684d-43f1-b9a5-b89464c0df3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1155 microversion: 2.1 time: 0.115835 Aug 30 16:46:33.516102 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3490/6571] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:33 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1155 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:34.539719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:34.540336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:34.554615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:34.555401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:34.557031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:34.557908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:34.564284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:34.565124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:34.754614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:34.762802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ebf68ca-e7b2-489c-98d5-0fb5e9eb1997 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1173 microversion: 2.1 time: 0.227193 Aug 30 16:46:34.772386 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3082/6572] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:34 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1173 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:35.789207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:35.789207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:35.807765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:35.808264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:35.808712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:35.809436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:35.809874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:35.823564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:36.279442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:36.289861 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d10bae0-f1fc-4704-8d2a-3161046755b3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1215 microversion: 2.1 time: 0.506299 Aug 30 16:46:36.303728 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3491/6573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:35 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1215 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:36.935994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6af998c-e9de-4ed2-a5c7-fcc050b7896b", "tag": "79996632-555e-421b-9941-50c4d4d7935c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:36.974894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:36.976414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:36.978560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:37.009111 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] Creating event network-changed:79996632-555e-421b-9941-50c4d4d7935c for instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b on n-h1-830883-28 Aug 30 16:46:37.036559 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b661bfbf-5dcb-4143-ad95-49d84c64319f req-d4039121-491f-4984-8db6-fff61122fbe4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368165 Aug 30 16:46:37.037208 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3083/6574] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:46:37.325699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:37.326374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:37.335711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:37.336220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:37.343235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:37.344301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:37.344960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:37.345571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:38.088533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:38.118684 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27177003-eff2-49a9-9051-50393dfe4129 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1215 microversion: 2.1 time: 0.790449 Aug 30 16:46:38.126451 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3492/6575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:37 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1215 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:39.150484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:39.151865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:39.159939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:39.160727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:39.161341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:39.162244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:39.162732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:39.163154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:39.413050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:39.421244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8032d37e-59eb-4b09-8205-825da41be6a9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1215 microversion: 2.1 time: 0.274994 Aug 30 16:46:39.430545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3084/6576] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:39 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:40.104064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:40.105881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.106446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.106896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.107636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.108102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.108536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.137104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b56c8123-6582-4475-8415-3c73e5785358 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.110714 Aug 30 16:46:40.138072 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3493/6577] 10.222.0.47 () {58 vars in 1185 bytes} [Tue Aug 30 16:46:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:46:40.288068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2083757128", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "availability_zone": "nova:n-h2-830883-28", "networks": [{"uuid": "3ecf3383-a357-41c3-9a01-2f5dc958b9c9"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:40.361395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] validate_networks() for [('3ecf3383-a357-41c3-9a01-2f5dc958b9c9', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:46:40.444661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:40.445316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:40.453572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.454150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.454849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.455586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.456169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.456903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.630834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:40.639708 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-898c48b8-4353-4078-939e-405c93b5b410 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1215 microversion: 2.1 time: 0.201252 Aug 30 16:46:40.640574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3494/6578] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:40 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:40.916434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:46:40.917326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:46:40.917901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:46:40.918604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:46:40.919112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:46:40.930769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.931585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.932136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.932994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:40.933542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:40.934153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:40.961368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Getting quotas for project 53300e4d72cf4eb8861363bc7a36327d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:46:40.981528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Getting quotas for user ea7ee663c17f46ba8963aec03cbc530b and project 53300e4d72cf4eb8861363bc7a36327d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:46:40.996573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:46:40.999045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:46:41.051612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-183339ed-572d-4879-a8d6-8024419d88a6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768592 Aug 30 16:46:41.052192 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3085/6579] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:46:41.063250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17f71b3c-3688-4a85-b007-dc21afb25df6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:41.063883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17f71b3c-3688-4a85-b007-dc21afb25df6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:41.158827 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17f71b3c-3688-4a85-b007-dc21afb25df6 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1329 microversion: 2.1 time: 0.099437 Aug 30 16:46:41.159979 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3495/6580] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:41 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:41.663336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:41.664787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:41.675586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:41.676547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:41.677274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:41.678062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:41.678755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:41.679273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:41.820332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:41.828642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5792c41-73e7-4d1e-b571-e4b8dd6bc6b1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.171423 Aug 30 16:46:41.829344 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3086/6581] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:41 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:42.181476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:42.183634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:42.192725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:42.193223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:42.193670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:42.194407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:42.194875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:42.195357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:42.266760 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0984e54a-d520-4ff4-a5ad-350951838026 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1418 microversion: 2.1 time: 0.089299 Aug 30 16:46:42.267344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3496/6582] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:42 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1418 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:42.850984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:42.851612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:42.859192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:42.859783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:42.860542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:42.861488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:42.862651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:42.863182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:43.106005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:43.114413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5acc02f3-b4e4-4884-83ec-5b5a551f5c0e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.267723 Aug 30 16:46:43.122758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3087/6583] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:42 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:43.288266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:43.288797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:43.295612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:43.296108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:43.296559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:43.297264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:43.297729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:43.298163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:43.439637 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2fe9f58-1e1a-4def-a4ed-d99fccd42375 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.155174 Aug 30 16:46:43.440309 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3497/6584] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:43 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:43.576825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4816b714-3224-47f5-bc4e-e77acdd97826", "tag": "0dab87cd-cd9b-4118-8502-dc354700947a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:43.588097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:43.589239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:43.589878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:43.604892 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] Creating event network-changed:0dab87cd-cd9b-4118-8502-dc354700947a for instance 4816b714-3224-47f5-bc4e-e77acdd97826 on n-h2-830883-28 Aug 30 16:46:43.610535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-fdcc25bf-2033-410b-b910-dfb682202cec req-8ae52fd6-e4a2-4cee-a71a-e951cbc7996b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038137 Aug 30 16:46:43.611713 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3088/6585] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:46:44.136931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:44.138079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:44.147680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:44.148240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:44.149708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:44.151013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:44.151733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:44.152267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:44.301080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:44.309187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34e55314-2b59-4831-9929-679bfa07991d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.178153 Aug 30 16:46:44.310138 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3498/6586] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:44 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:44.462687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:44.463531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:44.470768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:44.471358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:44.472006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:44.472775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:44.473314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:44.473819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:44.604487 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb114b5f-ada8-4f20-b16f-2b6160b8e74f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.145941 Aug 30 16:46:44.605234 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3089/6587] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:44 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:45.329292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:45.329919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:45.338225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:45.338763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:45.339213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:45.339932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:45.340406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:45.340834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:45.481928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:45.491018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-56b01bbd-e158-4ce8-b19c-80f0ced182c1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.165670 Aug 30 16:46:45.491644 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3499/6588] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:45 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:45.625887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:45.626538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:45.635016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:45.635546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:45.635987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:45.636950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:45.637583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:45.638022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:45.772731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04263628-98b8-468c-9a55-db076c72f107 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.151181 Aug 30 16:46:45.773312 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3090/6589] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:45 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:46.512187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:46.512809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:46.520500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:46.520990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:46.521428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:46.522123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:46.522617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:46.523048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:46.656136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:46.664881 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2596202c-641c-4503-b5ef-f301dc0e2b3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.156609 Aug 30 16:46:46.665470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3500/6590] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:46 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:46.793881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:46.794704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:46.802460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:46.803028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:46.803476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:46.804174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:46.804633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:46.805066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:46.939336 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b372dcbd-4f16-4e82-86f6-a7e853458f67 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.149171 Aug 30 16:46:46.939918 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3091/6591] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:46 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:47.687104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:47.687734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:47.695236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:47.695728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:47.696171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:47.696876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:47.697343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:47.697780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:47.831166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:47.839083 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1847afa4-6969-4d2d-b1c6-3a7023d8da20 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.155877 Aug 30 16:46:47.839727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3501/6592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:47 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:47.960313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:47.960926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:47.967905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:47.968384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:47.968817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:47.969495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:47.969943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:47.971059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:48.102070 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-def148fd-c94f-485e-a2b1-66ada56bc9ac tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.145379 Aug 30 16:46:48.102790 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3092/6593] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:47 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:48.860054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:48.860945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:48.868720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:48.869362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:48.869822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:48.870595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:48.871069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:48.871505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:49.001848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:49.010892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0aeb9e7-1d90-40cb-9cad-a74ccb664168 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.154492 Aug 30 16:46:49.012586 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3502/6594] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:48 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:49.123487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:49.124097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:49.131729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:49.132209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:49.132646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:49.133327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:49.133777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:49.134196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:49.262210 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2a668c66-6932-42df-89b1-4f53a58fbab2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.142389 Aug 30 16:46:49.262834 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3093/6595] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:49 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:50.033055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:50.033679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:50.040793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:50.041284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:50.041729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:50.042461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:50.042949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:50.043366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:50.115576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:50.180433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:50.189095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5df2930-1415-4e42-b87e-08644c90189d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.159913 Aug 30 16:46:50.189678 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3503/6596] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:50 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:50.283711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:50.284946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:50.291440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:50.291930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:50.292374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:50.293069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:50.293528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:50.293962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:50.421004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c63d7e6-137b-45ff-9895-633a4ac0c1b8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.141218 Aug 30 16:46:50.421577 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3094/6597] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:50 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:51.210673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:51.211299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:51.215062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:51.218709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:51.219206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:51.219650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:51.220758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:51.221541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:51.222354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:51.229733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:51.230996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:51.306532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4816b714-3224-47f5-bc4e-e77acdd97826", "name": "network-vif-plugged", "status": "completed", "tag": "0dab87cd-cd9b-4118-8502-dc354700947a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:51.317771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:51.318190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:51.318664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:51.335244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] Creating event network-vif-plugged:0dab87cd-cd9b-4118-8502-dc354700947a for instance 4816b714-3224-47f5-bc4e-e77acdd97826 on n-h2-830883-28 Aug 30 16:46:51.341141 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-82537414-288c-443d-9194-46faba533496 req-96190607-a87b-450f-b7ce-afcd875d304b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115739 Aug 30 16:46:51.342189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3095/6598] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:46:51.396574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:51.406617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-49ea1ffd-526e-465a-98d6-7a51c16e8b0c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.200660 Aug 30 16:46:51.407423 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3504/6599] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:51 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:51.445446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:51.446454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:51.453868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:51.454872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:51.456778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:51.457555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:51.458252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:51.458797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:51.652030 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b0bcad4-955e-462c-8fa8-ab8fe848b247 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.211921 Aug 30 16:46:51.652601 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3096/6600] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:51 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:52.428518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:52.429170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:52.436287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:52.436787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:52.437266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:52.437971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:52.438470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:52.438911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:52.566772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:52.574634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d9762c3e-c1aa-492b-ba8d-b22c90cc4926 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.150980 Aug 30 16:46:52.575219 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3505/6601] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:52 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:52.672862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:52.673483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:52.681140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:52.681628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:52.682068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:52.682789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:52.683248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:52.683678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:52.808662 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e8e37bf-9b9e-4fa5-9e5c-de2d1fd5215c tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1466 microversion: 2.1 time: 0.139446 Aug 30 16:46:52.809240 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3097/6602] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:52 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:53.359524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6af998c-e9de-4ed2-a5c7-fcc050b7896b", "name": "network-vif-plugged", "status": "completed", "tag": "79996632-555e-421b-9941-50c4d4d7935c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:53.370384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:53.370878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:53.371320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:53.383742 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] Creating event network-vif-plugged:79996632-555e-421b-9941-50c4d4d7935c for instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b on n-h1-830883-28 Aug 30 16:46:53.388822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f815edce-07a1-494b-9850-c81dc6f943f7 req-604dbf0f-8b60-414f-8981-6ce1d41f325f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033215 Aug 30 16:46:53.389411 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3506/6603] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:46:53.595433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:53.596074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:53.602636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:53.603120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:53.603558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:53.604238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:53.604691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:53.605116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:53.732340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:53.740943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08dfbbbc-272f-4ed8-a043-5b0219ef35de tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1203 microversion: 2.1 time: 0.149403 Aug 30 16:46:53.741528 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3098/6604] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:53 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:53.829973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:53.831174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:53.837397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:53.837882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:53.838351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:53.839042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:53.839499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:53.839926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:53.975238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1fc22a5-f326-4d77-95eb-114a92385c94 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1652 microversion: 2.1 time: 0.149823 Aug 30 16:46:53.975821 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3507/6605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:53 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1652 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:53.995424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:53.996031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:54.002436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.002920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.003500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.004423 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.004880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.005314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.149059 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd0298ed-bcf4-41df-95c0-faab7d9a2501 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1652 microversion: 2.1 time: 0.157360 Aug 30 16:46:54.149924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3099/6606] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:53 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1652 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:54.170327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:54.170961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:54.178664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.179501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.180085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.181178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.181674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.182117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.201396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:54.317689 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87e0f57b-fec6-4a75-9bfb-4407f09449d8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1652 microversion: 2.1 time: 0.151058 Aug 30 16:46:54.318267 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3508/6607] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:54 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:54.387463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1435526455", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "availability_zone": "nova:n-h1-830883-28", "networks": [{"uuid": "3ecf3383-a357-41c3-9a01-2f5dc958b9c9"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:54.448330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] validate_networks() for [('3ecf3383-a357-41c3-9a01-2f5dc958b9c9', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:46:54.761123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:54.761749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:54.768168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.768674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.769118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.769819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.770283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.770735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.837216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:46:54.837724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:46:54.838090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:46:54.838519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:46:54.838926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:46:54.848597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.849122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.849564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.850294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.850805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.851269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.869811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Getting quotas for project 53300e4d72cf4eb8861363bc7a36327d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:46:54.875208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Getting quotas for user ea7ee663c17f46ba8963aec03cbc530b and project 53300e4d72cf4eb8861363bc7a36327d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:46:54.888152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:46:54.890537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:46:54.904805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:54.913672 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d57e3938-f122-4c70-a0d3-574a3d1938a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1391 microversion: 2.1 time: 0.156250 Aug 30 16:46:54.914505 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3509/6608] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:54 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:54.934850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:54.935600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:54.938873 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef2e0751-c6b8-4df5-816f-8c4eb975325f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555734 Aug 30 16:46:54.939687 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3100/6609] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:46:54.942815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.943386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.943895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.944797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:54.945259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:54.945688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:54.951058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d1f2160-9b6f-4a3b-8ac6-e8310eda0fae tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:54.951688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d1f2160-9b6f-4a3b-8ac6-e8310eda0fae tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:55.031294 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d1f2160-9b6f-4a3b-8ac6-e8310eda0fae tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1329 microversion: 2.1 time: 0.083995 Aug 30 16:46:55.032075 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3101/6610] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:54 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:55.091109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:55.099726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ac08434-635b-4965-b569-56ab7a9c3d36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1391 microversion: 2.1 time: 0.168632 Aug 30 16:46:55.100316 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3510/6611] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:54 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:46:55.119120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:55.119740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:55.126954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.127979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.128628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.129335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.129793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.130223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.268737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:55.273503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:46:55.277915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9fc7dc43-b8d4-42c3-98a9-da72034fb305 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1391 microversion: 2.1 time: 0.162627 Aug 30 16:46:55.278569 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3102/6612] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:55 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:55.298560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:55.300234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:55.306429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.306928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.307392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.308082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.308547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.308984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.335452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:46:55.413234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0898fe8a-7c06-479d-8c32-7c990ea76ca9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 204 len: 0 microversion: 2.1 time: 0.118541 Aug 30 16:46:55.413953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3511/6613] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:46:55 2022] DELETE /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:46:55.422244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:55.423026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:55.430117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.430586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.431027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.431718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:55.432166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:55.432616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:55.563053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:55.571039 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-317c4ecd-1413-4c68-9b64-3d06b2d3df55 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1397 microversion: 2.1 time: 0.152689 Aug 30 16:46:55.571604 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3103/6614] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:55 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:56.053297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:56.054005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:56.061177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:56.061708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:56.062160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:56.062927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:56.063421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:56.063884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:56.132365 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34f1ec8d-cba4-4cdf-9865-5f8c7b5a7c22 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1338 microversion: 2.1 time: 0.084169 Aug 30 16:46:56.132957 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3512/6615] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:56 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1338 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:56.592837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:56.593443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:56.600772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:56.601255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:56.601684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:56.602384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:56.602834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:56.603263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:56.742668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:56.750704 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f693598-bfca-4680-9c0e-c6bbd44dd4ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1397 microversion: 2.1 time: 0.161815 Aug 30 16:46:56.751284 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3104/6616] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:56 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1397 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:57.153554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:57.154180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:57.161984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:57.162511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:57.162961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:57.163657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:57.164120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:57.164556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:57.238610 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b1a8900f-232f-49b3-be3d-041f91798a6b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1418 microversion: 2.1 time: 0.088641 Aug 30 16:46:57.239352 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3513/6617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:57 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1418 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:57.734616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6af998c-e9de-4ed2-a5c7-fcc050b7896b", "name": "network-vif-deleted", "tag": "79996632-555e-421b-9941-50c4d4d7935c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:57.747731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:57.748202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:57.748985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:57.762213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] Creating event network-vif-deleted:79996632-555e-421b-9941-50c4d4d7935c for instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b on n-h1-830883-28 Aug 30 16:46:57.772953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:57.773583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:57.779774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:57.780267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:57.780709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:57.782046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c6cec944-4fc6-40b5-a292-62e95dce1053 req-fe779b1d-1a57-41db-ae0b-1f8a788942ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051081 Aug 30 16:46:57.782704 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3105/6618] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:46:57.783612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:57.784385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:57.785528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:57.897562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:57.914780 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c65b91be-c913-455d-9c9a-125f9542a30d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1188 microversion: 2.1 time: 0.145834 Aug 30 16:46:57.937065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3514/6619] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:57 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1188 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:58.261398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:58.263763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:58.286272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:58.287080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:58.287737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:58.288757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:58.290994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:58.292708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:58.458260 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a69339d-6bf4-4423-b196-cb7bfb2ebdcb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.201155 Aug 30 16:46:58.459419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3106/6620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:58 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:58.933728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796c0350-44fd-4f87-abbf-67f6b42bfb1a", "tag": "738155b9-aa4a-48cc-946a-39556b71359e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:46:58.945741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:58.946864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:58.947277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:58.947860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:58.948467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:58.961078 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] Creating event network-changed:738155b9-aa4a-48cc-946a-39556b71359e for instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a on n-h1-830883-28 Aug 30 16:46:58.961695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:58.962443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:58.962989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:58.963864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:58.964505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:58.965178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:58.967131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bf9e6e68-f5eb-4c34-aa14-c6e0ef5f1933 req-7dfe60ef-05d4-4c1b-a926-4d88f6f32293 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037102 Aug 30 16:46:58.967985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3515/6621] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:46:59.038333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:46:59.052182 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-26d71db1-2ab6-4ca6-824f-75da3a0f90b9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1188 microversion: 2.1 time: 0.111159 Aug 30 16:46:59.052902 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3107/6622] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:58 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:46:59.481652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:46:59.482482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:46:59.490065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:59.490599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:59.491050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:59.491772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:46:59.492238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:46:59.492713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:46:59.628529 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a5443e0-ef31-4c53-ad20-8571c24a1ec4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.150224 Aug 30 16:46:59.629340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3516/6623] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:46:59 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:00.072977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:00.073590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:00.080743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:00.081688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:00.082260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:00.082853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:00.083319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:00.083750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:00.152349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:00.161692 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6c32d32-43f9-472c-b9b3-25308ca27eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1188 microversion: 2.1 time: 0.092589 Aug 30 16:47:00.167194 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3108/6624] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:00 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:00.651443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:00.653022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:00.663752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:00.664887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:00.666116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:00.668066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:00.668807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:00.670089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:00.901563 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba42fdf2-9755-44ae-a6a1-c5616a0f99c4 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.252248 Aug 30 16:47:00.914724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3517/6625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:00 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:01.183541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:01.184134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:01.191725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:01.192210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:01.192646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:01.193346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:01.193790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:01.194212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:01.268219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:01.278123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2fa91e88-f57f-4d1b-91d2-ea73c5451c78 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1188 microversion: 2.1 time: 0.098566 Aug 30 16:47:01.289877 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3109/6626] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:01 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:01.922804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:01.923430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:01.927289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:01.933341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:01.933842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:01.934292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:01.935036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:01.935506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:01.935943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:02.071878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1a02680-f432-4ee4-aba2-c6e08770d4c3 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.152810 Aug 30 16:47:02.072470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3518/6627] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:01 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:02.299944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:02.300961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:02.308009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:02.308508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:02.308946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:02.309638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:02.310107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:02.310606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:02.338528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:02.342547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:02.343034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:02.343474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:02.343926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid c6af998c-e9de-4ed2-a5c7-fcc050b7896b {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:47:02.387268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:02.395187 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8bb4624a-4562-4897-9059-f48497b7ec3a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 200 len: 1193 microversion: 2.1 time: 0.099638 Aug 30 16:47:02.395745 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3110/6628] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:02 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:03.092991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:03.093643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:03.100805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:03.101313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:03.101759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:03.102497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:03.102960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:03.103390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:03.228804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-852f4229-9cb6-4d28-8394-a66262bac8da tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.139454 Aug 30 16:47:03.229380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3519/6629] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:03 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:03.416990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:03.418258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c6af998c-e9de-4ed2-a5c7-fcc050b7896b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:03.426345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:03.426905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:03.427350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:03.428076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:03.428533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:03.428961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:03.443236 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b HTTP/1.1 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'c6af998c-e9de-4ed2-a5c7-fcc050b7896b'} Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:03.444885 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance c6af998c-e9de-4ed2-a5c7-fcc050b7896b could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c11dd7b5-46fb-426d-ba43-3930a398d8bc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b" status: 404 len: 111 microversion: 2.1 time: 0.033161 Aug 30 16:47:03.450599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3111/6630] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:03 2022] GET /compute/v2.1/servers/c6af998c-e9de-4ed2-a5c7-fcc050b7896b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:47:03.470962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796c0350-44fd-4f87-abbf-67f6b42bfb1a", "name": "network-vif-plugged", "status": "completed", "tag": "738155b9-aa4a-48cc-946a-39556b71359e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:03.485350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:03.486141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:03.486617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:03.499589 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] Creating event network-vif-plugged:738155b9-aa4a-48cc-946a-39556b71359e for instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a on n-h1-830883-28 Aug 30 16:47:03.505167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-16745e8a-9753-42bc-bfed-a2df1eced979 req-a6a1eea2-141f-4d01-8bf3-b4f6bf559e35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038493 Aug 30 16:47:03.505813 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3520/6631] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:04.250207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:04.251005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:04.257812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:04.258293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:04.258771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:04.259499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:04.259952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:04.260376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:04.392255 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ec63954-04cc-4b24-878b-7b8ebbf9a81f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1466 microversion: 2.1 time: 0.145791 Aug 30 16:47:04.392825 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3112/6632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:04 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1466 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:05.415584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:05.416419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:05.422964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.423453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.423892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.424598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.425045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.425956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.558009 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8caea43f-f719-4665-91bc-291fe284b18b tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1651 microversion: 2.1 time: 0.147624 Aug 30 16:47:05.558633 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3521/6633] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:05 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1651 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:05.578771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:05.579381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:05.583914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:05.584685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:05.588499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.588987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.589427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.590124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.590630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.591055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.725671 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b812804-f944-4e6e-a0bc-1e43cbb6e31f tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1651 microversion: 2.1 time: 0.150485 Aug 30 16:47:05.726250 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3113/6634] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:05 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1651 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:05.745802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:05.746469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:05.753394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.753983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.754471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.755172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.755683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.756118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.888599 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d01a2a38-2abb-416c-9613-8cfd50d91894 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1651 microversion: 2.1 time: 0.146509 Aug 30 16:47:05.889184 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3522/6635] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:05 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1651 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:05.909815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:05.910340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:05.916565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.917055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.917491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.918183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:05.918664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:05.919095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:05.949102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:47:06.028946 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ce0e511-b46a-4446-9837-0bd74b2360e2 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 204 len: 0 microversion: 2.1 time: 0.122880 Aug 30 16:47:06.029458 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3114/6636] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:47:05 2022] DELETE /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:47:06.038049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:06.038727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:06.046430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:06.046913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:06.047351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:06.048048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:06.048506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:06.048935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:06.180821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1ec21f06-820c-480c-b314-7a6c66dff7e8 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1657 microversion: 2.1 time: 0.146644 Aug 30 16:47:06.181429 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3523/6637] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:06 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1657 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:47:07.204095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:07.204793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:07.222008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:07.224193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:07.224658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:07.225381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:07.225848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:07.226282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:07.426382 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fc704f2e-fb43-4162-8700-144df682d8bb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1657 microversion: 2.1 time: 0.221806 Aug 30 16:47:07.427657 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3115/6638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:07 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1657 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:07.911952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796c0350-44fd-4f87-abbf-67f6b42bfb1a", "name": "network-vif-deleted", "tag": "738155b9-aa4a-48cc-946a-39556b71359e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:07.940769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:07.941788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:07.942543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:07.960000 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] Creating event network-vif-deleted:738155b9-aa4a-48cc-946a-39556b71359e for instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a on n-h1-830883-28 Aug 30 16:47:07.974818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-406e34ca-0629-425d-8429-090e3d28866c req-f181ef47-e905-4af6-9272-c2ad23ce0eac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067621 Aug 30 16:47:07.975465 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3524/6639] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:08.448758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:08.449383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:08.456654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:08.457397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:08.457831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:08.458852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:08.459312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:08.459741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:08.494752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:08.495169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:08.496064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:08.496524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lazy-loading 'fault' on Instance uuid 796c0350-44fd-4f87-abbf-67f6b42bfb1a {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:47:08.522803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1560710045", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1eec0d60-e20b-49f9-b9c2-5c1704a9d06a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:08.549003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-59dd3964-1a49-43fe-b49d-4722028853eb tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 200 len: 1456 microversion: 2.1 time: 0.104141 Aug 30 16:47:08.550151 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3116/6640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:08 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 1456 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:08.586116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:47:08.963992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:47:08.964578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:47:08.964885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:47:08.965295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:47:08.965711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:47:08.976700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:08.977188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:08.977625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:08.978380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:08.978838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:08.979268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:08.995924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:47:09.001233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:47:09.058512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:47:09.060610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eec0d60-e20b-49f9-b9c2-5c1704a9d06a',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:47:09.191270 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f8437977-88cd-44a2-8fd5-1bf7bca5494d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672805 Aug 30 16:47:09.191999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3525/6641] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:47:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 16:47:09.202836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-48f8896b-70c7-410c-b208-23d39108c511 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:09.203448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-48f8896b-70c7-410c-b208-23d39108c511 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:09.260565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-48f8896b-70c7-410c-b208-23d39108c511 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:09.267447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-48f8896b-70c7-410c-b208-23d39108c511 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1057 microversion: 2.1 time: 0.068463 Aug 30 16:47:09.268055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3117/6642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:09 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1057 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:09.572868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:09.573605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 796c0350-44fd-4f87-abbf-67f6b42bfb1a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:09.580684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.581187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.581635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.582362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.582833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.583267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.587270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:09.598760 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] HTTP exception thrown: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Request method failure captured: Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a HTTP/1.1 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7vy7idQqKGBvW7KCGPRNDJyBS-x36Dm4A4LVLmYuuTgrlN8a47Rlg5lefCbcqQSVrs8aKFITIPxFxELlRwjnfHXZHUYUl8FjC5mYPsluScj0V0rD88s5NyadBNoQkLz0IX93RbmVPcfuIIuI1F1xOYOYKABmcVa3Hh-wOxbaaIvLU Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 53300e4d72cf4eb8861363bc7a36327d Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestServerMultinode-1439133782 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/53300e4d72cf4eb8861363bc7a36327d"}]}] Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestServerMultinode-1439133782 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 53300e4d72cf4eb8861363bc7a36327d Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestServerMultinode-1439133782 Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestServerMultinode-1439133782-project-admin Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ea7ee663c17f46ba8963aec03cbc530b Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestServerMultinode-1439133782-project-admin Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '796c0350-44fd-4f87-abbf-67f6b42bfb1a'} Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:09.600543 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Returning 404 to user: Instance 796c0350-44fd-4f87-abbf-67f6b42bfb1a could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e7ea080-d2f1-4087-b49f-845330006257 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a" status: 404 len: 111 microversion: 2.1 time: 0.033823 Aug 30 16:47:09.605522 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3526/6643] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:09 2022] GET /compute/v2.1/servers/796c0350-44fd-4f87-abbf-67f6b42bfb1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:47:09.610670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:09.611769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:09.619229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.619711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.620148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.620928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.621367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.621791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.647494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:47:09.674129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:09.728490 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ec1a039-7377-4097-a33c-48047d9a69c0 tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "DELETE /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 204 len: 0 microversion: 2.1 time: 0.121108 Aug 30 16:47:09.729252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3118/6644] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:47:09 2022] DELETE /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:47:09.738483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:09.739102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:09.745882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.746402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.746842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.747534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:09.747992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:09.748419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:09.880243 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7beaf1e-6488-4e77-9a3f-aec1809a3e2d tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1658 microversion: 2.1 time: 0.146514 Aug 30 16:47:09.880895 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3527/6645] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:09 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:47:10.290168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:10.291147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:10.297462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:10.297928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:10.298420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:10.299282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:10.300607 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:10.301195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:10.368620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:10.377442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c3997bca-f512-4733-8fd2-638138afd90a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1173 microversion: 2.1 time: 0.091604 Aug 30 16:47:10.379037 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3119/6646] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:10 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1173 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:10.903144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:10.903861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:10.915782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:10.917136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:10.918387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:10.919583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:10.920311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:10.920869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:11.153805 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4d070a21-7fa3-467c-8d13-d11e1e1ac2df tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1658 microversion: 2.1 time: 0.255252 Aug 30 16:47:11.155049 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3528/6647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:10 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1658 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:11.398773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:11.399973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:11.408967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:11.409678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:11.410291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:11.411203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:11.411837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:11.412429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:11.606723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:11.619200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d5ef7d9-22ca-4ec2-8c88-6ca68d775c50 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1215 microversion: 2.1 time: 0.224238 Aug 30 16:47:11.620697 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3120/6648] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:11 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:11.679898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c70a6a3c-40fe-49e0-95bd-37d6c1095b69", "tag": "bb0da957-b22d-4f20-95f1-0f82c80d9358"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:11.702406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:11.702959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:11.703405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:11.723501 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] Creating event network-changed:bb0da957-b22d-4f20-95f1-0f82c80d9358 for instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 on n-h1-830883-28 Aug 30 16:47:11.740574 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-73e062ab-8d23-4293-ad63-eb7ee88567bd req-ffd78067-e2a5-4b81-8a22-86cc80cb0c24 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064585 Aug 30 16:47:11.741428 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3529/6649] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:11.850496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4816b714-3224-47f5-bc4e-e77acdd97826", "name": "network-vif-deleted", "tag": "0dab87cd-cd9b-4118-8502-dc354700947a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:11.863130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:11.864159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:11.864977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:11.879591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] Creating event network-vif-deleted:0dab87cd-cd9b-4118-8502-dc354700947a for instance 4816b714-3224-47f5-bc4e-e77acdd97826 on n-h2-830883-28 Aug 30 16:47:11.885931 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9d0084f5-9871-40df-81ae-dd4c7304615e req-56ef85fc-b1cf-40b0-bdbe-35a9a192ff6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040291 Aug 30 16:47:11.891846 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3121/6650] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:12.178071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:12.179577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:12.187234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:12.187997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:12.188452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:12.189309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:12.189779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:12.191055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:12.232055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:12.232828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:12.233275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:12.233932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lazy-loading 'fault' on Instance uuid 4816b714-3224-47f5-bc4e-e77acdd97826 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:47:12.300975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac15cde2-1fa2-4a7f-8890-9e45bcca5ebe tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 200 len: 1456 microversion: 2.1 time: 0.128283 Aug 30 16:47:12.301606 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3530/6651] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:12 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 1456 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:12.641324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:12.642504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:12.650961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:12.651460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:12.651937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:12.652820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:12.653293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:12.653728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:12.811886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:12.820677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-efd3d294-6def-4ae9-b285-f224a61500bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1215 microversion: 2.1 time: 0.183522 Aug 30 16:47:12.824992 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3122/6652] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:12 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:13.323835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:13.324372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] [instance: 4816b714-3224-47f5-bc4e-e77acdd97826] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:13.331968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:13.332458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:13.332899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:13.333586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:13.334044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:13.334496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:13.348555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] HTTP exception thrown: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Request method failure captured: Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 HTTP/1.1 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7vy7idQqKGBvW7KCGPRNDJyBS-x36Dm4A4LVLmYuuTgrlN8a47Rlg5lefCbcqQSVrs8aKFITIPxFxELlRwjnfHXZHUYUl8FjC5mYPsluScj0V0rD88s5NyadBNoQkLz0IX93RbmVPcfuIIuI1F1xOYOYKABmcVa3Hh-wOxbaaIvLU Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 53300e4d72cf4eb8861363bc7a36327d Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestServerMultinode-1439133782 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/53300e4d72cf4eb8861363bc7a36327d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/53300e4d72cf4eb8861363bc7a36327d"}]}] Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestServerMultinode-1439133782 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 53300e4d72cf4eb8861363bc7a36327d Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestServerMultinode-1439133782 Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestServerMultinode-1439133782-project-admin Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: ea7ee663c17f46ba8963aec03cbc530b Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestServerMultinode-1439133782-project-admin Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4816b714-3224-47f5-bc4e-e77acdd97826'} Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:13.350226 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] Returning 404 to user: Instance 4816b714-3224-47f5-bc4e-e77acdd97826 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9d781a9b-ac15-4248-9e5b-014ec0c2d16e tempest-TestServerMultinode-1439133782 tempest-TestServerMultinode-1439133782-project-admin] 10.222.0.47 "GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826" status: 404 len: 111 microversion: 2.1 time: 0.031748 Aug 30 16:47:13.354809 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3531/6653] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:13 2022] GET /compute/v2.1/servers/4816b714-3224-47f5-bc4e-e77acdd97826 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:47:13.841216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:13.842572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:13.850071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:13.850880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:13.851521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:13.852442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:13.853116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:13.853740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:14.000665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:14.011282 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b81b2d7-00f1-4316-8210-72682d82f64d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1215 microversion: 2.1 time: 0.173407 Aug 30 16:47:14.022490 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3123/6654] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:13 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:47:15.034175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:15.035964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:15.046732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:15.047471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:15.048082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:15.048964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:15.050130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:15.051140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:15.269067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:15.278219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff28479e-5c0d-4c15-af24-2c8d3cb8f72b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1215 microversion: 2.1 time: 0.249351 Aug 30 16:47:15.290414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3532/6655] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:15 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:16.302337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:16.303727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:16.310643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:16.311139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:16.311577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:16.312285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:16.312742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:16.313199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:16.494897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:16.504859 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a2dadee-5f29-4eba-bcab-b54eb97eb7ff tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.207674 Aug 30 16:47:16.510125 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3124/6656] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:16 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:17.530878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:17.531497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:17.539273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:17.539759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:17.540202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:17.540888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:17.541345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:17.541771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:17.688254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:17.697108 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9f45389-9c51-4ba2-a021-0ecf897f07e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.170068 Aug 30 16:47:17.697704 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3533/6657] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:17 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:18.718217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:18.719158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:18.726426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:18.727166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:18.727603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:18.728701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:18.728832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:18.729337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:18.953161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:18.961362 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f05aa34f-19fd-4480-ae55-a8b9aab0eadb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.247017 Aug 30 16:47:18.974496 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3125/6658] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:18 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:19.984109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:19.985317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:19.988787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:19.989537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:19.995546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:19.996447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:19.996879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:19.997590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:19.998065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:19.998650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:20.185846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:20.196187 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12f34561-c768-48de-9919-bc807c7d09a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.216430 Aug 30 16:47:20.196954 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3534/6659] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:19 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:21.218569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:21.219199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:21.221535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:21.228296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:21.228798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:21.229245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:21.229975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:21.230467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:21.230909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:21.373340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:21.382821 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dac080ee-d326-43d3-9df8-89d5484a697e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.168336 Aug 30 16:47:21.383541 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3126/6660] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:21 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:22.404725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:22.405289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:22.412505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:22.413024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:22.413468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:22.414189 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:22.414679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:22.415113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:22.544198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:22.552798 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e94eaee9-b471-4b2d-a5f2-50f4dba87290 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.152145 Aug 30 16:47:22.553403 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3535/6661] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:22 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:23.573317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:23.573935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:23.581294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:23.581767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:23.582967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:23.583684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:23.584137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:23.584563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:23.729106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:23.736963 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d452625b-419e-4ee2-b447-aebf08c551a3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.167494 Aug 30 16:47:23.737531 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3127/6662] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:23 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:24.758267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:24.758912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:24.765534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:24.766042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:24.766529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:24.767210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:24.767662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:24.768088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:24.900279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:24.908237 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-116f5431-97c3-4408-b357-04d0ecaae850 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.154616 Aug 30 16:47:24.908830 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3536/6663] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:24 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:47:25.570486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70a6a3c-40fe-49e0-95bd-37d6c1095b69", "name": "network-vif-plugged", "status": "completed", "tag": "bb0da957-b22d-4f20-95f1-0f82c80d9358"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:25.580953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:25.581443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:25.582410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:25.595878 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] Creating event network-vif-plugged:bb0da957-b22d-4f20-95f1-0f82c80d9358 for instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 on n-h1-830883-28 Aug 30 16:47:25.601522 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-71cb1f3d-dec4-4d88-9e0d-81530f0f2c9c req-1a59446b-9281-47ba-b8e5-e8ae9f68cb77 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034999 Aug 30 16:47:25.602352 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3128/6664] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:25.929465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:25.930085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:25.936940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:25.937425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:25.937873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:25.938599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:25.939061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:25.939484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:26.072220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:26.080065 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c78c266-bfac-422f-b189-0e4106f82b73 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1203 microversion: 2.1 time: 0.154776 Aug 30 16:47:26.080631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3537/6665] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:25 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:27.103082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:27.103831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:27.110043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.110559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.110991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.111671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.112121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.112538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.249069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:27.257571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2cdc3b55-65f3-499b-a524-c7643a0cf154 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1391 microversion: 2.1 time: 0.160426 Aug 30 16:47:27.258201 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3129/6666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:27 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:27.278367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:27.278995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:27.285957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.286490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.286942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.287635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.288094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.288526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.416965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:27.424859 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b280f26d-cf81-4a68-8678-6fce75a55726 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1391 microversion: 2.1 time: 0.150351 Aug 30 16:47:27.425450 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3538/6667] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:27 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:27.445401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:27.446043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:27.452006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.452486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.452921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.453602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.454056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.454525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.580923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:27.589810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b243b2b-b3f7-42f0-ae7c-c38c9bc08b0a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1391 microversion: 2.1 time: 0.149127 Aug 30 16:47:27.590400 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3130/6668] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:27 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:27.610205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:27.610756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:27.616990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.617422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.617870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.618656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.619125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.619564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.647323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:47:27.721385 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fde2abf5-3903-4fa6-9281-a38e6509e42d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 204 len: 0 microversion: 2.1 time: 0.114691 Aug 30 16:47:27.722019 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3539/6669] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:47:27 2022] DELETE /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:47:27.733698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:27.734329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:27.740888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.741375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.741814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.742557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:27.743014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:27.743439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:27.876700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:27.884625 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e26e2d40-d5fb-43a6-ba1c-26fcb09b04b5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1397 microversion: 2.1 time: 0.156521 Aug 30 16:47:27.885199 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3131/6670] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:27 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:28.906140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:28.906873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:28.915405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:28.915891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:28.916327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:28.917010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:28.917466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:28.917966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:29.045540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:29.054104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-56e2e03a-3818-4842-9378-dce473146a30 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1397 microversion: 2.1 time: 0.152193 Aug 30 16:47:29.054722 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3540/6671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:28 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:29.794531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c70a6a3c-40fe-49e0-95bd-37d6c1095b69", "name": "network-vif-deleted", "tag": "bb0da957-b22d-4f20-95f1-0f82c80d9358"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:29.807150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:29.807654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:29.808086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:29.820938 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] Creating event network-vif-deleted:bb0da957-b22d-4f20-95f1-0f82c80d9358 for instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 on n-h1-830883-28 Aug 30 16:47:29.826295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f784ffd4-3cd0-42fd-8656-cf25fcf09b8f req-92f2dcf1-69ee-495b-b5f7-9b0f321c6419 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Aug 30 16:47:29.828339 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3132/6672] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:47:30.075513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:30.076066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:30.084053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:30.084551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:30.084997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:30.085701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:30.086163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:30.086632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:30.150371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:30.158792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a0cbfbc-5b24-440b-9e40-80a492af709e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1188 microversion: 2.1 time: 0.087346 Aug 30 16:47:30.159364 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3541/6673] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:30 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:31.182088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:31.182824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:31.189044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:31.189528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:31.190783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:31.192014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:31.192478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:31.193075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:31.258931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:31.266842 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b4755b2-ce33-4232-8b2a-705aaad422a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1188 microversion: 2.1 time: 0.089893 Aug 30 16:47:31.275467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3133/6674] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:31 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:47:32.287619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:32.288957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:32.292204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:32.297512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:32.298076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:32.298630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:32.299397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:32.299924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:32.300421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:32.366650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:32.370195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:32.375256 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1a60426c-dfa0-46a4-9872-f6251dcdccae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1188 microversion: 2.1 time: 0.091643 Aug 30 16:47:32.375923 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3542/6675] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:32 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:33.396507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:33.397272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:33.400048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:33.405403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:33.405885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:33.406339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:33.407031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:33.407595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:33.408022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:33.471455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:33.480031 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-637e775c-bf94-4d87-8f71-49cecc25d0e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 200 len: 1188 microversion: 2.1 time: 0.087456 Aug 30 16:47:33.480595 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3134/6676] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:33 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:34.501372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:34.501948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c70a6a3c-40fe-49e0-95bd-37d6c1095b69] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:34.510792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:34.511284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:34.511728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:34.512455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:34.512920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:34.513350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:34.527385 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 HTTP/1.1 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c70a6a3c-40fe-49e0-95bd-37d6c1095b69'} Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:47:34.529033 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance c70a6a3c-40fe-49e0-95bd-37d6c1095b69 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d21e869-f008-4f2a-8a88-bde2769469fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69" status: 404 len: 111 microversion: 2.1 time: 0.033217 Aug 30 16:47:34.534011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3543/6677] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:34 2022] GET /compute/v2.1/servers/c70a6a3c-40fe-49e0-95bd-37d6c1095b69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:47:55.521510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2087244412", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "121c4fd4-8667-4eef-b1a4-bae3fdbfb3b7", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:55.531872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:55.532521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:55.613186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:47:55.993035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:47:55.993460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:47:55.993944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:47:55.994384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:47:55.994802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:47:56.004420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:56.004907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:56.005344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:56.006104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:56.006608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:56.007036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:56.024211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:47:56.029431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:47:56.042214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:47:56.044287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='121c4fd4-8667-4eef-b1a4-bae3fdbfb3b7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:47:56.121810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e329f6b2-ec42-49a7-af69-627cc8310035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604438 Aug 30 16:47:56.122501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3135/6678] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:47:56.133783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03a82b07-685b-469e-97b3-02f6f53ce081 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:56.135272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03a82b07-685b-469e-97b3-02f6f53ce081 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:56.137977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:56.138722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:47:56.205304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03a82b07-685b-469e-97b3-02f6f53ce081 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:56.213115 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03a82b07-685b-469e-97b3-02f6f53ce081 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1057 microversion: 2.1 time: 0.083609 Aug 30 16:47:56.213901 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3544/6679] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:56 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1057 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:57.234918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:57.235537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:57.242271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:57.242797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:57.243232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:57.244135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:57.244596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:57.245023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:57.318596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:57.327384 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2ffc49e9-483e-4150-921f-a9f1b106a66e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1117 microversion: 2.1 time: 0.097402 Aug 30 16:47:57.328161 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3136/6680] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:57 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1117 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:58.349187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:58.350045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:58.358907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:58.359679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:58.360126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:58.361018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:58.361652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:58.362256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:58.588550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:58.597371 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50cf7b6d-48ba-45ce-a280-7ff6c79a6e5b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.252390 Aug 30 16:47:58.597960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3545/6681] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:58 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:47:58.666422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de618a0-320b-452c-b4bc-f375127b28ec", "tag": "cca14e11-260b-40d4-8f25-697fd0f72384"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:47:58.683099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:58.683768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:58.684317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:58.697244 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] Creating event network-changed:cca14e11-260b-40d4-8f25-697fd0f72384 for instance 9de618a0-320b-452c-b4bc-f375127b28ec on n-h1-830883-28 Aug 30 16:47:58.703553 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-42d200a7-b0a6-403a-a006-ae701829a881 req-13866cb3-d53a-46c7-ba79-abcc75fbf8e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042094 Aug 30 16:47:58.704716 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3137/6682] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:47:59.618651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:47:59.619282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:47:59.626246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:59.626768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:59.627203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:59.628047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:47:59.628509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:47:59.628942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:47:59.770530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:47:59.779202 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ff35a8a-c62e-43c8-8b50-092a808c6603 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.164802 Aug 30 16:47:59.779784 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3546/6683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:47:59 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:00.806003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:00.807192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:00.818351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:00.819409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:00.820904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:00.822262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:00.823340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:00.824614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:01.000527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:01.008880 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b326253-5865-4fbf-a8d3-ff898a7ce236 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.211511 Aug 30 16:48:01.022229 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3138/6684] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:00 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:02.032701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:02.034097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:02.044413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:02.045042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:02.045501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:02.046212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:02.046705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:02.047145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:02.231846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:02.247308 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19d60da5-d1a4-4849-aa0e-a4200bc4a6e2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.218039 Aug 30 16:48:02.248134 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3547/6685] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:02 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:48:03.282857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:03.283531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:03.290205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:03.290820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:03.291274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:03.291968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:03.292416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:03.292847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:03.479369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:03.488994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-764da24d-80f5-416e-894c-9588855eab67 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.210864 Aug 30 16:48:03.489572 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3139/6686] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:03 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:48:04.512629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:04.513279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:04.519694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:04.520270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:04.520714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:04.521495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:04.521959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:04.522486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:04.666679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:04.675193 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b5591ff-28a5-41cd-a0cf-f2641d516456 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.167850 Aug 30 16:48:04.675984 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3548/6687] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:04 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:05.696088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:05.696701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:05.703719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:05.704210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:05.704651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:05.705340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:05.705863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:05.706568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:05.834961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:05.842682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-278cb65d-a62b-481e-ad65-d6546e2111ab tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.150481 Aug 30 16:48:05.843253 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3140/6688] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:05 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:06.863483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:06.864124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:06.866935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:06.872927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:06.873422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:06.873870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:06.874601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:06.875065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:06.875495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:07.016617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:07.025746 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d2b7cad-9438-4549-9af6-e7c7eb2f6546 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.166151 Aug 30 16:48:07.026335 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3549/6689] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:06 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:48:08.046260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:08.046838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:08.048683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:08.049517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:08.056885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:08.057370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:08.057836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:08.058578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:08.059027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:08.059446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:08.197677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:08.207065 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-020a6451-9545-47fc-b98f-ad81af312066 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.164744 Aug 30 16:48:08.207658 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3141/6690] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:08 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:09.228695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:09.229311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:09.236479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:09.236971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:09.237410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:09.238112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:09.238597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:09.239025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:09.376647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:09.384879 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab7e2369-8b5e-44d7-b913-26a2178083e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.160598 Aug 30 16:48:09.385487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3550/6691] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:09 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:48:10.407453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:10.408074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:10.415111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:10.415604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:10.416046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:10.416750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:10.417208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:10.417642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:10.551194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:10.559917 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffc4b6b8-8b55-42cb-81e5-95bc0713c0d4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.156385 Aug 30 16:48:10.560731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3142/6692] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:10 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:11.581402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:11.582040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:11.590755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:11.591252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:11.591693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:11.592399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:11.592860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:11.593309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:11.736126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:11.745119 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e88d572-d0a5-46b4-9a46-14dc64225990 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1169 microversion: 2.1 time: 0.167806 Aug 30 16:48:11.745712 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3551/6693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:11 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1169 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:12.765565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:12.766185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:12.773627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:12.774117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:12.774600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:12.775292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:12.775749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:12.776178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:12.909330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:12.917612 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e103d55-eefe-4459-95e3-8d1befb18a4d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.155965 Aug 30 16:48:12.918194 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3143/6694] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:12 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:13.938914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:13.939537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:13.946484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:13.946962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:13.947401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:13.948091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:13.948544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:13.948969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:14.077715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:14.085413 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75d512fb-1def-4bb7-981d-626faf440412 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.150458 Aug 30 16:48:14.085986 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3552/6695] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:13 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:15.106031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:15.106686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:15.113468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:15.113955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:15.114427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:15.115115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:15.115566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:15.115998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:15.248133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:15.255750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e959bb55-b1f7-4e62-821d-b4736a66613e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.154259 Aug 30 16:48:15.256318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3144/6696] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:15 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:16.276406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:16.277052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:16.284032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:16.284509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:16.284945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:16.285629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:16.286084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:16.286548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:16.419143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:16.427466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-991ff116-fca5-4a14-b343-81b3697f4b9d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.154762 Aug 30 16:48:16.427993 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3553/6697] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:16 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:17.449174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:17.449787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:17.456429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:17.456853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:17.457289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:17.457973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:17.458459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:17.458884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:17.595022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:17.602925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7ad8d16-125d-4338-adbc-eec06cc04773 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.158648 Aug 30 16:48:17.603506 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3145/6698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:17 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:18.624105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:18.624764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:18.632142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:18.632632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:18.633071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:18.633760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:18.634294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:18.634746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:18.766316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:18.774104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1deda3b3-b592-4f11-a7cc-78cd0dd61879 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.153976 Aug 30 16:48:18.775370 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3554/6699] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:18 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:19.794536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:19.795142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:19.801987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:19.802765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:19.803206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:19.803894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:19.804343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:19.804765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:19.943930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:19.952381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb27e985-d2a6-4d24-8b38-89fac3a94531 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.161758 Aug 30 16:48:19.952965 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3146/6700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:19 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:20.973048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:20.973673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:20.981095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:20.981585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:20.982025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:20.982749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:20.983208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:20.983636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:21.113019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:21.121601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-886b3cc8-df16-4496-a0d6-c73d8a15a287 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.152523 Aug 30 16:48:21.122179 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3555/6701] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:20 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:21.836032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de618a0-320b-452c-b4bc-f375127b28ec", "name": "network-vif-plugged", "status": "completed", "tag": "cca14e11-260b-40d4-8f25-697fd0f72384"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:48:21.847159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:21.847667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:21.848096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:21.861606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] Creating event network-vif-plugged:cca14e11-260b-40d4-8f25-697fd0f72384 for instance 9de618a0-320b-452c-b4bc-f375127b28ec on n-h1-830883-28 Aug 30 16:48:21.866715 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3a4b9396-34b4-4e36-a465-7770ade03505 req-e8e25049-2375-4ad7-bf88-14ed064394a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034346 Aug 30 16:48:21.867475 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3147/6702] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:48:22.143858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:22.144476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:22.152096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:22.152579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:22.153018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:22.153705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:22.154162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:22.154628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:22.285697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:22.294648 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fd4ac02e-5e5d-4bba-8d2f-8e11d6c4b346 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1203 microversion: 2.1 time: 0.154461 Aug 30 16:48:22.295246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3556/6703] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:22 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:48:23.316522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:23.317278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:23.324166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.324655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.325105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:23.325795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.326242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.326683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:23.467281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:23.475431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6b9486e-1fcb-4429-a954-6b422ff2f038 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1390 microversion: 2.1 time: 0.163924 Aug 30 16:48:23.476010 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3148/6704] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:23 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:23.497976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:23.498572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:23.505108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.505593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.506037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:23.506751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.507219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.507645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:23.950499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:23.958470 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2ffeb58-c4ca-4866-8c05-a56a9f3b41fb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1390 microversion: 2.1 time: 0.465108 Aug 30 16:48:23.959311 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3557/6705] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:23 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:23.980203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:23.980813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:23.986684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.987164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.987595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:23.988281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:23.988731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:23.989154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:24.123714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:24.131539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ce9ba37-f700-4412-8a68-5f8788a72eb2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1390 microversion: 2.1 time: 0.155734 Aug 30 16:48:24.132156 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3149/6706] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:23 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:24.210402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:24.210910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:24.217899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:24.218671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:24.219590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:24.220366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:24.220929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:24.221380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:24.250730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:48:24.327192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a77c0401-45ad-4702-b0cb-196e40ffdcbb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 204 len: 0 microversion: 2.1 time: 0.120432 Aug 30 16:48:24.327779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3558/6707] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:48:24 2022] DELETE /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:48:24.335825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:24.336473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:24.343825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:24.344331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:24.344752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:24.345440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:24.345904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:24.346385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:24.477212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:24.485415 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0e23d052-acfa-4243-8e49-cbe8fd64c1cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1396 microversion: 2.1 time: 0.153480 Aug 30 16:48:24.485994 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3150/6708] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:24 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:25.507463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:25.508131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:25.515144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:25.515638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:25.516084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:25.516779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:25.517242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:25.517675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:25.654101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:25.657912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:25.663713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83129b45-567f-4aee-9464-7fc44c3c4e5f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1396 microversion: 2.1 time: 0.160591 Aug 30 16:48:25.664297 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3559/6709] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:25 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:26.686078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:26.686797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:26.689623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:26.695272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:26.695647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:26.696077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:26.696841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:26.697388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:26.697811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:26.703120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=85 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:26.786745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:26.795797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de618a0-320b-452c-b4bc-f375127b28ec", "name": "network-vif-deleted", "tag": "cca14e11-260b-40d4-8f25-697fd0f72384"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:48:26.797646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ac9ea1e-4a8f-4e5f-ba49-bb31e8699198 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1354 microversion: 2.1 time: 0.115298 Aug 30 16:48:26.798326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3151/6710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:26 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:26.808007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:26.819005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:26.819543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:26.819988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:26.835792 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] Creating event network-vif-deleted:cca14e11-260b-40d4-8f25-697fd0f72384 for instance 9de618a0-320b-452c-b4bc-f375127b28ec on n-h1-830883-28 Aug 30 16:48:26.841611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a5fcebd5-4db3-4105-8fd2-3825bfe099df req-1f5cb46e-3850-44b5-81d7-996f1c7f27b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050680 Aug 30 16:48:26.842235 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3560/6711] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:48:27.820276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:27.820857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:27.827994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:27.828482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:27.828921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:27.829617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:27.830074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:27.830538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:27.892654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:27.901235 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-624d7a7d-3f73-43b1-97ce-cb1beaf58543 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1188 microversion: 2.1 time: 0.084812 Aug 30 16:48:27.901819 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3152/6712] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:27 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:28.922128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:28.922881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:28.930554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:28.932188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:28.932670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:28.933380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:28.933843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:28.934282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:28.998872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:29.006759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6424ce9d-8562-4a2c-9d7a-6ade8a1bbc8b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1188 microversion: 2.1 time: 0.089002 Aug 30 16:48:29.007328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3561/6713] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:28 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:30.028065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:30.028633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:30.036299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:30.036799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:30.037242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:30.037951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:30.038487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:30.038924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:30.109534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:30.117687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0a83a84-85c4-4945-8853-c12cf19e26d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1188 microversion: 2.1 time: 0.094050 Aug 30 16:48:30.119249 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3153/6714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:30 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:31.139254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:31.140044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:31.147365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:31.148056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:31.148522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:31.149237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:31.149847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:31.150290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:31.183317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:31.183811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:31.184256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:31.184708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid 9de618a0-320b-452c-b4bc-f375127b28ec {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:48:31.229334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:31.237568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83c83f9e-7c92-4166-8925-7863ea94cf52 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 200 len: 1193 microversion: 2.1 time: 0.102335 Aug 30 16:48:31.238150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3562/6715] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:31 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 1193 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:32.259077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:32.260485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:32.267474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:32.267963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:32.268397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:32.269092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:32.269538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:32.269963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:32.283897 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec HTTP/1.1 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9de618a0-320b-452c-b4bc-f375127b28ec'} Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:32.285563 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-053c3ae8-e1f8-4fdf-b7ae-b7fde1746ad1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 404 len: 111 microversion: 2.1 time: 0.031807 Aug 30 16:48:32.292350 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3154/6716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:32 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:48:34.442597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:34.443127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:34.450858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:34.451347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:34.451788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:34.452470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:34.452932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:34.453351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:34.467564 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec HTTP/1.1 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9de618a0-320b-452c-b4bc-f375127b28ec'} Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:48:34.469224 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-398ac8f1-307d-4a02-818e-ee38f57b3bf3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 404 len: 111 microversion: 2.1 time: 0.032136 Aug 30 16:48:34.473840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3563/6717] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:48:34 2022] DELETE /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:48:34.479486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:34.480104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 9de618a0-320b-452c-b4bc-f375127b28ec] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:34.487383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:34.487866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:34.488300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:34.488988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:34.489437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:34.489860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:34.503987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec HTTP/1.1 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '9de618a0-320b-452c-b4bc-f375127b28ec'} Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:48:34.505560 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 9de618a0-320b-452c-b4bc-f375127b28ec could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-407c7111-2c07-45b1-b4da-c38923de3cae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec" status: 404 len: 111 microversion: 2.1 time: 0.031303 Aug 30 16:48:34.511110 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3155/6718] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:34 2022] GET /compute/v2.1/servers/9de618a0-320b-452c-b4bc-f375127b28ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:48:54.176388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1692748293", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d7192b13-7f99-4008-94c2-4e73fc322dc8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:48:54.187350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:54.188002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:54.243374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:48:54.713638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:48:54.714318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:48:54.714777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:48:54.715196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:48:54.715614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:48:54.724567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:54.725054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:54.725498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:54.726222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:54.726714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:54.727146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:54.744188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:48:54.750401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:48:54.809722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:48:54.811892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7192b13-7f99-4008-94c2-4e73fc322dc8',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:48:54.939320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae81a392-d8d1-41f6-8335-9e3ae4b10da6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766936 Aug 30 16:48:54.939975 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3564/6719] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:48:54.950926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-712c2514-809b-47d3-9948-94fff7760d3f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:54.951531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-712c2514-809b-47d3-9948-94fff7760d3f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:54.953874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=9 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:54.954608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=21 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:48:55.007770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-712c2514-809b-47d3-9948-94fff7760d3f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:55.014750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-712c2514-809b-47d3-9948-94fff7760d3f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1071 microversion: 2.1 time: 0.067883 Aug 30 16:48:55.015311 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3156/6720] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:54 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1071 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:56.035640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:56.036389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:56.043917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:56.044424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:56.044900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:56.045641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:56.046067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:56.046537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:56.127363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:56.135196 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aaf48cc6-e23d-4f3d-acd6-adf957c24300 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1187 microversion: 2.1 time: 0.104511 Aug 30 16:48:56.143755 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3565/6721] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:56 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:57.158772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:57.159544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:57.168728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:57.169259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:57.169789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:57.170628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:57.171181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:57.171702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:57.314629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:57.325046 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b6183c52-2116-4162-bbc0-ba6d2fbe5f09 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1229 microversion: 2.1 time: 0.170671 Aug 30 16:48:57.325673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3157/6722] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:57 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:57.372820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6374e2-cc49-47e6-b34d-17b614b9f330", "tag": "ae65f198-69d1-4067-99d7-4508ffaca3b1"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:48:57.387605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:57.388513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:57.389203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:57.407263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] Creating event network-changed:ae65f198-69d1-4067-99d7-4508ffaca3b1 for instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 on n-h1-830883-28 Aug 30 16:48:57.414015 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f857ae72-678a-43c9-9927-e5ae791bc191 req-7c2a7aed-eeeb-45aa-9c64-853a4e3c9554 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046834 Aug 30 16:48:57.414794 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3566/6723] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:48:58.348231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:58.349976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:58.359669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:58.360835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:58.361271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:58.362181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:58.362921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:58.363527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:58.669998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:58.679661 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5894ea5-4f46-46c1-bb91-92b6466b73b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1229 microversion: 2.1 time: 0.335896 Aug 30 16:48:58.680245 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3158/6724] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:58 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1229 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:48:59.703401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:48:59.704107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:48:59.710414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:59.710912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:59.711355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:59.712051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:48:59.712512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:48:59.712946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:48:59.844678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:48:59.852464 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f18012ad-10a2-4605-9408-bc6f104eed61 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1229 microversion: 2.1 time: 0.154635 Aug 30 16:48:59.853036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3567/6725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:48:59 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1229 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:00.873349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:00.873958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:00.882694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:00.883190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:00.883627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:00.884328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:00.884813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:00.885233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:01.031577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:01.039639 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf125030-42a2-483b-95e7-413d1d93dc8d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1229 microversion: 2.1 time: 0.170304 Aug 30 16:49:01.040514 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3159/6726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:00 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:02.062097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:02.062977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:02.069367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:02.069847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:02.070288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:02.071001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:02.071457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:02.071883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:02.200675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:02.208653 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5a48c1a-1bd7-4914-882c-660e0643c602 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.151576 Aug 30 16:49:02.209229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3568/6727] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:02 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:03.228998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:03.229646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:03.236766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:03.237243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:03.237673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:03.238386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:03.238839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:03.239259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:03.616681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:03.624412 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6e01c16c-7705-4a46-b47e-3ad0fea4e9e1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.399299 Aug 30 16:49:03.624973 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3160/6728] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:03 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:04.645433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:04.646043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:04.653465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:04.653952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:04.654422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:04.655115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:04.655579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:04.656010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:04.735116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:04.757372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:04.846947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:04.854860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-08639cda-248e-4c3d-a7e6-4ba6fa806cf7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.213287 Aug 30 16:49:04.855437 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3569/6729] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:04 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:05.875674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:05.876292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:05.879083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:05.884820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:05.885294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:05.885729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:05.886445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:05.887399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:05.887825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:06.014715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:06.022417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de8721fc-f5ab-4123-89f4-7625314ef179 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.150668 Aug 30 16:49:06.022988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3161/6730] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:05 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:07.044276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:07.044923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:07.051800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:07.052291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:07.052732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:07.053675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:07.054129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:07.054586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:07.182596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:07.190549 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c74ac93-5abb-408f-b497-a8185559df76 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.150893 Aug 30 16:49:07.191124 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3570/6731] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:07 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:08.211791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:08.212415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:08.220093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:08.220591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:08.221035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:08.221739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:08.222197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:08.222653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:08.353195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:08.361309 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57ef610b-d2b0-471b-b234-c797ea2f14a2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.153499 Aug 30 16:49:08.361883 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3162/6732] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:08 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:09.382826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:09.383449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:09.390980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:09.391464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:09.391901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:09.392618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:09.393077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:09.393503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:09.527173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:09.534989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f5944fd-cf74-4dcd-b80f-e16580ff17d9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.156073 Aug 30 16:49:09.535560 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3571/6733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:09 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:10.560355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:10.561183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:10.567884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:10.568375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:10.568850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:10.569550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:10.570010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:10.570473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:10.701891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:10.709484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ca2da90-2478-4bd3-8e32-0a33ec668c22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.153816 Aug 30 16:49:10.710059 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3163/6734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:10 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:11.730578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:11.731213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:11.738174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:11.738700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:11.739150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:11.739851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:11.740318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:11.740759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:11.872994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:11.880651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab32c881-623d-4a13-a944-bf3f9025d414 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.154092 Aug 30 16:49:11.881229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3572/6735] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:11 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:12.098908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6374e2-cc49-47e6-b34d-17b614b9f330", "name": "network-vif-plugged", "status": "completed", "tag": "ae65f198-69d1-4067-99d7-4508ffaca3b1"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:12.109565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:12.110044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:12.110500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:12.122044 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] Creating event network-vif-plugged:ae65f198-69d1-4067-99d7-4508ffaca3b1 for instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 on n-h1-830883-28 Aug 30 16:49:12.127089 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1f526aff-73b9-4947-b7d8-ac092ab89db0 req-04ab51de-621b-4021-a7c8-ffc1a81c6eca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Aug 30 16:49:12.127783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3164/6736] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:49:12.901747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:12.902440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:12.909348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:12.909836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:12.910284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:12.911004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:12.911466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:12.911899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:13.045003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:13.052719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05652e9e-ffac-4982-93d5-4d5780549f5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1217 microversion: 2.1 time: 0.155022 Aug 30 16:49:13.053555 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3573/6737] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:12 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:14.075454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:14.076018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:14.082143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.082662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.083107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.083799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.084261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.084690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.217906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:14.225713 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b696e19c-1e16-4275-9e01-1d35521d9734 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1405 microversion: 2.1 time: 0.156467 Aug 30 16:49:14.226274 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3165/6738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:14 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:14.245174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:14.245805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:14.252940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.253433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.253883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.254612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.255080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.255517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.384883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:14.392853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-10124d23-b8e7-423c-b6af-3455264dca2e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1405 microversion: 2.1 time: 0.151700 Aug 30 16:49:14.393438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3574/6739] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:14 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:14.413137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-800318775"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:14.415593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:14.422101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.422621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.423055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.423731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:14.424180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:14.424600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:14.514388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Attempting to quiesce instance before volume snapshot. Aug 30 16:49:14.591442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 30 16:49:14.662574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Creating snapshot from volume d7192b13-7f99-4008-94c2-4e73fc322dc8. {{(pid=122351) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 30 16:49:15.480164 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f5f900a-8c49-4fdb-9d14-e1fd13e77e94 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330/action" status: 202 len: 0 microversion: 2.1 time: 1.070807 Aug 30 16:49:15.481523 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3166/6740] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:49:14 2022] POST /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 16:49:16.635156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-861186645", "imageRef": "4fdc2093-38c3-4b0a-ad89-dace21d2c1b3", "flavorRef": "452", "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:16.691863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:49:17.069263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:49:17.069695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:49:17.070176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:49:17.070662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:49:17.071088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:49:17.080753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:17.081185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:17.081628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:17.082395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:17.082866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:17.083301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:17.100993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:49:17.106537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:49:17.118746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:49:17.121406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b5d65fdf-abe9-4a66-930a-03534fa676f4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:49:17.197600 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6c6cda5e-2e77-4bce-a0d8-c7e4552e87bb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566254 Aug 30 16:49:17.198470 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3575/6741] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:49:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:49:17.211175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2264c801-a535-4e9e-91a8-53b3eed0106b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:17.211922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2264c801-a535-4e9e-91a8-53b3eed0106b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:17.268455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2264c801-a535-4e9e-91a8-53b3eed0106b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:17.275754 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2264c801-a535-4e9e-91a8-53b3eed0106b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1229 microversion: 2.1 time: 0.069706 Aug 30 16:49:17.276326 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3167/6742] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:17 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1229 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:18.298425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:18.299882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:18.307495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:18.308374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:18.309548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:18.310838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:18.311308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:18.311966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:18.383030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:18.393525 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ff34a572-9ad1-496f-8ccd-8acb803f94eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1289 microversion: 2.1 time: 0.100443 Aug 30 16:49:18.394580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3576/6743] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:18 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:19.415639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:19.416272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:19.423670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:19.424367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:19.424955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:19.425930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:19.426427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:19.427054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:19.667501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:19.676513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5542199-4d71-4248-a363-55f9bfd9593a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.264668 Aug 30 16:49:19.677276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3168/6744] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:19 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:19.749649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e24219-832d-417b-9bc8-15298b8e912b", "tag": "b578a4db-c71c-46ce-9af7-d3f1c78d75e3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:19.760576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:19.761299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:19.762743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:19.775182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] Creating event network-changed:b578a4db-c71c-46ce-9af7-d3f1c78d75e3 for instance a9e24219-832d-417b-9bc8-15298b8e912b on n-h2-830883-28 Aug 30 16:49:19.780957 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6d1f28ff-7c82-41db-beac-f197bc4dec02 req-565b8955-9440-437c-86bc-88faee9bad82 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Aug 30 16:49:19.781572 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3577/6745] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:49:20.703996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:20.705299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:20.711956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:20.712563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:20.713085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:20.713866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:20.714476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:20.715721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:20.861239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:20.869445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bc94bfba-1b07-4e4d-9af1-419059ede9cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.170533 Aug 30 16:49:20.870023 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3169/6746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:20 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:21.893530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:21.894277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:21.900886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:21.901573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:21.902025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:21.902866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:21.903540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:21.904174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:22.087537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:22.096261 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c7dfaff-52b6-4362-b3f2-23e4381fd7cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.208224 Aug 30 16:49:22.097134 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3578/6747] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:21 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:22.192126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:22.193224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:22.209402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:22.209952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:22.210794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:22.212237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:22.221636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:22.222210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:22.542567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:49:22.675927 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce94d453-e8d3-46ae-991c-a4cc1d3dc5ba tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 204 len: 0 microversion: 2.1 time: 0.653385 Aug 30 16:49:22.676913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3170/6748] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:49:22 2022] DELETE /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:49:22.688078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:22.689637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:22.695640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:22.696077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:22.696498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:22.697197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:22.697652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:22.698079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:22.882965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:22.894346 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4742c4b1-abdb-48dc-8e37-c00cbe2b3548 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1731 microversion: 2.1 time: 0.212347 Aug 30 16:49:22.896411 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3579/6749] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:22 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:23.119549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:23.120498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:23.129398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:23.129967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:23.130624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:23.131501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:23.132138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:23.132725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:23.156458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:23.335449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:23.348564 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d842181e-4dc5-4cba-8190-0f5237f58497 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.233732 Aug 30 16:49:23.349505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3171/6750] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:23 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:23.918141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:23.919942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:23.929019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:23.931174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:23.933005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:23.934244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:23.936376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:23.937330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:24.185542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:24.197930 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bbadea8-505b-4add-92a0-94b0ef6df272 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1731 microversion: 2.1 time: 0.283627 Aug 30 16:49:24.199036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3580/6751] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:23 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:49:24.370409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:24.371879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:24.382633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:24.383498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:24.384244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:24.385032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:24.386282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:24.387962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:24.677560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:24.687420 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e7d0d77-d275-4405-8e02-2daa54c04591 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.321023 Aug 30 16:49:24.701870 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3172/6752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:24 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:24.962829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f777430b-29a4-40d0-a8ae-c113607bcb1e", "name": "network-vif-deleted", "tag": "22c7b00a-5ac5-4494-9577-d41dc05f1eee"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:24.989997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:24.999335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.000270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.000850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.010508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=87 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:25.035892 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] Creating event network-vif-deleted:22c7b00a-5ac5-4494-9577-d41dc05f1eee for instance f777430b-29a4-40d0-a8ae-c113607bcb1e on n-h2-830883-28 Aug 30 16:49:25.045860 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-08be210b-6454-404a-a5f2-32fc7029f393 req-4934ce80-7087-4e0d-9f70-574ec5ee31a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096377 Aug 30 16:49:25.050523 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3581/6753] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:49:25.228581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:25.229592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:25.232250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:25.244675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.245581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.245778 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.259292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.259879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.260396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.330947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.332172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.332376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.332802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lazy-loading 'fault' on Instance uuid f777430b-29a4-40d0-a8ae-c113607bcb1e {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:49:25.423637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e0c82a4c524c1397d37f3eaa9c4280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41168af3efc64d3b81b35b9b35ab344f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:25.437923 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5db224de-bffc-4487-9644-b578722dab05 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 200 len: 1389 microversion: 2.1 time: 0.213118 Aug 30 16:49:25.438852 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3173/6754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:25 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 1389 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:25.708941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:25.709800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:25.716891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.717441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.717889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.718838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:25.719480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:25.720094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:25.863282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:25.877761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88748c5f-f62d-442e-81fd-7b68367255fe tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.173097 Aug 30 16:49:25.878749 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3582/6755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:25 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:26.461008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:26.461634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:26.469705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:26.470501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:26.470953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:26.471674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:26.472134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:26.472791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:26.487300 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] HTTP exception thrown: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Request method failure captured: Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e HTTP/1.1 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj4uhd2JeURBL8YIsLLjk5wPWzBcN4MQ9pls-btEG0B3Jb8ghhVH08IPuaDCTj6q-EU28yv_NMXJskaAHIb68QZSuHZz6uBHScOakMNgVHpIddxxqe3Sn5YJMMGtCe3T4ihUvJFC58KiGp0z8EeIAPrDq2irP8rev-NoP2wX-TkGGMg Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}] Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 67e0c82a4c524c1397d37f3eaa9c4280 Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f777430b-29a4-40d0-a8ae-c113607bcb1e'} Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:26.488973 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Returning 404 to user: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:49:26.493586 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46895023-9cee-4393-9dd2-b0c44968a75c tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 404 len: 111 microversion: 2.1 time: 0.033315 Aug 30 16:49:26.494917 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3174/6756] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:26 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:49:26.898877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:26.899582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:26.909578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:26.911058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:26.911058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:26.911275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:26.911650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:26.912271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:27.009788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:27.017500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:27.025115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:27.025615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:27.034610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:27.035997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:27.036974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:27.037559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:27.056370 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] HTTP exception thrown: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Request method failure captured: Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e HTTP/1.1 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj4uhd2JeURBL8YIsLLjk5wPWzBcN4MQ9pls-btEG0B3Jb8ghhVH08IPuaDCTj6q-EU28yv_NMXJskaAHIb68QZSuHZz6uBHScOakMNgVHpIddxxqe3Sn5YJMMGtCe3T4ihUvJFC58KiGp0z8EeIAPrDq2irP8rev-NoP2wX-TkGGMg Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}] Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 67e0c82a4c524c1397d37f3eaa9c4280 Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f777430b-29a4-40d0-a8ae-c113607bcb1e'} Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:49:27.059212 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Returning 404 to user: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82f2bc8a-ca74-47eb-af1e-be951ea9dbb7 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 404 len: 111 microversion: 2.1 time: 0.055592 Aug 30 16:49:27.063769 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3175/6757] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:49:27 2022] DELETE /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:49:27.071087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:27.075487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] [instance: f777430b-29a4-40d0-a8ae-c113607bcb1e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:27.083475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:27.084091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:27.084820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:27.085630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:27.086220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:27.086755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:27.092452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:27.108769 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] HTTP exception thrown: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.109371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Request method failure captured: Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e HTTP/1.1 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj4uhd2JeURBL8YIsLLjk5wPWzBcN4MQ9pls-btEG0B3Jb8ghhVH08IPuaDCTj6q-EU28yv_NMXJskaAHIb68QZSuHZz6uBHScOakMNgVHpIddxxqe3Sn5YJMMGtCe3T4ihUvJFC58KiGp0z8EeIAPrDq2irP8rev-NoP2wX-TkGGMg Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/41168af3efc64d3b81b35b9b35ab344f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/41168af3efc64d3b81b35b9b35ab344f"}]}] Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 41168af3efc64d3b81b35b9b35ab344f Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestServerBasicOps-2079802976 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 67e0c82a4c524c1397d37f3eaa9c4280 Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestServerBasicOps-2079802976-project Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'f777430b-29a4-40d0-a8ae-c113607bcb1e'} Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:27.110725 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Returning 404 to user: Instance f777430b-29a4-40d0-a8ae-c113607bcb1e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:49:27.115325 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ef1d839b-9c18-46b7-9f91-43e77be15bcd tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e" status: 404 len: 111 microversion: 2.1 time: 0.045829 Aug 30 16:49:27.115959 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3176/6758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:27 2022] GET /compute/v2.1/servers/f777430b-29a4-40d0-a8ae-c113607bcb1e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:49:27.116731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:27.120804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-033ec313-f9cf-48ae-aa5b-29e55243166b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.226060 Aug 30 16:49:27.126512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3583/6759] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:26 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:27.288695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3454aeae-3972-43be-a877-a44ad4e7afe1 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] Calling method '.version_select at 0x7fd3579918b0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:27.294191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:27.313890 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3454aeae-3972-43be-a877-a44ad4e7afe1 tempest-TestServerBasicOps-2079802976 tempest-TestServerBasicOps-2079802976-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1512725491" status: 202 len: 0 microversion: 2.1 time: 0.028980 Aug 30 16:49:27.314609 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3177/6760] 10.222.0.47 () {58 vars in 1254 bytes} [Tue Aug 30 16:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1512725491 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:49:28.144529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:28.145161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:28.156107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:28.156598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:28.157041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:28.157756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:28.158350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:28.158672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:28.326457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:28.334472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-786327e9-d05d-450c-b5a8-114ecc61d455 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.193767 Aug 30 16:49:28.334993 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3584/6761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:28 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:29.358651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:29.359960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:29.367371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:29.368346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:29.372296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:29.373414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:29.374246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:29.375366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:29.608656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:29.618175 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6db77dc-e487-4d9f-a81e-96cd1bb454b2 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.265336 Aug 30 16:49:29.619453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3178/6762] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:29 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:30.642391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:30.642947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:30.656139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:30.656957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:30.657407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:30.658118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:30.658643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:30.659162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:30.833652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:30.847542 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c4a9224-83f7-4c45-be34-dad7b3aef479 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.210577 Aug 30 16:49:30.848290 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3585/6763] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:30 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:31.878445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:31.879900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:31.890177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:31.891037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:31.891712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:31.893533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:31.894740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:31.895414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:32.067411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:32.076690 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-998a74a2-efc2-479e-a826-d1123ecf1487 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.206982 Aug 30 16:49:32.077962 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3179/6764] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:31 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:33.097339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:33.098780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:33.106908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:33.107610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:33.108469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:33.109278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:33.110044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:33.110744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:33.338466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:33.347048 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5931f88d-f52f-45a3-8a37-988a95d30567 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1341 microversion: 2.1 time: 0.253359 Aug 30 16:49:33.348507 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3586/6765] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:33 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:34.373217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:34.373971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:34.382825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:34.383557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:34.384092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:34.384919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:34.385496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:34.385943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:34.534902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:34.542519 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fba34cd9-6e80-4d9c-a3f1-fb878aa7f40a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.173935 Aug 30 16:49:34.543654 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3180/6766] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:34 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:35.564880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:35.565583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:35.572756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:35.573254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:35.573823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:35.574435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:35.574907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:35.576165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:35.721466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:35.729444 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c83dc9c6-abc4-4c07-ae75-c0a21fef7239 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.168554 Aug 30 16:49:35.730026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3587/6767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:35 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:36.755367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:36.756430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:36.767388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:36.768003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:36.768610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:36.769420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:36.770493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:36.772445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:37.373638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:37.387323 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f58b5f5c-597c-4621-b81b-af7c188de8d0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.639071 Aug 30 16:49:37.389501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3181/6768] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:36 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:38.416841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:38.417462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:38.426251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:38.426733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:38.427456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:38.428179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:38.428646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:38.429443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:38.598244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:38.608123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f71d897b-3a86-4636-bdcf-3052a20fe326 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.199258 Aug 30 16:49:38.608945 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3588/6769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:38 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:39.631808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:39.633652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:39.642655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:39.643113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:39.643648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:39.644371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:39.645025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:39.645466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:39.947137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:39.957765 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0967681b-6c1c-44ab-9b75-5af906a1d390 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.330758 Aug 30 16:49:39.958729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3182/6770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:39 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:40.983220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:40.983821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:40.991096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:40.991584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:40.992032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:40.994476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:40.994476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:40.994476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:41.150435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:41.158811 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef780d52-ce1a-4fc7-a8a1-227d34b6b41d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.182068 Aug 30 16:49:41.159388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3589/6771] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:40 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:42.183084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:42.184324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:42.198058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:42.198879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:42.200289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:42.202002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:42.202907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:42.203663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:42.752460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:42.771222 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-587ef24d-5869-4e89-aa0a-264cc633f9fa tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.593558 Aug 30 16:49:42.778988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3183/6772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:42 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:43.794828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:43.796170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:43.805880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:43.806680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:43.807380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:43.808360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:43.809011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:43.811460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:44.031322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:44.040271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e32c5c02-75cf-4232-aa74-23f6322a570d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.250534 Aug 30 16:49:44.050645 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3590/6773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:43 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:45.065388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:45.066104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:45.072205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:45.072788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:45.073494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:45.074420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:45.075071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:45.076307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:45.236548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:45.245041 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47d9a28a-d99c-4aea-8742-861c92767ec0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.185095 Aug 30 16:49:45.245635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3184/6774] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:45 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:46.268139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:46.268913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:46.277103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:46.277619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:46.278092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:46.279691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:46.280159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:46.280779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:46.470490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:46.479878 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-193bc54d-9297-4eca-a73d-0976949e3035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.217122 Aug 30 16:49:46.481889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3591/6775] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:46 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:46.770055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e24219-832d-417b-9bc8-15298b8e912b", "name": "network-vif-plugged", "status": "completed", "tag": "b578a4db-c71c-46ce-9af7-d3f1c78d75e3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:46.785450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:46.786030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:46.786729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:46.806092 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] Creating event network-vif-plugged:b578a4db-c71c-46ce-9af7-d3f1c78d75e3 for instance a9e24219-832d-417b-9bc8-15298b8e912b on n-h2-830883-28 Aug 30 16:49:46.816185 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6c7bc3ab-3a1b-46e6-a9ab-2dd480669bc0 req-3060aea0-496d-4692-a8ad-4d03fea1596e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053048 Aug 30 16:49:46.816558 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3185/6776] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:49:47.502184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:47.503087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:47.510680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:47.511192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:47.511637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:47.512388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:47.512859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:47.513595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:47.698197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:47.708703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-51192af0-e582-425a-8b39-b77f5c22ebca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1375 microversion: 2.1 time: 0.210677 Aug 30 16:49:47.709375 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3592/6777] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:47 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1375 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:48.734646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:48.735364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:48.744256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:48.744777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:48.745386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:48.746153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:48.746625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:48.747660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:48.912035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:48.926441 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c92a1474-ef28-4039-b441-4e75d0546035 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1562 microversion: 2.1 time: 0.197622 Aug 30 16:49:48.927381 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3186/6778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:48 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:48.949127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:48.950051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:48.958288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:48.958877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:48.959551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:48.960316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:48.960821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:48.961432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:49.105207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:49.115143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-605e96c9-63ae-404d-9a30-1cab0de854ba tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1562 microversion: 2.1 time: 0.169636 Aug 30 16:49:49.115754 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3593/6779] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:48 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:49.207712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:49.208235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:49.216588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:49.219116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:49.219584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:49.220317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:49.220790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:49.221232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:49.258727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:49:49.360915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-109513e3-c290-4c95-8898-53d7886863cc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 204 len: 0 microversion: 2.1 time: 0.156514 Aug 30 16:49:49.364588 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3187/6780] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:49:49 2022] DELETE /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:49:49.370102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:49.371525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:49.377186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:49.377679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:49.378117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:49.378852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:49.385532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:49.386005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:49.537029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:49.545297 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0def9d69-7ee8-492e-a87b-90e727153d92 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1568 microversion: 2.1 time: 0.179065 Aug 30 16:49:49.545891 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3594/6781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:49 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:50.567859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:50.568574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:50.576188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:50.576700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:50.577150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:50.577853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:50.578525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:50.579132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:50.728017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:50.737157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1a6c8716-a95f-4773-8aba-c39e920036f3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1568 microversion: 2.1 time: 0.173852 Aug 30 16:49:50.737749 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3188/6782] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:50 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:51.651180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e24219-832d-417b-9bc8-15298b8e912b", "name": "network-vif-deleted", "tag": "b578a4db-c71c-46ce-9af7-d3f1c78d75e3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:49:51.664241 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:49:51.664797 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 16:49:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 16:49:51.667984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:51.668751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:51.670266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:51.695586 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] Creating event network-vif-deleted:b578a4db-c71c-46ce-9af7-d3f1c78d75e3 for instance a9e24219-832d-417b-9bc8-15298b8e912b on n-h2-830883-28 Aug 30 16:49:51.715410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d62d6ad9-9ff3-45af-a51f-031201c3be90 req-487636c5-79ae-4de3-bdcd-3a271df76a7b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066331 Aug 30 16:49:51.719930 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3595/6783] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:49:51.757951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:51.758624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:51.768315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:51.769278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:51.769927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:51.770873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:51.772759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:51.773406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:51.917040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:51.920284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:51.931090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6e855bf-4504-448c-9033-50976d75ed7c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1360 microversion: 2.1 time: 0.177393 Aug 30 16:49:51.932030 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3189/6784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:51 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:52.966509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:52.968126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:52.975247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:52.975988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:52.976502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:52.977278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:52.978118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:52.978841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:53.050667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:53.059247 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f867a540-6629-4765-b63f-85c6b48dffb4 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1360 microversion: 2.1 time: 0.106975 Aug 30 16:49:53.059874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3596/6785] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:52 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:54.080645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:54.083272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:54.091769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:54.092417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:54.093139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:54.094111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:54.094834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:54.095523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:54.169170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:54.182067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4131410b-2aa5-435f-b612-52510b015896 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1360 microversion: 2.1 time: 0.106326 Aug 30 16:49:54.190486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3190/6786] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:54 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1360 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:55.211790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:55.212711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:55.223121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=32 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:55.224988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:55.225529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:55.226259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:55.227034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:55.227505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:55.227941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:55.231841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=88 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:55.312653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:55.328019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-605118db-13b1-4d50-b62d-d8599abbcd5a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1360 microversion: 2.1 time: 0.123330 Aug 30 16:49:55.340185 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3597/6787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:55 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1360 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:56.351165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:56.352453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:56.360731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:49:56.362251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:56.362879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:56.363513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:56.364419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:56.364989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:56.365504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:56.409658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:56.410235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:56.410716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:56.411181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid a9e24219-832d-417b-9bc8-15298b8e912b {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:49:56.463264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:49:56.473730 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac440056-4588-4e33-93cb-854838211f53 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 200 len: 1365 microversion: 2.1 time: 0.126322 Aug 30 16:49:56.474396 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3191/6788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:56 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 1365 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:49:57.497054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:49:57.498577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:49:57.506339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:57.507017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:57.507472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:57.508483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:49:57.509017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:49:57.509574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:49:57.526095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b HTTP/1.1 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a9e24219-832d-417b-9bc8-15298b8e912b'} Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:49:57.527848 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:49:57.535393 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c793f735-0d8f-4600-8746-d0e407db502c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 404 len: 111 microversion: 2.1 time: 0.037461 Aug 30 16:49:57.544271 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3598/6789] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:49:57 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:01.861509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:01.862067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:01.869059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:01.869556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:01.870005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:01.870739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:01.871213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:01.871652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:01.897644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:50:01.982961 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-64f49d43-79a5-4759-9b9f-8964f4a3ad22 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 204 len: 0 microversion: 2.1 time: 0.124125 Aug 30 16:50:01.983963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3192/6790] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:50:01 2022] DELETE /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:50:01.992467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:01.993197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:02.000491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:02.000982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:02.001418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:02.002109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:02.002716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:02.003147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:02.148864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:02.157063 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f651d772-c747-4bf9-8198-b1c0472594dd tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1411 microversion: 2.1 time: 0.168749 Aug 30 16:50:02.157638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3599/6791] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:01 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:50:03.179967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:03.180788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:03.188660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:03.189183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:03.189637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:03.190434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:03.190910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:03.191357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:03.364033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:03.372826 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6dfcba85-2faa-4233-b4e1-abb629353b45 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1411 microversion: 2.1 time: 0.196996 Aug 30 16:50:03.373546 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3193/6792] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:03 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:04.129192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6374e2-cc49-47e6-b34d-17b614b9f330", "name": "network-vif-deleted", "tag": "ae65f198-69d1-4067-99d7-4508ffaca3b1"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:04.141933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:04.142223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:04.142631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:04.155698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] Creating event network-vif-deleted:ae65f198-69d1-4067-99d7-4508ffaca3b1 for instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 on n-h1-830883-28 Aug 30 16:50:04.161019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-edafaa7f-d342-44da-9828-a8ba97991d39 req-320a68be-df77-45b4-8c1d-aebfa12e8eb4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035834 Aug 30 16:50:04.161947 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3600/6793] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:50:04.396066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:04.396712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:04.404739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:04.405256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:04.405715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:04.406683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:04.407163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:04.407611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:04.479042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:04.491326 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b3bed3c-573b-467f-a10c-be14f2a4d1a7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1202 microversion: 2.1 time: 0.098996 Aug 30 16:50:04.492285 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3194/6794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:04 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:05.515971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:05.517559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:05.537922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:05.538528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:05.539239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:05.540068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:05.540664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:05.541190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:05.618116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:05.627042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43634420-4f09-4cb1-8794-f5fbee3cd544 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1202 microversion: 2.1 time: 0.117837 Aug 30 16:50:05.638806 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3601/6795] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:05 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:06.648378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:06.649002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:06.656123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:06.656634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:06.657069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:06.657773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:06.658239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:06.658698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:06.727700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:06.736242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-73553123-d7ec-4e5c-a6b5-b337508dc291 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1202 microversion: 2.1 time: 0.091738 Aug 30 16:50:06.737030 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3195/6796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:06 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:07.757244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:07.757785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:07.765496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:07.765983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:07.766462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:07.767155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:07.767760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:07.768193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:07.830926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:07.838761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df9f6202-e95d-49c0-810b-4e3809d63459 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1202 microversion: 2.1 time: 0.085623 Aug 30 16:50:07.839543 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3602/6797] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:07 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:08.858842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:08.859572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:08.867447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:08.868029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:08.868546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:08.869319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:08.869856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:08.870384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:08.904863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:08.905604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:08.906120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:08.906798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid 7d6374e2-cc49-47e6-b34d-17b614b9f330 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:50:08.953866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:08.964068 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-623c582f-c3ae-425c-81bc-0c0e0a47788d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 200 len: 1161 microversion: 2.1 time: 0.109026 Aug 30 16:50:08.964667 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3196/6798] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:08 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 1161 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:09.985872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:09.987660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:09.994679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:09.995172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:09.995617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:09.996314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:09.996770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:09.997345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:10.010994 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 HTTP/1.1 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7d6374e2-cc49-47e6-b34d-17b614b9f330'} Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:10.012744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-021b2f2d-163d-46f4-ac8e-cc02febba72a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 404 len: 111 microversion: 2.1 time: 0.033095 Aug 30 16:50:10.017556 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3603/6799] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:09 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:13.243360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:13.243948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:13.252225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.252723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.253406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.254130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.254655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.255102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.272880 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b HTTP/1.1 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a9e24219-832d-417b-9bc8-15298b8e912b'} Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:50:13.274651 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.281750 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.286799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:50:13.286799 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b58882ab-dbcf-45c0-b9d7-6d242a2528db tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 404 len: 111 microversion: 2.1 time: 0.046693 Aug 30 16:50:13.287310 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3197/6800] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:50:13 2022] DELETE /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:13.295645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:13.296267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: a9e24219-832d-417b-9bc8-15298b8e912b] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:13.303437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.304220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.304972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.305732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.306272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.306786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.320662 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b HTTP/1.1 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a9e24219-832d-417b-9bc8-15298b8e912b'} Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.322200 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance a9e24219-832d-417b-9bc8-15298b8e912b could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f6aec28-139c-4023-b22f-dc2fdf4a7757 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b" status: 404 len: 111 microversion: 2.1 time: 0.031992 Aug 30 16:50:13.328834 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3604/6801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:13 2022] GET /compute/v2.1/servers/a9e24219-832d-417b-9bc8-15298b8e912b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:13.826106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:13.826783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:13.833158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.833674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.834140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.834914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.835397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.835845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.851215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 HTTP/1.1 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7d6374e2-cc49-47e6-b34d-17b614b9f330'} Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:50:13.853099 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d1796091-b00b-44e0-8f26-c02922e0b32c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 404 len: 111 microversion: 2.1 time: 0.032414 Aug 30 16:50:13.859279 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3198/6802] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:50:13 2022] DELETE /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:13.865193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:13.865911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 7d6374e2-cc49-47e6-b34d-17b614b9f330] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:13.872767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.873383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.873904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.874723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:13.875259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:13.875765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:13.891233 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 HTTP/1.1 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7d6374e2-cc49-47e6-b34d-17b614b9f330'} Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:50:13.892748 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 7d6374e2-cc49-47e6-b34d-17b614b9f330 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b311d8c-78b5-478f-903a-04cc7b794842 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330" status: 404 len: 111 microversion: 2.1 time: 0.032973 Aug 30 16:50:13.897823 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3605/6803] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:13 2022] GET /compute/v2.1/servers/7d6374e2-cc49-47e6-b34d-17b614b9f330 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:50:13.962759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-488e989a-cc1d-428d-82c9-772ecbadfc79 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: .version_select at 0x7fd35788a430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1252647331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZs6ojYA+KkeBXpgDxAoToCeaYqReHktyCQ15x8pTs9l5uWnnE7GCZLp6mZ7of9lEnFg+7Lr6lX1iej1P80ZZgaLiy1RRdHYs5PXmvE7YS8CJOjwcNWtln6sEbnvTyhpg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:13.978454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-488e989a-cc1d-428d-82c9-772ecbadfc79 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:50:13.984399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-488e989a-cc1d-428d-82c9-772ecbadfc79 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:50:14.011080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-488e989a-cc1d-428d-82c9-772ecbadfc79 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052256 Aug 30 16:50:14.011587 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3199/6804] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:50:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:50:31.455887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1562371512", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252647331", "security_groups": [{"name": "tempest-secgroup-smoke-946189534"}], "block_device_mapping_v2": [{"uuid": "9225ec7c-ca1a-4770-82ea-02d8fd78b61b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:31.467352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=17 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:31.468026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=33 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:31.587207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:50:31.954663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:50:31.955102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:50:31.955592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:50:31.956005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:50:31.956458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:50:31.965450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:31.966493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:31.966928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:31.967663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:31.968133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:31.968564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:31.985805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:50:31.991244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:50:32.051253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:50:32.053451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9225ec7c-ca1a-4770-82ea-02d8fd78b61b',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:50:32.199728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7302ee92-f67c-4fb7-8e43-e808346cc819 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747822 Aug 30 16:50:32.201213 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3606/6805] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:50:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:50:32.212166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0cae435e-e6c2-44d5-8f17-aae9b88108b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:32.212877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0cae435e-e6c2-44d5-8f17-aae9b88108b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:32.215419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:32.218747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:32.218747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:32.285959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0cae435e-e6c2-44d5-8f17-aae9b88108b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:32.293465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0cae435e-e6c2-44d5-8f17-aae9b88108b8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1095 microversion: 2.1 time: 0.085432 Aug 30 16:50:32.294567 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3200/6806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:32 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:33.321681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:33.323191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:33.333258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:33.333772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:33.334407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:33.335121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:33.335582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:33.337500 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:33.456899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:33.468879 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a0fa464a-e16c-4b2f-a047-2b8fd812b091 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1211 microversion: 2.1 time: 0.153464 Aug 30 16:50:33.482404 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3607/6807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:33 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1211 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:34.489124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:34.490530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:34.498771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:34.499659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:34.500362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:34.501326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:34.502013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:34.502702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:34.657090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:34.667825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-540ab19e-a7e1-4fa7-9543-122f444cc785 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1278 microversion: 2.1 time: 0.182359 Aug 30 16:50:34.669005 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3201/6808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:34 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:35.306757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8f274b-0f65-4db6-bfb7-591aa8c4abf7", "tag": "27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:35.325487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:35.325487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:35.325487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:35.335029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] Creating event network-changed:27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6 for instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 on n-h1-830883-28 Aug 30 16:50:35.340384 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6f99827f-3de1-44f0-aa1e-625146e5a682 req-2a16e9ba-995e-4f5f-8507-23b8bd2c1dda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252295 Aug 30 16:50:35.342099 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3608/6809] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:50:35.689926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:35.691268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:35.712836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:35.713861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:35.714573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:35.715594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:35.719204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:35.719922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:35.873485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:35.882440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b7d81de-5dca-4437-8860-f1e8c430d0c0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1278 microversion: 2.1 time: 0.196568 Aug 30 16:50:35.883314 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3202/6810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:35 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:36.905809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:36.906659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:36.913099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:36.913670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:36.914187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:36.914995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:36.915528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:36.916046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:37.058137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:37.067246 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4f780a9-412f-4e28-8350-146134dad99d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1278 microversion: 2.1 time: 0.166867 Aug 30 16:50:37.067962 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3609/6811] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:36 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:38.088382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:38.089011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:38.097020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:38.097526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:38.097984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:38.098729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:38.099200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:38.099854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:38.253736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:38.263423 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80a09514-cd07-41c9-b26c-80da9a6c286c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1278 microversion: 2.1 time: 0.178149 Aug 30 16:50:38.264017 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3203/6812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:38 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:39.284430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:39.285078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:39.292578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:39.293365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:39.293530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:39.294293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:39.295147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:39.295692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:39.437030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:39.444955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b69d131-2023-41fc-a8b9-cefaf35f6b83 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.164405 Aug 30 16:50:39.445469 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3610/6813] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:39 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:40.465216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:40.466496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:40.473400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:40.473902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:40.474384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:40.475094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:40.475566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:40.476010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:40.615506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:40.624068 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-15d1f162-215e-467c-b7b5-358938e23b26 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.162959 Aug 30 16:50:40.624642 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3204/6814] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:40 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:41.645206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:41.645868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:41.652872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:41.653425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:41.653844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:41.654567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:41.655038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:41.655475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:41.790636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:41.799375 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bf014700-1c26-4e5e-968b-00691f0e6d8a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.158126 Aug 30 16:50:41.799954 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3611/6815] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:41 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:42.821054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:42.821679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:42.824478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:42.830240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:42.830770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:42.831323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:42.832040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:42.832503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:42.832939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:42.972271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:42.980971 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-00805a6f-0209-4f62-988e-6b6dbd573330 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.163788 Aug 30 16:50:42.983953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3205/6816] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:42 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:44.001783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:44.002556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:44.004651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:44.005320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:50:44.011910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:44.012393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:44.012857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:44.013546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:44.014002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:44.014459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:44.145159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:44.153125 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6ac2f6dc-4330-426e-b5e4-2303f7143c99 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.155994 Aug 30 16:50:44.154452 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3612/6817] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:43 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:45.175628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:45.176287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:45.183578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:45.184084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:45.185082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:45.185796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:45.186265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:45.186805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:45.319152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:45.328083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-05a43743-c354-46a3-b908-9e97a2d9b259 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.156361 Aug 30 16:50:45.328657 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3206/6818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:45 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:46.348122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:46.348751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:46.355781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:46.356273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:46.357225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:46.357927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:46.358419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:46.358855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:46.507631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:46.516518 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-06789589-0ccf-4b88-8fef-eeae2be81d27 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.172277 Aug 30 16:50:46.517107 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3613/6819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:46 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:47.537871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:47.538522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:47.545337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:47.545842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:47.546315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:47.547032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:47.547508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:47.547953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:47.681655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:47.690415 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f731cdf-4b99-4b62-bcda-7647f74f4d3d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.156647 Aug 30 16:50:47.690991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3207/6820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:47 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:48.606723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8f274b-0f65-4db6-bfb7-591aa8c4abf7", "name": "network-vif-plugged", "status": "completed", "tag": "27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:48.619265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:48.620033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:48.620643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:48.632106 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] Creating event network-vif-plugged:27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6 for instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 on n-h1-830883-28 Aug 30 16:50:48.637429 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8a9131da-4166-40ab-a840-39108ce30082 req-1ebc69a2-3aa1-493d-a87d-8a71eb433056 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034895 Aug 30 16:50:48.639133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3614/6821] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:50:48.712405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:48.713039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:48.721186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:48.722424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:48.722890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:48.723604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:48.724090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:48.724534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:48.871121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:48.880682 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-612bebf8-c1d9-475e-8b47-1a83474db849 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1266 microversion: 2.1 time: 0.173279 Aug 30 16:50:48.881279 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3208/6822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:48 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:49.902723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:49.904135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:49.912374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:49.912881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:49.913330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:49.914053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:49.914545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:49.914991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:50.057923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:50.066428 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b02ac16b-adcd-4581-9c5d-5bb376d6d489 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1454 microversion: 2.1 time: 0.168749 Aug 30 16:50:50.067005 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3615/6823] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:49 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:50.087087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:50:50.087742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:50:50.095314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:50.095816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:50.096270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:50.097007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:50.097479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:50.097922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:50.242110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:50:50.250922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fde1e2bf-47e8-4d6b-908c-c15b0b8c10a0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1454 microversion: 2.1 time: 0.167700 Aug 30 16:50:50.251505 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3209/6824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:50:50 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:50:51.878999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8f274b-0f65-4db6-bfb7-591aa8c4abf7", "tag": "27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:50:51.891848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:50:51.891848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:50:51.891848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:50:51.905452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] Creating event network-changed:27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6 for instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 on n-h1-830883-28 Aug 30 16:50:51.912539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-91167bd2-dfe7-4f43-a828-12869caad835 req-bf4318bf-3cfe-4e39-bf12-9da376cb9783 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036979 Aug 30 16:50:51.913779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3616/6825] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:51:42.817364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aaef98c9-21c3-436c-92c4-7421cb43571c tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Action: 'create', calling method: .version_select at 0x7fd35c08b280>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-917280151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVqqXQYBNdZeIaYBw/EhjRoYB10H04hzEyJKfmCJ0QYH/dAG76iKjTwH303u6Jnp/so85sv/ij3/MeAn6/YB54+xyNJbmdmvKkjuXkCOcRiMlP5RDRPis6Xtla0jAb4jA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:51:42.822944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=22 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:42.823780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=54 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:42.837210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-aaef98c9-21c3-436c-92c4-7421cb43571c tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Getting quotas for project 86b85f0de14649b08cf77e24b8064e55. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:51:42.842245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-aaef98c9-21c3-436c-92c4-7421cb43571c tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Getting quotas for user 73848f244055453dbdc0977686799a05 and project 86b85f0de14649b08cf77e24b8064e55. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:51:42.867639 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aaef98c9-21c3-436c-92c4-7421cb43571c tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.054620 Aug 30 16:51:42.868248 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3210/6826] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 16:51:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:51:44.090109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1087333047", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dec9b94b-2682-41ba-9acc-c0545a7e2df8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-917280151", "security_groups": [{"name": "tempest-secgroup-smoke-793445739"}], "networks": [{"uuid": "cd44d6fd-a827-460f-a7a6-9427e8b1dfc4"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:51:44.100868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:44.101666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=50 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:44.212949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] validate_networks() for [('cd44d6fd-a827-460f-a7a6-9427e8b1dfc4', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:51:44.578775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:51:44.579209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:51:44.579693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:51:44.580137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:51:44.581365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:51:44.590183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:44.590697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:44.591137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:44.591872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:44.592332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:44.592766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:44.609729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Getting quotas for project 86b85f0de14649b08cf77e24b8064e55. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:51:44.615539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Getting quotas for user 73848f244055453dbdc0977686799a05 and project 86b85f0de14649b08cf77e24b8064e55. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:51:44.673985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:51:44.676298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dec9b94b-2682-41ba-9acc-c0545a7e2df8',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:51:44.806039 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53d3477d-e988-4e51-b4e6-f6b7b6b0c3a8 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720018 Aug 30 16:51:44.806737 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3617/6827] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:51:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:51:44.818265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d88a987a-93c2-48a2-9700-41226705b244 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:44.818922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d88a987a-93c2-48a2-9700-41226705b244 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:44.874116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d88a987a-93c2-48a2-9700-41226705b244 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:44.883135 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d88a987a-93c2-48a2-9700-41226705b244 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1098 microversion: 2.1 time: 0.069556 Aug 30 16:51:44.883729 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3211/6828] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:44 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:45.905584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:45.906154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:45.913291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:45.914466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:45.914926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:45.915813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:45.916283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:45.916719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:45.981524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:45.990231 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ef653e66-e418-41ac-bb09-93b4350264b7 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1196 microversion: 2.1 time: 0.089904 Aug 30 16:51:45.990840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3618/6829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:45 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:47.011826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:47.012509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:47.020782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:47.021621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:47.022262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:47.023249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:47.023908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:47.024539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:47.538213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:47.547156 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-594a8610-34e7-4aab-8990-56aaf292d980 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1281 microversion: 2.1 time: 0.539499 Aug 30 16:51:47.548067 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3212/6830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:47 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1281 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:47.910578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:51:47.920820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:47.921306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:47.921739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:47.934358 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] Creating event network-changed:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:51:47.939685 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a344ba45-b135-4110-87f7-3336242ad34b req-601616fc-f031-4fae-822e-118910359450 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104155 Aug 30 16:51:47.940521 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3619/6831] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:51:48.569523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:48.570335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:48.577481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:48.578101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:48.578687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:48.579483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:48.580748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:48.581396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:48.814669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:48.823075 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-afeaac3e-1d53-414d-be18-786d77fdeac5 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1281 microversion: 2.1 time: 0.258062 Aug 30 16:51:48.823908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3213/6832] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:48 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:49.845504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:49.847011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:49.853369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:49.853948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:49.854505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:49.855261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:49.855793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:49.856227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:49.997464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:50.006991 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2034b3a-1be8-4de1-8ce3-dae8e5ae6f48 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1281 microversion: 2.1 time: 0.166605 Aug 30 16:51:50.007776 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3620/6833] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:49 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:51.028312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:51.029062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:51.036728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:51.037238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:51.037695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:51.038577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:51.039063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:51.039514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:51.179464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:51.187436 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0713759f-11d3-4ad3-992a-431d40f1ca6a tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1281 microversion: 2.1 time: 0.162969 Aug 30 16:51:51.187998 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3214/6834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:51 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:52.208933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:52.209557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:52.216472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:52.216961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:52.217403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:52.218102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:52.218584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:52.219011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:52.358969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:52.366989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3201a5c3-ae91-414a-99b2-71dc82ad8176 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.162572 Aug 30 16:51:52.367586 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3621/6835] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:52 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:53.388881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:53.389546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:53.396979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:53.397480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:53.397940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:53.398676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:53.399148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:53.399589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:53.530253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:53.541114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cf934cec-184e-4d63-a53d-3fe0d50bec2f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.156142 Aug 30 16:51:53.541701 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3215/6836] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:53 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:54.562356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:54.562902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:54.570127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:54.570652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:54.571092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:54.571775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:54.572228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:54.572661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:54.599292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:54.622239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:54.709819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:54.717628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6226f81f-e648-4113-9c84-1251e38d0fd1 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.159282 Aug 30 16:51:54.718192 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3622/6837] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:54 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:55.737497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:55.738176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:55.740856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:51:55.746401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:55.746903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:55.747353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:55.748053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:55.748539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:55.748975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:55.883570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:55.891420 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-72789589-f622-4ba7-a128-dcd976f81758 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.157852 Aug 30 16:51:55.891981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3216/6838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:55 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:56.913846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:56.914514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:56.921366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:56.921854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:56.922321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:56.923016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:56.923485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:56.924604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:57.057374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:57.065401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7481819-8ada-46a3-915e-1235cdcb65b4 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.155453 Aug 30 16:51:57.065978 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3623/6839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:56 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:58.086572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:58.087202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:58.094064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:58.094598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:58.095045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:58.095774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:58.096241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:58.096670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:58.229079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:58.236816 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-31482181-d6aa-4aae-832e-75399947dae9 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.154135 Aug 30 16:51:58.237381 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3217/6840] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:58 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:51:59.256985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:51:59.257617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:51:59.264697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:59.265192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:59.265640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:59.266371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:51:59.266840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:51:59.267276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:51:59.398096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:51:59.406386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1d92339e-b4c3-4d1e-99d3-82b9b6a575b0 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.153230 Aug 30 16:51:59.406967 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3624/6841] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:51:59 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:52:00.427354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:00.427990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:00.435090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:00.435586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:00.436035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:00.436732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:00.437199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:00.437634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:00.572877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:00.580609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83cfc553-7f44-4e06-9081-b1d6fbaa953b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.158056 Aug 30 16:52:00.581175 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3218/6842] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:00 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:01.601718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:01.602373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:01.609026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:01.609507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:01.609947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:01.610673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:01.611132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:01.612256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:01.747352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:01.755916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dcd3fe63-86a4-4c20-bae4-3d9c0632b394 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.158430 Aug 30 16:52:01.756500 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3625/6843] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:01 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:02.776554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:02.777193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:02.785131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:02.785637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:02.786100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:02.786842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:02.787311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:02.787750 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:02.944245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:02.946696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "name": "network-vif-plugged", "status": "completed", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:02.952067 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3489deb-5cfb-4ea1-8009-8e8533ea1039 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.179791 Aug 30 16:52:02.952670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3219/6844] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:02 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:02.956971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:02.957448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:02.957879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:02.969334 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] Creating event network-vif-plugged:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:02.975104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bec3df3f-2c30-4494-8f29-43287ff87896 req-3bc7a987-ca27-4a3f-a7c0-8d7113648a4d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137650 Aug 30 16:52:02.975700 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3626/6845] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:03.973209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:03.973832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:03.980786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:03.981277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:03.981727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:03.982449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:03.982910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:03.983345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:04.117478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:04.125201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8047605-16bc-4328-943f-6db585428f25 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1269 microversion: 2.1 time: 0.156042 Aug 30 16:52:04.125773 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3220/6846] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:03 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:05.148483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:05.149192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:05.155467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:05.155951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:05.156385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:05.157064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:05.157525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:05.157944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:05.289697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:05.297555 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e26afe6-5adb-43af-b77f-c29912c996ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1457 microversion: 2.1 time: 0.155180 Aug 30 16:52:05.298120 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3627/6847] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:05 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1457 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:05.318218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:05.318882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:05.325613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:05.326110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:05.326600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:05.327301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:05.327769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:05.328209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:05.459930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:05.467781 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c001c98a-1a82-4c82-83fe-cc4f91888430 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1457 microversion: 2.1 time: 0.153480 Aug 30 16:52:05.468352 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3221/6848] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:05 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1457 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:07.567899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:07.578405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:07.578893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:07.579328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:07.594391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] Creating event network-changed:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:07.599874 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b918417c-3c8a-487a-8a0c-e87a58f0a7ef req-a17519eb-2ccb-4118-9555-fac8302e2397 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038001 Aug 30 16:52:07.603671 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3628/6849] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:08.530249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:08.542737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:08.543586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:08.544109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:08.557417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] Creating event network-changed:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:08.567089 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] [f8f594ef-4241-4496-b3a3-0c0a049941c8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 16:52:09.569614 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] [f8f594ef-4241-4496-b3a3-0c0a049941c8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46846. Aug 30 16:52:09.573774 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d3597b49-4ddc-45cf-82fa-0723869dd238 req-f1075b0d-f53a-4445-b076-3b1baa4a425e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047570 Aug 30 16:52:09.574597 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3222/6850] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:11.589097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:11.600491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:11.600969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:11.601397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:11.612842 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] Creating event network-changed:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:11.618125 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-cf39f3a9-4286-466f-95fa-418c8c405432 req-0cc071ec-1d57-4968-8afb-37b10992373b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032842 Aug 30 16:52:11.618739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3629/6851] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:40.492389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:52:40.493134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=62 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:52:40.497397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:40.499236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:40.499837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:40.503101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:52:40.504198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=58 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:52:40.508726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:40.509593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:40.510043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:40.511003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:40.511472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:40.511908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:40.512842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:40.513404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:40.513906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:40.526928 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] Creating event network-changed:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:40.532659 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-158b2f79-86c5-4cc3-8820-ebf9cfec9b80 req-46489b50-c027-4992-be7f-401b37cd975d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040825 Aug 30 16:52:40.533609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3630/6852] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:52:40.541798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:52:40.630760 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e644466e-2198-475f-8b19-fe44535dab3d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 204 len: 0 microversion: 2.1 time: 0.140799 Aug 30 16:52:40.631804 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3223/6853] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:52:40 2022] DELETE /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:52:40.641935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:40.642735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:40.649245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:40.649979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:40.650457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:40.651158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:40.651622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:40.652050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:40.790425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:40.799333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f47b808-8088-4cce-a0cd-b59f88d8801f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1582 microversion: 2.1 time: 0.163150 Aug 30 16:52:40.800105 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3631/6854] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:40 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1582 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:52:41.824678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:41.826293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:41.833153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:41.833653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:41.834102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:41.834829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:41.835305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:41.835743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:41.996994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:42.005255 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fe6fb8ec-9a95-4b98-b9d6-887d7e747e8d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1582 microversion: 2.1 time: 0.184924 Aug 30 16:52:42.005830 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3224/6855] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:41 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1582 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:42.898102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f449f8-bbc2-4023-b859-8fc46640538c", "name": "network-vif-deleted", "tag": "a2e83ff4-7255-4eec-b6f8-f57bac9c40f5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:42.910394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:42.911506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:42.912109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:42.926482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] Creating event network-vif-deleted:a2e83ff4-7255-4eec-b6f8-f57bac9c40f5 for instance d3f449f8-bbc2-4023-b859-8fc46640538c on n-h2-830883-28 Aug 30 16:52:42.931882 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fb67ebd8-3a38-4abd-8dac-42e28b38ab2b req-a3f8cbe3-b16e-4176-8106-724ed639117a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037613 Aug 30 16:52:42.932493 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3632/6856] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:43.027388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:43.028057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:43.035356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:43.035863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:43.036322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:43.037033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:43.037501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:43.037945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:43.111661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:43.119603 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be9f3017-b9e6-4285-84a3-07884265499f tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1229 microversion: 2.1 time: 0.096185 Aug 30 16:52:43.120179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3225/6857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:43 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:44.141676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:44.142399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:44.149471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:44.149948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:44.150419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:44.151091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:44.151548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:44.151976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:44.219184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:44.227409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60e3fc0a-5101-4a19-9c2a-4fc1a10284ba tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1229 microversion: 2.1 time: 0.090116 Aug 30 16:52:44.227990 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3633/6858] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:44 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:45.249523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:45.250155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:45.257327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:45.258119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:45.258452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:45.259405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:45.259532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:45.259911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:45.327602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:45.335795 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8b078959-fb6c-4961-bd2c-463fb69089bb tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1229 microversion: 2.1 time: 0.090773 Aug 30 16:52:45.336391 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3226/6859] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:45 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:46.358062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:46.358731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:46.365898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:46.366410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:46.366851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:46.367550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:46.368005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:46.368433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:46.438097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:46.446359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c13148ff-9520-4d30-82c6-4cef7f0ff34b tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1229 microversion: 2.1 time: 0.093111 Aug 30 16:52:46.446930 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3634/6860] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:46 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:47.468774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:47.469604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:47.476458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:47.476961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:47.477413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:47.478120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:47.478619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:47.479063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:47.512515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:47.512984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:47.513433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:47.513893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lazy-loading 'fault' on Instance uuid d3f449f8-bbc2-4023-b859-8fc46640538c {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:52:47.559250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73848f244055453dbdc0977686799a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b85f0de14649b08cf77e24b8064e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:47.567073 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-df10da0b-e2be-40d4-b3f9-7c096112277d tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 200 len: 1188 microversion: 2.1 time: 0.103367 Aug 30 16:52:47.567663 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3227/6861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:47 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 1188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:48.588612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:48.589242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] [instance: d3f449f8-bbc2-4023-b859-8fc46640538c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:48.596863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:48.597355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:48.597797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:48.598524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:48.599033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:48.599423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:48.613386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] HTTP exception thrown: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Request method failure captured: Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c HTTP/1.1 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj-k09NJHdd2FLLZ8_y9wZRl09lhkw6FAdxj1HfZwsWB9oLJEXq4WJgoezYJbioKIGGC-2Bt-Gu3FuvQcnfAA4A27QvuEMF_F3PpghXdVKUCCXJ52-ILvjX9C0lLLCwMRFHjCUHgdYxWLJTJLuU4cx8epZ2UCxKEYtc5naVnMEIMbLE Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 86b85f0de14649b08cf77e24b8064e55 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBackupRestore-1605342326 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86b85f0de14649b08cf77e24b8064e55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_86b85f0de14649b08cf77e24b8064e55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/86b85f0de14649b08cf77e24b8064e55"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/86b85f0de14649b08cf77e24b8064e55"}]}] Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBackupRestore-1605342326 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 86b85f0de14649b08cf77e24b8064e55 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1605342326 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBackupRestore-1605342326-project Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 73848f244055453dbdc0977686799a05 Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBackupRestore-1605342326-project Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'd3f449f8-bbc2-4023-b859-8fc46640538c'} Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:52:48.615063 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Returning 404 to user: Instance d3f449f8-bbc2-4023-b859-8fc46640538c could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2922b1d-e6b9-40c7-943c-f1301e2055fd tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c" status: 404 len: 111 microversion: 2.1 time: 0.032093 Aug 30 16:52:48.620779 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3635/6862] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:48 2022] GET /compute/v2.1/servers/d3f449f8-bbc2-4023-b859-8fc46640538c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:52:48.779753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89e898de-f86a-4939-af6f-749b0e834e45 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] Calling method '.version_select at 0x7fd3578c7ca0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:48.800977 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89e898de-f86a-4939-af6f-749b0e834e45 tempest-TestVolumeBackupRestore-1605342326 tempest-TestVolumeBackupRestore-1605342326-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-917280151" status: 202 len: 0 microversion: 2.1 time: 0.025824 Aug 30 16:52:48.805140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3228/6863] 10.222.0.47 () {58 vars in 1266 bytes} [Tue Aug 30 16:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-917280151 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:52:49.564819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:49.566870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:49.576985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:49.577576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:49.577956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:49.578813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:49.579269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:49.579989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:49.610945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:52:49.709769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45387071-2f79-49a1-8560-7c9635be4f5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 204 len: 0 microversion: 2.1 time: 0.211601 Aug 30 16:52:49.710693 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3636/6864] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:52:49 2022] DELETE /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:52:49.719325 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:49.720077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:49.728684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:49.729458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:49.729955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:49.731393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:49.732919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:49.733552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:49.910945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:49.921171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-da29a6a7-7996-46bc-ad9e-8b0879bb916b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1579 microversion: 2.1 time: 0.205657 Aug 30 16:52:49.922398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3229/6865] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:49 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1579 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:52:50.949330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:50.951906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:50.960878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:50.961777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:50.962835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:50.964364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:50.965340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:50.966792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:51.164543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:51.174763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77c96a5e-b822-47da-a578-0e4f9c1ead80 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1579 microversion: 2.1 time: 0.233007 Aug 30 16:52:51.175376 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3637/6866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:50 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1579 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:52.206467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:52.208149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:52.224453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:52.224977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:52.225436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:52.226356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:52.226653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:52.227098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:52.458341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:52.467826 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b05395fc-3fa3-4390-b9a2-b580336494e8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1579 microversion: 2.1 time: 0.273807 Aug 30 16:52:52.468519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3230/6867] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:52 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1579 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:52.947170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8f274b-0f65-4db6-bfb7-591aa8c4abf7", "name": "network-vif-deleted", "tag": "27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:52.979262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:52.979994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:52.981853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:52.996223 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] Creating event network-vif-deleted:27dbf10b-45f4-4c2f-a3b9-2edf43ed20f6 for instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 on n-h1-830883-28 Aug 30 16:52:53.004411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1b9a242f-9208-49a6-92b5-f06e8c87b779 req-938272d9-447c-430b-9bf2-b5170d694e1a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060607 Aug 30 16:52:53.005295 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3638/6868] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:52:53.489477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:53.490439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:53.505094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:53.505897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:53.508941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:53.509816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:53.510655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:53.511563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:53.634788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:53.647562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d840b24d-3541-4267-8a1d-ae48dced68ea tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1226 microversion: 2.1 time: 0.162315 Aug 30 16:52:53.648858 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3231/6869] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:53 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:54.673572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:54.674289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:54.682513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:54.682999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:54.683439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:54.684667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:54.685123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:54.685701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:54.792859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:54.801031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9c55dac4-ebec-4027-a3a3-3d3c96cfcb9b tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1226 microversion: 2.1 time: 0.134649 Aug 30 16:52:54.801610 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3639/6870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:54 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:55.822035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:55.822803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:55.830950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:55.831246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:55.831776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:55.832579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:55.833126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:55.833643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:55.901352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:55.910925 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebe6eb7b-e5af-4f4b-9fdb-4cc170338bd1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1226 microversion: 2.1 time: 0.092670 Aug 30 16:52:55.911522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3232/6871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:55 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:56.933479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:56.934325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:56.943625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:56.944428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:56.945043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:56.945901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:56.948132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:56.948425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:57.046037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:57.055415 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e8472bc0-0622-414d-84e2-bbdc073ec4f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1226 microversion: 2.1 time: 0.127128 Aug 30 16:52:57.066391 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3640/6872] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:56 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:52:58.076993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:58.078495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:58.090757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:58.091910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:58.092514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:58.093422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:58.094090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:58.094547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:58.133787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:58.134371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:58.134804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:58.135282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:52:58.276504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:52:58.285016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0366b313-fb1c-4806-8283-fd284fa95b33 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 200 len: 1185 microversion: 2.1 time: 0.213070 Aug 30 16:52:58.285921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3233/6873] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:58 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 1185 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:52:59.315448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:52:59.316249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:52:59.323312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:59.323819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:59.324271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:59.325886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:52:59.326532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:52:59.326974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:52:59.343227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 HTTP/1.1 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bb8f274b-0f65-4db6-bfb7-591aa8c4abf7'} Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:52:59.344904 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2f414546-e6d1-453b-b0d8-5b2a9c40ce31 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 404 len: 111 microversion: 2.1 time: 0.034859 Aug 30 16:52:59.348095 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3641/6874] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:52:59 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:52:59.396969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-863794089", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252647331", "security_groups": [{"name": "tempest-secgroup-smoke-946189534"}], "block_device_mapping_v2": [{"uuid": "9225ec7c-ca1a-4770-82ea-02d8fd78b61b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:52:59.570619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:53:00.419523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:53:00.420151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:53:00.420433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:53:00.420858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:53:00.421770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:53:00.442529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:00.443265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:00.443939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:00.444924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:00.445551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:00.446232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:00.473886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:53:00.480387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:53:00.569673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:53:00.572364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9225ec7c-ca1a-4770-82ea-02d8fd78b61b',volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:53:00.718392 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [05bd32bc-5bd5-4c56-9fd6-5c5a33294472] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 16:53:01.725577 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [05bd32bc-5bd5-4c56-9fd6-5c5a33294472] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 47422. Aug 30 16:53:01.732060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9d3bf4cb-2670-48da-82f4-5cbbec636fdc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.339429 Aug 30 16:53:01.732485 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3234/6875] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:52:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:53:01.745201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70432bdd-7a36-406e-9024-b555c0ea339c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:01.746375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70432bdd-7a36-406e-9024-b555c0ea339c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:01.814320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70432bdd-7a36-406e-9024-b555c0ea339c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:01.822095 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70432bdd-7a36-406e-9024-b555c0ea339c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1094 microversion: 2.1 time: 0.082368 Aug 30 16:53:01.822831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3642/6876] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:01 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:02.844366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:02.845029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:02.851767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:02.852260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:02.852713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:02.853415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:02.853885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:02.854347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:02.917658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:02.926582 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-058ec9f8-e9ef-48ff-8338-7ba3484fde5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1192 microversion: 2.1 time: 0.087681 Aug 30 16:53:02.927206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3235/6877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:02 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:03.950483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:03.951300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:03.959793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:03.960471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:03.961016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:03.961827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:03.962424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:03.962961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:04.226947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:04.236651 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-87c6f7b5-fe97-4ce4-a935-be30ad3a1e5d tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1277 microversion: 2.1 time: 0.292063 Aug 30 16:53:04.237332 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3643/6878] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:03 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:04.599361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c752b196-136e-47d1-aa34-b4595cb4321c", "tag": "dc7a5ab2-ce4c-4c47-9945-870e71744121"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:53:04.610296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:04.611115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:04.611747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:04.630734 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] Creating event network-changed:dc7a5ab2-ce4c-4c47-9945-870e71744121 for instance c752b196-136e-47d1-aa34-b4595cb4321c on n-h1-830883-28 Aug 30 16:53:04.641960 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1e673d42-ca0d-4cfd-9c61-50d50a214bb8 req-a33992cd-9649-44b2-b089-040c15f9a6b2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046751 Aug 30 16:53:04.642794 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3236/6879] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:53:05.260922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:05.261760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:05.270790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:05.271517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:05.272129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:05.272978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:05.273650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:05.274221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:05.506870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:05.515739 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e19e44c1-4cc9-40d4-bedc-b5d83331f440 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1277 microversion: 2.1 time: 0.258693 Aug 30 16:53:05.516463 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3644/6880] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:05 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:06.538571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:06.539342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:06.545597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:06.546093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:06.546568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:06.547281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:06.547748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:06.548188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:06.687287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:06.695184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bdcd7902-da39-48c9-914f-c79002544486 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1277 microversion: 2.1 time: 0.161801 Aug 30 16:53:06.695890 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3237/6881] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:06 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:07.716299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:07.716922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:07.723818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:07.724305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:07.724745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:07.725438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:07.725899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:07.726349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:07.865761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:07.873810 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d7b8993-c81b-4086-b9de-b3ed13f6e745 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1277 microversion: 2.1 time: 0.161613 Aug 30 16:53:07.874409 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3645/6882] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:07 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:53:08.894871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:08.895502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:08.902616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:08.903225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:08.903681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:08.904389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:08.904868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:08.905314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:09.047432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:09.055556 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-731f371c-aa43-483f-920d-c020a39132cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.164564 Aug 30 16:53:09.056144 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3238/6883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:08 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:10.077635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:10.078260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:10.085190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:10.085694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:10.086121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:10.086839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:10.087308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:10.087736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:10.218920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:10.226763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-623195f4-6012-45b0-af5b-544e1ffe7f24 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.153728 Aug 30 16:53:10.227334 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3646/6884] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:10 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:11.248112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:11.248767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:11.251609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:11.252302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:11.252957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:11.258901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:11.259403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:11.259856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:11.260564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:11.261033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:11.261479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:11.267467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:11.401812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:11.410418 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f40d3f7f-3784-439c-9590-0a16944996e6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.166999 Aug 30 16:53:11.410985 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3239/6885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:11 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:12.431939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:12.432559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:12.436079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:12.436742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:12.442638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:12.443129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:12.443570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:12.444265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:12.444723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:12.445154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:12.450519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:53:12.584168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:12.591944 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-02dd194b-d2e8-4e5c-9c07-fdd7881cde28 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.164204 Aug 30 16:53:12.592518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3647/6886] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:12 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:13.613158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:13.613766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:13.620627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:13.621119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:13.622239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:13.622978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:13.623441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:13.623876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:13.755130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:13.763446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6745d07-bef3-4d7d-b62e-0bbf6f6a4a89 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.154386 Aug 30 16:53:13.764017 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3240/6887] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:13 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:14.784487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:14.785109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:14.792257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:14.792749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:14.793912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:14.794914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:14.795408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:14.795851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:14.926398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:14.934587 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2b12ae86-9fe2-4f69-b8bf-e4f449ef68c5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.154031 Aug 30 16:53:14.935160 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3648/6888] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:14 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:15.955263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:15.955812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:15.962328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:15.962824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:15.963270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:15.963962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:15.964424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:15.964986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:16.097153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:16.104916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6c247555-9e29-4213-a31e-41edf0d2f4bf tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.153893 Aug 30 16:53:16.105482 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3241/6889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:15 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:17.126196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:17.126834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:17.134013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:17.134584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:17.135215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:17.135946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:17.136572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:17.137099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:17.251499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c752b196-136e-47d1-aa34-b4595cb4321c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7a5ab2-ce4c-4c47-9945-870e71744121"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:53:17.262380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:17.263308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:17.263761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:17.275410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:17.285586 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41382dd4-7cc2-4720-b96e-e74c244b5d00 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.163194 Aug 30 16:53:17.286164 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3649/6890] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:17 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:17.289752 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] Creating event network-vif-plugged:dc7a5ab2-ce4c-4c47-9945-870e71744121 for instance c752b196-136e-47d1-aa34-b4595cb4321c on n-h1-830883-28 Aug 30 16:53:17.301161 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a018442e-b0a1-48a3-ad57-9e9290fd030b req-7dc16cec-77b2-4bb3-906f-6afb8584d395 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053231 Aug 30 16:53:17.302149 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3242/6891] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:53:18.307362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:18.307988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:18.315275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:18.315766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:18.316205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:18.316899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:18.317358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:18.317789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:18.455811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:18.463680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b13bec62-09e0-4840-b132-5afc28d625ae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1265 microversion: 2.1 time: 0.160562 Aug 30 16:53:18.464272 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3650/6892] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:18 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:19.487254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:19.487889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:19.494129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:19.494669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:19.495125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:19.495827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:19.496296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:19.496762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:19.896042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:19.904416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0ac3152-e502-4930-bd82-1add3790ef4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1452 microversion: 2.1 time: 0.422422 Aug 30 16:53:19.904992 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3243/6893] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:19 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1452 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:19.924957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:53:19.925575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:53:19.932668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:19.933152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:19.933613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:19.934876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:19.935338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:19.935767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:20.069315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:53:20.078045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0100bba1-1d80-4956-8a8c-613c25b0904a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1452 microversion: 2.1 time: 0.157022 Aug 30 16:53:20.078665 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3651/6894] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:53:19 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:53:22.091542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c752b196-136e-47d1-aa34-b4595cb4321c", "tag": "dc7a5ab2-ce4c-4c47-9945-870e71744121"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:53:22.102723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:53:22.103305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:53:22.103968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:53:22.115739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] Creating event network-changed:dc7a5ab2-ce4c-4c47-9945-870e71744121 for instance c752b196-136e-47d1-aa34-b4595cb4321c on n-h1-830883-28 Aug 30 16:53:22.120923 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-69888e0c-23d2-474a-8602-6843ae7c4395 req-3bd91c3d-a48a-4f62-8011-ebaf05765f5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033324 Aug 30 16:53:22.122521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3244/6895] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:55:01.133877 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 16:55:01.134401 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 16:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 30 16:55:01.135361 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:55:01.135499 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 16:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 30 16:55:01.136405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=9 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:01.137387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=29 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:01.141349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1793544474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1252647331", "security_groups": [{"name": "tempest-secgroup-smoke-946189534"}], "block_device_mapping_v2": [{"uuid": "c08bb4cc-9aa3-4e41-b602-dd0194fe9ce8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3e92749-4d94-4211-a5e8-c0ac0d17ac4a"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:55:01.474162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] validate_networks() for [('a3e92749-4d94-4211-a5e8-c0ac0d17ac4a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:55:01.891469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:55:01.891915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:55:01.892394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:55:01.892860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:55:01.893275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:55:01.902789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:01.903272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:01.903705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:01.904422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:01.904876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:01.905302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:01.922843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:55:01.928067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Getting quotas for user 7bfd62e442664e2cb98c16762b41dd3b and project d820be03c18249cfb0a9c8c05c48c6dd. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:55:01.986020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:55:01.988172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c08bb4cc-9aa3-4e41-b602-dd0194fe9ce8',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:55:02.116522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2e96e816-f67a-4320-9635-0bc16bdf9a8f tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.985809 Aug 30 16:55:02.117342 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3652/6896] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:55:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:55:02.127527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=11 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:02.128281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=27 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:02.135238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b4b5e08-cdfe-403d-81a6-4eca42cfecb9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:02.135977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b4b5e08-cdfe-403d-81a6-4eca42cfecb9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:02.257442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b4b5e08-cdfe-403d-81a6-4eca42cfecb9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:02.264632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b4b5e08-cdfe-403d-81a6-4eca42cfecb9 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1095 microversion: 2.1 time: 0.140357 Aug 30 16:55:02.265212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3245/6897] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:02 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:03.287004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:03.288866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:03.295400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:03.296103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:03.296710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:03.297691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:03.298413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:03.298987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:03.371356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:03.379928 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4e06147-1e51-4d1b-b69f-26dc5e9eacae tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1201 microversion: 2.1 time: 0.098521 Aug 30 16:55:03.380595 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3653/6898] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:03 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:04.401786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:04.403130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:04.411732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:04.412258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:04.412953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:04.413700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:04.414289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:04.414766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:04.647427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:04.658750 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e1523cd3-97ac-4736-a819-9420e2f1cb57 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1278 microversion: 2.1 time: 0.261273 Aug 30 16:55:04.659583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3246/6899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:04 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:04.737666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3", "tag": "39c53ebd-d2aa-44be-bece-5eadd2f74441"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:55:04.751440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:04.752547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:04.753227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:04.766150 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] Creating event network-changed:39c53ebd-d2aa-44be-bece-5eadd2f74441 for instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 on n-h2-830883-28 Aug 30 16:55:04.771728 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-616c9938-3820-4542-b6ba-7f37d43f3aae req-dcd2c942-37c9-42a1-812b-124ecaa93fff service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038065 Aug 30 16:55:04.772915 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3654/6900] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:55:05.682894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:05.683569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:05.690747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:05.691252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:05.691884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:05.692600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:05.693159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:05.693601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:05.835190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:05.843037 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43597b8a-7223-45f6-a071-f1b5724a93ac tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1278 microversion: 2.1 time: 0.165690 Aug 30 16:55:05.843607 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3247/6901] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:05 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:06.865233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:06.865943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:06.872319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:06.872806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:06.873246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:06.873942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:06.874439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:06.874895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:07.009131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:07.016904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-15319d9b-015c-43c8-9a48-ca0ebe1bb906 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1278 microversion: 2.1 time: 0.156816 Aug 30 16:55:07.017477 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3655/6902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:06 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:08.037354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:08.038076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:08.045733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:08.046240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:08.046797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:08.047532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:08.048001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:08.048439 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:08.218904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:08.227195 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-66ecbecb-5575-4a3f-8223-f2e15103e9a8 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1278 microversion: 2.1 time: 0.193836 Aug 30 16:55:08.227794 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3248/6903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:08 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:09.252117 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:09.252663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:09.260411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:09.260893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:09.261333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:09.262022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:09.262520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:09.262950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:09.396170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:09.404375 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a321090f-adbe-404d-8fe4-f44c1644de4c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.156220 Aug 30 16:55:09.404959 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3656/6904] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:09 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:10.426277 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:10.426959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:10.435194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:10.435695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:10.436148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:10.436854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:10.437337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:10.437777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:10.577319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:10.585159 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bef227aa-6d20-42e5-babf-20a05a6fcf70 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.162794 Aug 30 16:55:10.586327 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3249/6905] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:10 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:11.607480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:11.608024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:11.614884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:11.615369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:11.615808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:11.616493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:11.617115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:11.617698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:11.753124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:11.761298 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-547086c0-c733-494d-a809-8366cab5fbbc tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.157836 Aug 30 16:55:11.761880 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3657/6906] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:11 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:12.783775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:12.784442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:12.787333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:12.794124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:12.794675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:12.795200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:12.796010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:12.796484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:12.796926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:12.946181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:12.955417 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-898ef187-b4d2-475d-9819-c7f073501a69 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.176016 Aug 30 16:55:12.956091 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3250/6907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:12 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:13.977027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:13.977653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:13.979662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:13.980943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:55:13.987955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:13.988447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:13.988893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:13.989592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:13.990056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:13.990522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:14.121994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:14.129634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d425a55b-a857-41ad-b18e-40ca25ff47cb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.156563 Aug 30 16:55:14.130209 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3658/6908] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:13 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:15.150579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:15.151215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:15.158898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:15.159391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:15.159843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:15.160535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:15.160997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:15.161428 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:15.300694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:15.309042 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b59023d0-86e8-49f0-8d41-47680da9096c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.162389 Aug 30 16:55:15.309625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3251/6909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:15 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:16.329765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:16.330429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:16.337256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:16.337738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:16.338177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:16.338924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:16.339983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:16.340451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:16.477186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:16.486117 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2124492b-b031-42b1-96ec-f5c73b410a05 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.160253 Aug 30 16:55:16.486747 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3659/6910] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:16 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:17.506673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:17.507233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:17.513876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:17.514418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:17.514876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:17.515581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:17.516057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:17.516525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:17.648630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:17.656651 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f39b299-4d5d-408e-8229-1b16c0ea5ac0 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.153982 Aug 30 16:55:17.657234 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3252/6911] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:17 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:18.677479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:18.678138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:18.685887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:18.686414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:18.686863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:18.687561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:18.688025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:18.688462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:18.820116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:18.828698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a037ac11-2d4a-4c7a-8eb6-cb026bca7b87 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.155099 Aug 30 16:55:18.829275 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3660/6912] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:18 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:19.775579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3", "name": "network-vif-plugged", "status": "completed", "tag": "39c53ebd-d2aa-44be-bece-5eadd2f74441"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:55:19.786483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:19.786979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:19.787426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:19.799151 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] Creating event network-vif-plugged:39c53ebd-d2aa-44be-bece-5eadd2f74441 for instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 on n-h2-830883-28 Aug 30 16:55:19.804123 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-cad33393-2115-4d19-88ca-946148529958 req-3fee054d-07ed-4c79-9bae-36150002331f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Aug 30 16:55:19.805031 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3253/6913] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:55:19.849039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:19.849696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:19.857647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:19.858140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:19.858704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:19.859403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:19.859860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:19.860282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:19.992744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:20.001308 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e522e4ca-c87d-4fb4-b695-75e7a46b68eb tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.156144 Aug 30 16:55:20.001892 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3661/6914] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:19 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:21.022736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:21.023448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:21.029800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:21.030291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:21.030760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:21.031450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:21.031912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:21.032352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:21.166100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:21.174818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f9564da-ede9-4e23-9d3a-d963c542275e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1266 microversion: 2.1 time: 0.157244 Aug 30 16:55:21.175393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3254/6915] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:21 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:22.195420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:22.196045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:22.204332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:22.204570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:22.205008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:22.205708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:22.206168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:22.206629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:22.346807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:22.355531 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cad54c50-b964-4495-974b-749b7f180538 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1453 microversion: 2.1 time: 0.163846 Aug 30 16:55:22.356238 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3662/6916] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:22 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:22.375692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:55:22.376328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:55:22.383252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:22.383755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:22.384208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:22.384913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:22.385385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:22.385827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:22.522628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:55:22.530601 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b98ad967-2827-4e4f-8576-829062741222 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1453 microversion: 2.1 time: 0.158721 Aug 30 16:55:22.531182 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3255/6917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:55:22 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:55:24.377650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3", "tag": "39c53ebd-d2aa-44be-bece-5eadd2f74441"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:55:24.388330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:55:24.388816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:55:24.389257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:55:24.400785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] Creating event network-changed:39c53ebd-d2aa-44be-bece-5eadd2f74441 for instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 on n-h2-830883-28 Aug 30 16:55:24.406593 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bb930e18-80d5-45f0-8f02-ed3f89758afd req-b08a72df-312e-49cc-8b97-aa100b6671e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032529 Aug 30 16:55:24.407549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3663/6918] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:04.070917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=24 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:04.072113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=56 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:04.072960 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:57:04.073108 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 16:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 (ip 10.222.0.47) !!! Aug 30 16:57:04.074291 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:57:04.074434 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 16:57:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 (ip 10.222.0.47) !!! Aug 30 16:57:04.078788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:04.079278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:04.079377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:04.080550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=60 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:04.090522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:04.091028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:04.091477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:04.092188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:04.092653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:04.093093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:04.122826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:57:04.155225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3", "tag": "39c53ebd-d2aa-44be-bece-5eadd2f74441"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:04.166642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:04.167144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:04.167583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:04.180411 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] Creating event network-changed:39c53ebd-d2aa-44be-bece-5eadd2f74441 for instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 on n-h2-830883-28 Aug 30 16:57:04.187167 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-686b2ffe-3316-4a16-8ec5-fb1ca0768ffe req-dfba508f-ff00-47c9-a649-c9cf1ad3c3c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115133 Aug 30 16:57:04.187993 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3664/6919] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:57:04.207963 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5eb25bc-d2ab-4d99-bf14-56e96b8b511c tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 204 len: 0 microversion: 2.1 time: 0.139354 Aug 30 16:57:04.208580 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3256/6920] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:57:04 2022] DELETE /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:57:04.217221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:04.217931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:04.233307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:04.233834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:04.234282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:04.235022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:04.235490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:04.235915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:04.388301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:04.396482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bddb462e-c830-4d8d-ad90-6dc4a9526ac7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1577 microversion: 2.1 time: 0.183400 Aug 30 16:57:04.397080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3665/6921] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:04 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:05.418721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:05.419436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:05.427976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:05.428478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:05.428925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:05.429716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:05.430177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:05.430646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:05.573902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:05.581887 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44c90563-c4bd-42e2-83ee-9b11f04705ca tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1577 microversion: 2.1 time: 0.168129 Aug 30 16:57:05.582840 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3257/6922] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:05 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:06.540633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3", "name": "network-vif-deleted", "tag": "39c53ebd-d2aa-44be-bece-5eadd2f74441"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:06.554599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:06.555007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:06.555442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:06.568754 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] Creating event network-vif-deleted:39c53ebd-d2aa-44be-bece-5eadd2f74441 for instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 on n-h2-830883-28 Aug 30 16:57:06.574904 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-fc5de37c-5afa-4ebb-9ab8-49bc4211d3cf req-82e0aa4c-d8c1-4320-a614-6625db22a353 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038170 Aug 30 16:57:06.575512 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3666/6923] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:06.605503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:06.606147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:06.612861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:06.614127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:06.614655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:06.615379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:06.615857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:06.616300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:06.682859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:06.690885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6c6f189-d83c-4a6d-959e-35fd1f2b959e tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1226 microversion: 2.1 time: 0.089943 Aug 30 16:57:06.692162 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3258/6924] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:06 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:07.712195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:07.712927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:07.720095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:07.720590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:07.721041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:07.721740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:07.722206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:07.722773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:07.785830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:07.793844 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7cefd09b-5910-4620-b576-d7e35967cdda tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1226 microversion: 2.1 time: 0.085989 Aug 30 16:57:07.794453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3667/6925] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:07 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:08.815567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:08.816201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:08.823991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:08.824486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:08.824934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:08.825632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:08.826096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:08.826561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:08.892220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:08.900296 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49262766-b333-4608-a6ad-35db2900d9d3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1226 microversion: 2.1 time: 0.088629 Aug 30 16:57:08.900856 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3259/6926] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:08 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:57:09.921353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:09.923037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:09.931251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:09.932078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:09.932604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:09.933389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:09.933926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:09.934469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:10.011172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:10.019482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58d12c11-670a-488a-bc9d-d4b0e99902d7 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1226 microversion: 2.1 time: 0.102074 Aug 30 16:57:10.020390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3668/6927] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:09 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:57:11.040753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:11.041312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:11.048171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:11.048671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:11.049123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:11.049838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:11.050324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:11.050801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:11.081418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:11.082524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:11.083222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:11.083684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lazy-loading 'fault' on Instance uuid 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:57:11.123742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:11.132243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04d6bc55-c739-4903-afb3-d470a09ddd86 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 200 len: 1231 microversion: 2.1 time: 0.095493 Aug 30 16:57:11.132813 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3260/6928] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:11 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:12.154792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:12.155408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:12.163083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:12.163566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:12.164004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:12.164687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:12.165142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:12.165564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:12.178619 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 HTTP/1.1 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3'} Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:12.180276 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance 0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58efe82e-15e8-497c-b8eb-dc6142697e77 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3" status: 404 len: 111 microversion: 2.1 time: 0.030823 Aug 30 16:57:12.184290 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3669/6929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:12 2022] GET /compute/v2.1/servers/0ad92ffb-cfd0-42fe-ad69-3386bf63e5c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:18.679764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:18.680286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:18.687614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:18.688295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:18.688755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:18.689464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:18.689935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:18.690493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:18.717338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:57:18.747301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c752b196-136e-47d1-aa34-b4595cb4321c", "tag": "dc7a5ab2-ce4c-4c47-9945-870e71744121"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:18.759359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:18.760194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:18.760908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:18.773829 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] Creating event network-changed:dc7a5ab2-ce4c-4c47-9945-870e71744121 for instance c752b196-136e-47d1-aa34-b4595cb4321c on n-h1-830883-28 Aug 30 16:57:18.779466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-4526c5ce-02a2-4046-a05d-72f325c4e0c4 req-232e0664-f8d4-40e6-a7ad-192cbdb0ec32 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101784 Aug 30 16:57:18.780317 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3670/6930] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:18.801366 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52cc4d2c-a878-4904-8bd8-cb5e626e4741 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 204 len: 0 microversion: 2.1 time: 0.126369 Aug 30 16:57:18.802237 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3261/6931] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:57:18 2022] DELETE /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:57:18.811871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:18.812903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:18.829719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:18.830523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:18.831226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:18.832200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:18.833544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:18.834143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:18.986666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:18.994647 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7714684a-4633-4f0a-afb4-b16154a23404 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1576 microversion: 2.1 time: 0.187533 Aug 30 16:57:18.995418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3671/6932] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:18 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:20.017762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:20.018525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:20.026061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:20.026592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:20.027050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:20.027760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:20.028237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:20.028683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:20.168784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:20.177460 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f9b6a12-aa98-441e-b888-0ead4f843fa6 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1576 microversion: 2.1 time: 0.164060 Aug 30 16:57:20.178042 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3262/6933] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:20 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:20.961350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c752b196-136e-47d1-aa34-b4595cb4321c", "name": "network-vif-deleted", "tag": "dc7a5ab2-ce4c-4c47-9945-870e71744121"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:20.971620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:20.972100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:20.972528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:20.984528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] Creating event network-vif-deleted:dc7a5ab2-ce4c-4c47-9945-870e71744121 for instance c752b196-136e-47d1-aa34-b4595cb4321c on n-h1-830883-28 Aug 30 16:57:20.990208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-562030d9-bc7a-48db-b4f9-bfda3423cf86 req-14b16e6e-0987-49cc-adc5-5e40d228e00a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Aug 30 16:57:20.990838 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3672/6934] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:21.199669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:21.200232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:21.207513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:21.208102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:21.208562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:21.209282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:21.209781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:21.210237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:21.274983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:21.283532 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0464b4f7-4a7b-40d7-a49a-f8d58b115ff5 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1225 microversion: 2.1 time: 0.088029 Aug 30 16:57:21.284133 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3263/6935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:21 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:22.307476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:22.308191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:22.314562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:22.315064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:22.315514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:22.316212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:22.316717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:22.317159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:22.385585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:22.393730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac594e13-07b1-4e47-9a6d-c148957074f1 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1225 microversion: 2.1 time: 0.092368 Aug 30 16:57:22.394334 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3673/6936] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:22 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:23.415865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:23.416529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:23.423543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:23.424045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:23.424492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:23.425197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:23.425660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:23.426662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:23.493821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:23.501981 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc5cf0b3-fa73-48cf-8a0d-9b74dcfd5891 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1225 microversion: 2.1 time: 0.090112 Aug 30 16:57:23.502579 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3264/6937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:23 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:24.522900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:24.523428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:24.530009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:24.530534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:24.530980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:24.531673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:24.532138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:24.532569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:24.595198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bfd62e442664e2cb98c16762b41dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd820be03c18249cfb0a9c8c05c48c6dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:24.603700 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-55cd1ee8-e982-46b0-9b5a-4085f6ab0e46 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 200 len: 1225 microversion: 2.1 time: 0.085070 Aug 30 16:57:24.617146 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3674/6938] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:24 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:25.624936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:25.625562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: c752b196-136e-47d1-aa34-b4595cb4321c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:25.633057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:25.633554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:25.634001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:25.634795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:25.635903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:25.636414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:25.649782 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c HTTP/1.1 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'c752b196-136e-47d1-aa34-b4595cb4321c'} Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:25.651479 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance c752b196-136e-47d1-aa34-b4595cb4321c could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c2e4c0d1-05b4-4bcd-be09-d265e2766fb3 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c" status: 404 len: 111 microversion: 2.1 time: 0.031969 Aug 30 16:57:25.655190 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3265/6939] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:25 2022] GET /compute/v2.1/servers/c752b196-136e-47d1-aa34-b4595cb4321c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:26.107303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:26.107809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:26.115458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:26.115977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:26.116421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:26.117113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:26.117575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:26.118013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:26.132250 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 HTTP/1.1 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'bb8f274b-0f65-4db6-bfb7-591aa8c4abf7'} Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:57:26.135433 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-840a6890-a39e-4bb6-a949-41f73a840a7a tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 404 len: 111 microversion: 2.1 time: 0.033987 Aug 30 16:57:26.141552 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3675/6940] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:57:26 2022] DELETE /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:26.147275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:26.147936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] [instance: bb8f274b-0f65-4db6-bfb7-591aa8c4abf7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:26.154046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:26.154574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:26.155033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:26.155720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:26.156183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:26.156619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:26.170872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] HTTP exception thrown: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Request method failure captured: Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 HTTP/1.1 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDj7dmtOXVhxfQYkpUhPPEwktUDvNjMbZeA-zfYFVeuFtilCLXMZu5ntBkyjR85Z-9jIYPvOlILBSF1TcvdPydgxaBQldl4zBnvpe5l5fRhC3594EiKId8ZzrZLd6wPqAa8eyfbUxtZRKu9EkPCxHwPhtP3sZwvB-U9MG9iwhcvojydg Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d820be03c18249cfb0a9c8c05c48c6dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d820be03c18249cfb0a9c8c05c48c6dd"}]}] Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d820be03c18249cfb0a9c8c05c48c6dd Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1249257075 Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 7bfd62e442664e2cb98c16762b41dd3b Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestVolumeBootPattern-1249257075-project Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bb8f274b-0f65-4db6-bfb7-591aa8c4abf7'} Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:26.172406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Returning 404 to user: Instance bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b44f6b28-45c3-4e96-9b4d-71d223525076 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7" status: 404 len: 111 microversion: 2.1 time: 0.031149 Aug 30 16:57:26.176484 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3266/6941] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:26 2022] GET /compute/v2.1/servers/bb8f274b-0f65-4db6-bfb7-591aa8c4abf7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:29.592551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a96723d9-f002-4c19-ac20-ca0ecc9d1b36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] Calling method '.version_select at 0x7fd357e25c10>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:29.625020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a96723d9-f002-4c19-ac20-ca0ecc9d1b36 tempest-TestVolumeBootPattern-1249257075 tempest-TestVolumeBootPattern-1249257075-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1252647331" status: 202 len: 0 microversion: 2.1 time: 0.036347 Aug 30 16:57:29.629945 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3676/6942] 10.222.0.47 () {58 vars in 1263 bytes} [Tue Aug 30 16:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1252647331 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:57:47.864086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:47.864830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:47.980570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1297910299", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:48.036024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] validate_networks() for None {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:57:48.309232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:57:48.309667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:57:48.310149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:57:48.310600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:57:48.311026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:57:48.320674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:48.321195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:48.321651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:48.322445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:48.322915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:48.323350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:48.340156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Getting quotas for project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:57:48.345532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Getting quotas for user 03f1437b91bf49be83898cda7537f47b and project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:57:48.357779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:57:48.360068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:57:48.405122 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bff2ac64-e28e-490b-90ec-be575131a4b8 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546337 Aug 30 16:57:48.406041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3267/6943] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:57:48.416281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=48 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:48.417362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:48.424010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1635e8c-5d7e-46bc-aa58-9bd74ec3117e tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:48.424556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1635e8c-5d7e-46bc-aa58-9bd74ec3117e tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:48.482132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1635e8c-5d7e-46bc-aa58-9bd74ec3117e tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:48.489166 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1635e8c-5d7e-46bc-aa58-9bd74ec3117e tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1222 microversion: 2.1 time: 0.074692 Aug 30 16:57:48.489738 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3677/6944] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:48 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:49.512084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:49.512724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:49.520053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:49.520561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:49.521022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:49.521754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:49.522634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:49.522765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:49.605703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:49.614269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a1dc3b2-ebaf-4b50-8d67-098423fef05d tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1292 microversion: 2.1 time: 0.107989 Aug 30 16:57:49.614864 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3268/6945] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:49 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:50.637335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:50.637959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:50.644870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:50.645350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:50.645798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:50.646533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:50.647818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:50.648267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:50.777580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:50.785558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fab8895a-a307-4849-b095-0874eaea9842 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.152120 Aug 30 16:57:50.786139 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3678/6946] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:50 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:51.029667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7558a8d-58a7-43ce-ad36-2dd5b637c853", "tag": "e6bd9573-f7cd-46a7-8a8e-4464521d9c0c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:51.043144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:51.044062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:51.044526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:51.056425 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] Creating event network-changed:e6bd9573-f7cd-46a7-8a8e-4464521d9c0c for instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 on n-h1-830883-28 Aug 30 16:57:51.062699 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-15425012-b3bf-4f0f-a837-5963c61c6deb req-40609b47-e97e-4673-9004-2c88143b89b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037972 Aug 30 16:57:51.063316 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3269/6947] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:51.809381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:51.810036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:51.816951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:51.817442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:51.817889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:51.818664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:51.819330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:51.819774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:51.951906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:51.960417 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b53f7d1f-e4b6-4c46-b96b-9dc877c0f098 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.155055 Aug 30 16:57:51.960999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3679/6948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:51 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:52.982232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:52.982980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:52.990118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:52.991291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:52.991742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:52.992436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:52.992903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:52.993341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:53.123619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:53.131426 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53ea38bc-d9e9-420d-8aba-2df0005520eb tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.153483 Aug 30 16:57:53.131996 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3270/6949] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:52 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:54.152023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:54.152680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:54.159438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:54.159932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:54.160383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:54.161082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:54.161549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:54.161987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:54.297284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:54.306185 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-28f4cb16-3675-4a80-91c0-15352c39f9f4 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.158109 Aug 30 16:57:54.307055 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3680/6950] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:54 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:57:55.326673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:55.327340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:55.335024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:55.335536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:55.335995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:55.336693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:55.337160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:55.337600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:55.471008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:55.479947 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5cd77ddf-2b5a-4b90-a916-b1067b1f18db tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.157330 Aug 30 16:57:55.480518 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3271/6951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:55 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:56.500714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:56.501463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:56.508981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:56.509469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:56.509910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:56.510653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:56.511096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:56.511519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:56.650146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:56.658547 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ff5d590-44c5-416f-b180-587a0035ccc2 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.161683 Aug 30 16:57:56.670981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3681/6952] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:56 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:56.698636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7558a8d-58a7-43ce-ad36-2dd5b637c853", "name": "network-vif-plugged", "status": "completed", "tag": "e6bd9573-f7cd-46a7-8a8e-4464521d9c0c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:56.708324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:56.708742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:56.709862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:56.720829 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] Creating event network-vif-plugged:e6bd9573-f7cd-46a7-8a8e-4464521d9c0c for instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 on n-h1-830883-28 Aug 30 16:57:56.725894 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d21938e6-4ed2-49a2-b0f9-0d2284c549d3 req-43ac7b34-9ce0-42d3-87d2-beeae000dd55 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112969 Aug 30 16:57:56.726530 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3272/6953] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:57:57.680133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:57.680757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:57.687991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:57.688486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:57.688935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:57.689637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:57.690107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:57.690567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:57.821229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:57.829001 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf02bc4a-4dc6-4673-994b-8ced70fa8dd6 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1322 microversion: 2.1 time: 0.152800 Aug 30 16:57:57.829573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3682/6954] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:57 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:58.848659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:58.849474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:58.854366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:58.855079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:58.862167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:58.862695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:58.863149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:58.863850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:58.864324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:58.864766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:58.999984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:59.008507 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec11f50f-3e7d-4c55-9260-bc9818aa5699 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1472 microversion: 2.1 time: 0.161633 Aug 30 16:57:59.009074 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3273/6955] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:58 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:59.032529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:57:59.088158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-15e88898-6f92-4189-bf90-b4c2a26205ff tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '.version_select at 0x7fd357e088b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.154864 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-15e88898-6f92-4189-bf90-b4c2a26205ff tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/de2169cc8cb7478fadc96f1face1a80c" status: 200 len: 371 microversion: 2.1 time: 0.126962 Aug 30 16:57:59.155434 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3683/6956] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:57:59 2022] GET /compute/v2.1/os-quota-sets/de2169cc8cb7478fadc96f1face1a80c => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:59.167242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37f54117-2a05-408d-9847-0c8bdc25d5a0 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-923135985", "id": 630936876, "os-flavor-access:is_public": "True"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:59.185555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37f54117-2a05-408d-9847-0c8bdc25d5a0 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022110 Aug 30 16:57:59.186127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3274/6957] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:57:59 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:59.198570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "630936876"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:59.200934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:59.207190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.207694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.208138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.208842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.209778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.210294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.295674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'da792b8bd9ea4070b6a963e0b274f792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2169cc8cb7478fadc96f1face1a80c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:59.301895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-923135985 {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:57:59.309536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.309957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.310418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.311140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.311597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.312026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.332849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Getting quotas for project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:57:59.337918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Getting quotas for user 03f1437b91bf49be83898cda7537f47b and project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:57:59.349920 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.compute.api [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] ram quota exceeded for de2169cc8cb7478fadc96f1face1a80c, tried to resize instance. Aug 30 16:57:59.350504 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Request method failure captured: Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action HTTP/1.1 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 38 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkGLFinsKRjD3C8_sEhcc8dPxvf1Y6Q3RkfrjnvkC9xf4iTyN2oH80T0-Eb86CiF5XxqYuJ-kishPTFpWoEknTVzuHSf31R089zz2ScIisckEmXxlkchWs0NpqsN0VeFM7QcKFX-57Z5QeZ3u_A4hcxOvACfpWhyXkiLWYTGNJhyy0A Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: de2169cc8cb7478fadc96f1face1a80c Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member,admin Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member,admin Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/de2169cc8cb7478fadc96f1face1a80c"}]}] Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: de2169cc8cb7478fadc96f1face1a80c Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersAdminNegativeTestJSON-651964557-project-admin Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: da792b8bd9ea4070b6a963e0b274f792 Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersAdminNegativeTestJSON-651964557-project-admin Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: {"resize": {"flavorRef": "630936876"}} Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a7558a8d-58a7-43ce-ad36-2dd5b637c853', 'body': {'resize': {'flavorRef': '630936876'}}} Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3888, in _check_quota_for_upsize Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1081, in _resize Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.352447 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4254, in resize Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3906, in _check_quota_for_upsize Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1167, in _action_resize Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1084, in _resize Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-adb2cd6b-d69a-4f7d-be40-1ae68533745d tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action" status: 403 len: 118 microversion: 2.1 time: 0.159916 Aug 30 16:57:59.356118 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3684/6958] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:57:59 2022] POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action => generated 118 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:59.362679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58bd6226-f647-44c2-931e-c01eb41b563e tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.380484 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58bd6226-f647-44c2-931e-c01eb41b563e tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/630936876" status: 202 len: 0 microversion: 2.1 time: 0.021476 Aug 30 16:57:59.381631 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3275/6959] 10.222.0.47 () {58 vars in 1158 bytes} [Tue Aug 30 16:57:59 2022] DELETE /compute/v2.1/flavors/630936876 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:57:59.389424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e267cde5-875e-4041-b988-89f54df24cab tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.409482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e267cde5-875e-4041-b988-89f54df24cab tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023647 Aug 30 16:57:59.410040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3685/6960] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:57:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:59.430222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b521a858-38d2-41f5-b513-9243588a632b tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '.version_select at 0x7fd35797d670>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.499265 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b521a858-38d2-41f5-b513-9243588a632b tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "GET /compute/v2.1/os-quota-sets/de2169cc8cb7478fadc96f1face1a80c" status: 200 len: 371 microversion: 2.1 time: 0.073811 Aug 30 16:57:59.499835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3276/6961] 10.222.0.47 () {58 vars in 1242 bytes} [Tue Aug 30 16:57:59 2022] GET /compute/v2.1/os-quota-sets/de2169cc8cb7478fadc96f1face1a80c => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:59.510963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6202b947-5761-49fa-a047-83b7a5fb70f5 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1434987062", "id": 21695362, "os-flavor-access:is_public": "True"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:59.528395 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6202b947-5761-49fa-a047-83b7a5fb70f5 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.021071 Aug 30 16:57:59.528986 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3686/6962] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:57:59 2022] POST /compute/v2.1/flavors => generated 431 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:57:59.541189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "21695362"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:57:59.543502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:59.549531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.550031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.550516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.551226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.551700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.552142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.636829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'da792b8bd9ea4070b6a963e0b274f792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2169cc8cb7478fadc96f1face1a80c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:57:59.643031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1434987062 {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:57:59.649571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.650063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.650547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.651282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.651749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.652187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.681392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Getting quotas for project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:57:59.686742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Getting quotas for user 03f1437b91bf49be83898cda7537f47b and project a3cd7d1a902a483ea243b5032f331777. Resources: {'cores', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:57:59.698643 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] cores quota exceeded for de2169cc8cb7478fadc96f1face1a80c, tried to resize instance. Aug 30 16:57:59.699190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Request method failure captured: Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action HTTP/1.1 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 37 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkGLFinsKRjD3C8_sEhcc8dPxvf1Y6Q3RkfrjnvkC9xf4iTyN2oH80T0-Eb86CiF5XxqYuJ-kishPTFpWoEknTVzuHSf31R089zz2ScIisckEmXxlkchWs0NpqsN0VeFM7QcKFX-57Z5QeZ3u_A4hcxOvACfpWhyXkiLWYTGNJhyy0A Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: de2169cc8cb7478fadc96f1face1a80c Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member,admin Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member,admin Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/de2169cc8cb7478fadc96f1face1a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/de2169cc8cb7478fadc96f1face1a80c"}]}] Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: de2169cc8cb7478fadc96f1face1a80c Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-651964557 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAdminNegativeTestJSON-651964557-project-admin Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: da792b8bd9ea4070b6a963e0b274f792 Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAdminNegativeTestJSON-651964557-project-admin Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: {"resize": {"flavorRef": "21695362"}} Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a7558a8d-58a7-43ce-ad36-2dd5b637c853', 'body': {'resize': {'flavorRef': '21695362'}}} Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3888, in _check_quota_for_upsize Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1081, in _resize Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.701260 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4254, in resize Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3906, in _check_quota_for_upsize Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1167, in _action_resize Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1084, in _resize Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-22e4dfd2-896a-4746-99ef-29ffd70aef09 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action" status: 403 len: 113 microversion: 2.1 time: 0.166143 Aug 30 16:57:59.705541 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3277/6963] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:57:59 2022] POST /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853/action => generated 113 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:57:59.711468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12fc127e-4932-45eb-954c-2a3b997937b0 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.730917 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12fc127e-4932-45eb-954c-2a3b997937b0 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "DELETE /compute/v2.1/flavors/21695362" status: 202 len: 0 microversion: 2.1 time: 0.023226 Aug 30 16:57:59.731505 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3687/6964] 10.222.0.47 () {58 vars in 1155 bytes} [Tue Aug 30 16:57:59 2022] DELETE /compute/v2.1/flavors/21695362 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:57:59.739508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b9cd853-2d67-427f-9e7f-d0054b6eb226 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.759837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b9cd853-2d67-427f-9e7f-d0054b6eb226 tempest-ServersAdminNegativeTestJSON-651964557 tempest-ServersAdminNegativeTestJSON-651964557-project-admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024022 Aug 30 16:57:59.760398 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3278/6965] 10.222.0.47 () {58 vars in 1146 bytes} [Tue Aug 30 16:57:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:57:59.779741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.780246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:59.786242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.786761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.787736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.788424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.788881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.789308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.817998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:57:59.907299 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3045d00a-c321-4a6f-91f9-6ccd70639bc5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 204 len: 0 microversion: 2.1 time: 0.130937 Aug 30 16:57:59.908171 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3688/6966] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:57:59 2022] DELETE /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:57:59.918262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:57:59.918918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:57:59.928091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.929598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.930071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:57:59.930819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:57:59.931297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:57:59.932007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:00.061966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:00.070022 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d7c55729-52b2-449e-8ed7-49fedfa4d8a0 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1478 microversion: 2.1 time: 0.156689 Aug 30 16:58:00.070636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3279/6967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:57:59 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:01.091955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:01.092589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:01.099254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:01.099932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:01.099932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:01.100915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:01.101390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:01.101828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:01.235218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:01.243756 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab4b5301-d6c1-483a-93c8-73664ea7c2d5 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1478 microversion: 2.1 time: 0.156084 Aug 30 16:58:01.244574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3689/6968] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:01 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:02.063298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7558a8d-58a7-43ce-ad36-2dd5b637c853", "name": "network-vif-deleted", "tag": "e6bd9573-f7cd-46a7-8a8e-4464521d9c0c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:02.074853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:02.075349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:02.075799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:02.088381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] Creating event network-vif-deleted:e6bd9573-f7cd-46a7-8a8e-4464521d9c0c for instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 on n-h1-830883-28 Aug 30 16:58:02.093875 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-783497e3-9308-42f4-968d-c2804aeffd3c req-c119ceba-4e90-4f6e-a90c-e3c67188a3e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Aug 30 16:58:02.094810 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3280/6969] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:58:02.265380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:02.266177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:02.273423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:02.273917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:02.274399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:02.275099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:02.275553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:02.276194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:02.308718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:02.309212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:02.309658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:02.310110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lazy-loading 'fault' on Instance uuid a7558a8d-58a7-43ce-ad36-2dd5b637c853 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:58:02.354579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1437b91bf49be83898cda7537f47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3cd7d1a902a483ea243b5032f331777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:02.362506 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-82f6fbb5-ee1d-48a3-b832-8e44c96b9290 tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 200 len: 1312 microversion: 2.1 time: 0.100951 Aug 30 16:58:02.363086 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3690/6970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:02 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:03.385828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:03.386585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] [instance: a7558a8d-58a7-43ce-ad36-2dd5b637c853] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:03.392828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:03.393321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:03.393766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:03.394501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:03.394966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:03.395402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:03.408906 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] HTTP exception thrown: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Request method failure captured: Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 HTTP/1.1 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkGLp5A1J5LeeNMd5cy86K6pp-xZTfaFBgjS2R9AbMVbcYljoiIPkrGBEYqbuFl8phUwFaqB1CRIcbSsXIKKAy4E2Lx8fWbj5xSXD3BAAJAvCug9Jv3whD6fMbIxjJz8CtTZ8mPp9FC_Ftiz5TANM5ccPgj9kGWddN-HPjov2-Mkumw Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: a3cd7d1a902a483ea243b5032f331777 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1885542899 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3cd7d1a902a483ea243b5032f331777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3cd7d1a902a483ea243b5032f331777"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3cd7d1a902a483ea243b5032f331777"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3cd7d1a902a483ea243b5032f331777"}]}] Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1885542899 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: a3cd7d1a902a483ea243b5032f331777 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1885542899 Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersAdminNegativeTestJSON-1885542899-project Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 03f1437b91bf49be83898cda7537f47b Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1885542899-project Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a7558a8d-58a7-43ce-ad36-2dd5b637c853'} Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:58:03.410556 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] Returning 404 to user: Instance a7558a8d-58a7-43ce-ad36-2dd5b637c853 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82ca3b92-8b20-4ce5-9c82-1fa8409f508c tempest-ServersAdminNegativeTestJSON-1885542899 tempest-ServersAdminNegativeTestJSON-1885542899-project] 10.222.0.47 "GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853" status: 404 len: 111 microversion: 2.1 time: 0.031588 Aug 30 16:58:03.415256 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3281/6971] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:03 2022] GET /compute/v2.1/servers/a7558a8d-58a7-43ce-ad36-2dd5b637c853 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:58:09.547893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:09.549137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:09.672634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-550037323", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "0def75cf-7bc2-4874-a138-38094c0867af"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:09.727361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] validate_networks() for [('0def75cf-7bc2-4874-a138-38094c0867af', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:58:10.148351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:58:10.149058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:58:10.149567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:58:10.149991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:58:10.150456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:58:10.161744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:10.162383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:10.162971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:10.163730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:10.164183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:10.164618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:10.183423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Getting quotas for project d7cdba2cee1f4c56bf5d348330d0816c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:58:10.189186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Getting quotas for user cdd3e282af82444682aeff0209db7a24 and project d7cdba2cee1f4c56bf5d348330d0816c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:58:10.207550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:58:10.211040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:58:10.260156 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 16:58:11.269415 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 48036. Aug 30 16:58:11.273757 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-56ef4a62-2f24-4d01-af6c-5dde572b13f3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731650 Aug 30 16:58:11.274642 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3691/6972] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:58:11.285162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-765589a3-297f-4d9d-9e2c-c5cee9e9006f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:11.285796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-765589a3-297f-4d9d-9e2c-c5cee9e9006f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:11.304996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:11.305835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:11.367532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-765589a3-297f-4d9d-9e2c-c5cee9e9006f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:11.378569 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-765589a3-297f-4d9d-9e2c-c5cee9e9006f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1214 microversion: 2.1 time: 0.097149 Aug 30 16:58:11.379178 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3282/6973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:11 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:12.401995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:12.402879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:12.410084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:12.411732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:12.413196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:12.414549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:12.415260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:12.415443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:12.498142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:12.523281 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7a9db27-694a-4f03-b0e0-e714dcd292bd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1274 microversion: 2.1 time: 0.125910 Aug 30 16:58:12.526733 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3692/6974] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:12 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:13.545164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:13.546020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:13.550834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=53 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:13.556289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:13.557611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:13.558133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:13.559481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:13.560208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:13.560828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:13.754529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:13.763262 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-848ec351-a748-408f-b828-1f90b62feb06 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.222059 Aug 30 16:58:13.763845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3283/6975] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:13 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:13.835159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:13.847473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:13.848084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:13.848592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:13.860948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] Creating event network-changed:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h1-830883-28 Aug 30 16:58:13.866768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-77fdcd34-87ae-4e43-94fe-6f3c76008300 req-1328b552-95a9-4b5d-8081-872abfd1e83d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036073 Aug 30 16:58:13.867408 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3693/6976] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:58:14.785549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:14.786200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:14.793771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:14.794278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:14.794771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:14.795487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:14.795964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:14.796410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:14.929358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:14.937513 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b4fd278-edee-4970-8ee8-57d1f031fce1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.155955 Aug 30 16:58:14.938089 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3284/6977] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:14 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:15.959682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:15.960422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:15.967480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:15.967964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:15.968404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:15.969092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:15.969553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:15.969981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:16.107167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:16.114992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0637bae3-a4e9-4d6c-a405-eaab8e360272 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.159864 Aug 30 16:58:16.115621 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3694/6978] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:15 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:17.136061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:17.136690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:17.143349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:17.143844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:17.144288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:17.144988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:17.145450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:17.145885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:17.278076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:17.285778 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0076b2f6-60e6-424a-b9c1-7b24088cac6f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.153605 Aug 30 16:58:17.286372 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3285/6979] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:17 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:18.307506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:18.308123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:18.315022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:18.315506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:18.315942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:18.316623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:18.317078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:18.317639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:18.449101 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:18.451508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:18.460027 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ca50c3fe-f972-464d-85a0-b5a158c515eb tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.155628 Aug 30 16:58:18.460340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3695/6980] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:18 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:19.482019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:19.482682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:19.485372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:19.491595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:19.492099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:19.492556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:19.493265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:19.493738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:19.494180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:19.627359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:19.635075 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c2f11fe-0c7f-49c1-973a-a6fe11cde18f tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.157034 Aug 30 16:58:19.635646 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3286/6981] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:19 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:20.656918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:20.657552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:20.660287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:20.660959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:20.661704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:20.669696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:20.670286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:20.670813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:20.671547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:20.672025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:20.672845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:20.781390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "name": "network-vif-plugged", "status": "completed", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:20.792895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:20.793582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:20.794215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:20.806913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] Creating event network-vif-plugged:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h1-830883-28 Aug 30 16:58:20.812278 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-289b0737-688f-4dd2-a0f1-e47ac496bfbf req-a3c5e48f-76e0-4b1b-9b63-d55b4ba82a68 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Aug 30 16:58:20.812900 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3287/6982] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:58:20.816394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:20.824606 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74c23107-ccf8-441b-8143-fcae6f31c8c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.172128 Aug 30 16:58:20.825414 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3696/6983] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:20 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:21.842865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:21.848102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:21.848831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:21.856008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:21.856528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:21.856986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:21.857706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:21.858189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:21.858669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:22.010956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:22.020738 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ebcb1f2-549c-4b93-90e0-b30834b61654 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1314 microversion: 2.1 time: 0.178853 Aug 30 16:58:22.022086 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3288/6984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:21 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:23.043214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:23.043837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:23.050819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.051310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.051751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.053150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.053910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.054380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.183818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:23.191656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8727aad3-579e-45e6-9a4a-4077b3628dfd tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1501 microversion: 2.1 time: 0.152360 Aug 30 16:58:23.192239 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3697/6985] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:23 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:23.213109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:23.215438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:23.222552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.223093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.223559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.224332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.224820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.225275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.254737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:23.261370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Old instance type m1.heat2, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:58:23.267816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:58:23.268261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:58:23.268746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:58:23.269173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:58:23.269600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:58:23.334646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0c0f87f5-8279-4563-9587-dbc8a3649b37 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "POST /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82/action" status: 202 len: 0 microversion: 2.1 time: 0.125748 Aug 30 16:58:23.335298 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3289/6986] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:58:23 2022] POST /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:58:23.343302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:23.343928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:23.349968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.350518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.350960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.351658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:23.352118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:23.352547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:23.488915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:23.497823 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-44a8f1dc-1acc-4736-9318-89e5478d09a1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1510 microversion: 2.1 time: 0.158396 Aug 30 16:58:23.498437 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3698/6987] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:23 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:24.520954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:24.521603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:24.531217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:24.531724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:24.532176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:24.532881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:24.533346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:24.533782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:24.669000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:24.676829 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f4759ea-67ae-443b-ba2c-1d5ea2c00aa2 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1510 microversion: 2.1 time: 0.160570 Aug 30 16:58:24.677989 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3290/6988] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:24 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:25.699174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:25.699791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:25.706635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:25.707122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:25.707561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:25.708247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:25.708727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:25.709246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:25.849060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:25.858144 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6544e263-dcd6-4c86-9f8a-cd141069f893 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.162791 Aug 30 16:58:25.858853 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3699/6989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:25 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:26.880238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:26.880881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:26.887872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:26.888379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:26.888836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:26.889577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:26.890059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:26.890538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:27.023415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:27.031192 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-58fdb294-d94b-4c78-b085-9bea08af2811 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.154914 Aug 30 16:58:27.031767 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3291/6990] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:26 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:28.052308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:28.052985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:28.060151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:28.060646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:28.061097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:28.061791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:28.062257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:28.062720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:28.195620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:28.204195 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c0b9be4-0792-465c-834f-49701b1dac50 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.155149 Aug 30 16:58:28.204195 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3700/6991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:28 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:29.225154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:29.225715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:29.232907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:29.233397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:29.233841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:29.234570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:29.235035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:29.235470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:29.371463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:29.379313 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16609226-f0df-4215-9aae-48bd04b07723 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.158116 Aug 30 16:58:29.379893 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3292/6992] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:29 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:30.403003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:30.403645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:30.410384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:30.410878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:30.411317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:30.412005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:30.412456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:30.412882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:30.544810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:30.552601 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-670d4b54-d32d-451a-8133-73d2c641dc20 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.155504 Aug 30 16:58:30.553181 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3701/6993] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:30 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:31.574335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:31.574910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:31.581921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:31.582451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:31.582920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:31.583622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:31.584083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:31.584520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:31.712557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:31.720399 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-525c9e7c-0c73-4b0d-988c-73fb49a4fbad tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.150307 Aug 30 16:58:31.720982 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3293/6994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:31 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:32.743512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:32.744127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:32.751253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:32.751772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:32.752423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:32.753115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:32.753571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:32.753995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:32.890481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:32.899793 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-585e647c-48c4-4c97-bfca-89605609fd1d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.161370 Aug 30 16:58:32.900379 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3702/6995] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:32 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:33.920877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:33.921503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:33.928541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:33.929724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:33.930184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:33.930904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:33.931374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:33.932072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:34.068221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:34.076060 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b2a0dcae-07ac-4be1-9ab9-e04097c8c1a4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.159047 Aug 30 16:58:34.076638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3294/6996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:33 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:35.096960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:35.097489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:35.105133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:35.105617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:35.106065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:35.106771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:35.107235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:35.107660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:35.242074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:35.251161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70c3e085-9607-43b5-9a5e-f0b0b56610e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.158108 Aug 30 16:58:35.251732 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3703/6997] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:35 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:36.272332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:36.273235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:36.280305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:36.280805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:36.281262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:36.281964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:36.282468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:36.282915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:36.412830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:36.421427 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-854d4d7b-9154-4177-80b7-b09aa9340024 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.153115 Aug 30 16:58:36.422008 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3295/6998] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:36 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:37.443390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:37.444016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:37.451768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:37.452471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:37.452943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:37.453636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:37.454098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:37.454673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:37.590960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:37.598853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7eac17ee-2c2d-40ec-a890-ebd5c77e420d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.159333 Aug 30 16:58:37.599436 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3704/6999] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:37 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:38.619649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:38.620222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:38.627190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:38.627695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:38.628154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:38.628860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:38.629339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:38.629785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:38.760386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:38.768082 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a1910ef5-4f74-43c6-8e33-bccad85991e1 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.152576 Aug 30 16:58:38.768643 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3296/7000] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:38 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:39.790565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:39.791136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:39.798199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:39.798720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:39.799160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:39.799875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:39.800331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:39.800758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:39.932213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:39.939982 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68c4bb74-7df1-4555-9013-9424c563a1ee tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.154135 Aug 30 16:58:39.940596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3705/7001] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:39 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:40.961647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:40.962270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:40.969219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:40.969713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:40.970161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:40.970880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:40.971349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:40.971784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:41.107483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:41.115233 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-382f4101-a573-4d09-bc49-4e8338ac5041 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.157595 Aug 30 16:58:41.115820 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3297/7002] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:40 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:42.138134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:42.138813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:42.145713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:42.146194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:42.146741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:42.147429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:42.147891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:42.148351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:42.284498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:42.293255 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-783b0f4f-5265-4730-a683-4fd70cb4d0d6 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.158994 Aug 30 16:58:42.293845 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3706/7003] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:42 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:43.315518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:43.316147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:43.323992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:43.324498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:43.324956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:43.325664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:43.326145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:43.326624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:43.454209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:43.457687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:43.462915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4dd4f1c8-5b6d-47eb-8d23-85bc6ac7432c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.151430 Aug 30 16:58:43.463497 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3298/7004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:43 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:44.484318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:44.484938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:44.492848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:44.493329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:44.493765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:44.494477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:44.494933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:44.495355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:44.623572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:44.631333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9552eb7d-1265-445a-ad7e-70df92d7703e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.151026 Aug 30 16:58:44.631933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3707/7005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:44 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:45.654213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:45.654871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:45.663831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:45.665502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:45.665959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:45.666710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:45.667180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:45.667624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:45.799508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:45.808139 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a29ac306-85c7-4bf5-a523-c31260e9f289 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.158098 Aug 30 16:58:45.808715 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3299/7006] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:45 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:46.829499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:46.830171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:46.837316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:46.837807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:46.838274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:46.838991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:46.839441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:46.839872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:46.977896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:46.985634 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ae23c7c-fe9a-416b-aa2b-7946305a743e tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.160095 Aug 30 16:58:46.986204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3708/7007] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:46 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:48.007319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:48.008729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:48.015820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:48.016313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:48.017177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:48.017879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:48.018370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:48.018812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:48.147961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:48.155941 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1dd39619-de24-441c-b47c-a74ff45411f7 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.152531 Aug 30 16:58:48.156516 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3300/7008] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:48 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:49.177675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:49.178210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:49.185432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:49.185929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:49.186390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:49.187094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:49.187560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:49.187995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:49.320787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:49.328537 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0fe90d71-f404-4f92-a150-c5174af97adf tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.154866 Aug 30 16:58:49.329112 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3709/7009] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:49 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:50.348602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:50.349236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:50.351775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:50.358212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:50.358741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:50.359194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:50.359901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:50.360373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:50.360817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:50.497940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:50.506008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4bfd44c7-f83b-43b8-ad30-7bd634260400 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.161448 Aug 30 16:58:50.506628 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3301/7010] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:50 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:51.527281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:51.527938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:51.530715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=28 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:51.536082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:51.536586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:51.537031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:51.537728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:51.538193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:51.538954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:51.543532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=86 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:58:51.668172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:51.675992 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-917fc43a-dace-4f17-bec8-4bcdfb2ae291 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.152822 Aug 30 16:58:51.676569 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3710/7011] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:51 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:52.697507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:52.698490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:52.705991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:52.706588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:52.707038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:52.707742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:52.708207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:52.708642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:52.841193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:52.848959 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-60124548-ffb0-4306-9971-239819121e36 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.155418 Aug 30 16:58:52.849521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3302/7012] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:52 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:53.871318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:53.871940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:53.878679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:53.879162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:53.879602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:53.880284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:53.880738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:53.881161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:54.016652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:54.024510 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c71da271-3792-4a21-a03c-61dc6466d52d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.157840 Aug 30 16:58:54.025089 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3711/7013] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:53 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:55.045195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:55.045848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:55.052793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:55.053290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:55.053741 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:55.054464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:55.054931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:55.055368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:55.186496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:55.194259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9219785-da61-4159-9cf3-7f90ba86d006 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.152951 Aug 30 16:58:55.194908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3303/7014] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:55 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:58:56.216006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:56.216635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:56.223729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:56.224224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:56.224707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:56.225856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:56.226368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:56.226810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:56.358480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:56.366126 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe8fca72-8de0-458f-aa69-e1c951ed1565 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.154654 Aug 30 16:58:56.366727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3712/7015] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:56 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:57.387024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:57.387656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:57.394858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:57.395356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:57.395803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:57.396509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:57.396978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:57.397473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:57.538003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:57.546814 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e6cf1098-db8b-4a95-9e6f-582541d7e4c4 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1515 microversion: 2.1 time: 0.163626 Aug 30 16:58:57.547465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3304/7016] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:57 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:58.010851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "name": "network-vif-unplugged", "status": "completed", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:58:58.022232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:58.022976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:58.023573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:58.035916 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Creating event network-vif-unplugged:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h2-830883-28 Aug 30 16:58:58.042124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:58:58.054103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-53844bab-b5ce-4fd3-8d7e-2ef3722dd588 req-bff5ddaa-322f-4df0-906b-ecb96dc258e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047109 Aug 30 16:58:58.054928 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3713/7017] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:58:58.568408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:58.569078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:58.576715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:58.577213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:58.577664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:58.578508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:58.578925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:58.579507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:58.781079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:58.789464 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47c048c4-2b7f-40b9-b1c0-8e596d0d1f27 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1514 microversion: 2.1 time: 0.225053 Aug 30 16:58:58.791089 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3305/7018] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:58 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:58:59.812436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:58:59.813085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:58:59.820118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:59.820604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:59.821127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:59.821815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:58:59.822272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:58:59.822726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:58:59.959892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:58:59.968181 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1bbfca32-a7a8-47f9-a1d8-b9b4189492aa tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1512 microversion: 2.1 time: 0.160093 Aug 30 16:58:59.968792 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3714/7019] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:58:59 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:00.077177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:00.088073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:00.088572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:00.089030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:00.102066 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Creating event network-changed:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h2-830883-28 Aug 30 16:59:00.108743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:59:00.119813 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-34f9e21a-2180-4302-b1c4-a48ac8d2782b req-386fe706-b1bc-461d-8bf6-1fefc5776003 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046428 Aug 30 16:59:00.120434 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3306/7020] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:59:00.990263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:00.990841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:00.998336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:00.998835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:00.999287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:00.999988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:01.000461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:01.000895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:01.132502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:01.140568 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ab07f8c0-70aa-479e-bd09-b2fbf010d1c5 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1512 microversion: 2.1 time: 0.154279 Aug 30 16:59:01.141160 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3715/7021] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:00 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:02.162976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:02.163718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:02.170733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:02.171351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:02.171864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:02.172573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:02.173032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:02.173471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:02.304899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:02.312900 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-47e60c24-9575-4b9e-b15b-647b6fefd2e3 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1509 microversion: 2.1 time: 0.155183 Aug 30 16:59:02.313467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3307/7022] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:02 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:02.332668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:02.333160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:02.340548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:02.341039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:02.341483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:02.342179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:02.342679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:02.343112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:02.369495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:59:02.419591 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.compute.api [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Found an unconfirmed migration during delete, id: 16, status: finished Aug 30 16:59:03.912382 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d3e2e490-9b1e-45f2-bc0b-4ce3fddb13e9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 204 len: 0 microversion: 2.1 time: 1.583191 Aug 30 16:59:03.913135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3716/7023] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:59:02 2022] DELETE /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 0 bytes in 1585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:59:03.923344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:03.924080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:03.931332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:03.932089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:03.932539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:03.933245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:03.933744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:03.934184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:04.068562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:04.076583 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5302cc65-46e0-44a2-8767-6d7c6dbcd016 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1501 microversion: 2.1 time: 0.157552 Aug 30 16:59:04.077149 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3308/7024] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:03 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:04.690678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "name": "network-vif-plugged", "status": "completed", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:04.702452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:04.703558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:04.704003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:04.715959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] Creating event network-vif-plugged:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h2-830883-28 Aug 30 16:59:04.720680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8a124872-8cc9-4be5-8472-db0213830c48 req-1a5a62cd-afb1-4517-9a2c-7d316c423688 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Aug 30 16:59:04.721290 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3717/7025] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:59:05.104013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:05.104649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:05.111906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:05.112399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:05.112845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:05.113543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:05.114101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:05.114569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:05.245556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd3e282af82444682aeff0209db7a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cdba2cee1f4c56bf5d348330d0816c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:05.253822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8191a0a-7588-48af-a1bb-d0aaeafc597d tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 200 len: 1501 microversion: 2.1 time: 0.155215 Aug 30 16:59:05.254421 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3309/7026] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:05 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:05.895248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82", "name": "network-vif-deleted", "tag": "556d768f-30ed-4018-9cad-d75ecaccf36c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:05.906171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:05.907951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:05.909387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:05.929043 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] Creating event network-vif-deleted:556d768f-30ed-4018-9cad-d75ecaccf36c for instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 on n-h2-830883-28 Aug 30 16:59:05.934730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-375ed542-782a-47c9-aaa1-adabe86c1f76 req-90fbb3d0-e70b-42ee-9ac1-8c077574ee38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044421 Aug 30 16:59:05.935356 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3718/7027] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:59:06.276054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:06.276710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:06.283596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.284091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.284537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.285235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.285703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.286140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.302533 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] HTTP exception thrown: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Request method failure captured: Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 HTTP/1.1 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkGhuy74Gy6UEU-HdZeY2Redc6ZDy2oXsWMlMZ71EK_yzNqoHIYJdJ-m5sAArrurPBYX5I-3Cb5rz_xe6UFJ9qbFehIAAxJNMaIP81fEi0P3CbVIIc1SHNhcECbJ_BkFG9RGd41rbOyAlHR929rnqwHxkfwNTP9u-tzHnBv2PhH6xkU Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}] Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cdd3e282af82444682aeff0209db7a24 Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82'} Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.304240 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Returning 404 to user: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:59:06.309190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-46891f94-5a41-4528-9947-d1b8e52566b9 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 404 len: 111 microversion: 2.1 time: 0.034099 Aug 30 16:59:06.309918 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3310/7028] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:06 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:59:06.322840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:06.323426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:06.330176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.330701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.331142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.331828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.332284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.332993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.346803 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] HTTP exception thrown: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Request method failure captured: Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 HTTP/1.1 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkGhuy74Gy6UEU-HdZeY2Redc6ZDy2oXsWMlMZ71EK_yzNqoHIYJdJ-m5sAArrurPBYX5I-3Cb5rz_xe6UFJ9qbFehIAAxJNMaIP81fEi0P3CbVIIc1SHNhcECbJ_BkFG9RGd41rbOyAlHR929rnqwHxkfwNTP9u-tzHnBv2PhH6xkU Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}] Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: cdd3e282af82444682aeff0209db7a24 Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82'} Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:59:06.348424 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Returning 404 to user: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa617a8e-3c97-4282-95bd-e83c8ebd301c tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 404 len: 111 microversion: 2.1 time: 0.031796 Aug 30 16:59:06.352943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3719/7029] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 16:59:06 2022] DELETE /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:59:06.358480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:06.359120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] [instance: 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:06.365299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.365806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.366265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.367021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:06.367497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:06.367979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:06.381746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] HTTP exception thrown: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Request method failure captured: Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 HTTP/1.1 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkGhuy74Gy6UEU-HdZeY2Redc6ZDy2oXsWMlMZ71EK_yzNqoHIYJdJ-m5sAArrurPBYX5I-3Cb5rz_xe6UFJ9qbFehIAAxJNMaIP81fEi0P3CbVIIc1SHNhcECbJ_BkFG9RGd41rbOyAlHR929rnqwHxkfwNTP9u-tzHnBv2PhH6xkU Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d7cdba2cee1f4c56bf5d348330d0816c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d7cdba2cee1f4c56bf5d348330d0816c"}]}] Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: d7cdba2cee1f4c56bf5d348330d0816c Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-DeleteServersTestJSON-912215625 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: cdd3e282af82444682aeff0209db7a24 Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-DeleteServersTestJSON-912215625-project Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82'} Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:59:06.383320 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] Returning 404 to user: Instance 7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-88e6c54f-14fe-4cda-8673-3e1f48223f09 tempest-DeleteServersTestJSON-912215625 tempest-DeleteServersTestJSON-912215625-project] 10.222.0.47 "GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82" status: 404 len: 111 microversion: 2.1 time: 0.030987 Aug 30 16:59:06.388185 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3311/7030] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:06 2022] GET /compute/v2.1/servers/7e0c2e35-b3d6-40ad-88a4-6a6fe6e45f82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:59:15.106164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-303018690", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "f2493f56-05a3-45d1-9710-c91164da1c85"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:15.163460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] validate_networks() for [('f2493f56-05a3-45d1-9710-c91164da1c85', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:59:15.575084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:59:15.575515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:59:15.575994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:59:15.576409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:59:15.576855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:59:15.586899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:15.587615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:15.588056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:15.588826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:15.589284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:15.589713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:15.611434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for project ef7e593fa3324de9a3925596454ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:59:15.617638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for user b11d98ff1e9e4d32913fec042f6c4489 and project ef7e593fa3324de9a3925596454ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:59:15.633435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:59:15.636040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:59:15.685218 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3110716a-d215-4510-9d08-4bb40860d7a6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718886 Aug 30 16:59:15.686161 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3720/7031] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 16:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:59:15.697825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-97f2107a-8a28-48a9-ac4c-bb96d9eb6c1e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:15.702207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-97f2107a-8a28-48a9-ac4c-bb96d9eb6c1e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:15.767039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-97f2107a-8a28-48a9-ac4c-bb96d9eb6c1e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:15.779703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-97f2107a-8a28-48a9-ac4c-bb96d9eb6c1e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1217 microversion: 2.1 time: 0.082048 Aug 30 16:59:15.780608 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3312/7032] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:15 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:16.800931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:16.801739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:16.813909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:16.814832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:16.815488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:16.816252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:16.816619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:16.817047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:16.889375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:16.897758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-38cad9c8-99a4-4c7a-bb61-d34a099a2e19 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1277 microversion: 2.1 time: 0.100724 Aug 30 16:59:16.898355 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3721/7033] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:16 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:17.920504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:17.921874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:17.925248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=68 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:17.932214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:17.932985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:17.933600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:17.934763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:17.935181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:17.935586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:18.361760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:18.369869 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd5ba791-fa91-4016-9c02-0a409407db03 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.453851 Aug 30 16:59:18.371181 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3313/7034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:17 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:18.648079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:18.660274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:18.660772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:18.661219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:18.678981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] Creating event network-changed:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h2-830883-28 Aug 30 16:59:18.686632 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ac1ed81a-4dc4-4444-a5eb-f5258a7ea087 req-02c7a51c-9129-4b52-9125-d02d40a9b04a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Aug 30 16:59:18.688413 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3722/7035] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:59:19.391942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:19.392578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:19.400113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:19.400614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:19.401072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:19.401780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:19.402254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:19.402781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:19.547781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:19.556709 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d10fef33-5116-4910-a35e-911cb6245ffe tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.168435 Aug 30 16:59:19.557301 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3314/7036] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:19 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:20.578503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:20.579241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:20.585458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:20.585939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:20.587012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:20.587708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:20.588171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:20.588603 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:20.723861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:20.732631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d803605e-01f1-4cd5-8670-9650fee2fceb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.159243 Aug 30 16:59:20.733253 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3723/7037] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:20 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:21.753660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:21.754287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:21.756842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:21.763079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:21.763837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:21.764298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:21.765031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:21.765496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:21.765938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:21.896707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:21.904687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4ce21d8f-e349-4825-adc4-7c45cd70fd4a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.154969 Aug 30 16:59:21.905252 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3315/7038] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:21 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:22.925933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:22.926765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:22.929504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:22.936080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:22.936573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:22.937012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:22.937743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:22.938196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:22.938655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:22.943065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:23.074622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:23.082326 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6883d38-467a-4238-b481-0c4466bf99b5 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.160286 Aug 30 16:59:23.082916 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3724/7039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:22 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:24.103659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:24.104321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:24.111431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:24.111929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:24.112450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:24.113146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:24.113610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:24.114050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:24.245768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:24.253544 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5e1bb45-36c8-4f45-a619-3b38cd0d6367 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.154588 Aug 30 16:59:24.254112 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3316/7040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:24 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:59:24.728174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "name": "network-vif-plugged", "status": "completed", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:24.739395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:24.740068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:24.740594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:24.752981 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] Creating event network-vif-plugged:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h2-830883-28 Aug 30 16:59:24.757936 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5272efd7-dd4f-4293-bbac-840884f194e4 req-38cea461-f403-4298-a39a-bb03d74c134f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Aug 30 16:59:24.759340 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3725/7041] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:59:25.274755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:25.275394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:25.282264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:25.282799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:25.283254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:25.283958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:25.284431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:25.284872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:25.417144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:25.424820 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-677af6e0-0d98-411f-8b03-9d6b9a8a3002 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1317 microversion: 2.1 time: 0.154571 Aug 30 16:59:25.425394 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3317/7042] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:25 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:26.444801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:26.446096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:26.451574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:26.452274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:26.459452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.459933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.460372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.461060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.462179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.462632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.599479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:26.607822 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-aefa18d3-8f35-4c84-8238-01d6c6ad0542 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1506 microversion: 2.1 time: 0.163984 Aug 30 16:59:26.608415 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3726/7043] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:26 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:26.628749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:26.629378 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:26.631404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:26.637656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.638150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.638625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.639349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.639848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.640287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.776471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:26.784216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-204377d3-43c1-49b4-bbd6-b95df9e74289 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1506 microversion: 2.1 time: 0.159362 Aug 30 16:59:26.784789 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3318/7044] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:26 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:26.805135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:26.807860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:26.813866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.814385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.814837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.815536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.815997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.816434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.879466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0572f9e0-5161-44bc-bc79-2c94779a8b13 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "PUT /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1078 microversion: 2.1 time: 0.078149 Aug 30 16:59:26.880103 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3727/7045] 10.222.0.47 () {60 vars in 1256 bytes} [Tue Aug 30 16:59:26 2022] PUT /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:26.896843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:26.897480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:26.904292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.904787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.905237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:26.905930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:26.906429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:26.906874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.037368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:27.046177 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebe0529e-12ff-4920-ab13-5ae48440ff41 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1504 microversion: 2.1 time: 0.153180 Aug 30 16:59:27.046783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3319/7046] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:26 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:59:27.066054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:27.066710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:27.078481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.079141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.079592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.080795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.081265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.082198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.213110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:27.221020 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0dcb31d7-d0bc-44c5-aec9-3d7767d662c9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1504 microversion: 2.1 time: 0.159038 Aug 30 16:59:27.221601 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3728/7047] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:27 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:59:27.240972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:27.243631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:27.249551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.250043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.250528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.251229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.251697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.252136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.281315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:27.287616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 16:59:27.294279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:59:27.294737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:59:27.295229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:59:27.295683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:59:27.296115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:59:27.358710 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8908ac30-f46c-46b6-af10-0e332875c875 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e/action" status: 202 len: 0 microversion: 2.1 time: 0.121298 Aug 30 16:59:27.359325 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3320/7048] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 16:59:27 2022] POST /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:59:27.367526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:27.368315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:27.374436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.374930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.375372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.376074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:27.376915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:27.377026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:27.524658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:27.532698 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b5964b26-7d96-40fc-98f8-6b4ad2dd5c8e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1515 microversion: 2.1 time: 0.169157 Aug 30 16:59:27.533372 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3729/7049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:27 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:28.555952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:28.557183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:28.567430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:28.568124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:28.568663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:28.569509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:28.570213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:28.570782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:28.792216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:28.800147 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-203e570c-e813-42f8-bddc-7cb92d2c50c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1515 microversion: 2.1 time: 0.250422 Aug 30 16:59:28.800765 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3321/7050] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:28 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:29.823521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:29.824096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:29.830967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:29.831455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:29.831897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:29.832586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:29.833045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:29.833476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:29.963822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:29.971653 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1783942-a46f-4c0c-9345-e5fdcbecca7a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.153237 Aug 30 16:59:29.972223 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3730/7051] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:29 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:30.993107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:30.993860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:31.000903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:31.001410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:31.001862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:31.002604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:31.003082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:31.003526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:31.131589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:31.140011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7fcb2bee-e47f-4f22-8d37-dcee819fa715 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.151007 Aug 30 16:59:31.140594 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3322/7052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:30 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:32.160571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:32.161187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:32.168263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:32.168748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:32.169185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:32.169869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:32.170391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:32.170820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:32.300684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:32.308838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86ca685b-35b0-4781-9964-460167efe685 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.152274 Aug 30 16:59:32.309425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3731/7053] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:32 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:33.330593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:33.331336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:33.338442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:33.338940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:33.339418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:33.340119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:33.340589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:33.341030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:33.475826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:33.484176 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c1101db-5435-46be-8fb8-fdaf0730b919 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.157614 Aug 30 16:59:33.485495 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3323/7054] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:33 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:34.505188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:34.505764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:34.513240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:34.513734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:34.514171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:34.514897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:34.515360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:34.515792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:34.658913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:34.667367 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54afa635-6048-46c9-8102-24c454c1bba3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.166206 Aug 30 16:59:34.667943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3732/7055] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:34 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:35.688392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:35.689058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:35.696655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:35.697156 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:35.697610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:35.698327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:35.698799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:35.699237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:35.832969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:35.840791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e2883a53-cf0f-4695-a5e7-acfd60f37f7f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.156325 Aug 30 16:59:35.841363 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3324/7056] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:35 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:36.861331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:36.861983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:36.870371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:36.870865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:36.871302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:36.872048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:36.872501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:36.872925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:37.004286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:37.012295 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-05f3c97b-0d65-49ec-933f-bdfb27348146 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.154816 Aug 30 16:59:37.012861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3733/7057] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:36 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:38.033481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:38.034111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:38.042131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:38.042684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:38.043133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:38.043838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:38.044310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:38.044748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:38.186176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:38.194139 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-851ccef7-c9d8-4044-aace-35496ae4d787 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.164632 Aug 30 16:59:38.194768 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3325/7058] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:38 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:39.215766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:39.216399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:39.223356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:39.223848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:39.224292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:39.224989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:39.225449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:39.225875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:39.357123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:39.365062 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-802b25c2-f5c6-4b24-991a-3362d6d3fa16 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.153820 Aug 30 16:59:39.365633 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3734/7059] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:39 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:40.386125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:40.386789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:40.393660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:40.394159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:40.394647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:40.395353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:40.395825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:40.396271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:40.527166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:40.535695 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8dc2028f-207c-4304-b97b-b26596d2ca60 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.154532 Aug 30 16:59:40.536294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3326/7060] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:40 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:41.557854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:41.558519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:41.565474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:41.565967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:41.566446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:41.567146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:41.567610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:41.568043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:41.697971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:41.705779 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fcf38953-e449-40ff-9137-7fc35f3fe827 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.152738 Aug 30 16:59:41.706361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3735/7061] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:41 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:42.728621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:42.729280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:42.736150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:42.736649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:42.737098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:42.737800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:42.738268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:42.738736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:42.871212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:42.878893 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5133b587-e5e1-41b0-9c09-fe6033dfe3f3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.154935 Aug 30 16:59:42.879501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3327/7062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:42 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:43.900534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:43.901152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:43.908050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:43.908547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:43.908966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:43.909651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:43.910109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:43.910567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:44.042262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:44.050072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1263d319-e4c5-4386-8c76-9b2994647ec6 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.153678 Aug 30 16:59:44.050681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3736/7063] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:43 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:45.072787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:45.073429 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:45.080342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:45.080843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:45.081295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:45.082034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:45.082537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:45.082979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:45.087002 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:45.212471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:45.220485 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0e9ef0c4-23f7-41be-8ca5-dd6210153410 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.152198 Aug 30 16:59:45.221062 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3328/7064] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:45 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:46.241043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:46.241661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:46.249394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:46.249888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:46.250365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:46.251093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:46.251553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:46.252001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:46.385992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:46.393774 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83704377-6c06-4c62-bb4e-1f7809b122aa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.156704 Aug 30 16:59:46.394373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3737/7065] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:46 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:47.415426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:47.416062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:47.422627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:47.423126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:47.423579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:47.424279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:47.424747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:47.425190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:47.557432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:47.566029 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-85a0ad5a-a2c9-44d8-80a0-4c6202e8102c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.154792 Aug 30 16:59:47.566655 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3329/7066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:47 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:48.588473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:48.589090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:48.596200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:48.596691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:48.597171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:48.597866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:48.598347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:48.598783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:48.732784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:48.740618 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c94b165e-5405-4450-b981-2475f11dfda7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.156350 Aug 30 16:59:48.741202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3738/7067] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:48 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:49.762608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:49.763194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:49.770134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:49.770683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:49.771133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:49.771825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:49.772290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:49.772726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:49.911127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:49.919591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee24f2c2-9db7-43f8-a8fc-84546a9e4844 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.161013 Aug 30 16:59:49.920179 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3330/7068] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:49 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:50.940908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:50.941583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:50.948832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:50.949314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:50.949750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:50.950470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:50.950929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:50.951355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:51.093492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:51.101433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f79b70ca-6fdc-4f60-a8a7-4afef48d7675 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.164326 Aug 30 16:59:51.102033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3739/7069] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:50 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:52.122789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:52.123417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:52.126113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=36 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:52.132292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:52.132786 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:52.133231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:52.133961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:52.135192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:52.135639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:52.269785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:52.277825 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f559849-8830-4e5c-bc5b-aeed09bfbdaa tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.159121 Aug 30 16:59:52.278437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3331/7070] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:52 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:53.299089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:53.299711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:53.302015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=32 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:53.307978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:53.308464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:53.308907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:53.309593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:53.310048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:53.310510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:53.313180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:59:53.441657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:53.449788 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86e1f0e1-9732-4afc-b2ed-7b3991f0fcad tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.154835 Aug 30 16:59:53.450374 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3740/7071] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:53 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:54.470995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:54.471603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:54.478583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:54.479075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:54.479522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:54.480213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:54.480675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:54.481111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:54.608964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:54.616608 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4b4420a6-3dd5-440d-9083-9d69af05d96c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.149583 Aug 30 16:59:54.617178 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3332/7072] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:54 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:55.640759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:55.641388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:55.648341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:55.648833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:55.649282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:55.650662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:55.651129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:55.651562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:55.785328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:55.794054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-67ce808c-1d43-42ef-b223-328154e5353c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1520 microversion: 2.1 time: 0.157264 Aug 30 16:59:55.794661 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3741/7073] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:55 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:56.676987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "name": "network-vif-unplugged", "status": "completed", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:56.688426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:56.688921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:56.689363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:56.702552 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Creating event network-vif-unplugged:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h1-830883-28 Aug 30 16:59:56.708095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:59:56.719256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2d376215-85a1-4f63-b1db-942e06c8a3e3 req-d3bdcca0-56d6-418f-b7ef-daead83cd02e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045980 Aug 30 16:59:56.719871 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3333/7074] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:59:56.817357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:56.818133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:56.825860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:56.826446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:56.826955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:56.827710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:56.828238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:56.828728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:56.969969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:56.978219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8e9fe2f-a908-4941-9760-eeb1596966af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1519 microversion: 2.1 time: 0.164705 Aug 30 16:59:56.979043 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3742/7075] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:56 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:58.000377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:58.001087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:58.007343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:58.007840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:58.008282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:58.009503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:58.010041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:58.010506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:58.142340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:58.150749 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cca96aa8-6f20-4a7b-bfd2-984d025a7f3a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1517 microversion: 2.1 time: 0.155504 Aug 30 16:59:58.151323 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3334/7076] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:57 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:59:58.739929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:59:58.751084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:58.751491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:58.751927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:58.763995 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Creating event network-changed:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h1-830883-28 Aug 30 16:59:58.769569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 16:59:58.780545 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-975ddbf9-1d4f-4ac7-bce9-ddb0700b127c req-58e0238e-de1e-4729-a58a-0c9beb7e6ec7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044304 Aug 30 16:59:58.781239 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3743/7077] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 16:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:59:59.173268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:59:59.174096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:59:59.181692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:59.182314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:59.182780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:59.183496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:59:59.183968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:59:59.184412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:59:59.466667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:59:59.474439 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdf84666-5e3b-4d46-a8bf-9fbd97858a33 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1517 microversion: 2.1 time: 0.305279 Aug 30 16:59:59.475050 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3335/7078] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 16:59:59 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:00.496983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:00.497681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:00.503937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.504425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.504862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:00.505546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.506001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.506467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:00.640247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:00.648069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9db219c8-19ac-4b4e-b689-7799ca2a9e59 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1514 microversion: 2.1 time: 0.156221 Aug 30 17:00:00.648650 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3744/7079] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:00 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:00.669913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:00.670538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:00.677962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.678581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.679412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:00.680576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.681662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.682140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:00.755380 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38579bd1-d63d-4897-9c22-7db212912a15 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e/action" status: 204 len: 0 microversion: 2.1 time: 0.089951 Aug 30 17:00:00.756279 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3336/7080] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:00:00 2022] POST /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:00:00.764596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:00.765503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:00.771925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.772429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.772877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:00.773644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:00.774098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:00.775060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:01.004786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:01.013962 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1417717a-31bf-4a4e-8a1d-048d24dce4bf tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1514 microversion: 2.1 time: 0.253212 Aug 30 17:00:01.014596 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3745/7081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:00 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:02.038078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:02.039029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:02.045730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:02.046334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:02.046883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:02.047584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:02.048046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:02.048501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:02.236940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:02.245308 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f49409d-bba6-4fd0-bf75-e3f4b7b61600 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1514 microversion: 2.1 time: 0.212357 Aug 30 17:00:02.245886 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3337/7082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:02 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:03.212674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "name": "network-vif-plugged", "status": "completed", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:03.223609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:03.224112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:03.224541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:03.237028 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] Creating event network-vif-plugged:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h1-830883-28 Aug 30 17:00:03.241928 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-bb7bb9a3-eaa8-4607-be03-21ab27102237 req-91c029f3-299a-4d67-a470-6a96e6525d17 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Aug 30 17:00:03.242580 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3746/7083] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:03.265219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:03.265929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:03.273790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:03.274314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:03.274833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:03.275534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:03.276183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:03.276623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:03.413288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:03.421632 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8e4550a1-40b0-4534-a696-358bc0e24d07 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1506 microversion: 2.1 time: 0.160408 Aug 30 17:00:03.422210 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3338/7084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:03 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:03.443924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:03.444716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:03.451124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:03.451608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:03.452045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:03.452728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:03.453184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:03.453610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:03.584295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:03.592802 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-83356e5b-4b22-425d-9f71-5c4c36ef6411 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1506 microversion: 2.1 time: 0.153123 Aug 30 17:00:03.593398 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3747/7085] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:03 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:00:03.616455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a20eac9-80b0-4aff-bbc8-55840c8b92bb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'create', calling method: .version_select at 0x7fd35cbced30>, body: {"keypair": {"name": "tempest-keypair-891009559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ8Kl1K1AC8wosBNxujoAoT89I4pXZfzO3ZZfhlieggoyOElFv5shsWZfGiuqxGjpnew16LJ6qnRs0gwOfnOyCNxM/LkH2Zh05ihigSZqRB+ki52xI9G6dedUIUGUZrZA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:03.631825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3a20eac9-80b0-4aff-bbc8-55840c8b92bb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for project ef7e593fa3324de9a3925596454ff888. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:00:03.636968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3a20eac9-80b0-4aff-bbc8-55840c8b92bb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for user b11d98ff1e9e4d32913fec042f6c4489 and project ef7e593fa3324de9a3925596454ff888. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:00:03.664696 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a20eac9-80b0-4aff-bbc8-55840c8b92bb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052168 Aug 30 17:00:03.666037 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3339/7086] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:00:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:04.856145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:04.856759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:04.863742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:04.864223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:04.864657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:04.865340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:04.865799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:04.866225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:04.996276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:05.004012 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-445e48f3-7e55-4173-8e4a-6a370aa5a1ac tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 200 len: 1506 microversion: 2.1 time: 0.152401 Aug 30 17:00:05.004591 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3748/7087] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:04 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:05.026435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:05.026956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:05.033611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:05.034110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:05.034598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:05.035306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:05.035776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:05.036222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:05.061892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:00:05.136935 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-99d2df0d-e926-42ca-af86-4e833fe3cf1c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 204 len: 0 microversion: 2.1 time: 0.116100 Aug 30 17:00:05.137795 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3340/7088] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:00:05 2022] DELETE /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:00:05.197544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1865432049", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "f2493f56-05a3-45d1-9710-c91164da1c85"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:05.251598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] validate_networks() for [('f2493f56-05a3-45d1-9710-c91164da1c85', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:00:05.668488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:00:05.668945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:00:05.669457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:00:05.669868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:00:05.670282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:00:05.679131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:05.679613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:05.680050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:05.681644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:05.682112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:05.682573 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:05.699773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for project ef7e593fa3324de9a3925596454ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:00:05.705024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Getting quotas for user b11d98ff1e9e4d32913fec042f6c4489 and project ef7e593fa3324de9a3925596454ff888. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:00:05.717437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:00:05.719775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:00:05.764297 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ca94138-6b4b-42b8-8878-8bbb584e86dc tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571603 Aug 30 17:00:05.764871 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3749/7089] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:00:05.776317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc593789-e921-4daa-a410-73cec5c9f3a7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:05.777037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc593789-e921-4daa-a410-73cec5c9f3a7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:05.831762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cc593789-e921-4daa-a410-73cec5c9f3a7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:05.839422 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc593789-e921-4daa-a410-73cec5c9f3a7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1218 microversion: 2.1 time: 0.067496 Aug 30 17:00:05.840010 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3341/7090] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:05 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:06.860961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:06.861779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:06.871330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:06.872043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:06.872668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:06.873730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:06.874546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:06.875224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:06.939381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:06.948271 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d97d52f0-8ffb-41b2-bc52-59ae20fb2889 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1270 microversion: 2.1 time: 0.092248 Aug 30 17:00:06.948856 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3750/7091] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:06 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:07.042101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c27a957-c0cf-4597-aed3-bd13f0dd8e6e", "name": "network-vif-deleted", "tag": "b210792a-7082-4402-8b2c-68f8512e0807"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:07.055006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:07.055777 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:07.056810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:07.069085 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] Creating event network-vif-deleted:b210792a-7082-4402-8b2c-68f8512e0807 for instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e on n-h1-830883-28 Aug 30 17:00:07.074866 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-b3a897a0-fec1-40a4-90e0-9daaf3be99b4 req-3947b8a6-13c6-4c51-b4f0-466390c317ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038673 Aug 30 17:00:07.075490 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3342/7092] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:07.969415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:07.970114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:07.977158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:07.978361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:07.979108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:07.980004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:07.980468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:07.981053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:08.129751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:08.138739 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a2c3a04b-e253-4c30-9eae-5afd045ee15d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.173095 Aug 30 17:00:08.139654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3751/7093] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:07 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:09.090920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:09.100430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:09.100924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:09.101372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:09.113224 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] Creating event network-changed:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h1-830883-28 Aug 30 17:00:09.118012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-38a3d961-247c-40a2-b122-626f60b141db req-2f0a06c4-2497-4e5f-8a7f-78e7ec84d49a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032150 Aug 30 17:00:09.119374 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3343/7094] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:00:09.160217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:09.160880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:09.169003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:09.169490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:09.169932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:09.170668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:09.171129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:09.171558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:09.299352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:09.307970 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-510b4dcf-3e89-44c0-9d3c-53da078bcfbd tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.151577 Aug 30 17:00:09.308542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3752/7095] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:09 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:10.330029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:10.330670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:10.337536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:10.338043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:10.338602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:10.339417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:10.339793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:10.340236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:10.475230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:10.483903 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a63c9d95-5df0-4e13-8629-577eff0ff772 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.159099 Aug 30 17:00:10.484489 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3344/7096] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:10 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:11.506170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:11.507404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:11.519059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:11.519554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:11.519996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:11.520697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:11.521154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:11.521579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:11.663380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:11.671786 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0efd8db8-7db7-4d15-a6b6-ee4bec860088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.170732 Aug 30 17:00:11.672356 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3753/7097] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:11 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:12.692676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:12.693331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:12.701068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:12.701562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:12.702009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:12.702751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:12.703210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:12.703642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:12.837354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:12.839697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:12.846673 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d4c6ba6d-887f-4c26-9c4b-49e2991b5c5a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.157828 Aug 30 17:00:12.847254 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3345/7098] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:12 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:13.868094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:13.868615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:13.875514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:13.875991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:13.876427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:13.877110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:13.877561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:13.877983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:14.010647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:14.018380 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-53bae45f-dcab-4770-9c39-6f2352114ae7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.154318 Aug 30 17:00:14.018951 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3754/7099] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:13 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:15.039690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:15.041320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:15.049243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:15.049749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:15.050202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:15.050924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:15.051394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:15.051831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:15.187522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:15.195379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac38b33c-af10-403b-86d8-7ef58066389b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.160026 Aug 30 17:00:15.197400 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3346/7100] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:15 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:15.254648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "name": "network-vif-plugged", "status": "completed", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:15.265928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:15.266525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:15.266974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:15.278985 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] Creating event network-vif-plugged:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h1-830883-28 Aug 30 17:00:15.284474 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-96ba0bbc-d1cb-4b64-b167-df499788af2d req-ec1e3718-c72e-40c5-905c-5fc7fde848cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Aug 30 17:00:15.285164 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3755/7101] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:16.229521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:16.230155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:16.232205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:16.238147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:16.238673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:16.239127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:16.239829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:16.240299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:16.240743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:16.374964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:16.382759 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4af64a3f-1156-492e-bed1-0e18c448c69a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1318 microversion: 2.1 time: 0.157574 Aug 30 17:00:16.383333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3347/7102] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:16 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:17.401982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:17.402785 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:17.408306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:17.409009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:17.416046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.416525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.416959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.417634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.418091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.418545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.550365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:17.558598 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a760b85c-48ff-4aa2-9369-b0ef347ba671 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1507 microversion: 2.1 time: 0.157509 Aug 30 17:00:17.559166 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3756/7103] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:17 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:17.579398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:17.580033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:17.587732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.588550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.589009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.589816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.590187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.590711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.719234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:17.726942 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96bfee00-61bb-4c90-9277-6df4d9c505ba tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1507 microversion: 2.1 time: 0.151404 Aug 30 17:00:17.727521 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3348/7104] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:17 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:00:17.747681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:17.749973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:17.756035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.756529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.756975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.757670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.758132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.758608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.786736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:17.792598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:00:17.799031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:00:17.799465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:00:17.799949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:00:17.800369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:00:17.800793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:00:17.851515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:17.866639 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b50f7dd5-fe5e-442c-8782-8f5c9edc60af tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0/action" status: 202 len: 0 microversion: 2.1 time: 0.123576 Aug 30 17:00:17.867261 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3757/7105] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:00:17 2022] POST /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:00:17.876024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:17.876686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:17.882724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.883422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.883884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:17.885769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:17.886246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:17.886746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:18.047947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:18.058786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-820069fe-e618-4112-ad12-e0412af6ae3b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1514 microversion: 2.1 time: 0.184023 Aug 30 17:00:18.059392 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3349/7106] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:17 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:00:19.081778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:19.083163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:19.090439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:19.091034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:19.091381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:19.092122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:19.092582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:19.093018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:19.237689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:19.246223 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-554ebdb8-b425-4550-bd33-f2bb62dd0866 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1514 microversion: 2.1 time: 0.170487 Aug 30 17:00:19.246896 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3758/7107] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:19 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:20.268452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:20.269089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:20.276854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:20.277347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:20.277813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:20.278611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:20.279073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:20.279509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:20.412610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:20.420428 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ab4cac7-c04b-446e-aecd-11fbb219440e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.156003 Aug 30 17:00:20.421006 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3350/7108] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:20 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:21.441682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:21.442325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:21.449837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:21.450342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:21.450788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:21.451479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:21.451940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:21.452372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:21.581040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:21.588990 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-78a9538f-7a94-4d92-9d67-206b81ad1d92 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.151199 Aug 30 17:00:21.589568 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3759/7109] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:21 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:22.610073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:22.610670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:22.613494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:22.619990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:22.620492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:22.620971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:22.621669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:22.622142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:22.622620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:22.761116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:22.769035 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c93b269e-af17-4aa0-8e2f-c1ec0a563e06 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.162976 Aug 30 17:00:22.769617 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3351/7110] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:22 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:23.791856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:23.792436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:23.794795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:23.800301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:23.800784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:23.801223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:23.801905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:23.802383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:23.802806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:23.936466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:23.944266 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a74604f5-5586-4cba-b6fc-089adddb18d1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.157552 Aug 30 17:00:23.944837 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3760/7111] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:23 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:24.965455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:24.966092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:24.973020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:24.973521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:24.973973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:24.974709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:24.975184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:24.975632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:25.105261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:25.112955 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf0a1b57-9c74-4a94-a10a-dc002bef36c1 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.151460 Aug 30 17:00:25.113522 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3352/7112] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:24 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:26.135020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:26.135644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:26.138123 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:00:26.138275 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 (ip 10.222.0.47) !!! Aug 30 17:00:26.146697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:26.147121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:26.147555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:26.148276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:26.148728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:26.149153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:26.283281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:26.291744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fa34e3a8-710f-4076-b882-0d2fe6672aab tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.161206 Aug 30 17:00:26.292312 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3761/7113] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:26 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:27.312562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:27.313211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:27.320732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:27.321732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:27.322188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:27.322905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:27.323372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:27.323810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:27.458024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:27.466975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3ae5a46f-7e71-4f03-aa8f-7db864b89a1b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.158390 Aug 30 17:00:27.467544 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3353/7114] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:27 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:28.489584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:28.490205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:28.498182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:28.498701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:28.499147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:28.499840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:28.500300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:28.500770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:28.630968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:28.639164 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9dd6f97d-41b6-43b9-8c84-be8805e6a942 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.153544 Aug 30 17:00:28.639745 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3762/7115] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:28 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:29.660170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:29.660801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:29.667729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:29.668230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:29.668688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:29.669391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:29.669860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:29.670324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:29.799684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:29.808733 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ec98367-1d51-4257-a205-581b6dab4109 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.152490 Aug 30 17:00:29.809309 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3354/7116] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:29 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:30.830419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:30.831039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:30.838432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:30.838922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:30.839362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:30.840053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:30.840509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:30.840936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:30.975208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:30.982968 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-035911a5-ff9e-46bf-9f3b-f842ad362177 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.156413 Aug 30 17:00:30.983540 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3763/7117] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:30 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:32.003932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:32.004567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:32.012682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:32.013179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:32.013631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:32.014356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:32.014828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:32.015269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:32.143024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:32.151212 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2bc83a33-e573-48c4-84e9-a54b8254fa5f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.151227 Aug 30 17:00:32.151791 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3355/7118] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:31 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:33.172296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:33.172947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:33.179721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:33.180204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:33.180645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:33.181880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:33.182365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:33.182793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:33.311808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:33.319650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b1f9e49-f3d9-42bc-861b-1d7f8af9cdb0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.151250 Aug 30 17:00:33.320227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3764/7119] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:33 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:34.341639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:34.342413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:34.351385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:34.351882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:34.352358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:34.353659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:34.354260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:34.354730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:34.488699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:34.496981 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-62e25148-800c-4625-b363-a15bb6c99ced tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.159867 Aug 30 17:00:34.497552 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3356/7120] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:34 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:35.518843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:35.519489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:35.526469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:35.526953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:35.527393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:35.528854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:35.529469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:35.529899 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:35.661527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:35.669925 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-707dff07-1287-45a1-b2b9-d284737c3c26 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.155045 Aug 30 17:00:35.670536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3765/7121] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:35 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:36.691350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:36.692038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:36.698962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:36.699461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:36.700433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:36.701323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:36.701795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:36.702236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:36.835993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:36.844966 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13a47bde-863b-4149-9a2f-3c1542744642 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.157547 Aug 30 17:00:36.845555 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3357/7122] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:36 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:37.866250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:37.866821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:37.873687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:37.874165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:37.874631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:37.875342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:37.875794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:37.876218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:38.004775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:38.012617 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-12bb4b56-2d54-4280-9710-0e44589ceaed tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.150361 Aug 30 17:00:38.013310 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3766/7123] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:37 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:39.033693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:39.034346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:39.041213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:39.041705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:39.042157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:39.042889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:39.043349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:39.044445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:39.172194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:39.179988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-de8541ab-4c88-4b4c-b93c-af49ace6373b tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.150228 Aug 30 17:00:39.180559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3358/7124] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:39 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:40.203364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:40.203986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:40.211092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:40.211571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:40.212003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:40.212690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:40.213179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:40.213606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:40.343925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:40.351711 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9d8590e-2744-4187-8c88-ec9866e575e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.153353 Aug 30 17:00:40.352292 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3767/7125] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:40 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:41.373972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:41.374632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:41.381529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:41.382027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:41.382511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:41.383211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:41.383679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:41.384119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:41.516492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:41.524307 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d06a5134-18bd-4c6a-9053-0af86884ffee tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.155452 Aug 30 17:00:41.524883 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3359/7126] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:41 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:42.546018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:42.546655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:42.553491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:42.553975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:42.554455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:42.555146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:42.555606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:42.556286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:42.690369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:42.698251 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f4299286-4bc4-42ba-a18c-71c478db27eb tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.157027 Aug 30 17:00:42.698942 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3768/7127] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:42 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:43.719939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:43.720566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:43.727457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:43.727948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:43.728395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:43.729087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:43.729553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:43.729984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:43.858889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:43.866567 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f129a936-7665-4935-bf5c-8d2222a0173f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.150542 Aug 30 17:00:43.867135 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3360/7128] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:43 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:44.888025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:44.888776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:44.895632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:44.896115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:44.896553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:44.897237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:44.897690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:44.898112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:45.030168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:45.038055 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88b682f5-0cc8-4b0e-9e5e-acf4f7b22a6c tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.154490 Aug 30 17:00:45.038677 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3769/7129] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:44 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:46.059690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:46.060880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:46.068593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:46.069086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:46.069534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:46.070226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:46.070718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:46.071160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:46.075047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=92 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:46.204336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:46.211988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3842479c-9359-427f-a546-ea20533927e9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1519 microversion: 2.1 time: 0.156484 Aug 30 17:00:46.212551 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3361/7130] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:46 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:00:47.233355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:47.233971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:47.241298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:47.241790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:47.242226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:47.242953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:47.243413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:47.243869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:47.390075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:47.398337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-350b1763-65ae-4230-83a4-16e73a46f33e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1518 microversion: 2.1 time: 0.168941 Aug 30 17:00:47.398926 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3770/7131] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:47 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:00:47.679876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "name": "network-vif-unplugged", "status": "completed", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:47.690952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:47.691605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:47.692042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:47.704190 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Creating event network-vif-unplugged:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h2-830883-28 Aug 30 17:00:47.709901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:00:47.722611 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-237f9cdf-ec4a-4574-8cee-ce8343731c35 req-278693e7-5f19-4050-a170-b50dd3049c2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046438 Aug 30 17:00:47.723299 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3362/7132] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:48.420978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:48.422159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:48.429271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:48.429758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:48.430201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:48.430932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:48.431930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:48.432520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:48.570043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:48.578134 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b91a3644-01a0-4734-aa3c-b917cb9ac627 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1518 microversion: 2.1 time: 0.161452 Aug 30 17:00:48.578754 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3771/7133] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:48 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:49.600520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:49.601240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:49.607594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:49.608099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:49.609206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:49.610539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:49.611018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:49.611462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:49.753613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:49.754279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:49.762449 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-884fabcc-5ee1-4178-809d-7d39cb8b7340 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1516 microversion: 2.1 time: 0.167117 Aug 30 17:00:49.763043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3363/7134] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:49 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:49.763556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:49.764036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:49.764474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:49.768533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=85 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:49.776923 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Creating event network-changed:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h2-830883-28 Aug 30 17:00:49.783602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:00:49.794067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-8661a6cc-3e81-4b4e-9ccb-543864d9fcfa req-c8be190a-8079-4016-b272-9c103f0d8979 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044733 Aug 30 17:00:49.794762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3772/7135] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:00:50.784162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:50.784787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:50.791650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:50.792154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:50.792640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:50.793375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:50.793843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:50.794285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:50.928365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:50.936478 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fd253b04-04e0-46f3-a2db-cc9c927a363d tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1516 microversion: 2.1 time: 0.156892 Aug 30 17:00:50.937698 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3364/7136] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:50 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:51.960385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:51.961103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:51.967421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:51.968583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:51.969042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:51.969754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:51.970219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:51.970709 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:52.113495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:52.121362 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e09c755b-792b-4ac9-8b3f-682e962f3b3f tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1513 microversion: 2.1 time: 0.166265 Aug 30 17:00:52.121953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3773/7137] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:51 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:52.142621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:52.143157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:52.150062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:52.150596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:52.151040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:52.151735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:52.152195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:52.152625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:52.214182 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-238a413c-3314-4ceb-b6ed-de011160d0c3 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "POST /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0/action" status: 204 len: 0 microversion: 2.1 time: 0.075154 Aug 30 17:00:52.215114 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3365/7138] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:00:52 2022] POST /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:00:52.229047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:52.229732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:52.236430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:52.236921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:52.237361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:52.238059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:52.238549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:52.238969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:52.373149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:52.381679 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e6ac3cc-78ed-4302-95e1-fe7ecd76c1d7 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1513 microversion: 2.1 time: 0.161498 Aug 30 17:00:52.382661 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3774/7139] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:52 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:53.193409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "name": "network-vif-plugged", "status": "completed", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:53.199898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:53.209341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:53.209996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:53.210564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:53.224630 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Creating event network-vif-plugged:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h2-830883-28 Aug 30 17:00:53.230701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:00:53.244499 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-68d46ffa-a127-4fcd-88c4-486229559f7e req-e4b178a0-c9d5-400b-8a5f-0418db372902 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057142 Aug 30 17:00:53.245200 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3366/7140] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:53.404876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:53.405503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:53.412748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:53.413236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:53.413697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:53.414414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:53.414881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:53.415313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:53.546986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:53.555632 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0593391-0d6d-42dd-94bc-87cb022e319e tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1513 microversion: 2.1 time: 0.153770 Aug 30 17:00:53.556518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3775/7141] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:53 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:54.584961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:54.586180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:54.593374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.594042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.594530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:54.595225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.595690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.596121 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:54.727814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:54.736247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09805ded-9861-4585-9df9-09498a1c3805 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1505 microversion: 2.1 time: 0.157944 Aug 30 17:00:54.736823 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3367/7142] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:54 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:54.756718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:54.757347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:54.760179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=32 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:00:54.765784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.766274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.766754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:54.767451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.767943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.768382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:54.905048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:54.913448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0abedd76-4965-402d-8e45-6b5beede6024 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1505 microversion: 2.1 time: 0.160539 Aug 30 17:00:54.914029 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3776/7143] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:54 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:54.933729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:54.934431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:54.940954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.941449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.941931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:54.942667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:54.943136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:54.943609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.080851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:55.088602 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-988be09c-e096-42c4-b843-581b0c844a46 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1505 microversion: 2.1 time: 0.159063 Aug 30 17:00:55.089171 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3368/7144] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:54 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:55.108380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:55.108966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:55.114918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.115395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.115831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.116511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.116965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.117386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.142737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:00:55.221021 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f276451e-e18d-4069-82f9-80c53a8d7c05 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 204 len: 0 microversion: 2.1 time: 0.116223 Aug 30 17:00:55.221656 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3777/7145] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:00:55 2022] DELETE /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:00:55.239771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:55.240290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:55.246341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.246839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.247294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.247996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.248466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.248913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.275189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:00:55.319535 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.compute.api [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Instance is already in deleting state, ignoring this request Aug 30 17:00:55.320379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1c5064bd-0fa4-497f-a728-89f5faf93088 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 204 len: 0 microversion: 2.1 time: 0.084720 Aug 30 17:00:55.320948 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3369/7146] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:00:55 2022] DELETE /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:00:55.330070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:55.330804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:55.336834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.337322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.337758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.338481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:55.338943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:55.339374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:55.475211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:55.483030 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b73e343b-0c19-4fb4-b3fa-3329cd07af32 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1511 microversion: 2.1 time: 0.157781 Aug 30 17:00:55.483613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3778/7147] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:55 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:56.504542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:56.505094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:56.512393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:56.512885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:56.513338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:56.514033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:56.515333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:56.516130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:56.646176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b11d98ff1e9e4d32913fec042f6c4489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7e593fa3324de9a3925596454ff888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:00:56.654001 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecea5af5-c89d-4839-9bed-97e1a604c30a tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 200 len: 1511 microversion: 2.1 time: 0.153503 Aug 30 17:00:56.654610 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3370/7148] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:56 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:00:57.231518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03bda89e-1301-47ae-8ac4-f40054688bf0", "name": "network-vif-deleted", "tag": "94060ebf-a450-4141-b342-5b3c3171a6c3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:00:57.243107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:57.243585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:57.244013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:57.256135 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] Creating event network-vif-deleted:94060ebf-a450-4141-b342-5b3c3171a6c3 for instance 03bda89e-1301-47ae-8ac4-f40054688bf0 on n-h2-830883-28 Aug 30 17:00:57.261173 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-454c6251-933a-4246-9584-1d1b983b726b req-a89f96f7-b8eb-4a6a-95d0-8516bafba812 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034026 Aug 30 17:00:57.261778 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3779/7149] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:00:57.675135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:57.675802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 03bda89e-1301-47ae-8ac4-f40054688bf0] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:57.683023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:57.683526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:57.683983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:57.684693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:57.685167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:57.685615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:57.699125 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] HTTP exception thrown: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Request method failure captured: Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 HTTP/1.1 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkHi3cEw2FVDj9nJdxuIMhY5fDOOPXuAPV_56UthceQKKDz-R3nwWp2iGGTCtdCUD1vSG_gC7sNnIZpp5aNr2QjrNjjA9ITyln1xd-zZaMgbb6rjSUAXK1-bid2hTfHjsJiXA4OGgQ8s5EIs6WDyePr-Cj4RThTpP3hNcXJ8w8MEGVI Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}] Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b11d98ff1e9e4d32913fec042f6c4489 Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '03bda89e-1301-47ae-8ac4-f40054688bf0'} Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:57.700802 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Returning 404 to user: Instance 03bda89e-1301-47ae-8ac4-f40054688bf0 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-526e25a0-673b-486e-bb65-ca572d0ef0d0 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0" status: 404 len: 111 microversion: 2.1 time: 0.031278 Aug 30 17:00:57.705991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3371/7150] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:57 2022] GET /compute/v2.1/servers/03bda89e-1301-47ae-8ac4-f40054688bf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:00:57.712187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79a6e04a-85b7-4736-a29a-8e14689fd219 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '.version_select at 0x7fd357729ee0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:57.736399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79a6e04a-85b7-4736-a29a-8e14689fd219 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891009559" status: 202 len: 0 microversion: 2.1 time: 0.028276 Aug 30 17:00:57.736981 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3780/7151] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 17:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891009559 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:00:58.362379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:58.362887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:58.368905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:58.369402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:58.369851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:58.370640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:58.371106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:58.371545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:58.388090 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] HTTP exception thrown: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Request method failure captured: Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e HTTP/1.1 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkHi3cEw2FVDj9nJdxuIMhY5fDOOPXuAPV_56UthceQKKDz-R3nwWp2iGGTCtdCUD1vSG_gC7sNnIZpp5aNr2QjrNjjA9ITyln1xd-zZaMgbb6rjSUAXK1-bid2hTfHjsJiXA4OGgQ8s5EIs6WDyePr-Cj4RThTpP3hNcXJ8w8MEGVI Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}] Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: b11d98ff1e9e4d32913fec042f6c4489 Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5c27a957-c0cf-4597-aed3-bd13f0dd8e6e'} Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:00:58.390263 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Returning 404 to user: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5a7bffa0-3460-4cf5-8928-40fd4a3c7a42 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 404 len: 111 microversion: 2.1 time: 0.033626 Aug 30 17:00:58.394406 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3372/7152] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:00:58 2022] DELETE /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:00:58.401022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:00:58.401753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] [instance: 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:00:58.408623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:58.409100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:58.409536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:58.410215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:00:58.410706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:00:58.411131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:00:58.424773 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] HTTP exception thrown: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Request method failure captured: Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e HTTP/1.1 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkHi3cEw2FVDj9nJdxuIMhY5fDOOPXuAPV_56UthceQKKDz-R3nwWp2iGGTCtdCUD1vSG_gC7sNnIZpp5aNr2QjrNjjA9ITyln1xd-zZaMgbb6rjSUAXK1-bid2hTfHjsJiXA4OGgQ8s5EIs6WDyePr-Cj4RThTpP3hNcXJ8w8MEGVI Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ef7e593fa3324de9a3925596454ff888"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ef7e593fa3324de9a3925596454ff888"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ef7e593fa3324de9a3925596454ff888"}]}] Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: ef7e593fa3324de9a3925596454ff888 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1155203570 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: b11d98ff1e9e4d32913fec042f6c4489 Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerDiskConfigTestJSON-1155203570-project Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '5c27a957-c0cf-4597-aed3-bd13f0dd8e6e'} Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:00:58.426406 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] Returning 404 to user: Instance 5c27a957-c0cf-4597-aed3-bd13f0dd8e6e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3d460eb5-fb62-4dac-9bb9-cd23ef4059b9 tempest-ServerDiskConfigTestJSON-1155203570 tempest-ServerDiskConfigTestJSON-1155203570-project] 10.222.0.47 "GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e" status: 404 len: 111 microversion: 2.1 time: 0.031443 Aug 30 17:00:58.430752 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3781/7153] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:00:58 2022] GET /compute/v2.1/servers/5c27a957-c0cf-4597-aed3-bd13f0dd8e6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:01:07.353805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ccab7e1-e935-44d7-86fc-965b24949174 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: .version_select at 0x7fd35caf04c0>, body: {"keypair": {"name": "tempest-keypair-979526234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1QPG5m9CDWg316hIMt5jtDxtloJnzdrNd624o2HUI+EwZf+ETUm2/cogzYzQqpVzGIPLg3LdByydRULO1Qj1wGf+CwIZ8Jexxa7Hm+POPxiG8UT/yJSv+c11SoqSiT/A=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:01:07.370561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6ccab7e1-e935-44d7-86fc-965b24949174 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:01:07.376022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6ccab7e1-e935-44d7-86fc-965b24949174 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:01:07.402646 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ccab7e1-e935-44d7-86fc-965b24949174 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187149 Aug 30 17:01:07.410212 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3373/7154] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:01:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:01:08.719427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1180254214", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1958b40-f05d-48b7-85bd-41b85b3cd243"}], "security_groups": [{"name": "tempest-securitygroup--785179794"}], "key_name": "tempest-keypair-979526234", "user_data": "}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:01:08.729211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:08.730064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:08.844222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] validate_networks() for [('c1958b40-f05d-48b7-85bd-41b85b3cd243', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:01:09.234475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:01:09.234938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:01:09.235568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:01:09.236023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:01:09.236437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:01:09.246323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:09.247156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:09.247600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:09.248326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:09.249319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:09.249752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:09.267226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:01:09.272783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:01:09.286623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:01:09.288958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:01:09.337467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e0f923e-3557-48b8-8f0a-ab5354f1a630 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.623445 Aug 30 17:01:09.338366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3782/7155] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:01:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:01:09.349252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53b8ecc4-2465-4017-af2c-270fc00fa83e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:09.349964 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53b8ecc4-2465-4017-af2c-270fc00fa83e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:09.353848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:09.418601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-53b8ecc4-2465-4017-af2c-270fc00fa83e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:09.426849 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53b8ecc4-2465-4017-af2c-270fc00fa83e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1238 microversion: 2.1 time: 0.081456 Aug 30 17:01:09.427641 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3374/7156] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:09 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:10.449333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:10.450512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:10.459208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:10.459706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:10.460147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:10.460925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:10.461382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:10.461844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:10.543551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:10.556515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e85cbd7-a47a-407e-9bb8-109b98f98335 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1298 microversion: 2.1 time: 0.110782 Aug 30 17:01:10.559361 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3783/7157] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:10 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:11.583757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:11.585085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:11.595736 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:11.596474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:11.597092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:11.597988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:11.601661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:11.602485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:11.810834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:11.821133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-855feea8-84fa-4e8e-a0c8-3862df18a278 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.244978 Aug 30 17:01:11.821730 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3375/7158] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:11 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:11.997198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:01:12.009082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:12.009676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:12.010343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:12.025230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] Creating event network-changed:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h2-830883-28 Aug 30 17:01:12.031103 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-51737e77-055a-487e-bc83-db2a3318cae2 req-ba0f47be-35c4-40c5-9d35-99cb8bc9c57a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037000 Aug 30 17:01:12.031991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3784/7159] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:01:12.843272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:12.843894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:12.850857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:12.851352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:12.851794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:12.852486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:12.852946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:12.853380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:12.995743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:13.004223 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d2cd634b-987f-49b8-92d5-e05d0e85dff4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.164889 Aug 30 17:01:13.004788 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3376/7160] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:12 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:14.025712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:14.026454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:14.033648 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:14.034136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:14.034600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:14.035289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:14.035745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:14.036175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:14.165507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:14.174115 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-da4fae1e-422f-48f4-b7ea-d632d332c244 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.153428 Aug 30 17:01:14.174727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3785/7161] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:14 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:15.196073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:15.196714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:15.203869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:15.204571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:15.204817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:15.205527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:15.206003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:15.206476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:15.344085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:15.351764 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7b5e42d2-aa45-47b6-a492-8ae326dce43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.159703 Aug 30 17:01:15.352340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3377/7162] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:15 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:16.373452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:16.375264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:16.382111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:16.382640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:16.383086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:16.383775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:16.384259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:16.384723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:16.517944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:16.525745 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dd600504-fc0a-452e-8253-966ee1480a46 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.156154 Aug 30 17:01:16.526336 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3786/7163] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:16 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:17.238864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "name": "network-vif-plugged", "status": "completed", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:01:17.249903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:17.250647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:17.251105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:17.262406 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] Creating event network-vif-plugged:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h2-830883-28 Aug 30 17:01:17.267926 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-156b07bd-c27a-49a2-b54c-e5aa6b2aeb08 req-5212a110-e6d1-4b8b-b3f0-cebe5a392e96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Aug 30 17:01:17.268520 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3378/7164] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:01:17.546891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:17.547549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:17.555540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:17.556300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:17.556753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:17.557458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:17.557927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:17.558477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:17.689102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:17.696769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fccf8293-ce43-4091-a496-e430d8dea011 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.153871 Aug 30 17:01:17.697337 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3787/7165] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:17 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:18.719143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:18.719894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:18.726224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:18.726706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:18.727160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:18.727873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:18.728348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:18.728825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:18.865130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:18.873560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd0bf458-0de9-4f51-bb2a-9a0045bd5bfe tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1363 microversion: 2.1 time: 0.160208 Aug 30 17:01:18.874790 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3379/7166] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:18 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:19.895167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:19.895792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:19.898804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:19.899508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:19.905862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:19.906378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:19.906826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:19.907534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:19.907996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:19.908430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:20.042369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:01:20.050944 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1e97b426-2f4d-4ba9-8865-7505381d516c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1549 microversion: 2.1 time: 0.159654 Aug 30 17:01:20.051519 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3788/7167] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:01:19 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:01:20.071734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:01:20.072235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:01:20.074387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:01:20.080928 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:20.081424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:20.081874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:20.082632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:20.083104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:20.083555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:20.163659 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ed005d0-2c6e-423b-b106-3a96be7d6536 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095707 Aug 30 17:01:20.164266 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3380/7168] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:01:20 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:01:21.380611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:01:21.391557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:01:21.392046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:01:21.392488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:01:21.403391 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] Creating event network-changed:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h2-830883-28 Aug 30 17:01:21.409042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6da006eb-81a3-4835-8875-621d9b837d25 req-5106e730-a493-483e-9ad6-2104ea55a597 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Aug 30 17:01:21.410071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3789/7169] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:02:36.700051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:02:36.700872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:02:36.702263 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:02:36.702545 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f (ip 10.222.0.47) !!! Aug 30 17:02:36.709573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:36.710200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:36.723739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:36.724239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:36.724690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:36.725395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:36.725865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:36.726324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.073410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:37.081766 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8ccdff4-9a1d-4ed5-a739-ab2a1f10094b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.384444 Aug 30 17:02:37.082366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3381/7170] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:36 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:37.100195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:02:37.100948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:02:37.105869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:37.106606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:37.114382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.114872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.115311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.115995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.116449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.116878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.366865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:37.374569 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf2dcc39-fd60-40a5-80db-5f74300526c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.276623 Aug 30 17:02:37.375371 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3790/7171] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:37 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:37.394872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:37.395494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:37.401464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.401954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.402441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.403138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.403605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.404038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.531645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:37.539618 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa69d25c-eea3-409a-b89a-81cd154cb9b6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.149125 Aug 30 17:02:37.540196 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3382/7172] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:37 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:37.560699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:02:37.563560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:37.569650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.570146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.570690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.571392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.572187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.572932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.604219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:37.610541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:02:37.616973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:02:37.617397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:02:37.617869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:02:37.618278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:02:37.618711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:02:37.680676 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d886d0bd-a060-4d5e-9bb6-6674dbe6ebf4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/action" status: 202 len: 0 microversion: 2.1 time: 0.123562 Aug 30 17:02:37.681535 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3791/7173] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:02:37 2022] POST /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:02:37.690047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:37.690724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:37.697155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.697306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.697718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.698469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:37.699182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:37.699739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:37.858244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:37.866105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-33e03c64-10bc-4eee-b268-5c0b53bf0266 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1677 microversion: 2.1 time: 0.180399 Aug 30 17:02:37.866723 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3383/7174] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:37 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:38.889729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:38.890420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:38.897450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:38.898020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:38.898507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:38.899201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:38.899661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:38.900088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:39.037156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:39.044888 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fdee27b0-6640-41ac-bbeb-6b939e46bd82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1677 microversion: 2.1 time: 0.160172 Aug 30 17:02:39.045471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3792/7175] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:38 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:40.068255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:40.068895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:40.075859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:40.076362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:40.076819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:40.077524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:40.077994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:40.079253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:40.212221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:40.220437 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3fbd7d11-5a0b-436c-a741-87ddeee98198 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.156219 Aug 30 17:02:40.221014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3384/7176] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:40 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:41.241722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:41.242364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:41.249339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:41.249822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:41.252071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:41.252819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:41.253283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:41.253714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:41.388966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:41.397545 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1b19a31-d866-475f-a8f8-9e4bba33671f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.159595 Aug 30 17:02:41.398132 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3793/7177] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:41 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:42.419367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:42.420051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:42.427016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:42.427505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:42.427959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:42.428656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:42.429134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:42.429575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:42.559179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:42.567595 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3d8f4a9d-c6a5-42b3-b2b7-c3ece982c799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.152136 Aug 30 17:02:42.568167 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3385/7178] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:42 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:43.588076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:43.588695 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:43.596157 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:43.596642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:43.597098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:43.597771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:43.598214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:43.598666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:43.730624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:43.739148 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-783a8232-1b3d-4798-bc0a-95ffbb54dc7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.154927 Aug 30 17:02:43.739726 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3794/7179] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:43 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:44.760903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:44.761539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:44.769099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:44.769605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:44.770063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:44.770801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:44.771280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:44.771723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:44.905860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:44.914082 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c845ee0-bded-4a55-a001-f96cbbced91a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.157135 Aug 30 17:02:44.914691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3386/7180] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:44 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:45.935836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:45.936460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:45.943511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:45.944031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:45.944473 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:45.945166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:45.945626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:45.946057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:46.081530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:46.089300 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4736ea49-c4db-4b97-9eff-f4e3085d97e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.157399 Aug 30 17:02:46.089872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3795/7181] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:45 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:47.111444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:47.112070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:47.118759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:47.119253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:47.119701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:47.120399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:47.120861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:47.121296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:47.257716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:47.265476 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7448d63e-c7b0-4118-bf53-bdca20cef0d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.158944 Aug 30 17:02:47.266531 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3387/7182] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:47 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:02:48.287651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:48.288272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:48.295806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:48.296331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:48.297646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:48.298697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:48.299160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:48.299593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:48.433479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:48.441452 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0d675ce-1334-4e8d-ade2-8cfb5691b6a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.157891 Aug 30 17:02:48.442079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3796/7183] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:48 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:49.463341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:49.463929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:49.471582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:49.472080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:49.472533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:49.473234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:49.473701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:49.474140 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:49.603040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:49.610920 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3417385-fb9c-4e72-b18e-262c64522771 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.151570 Aug 30 17:02:49.611493 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3388/7184] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:49 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:50.632048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:50.632661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:50.639496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:50.639997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:50.640412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:50.641747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:50.642289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:50.642738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:50.776278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:50.784675 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a47eced4-0ad1-4f3c-8e72-68f8ac88487e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.156700 Aug 30 17:02:50.785255 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3797/7185] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:50 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:02:51.807073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:51.807706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:51.814745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:51.815236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:51.815681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:51.816381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:51.816842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:51.817276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:51.948759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:51.957691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a965e673-09e5-43d8-b1bc-91cee01b9a43 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.155095 Aug 30 17:02:51.958270 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3389/7186] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:51 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:52.979491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:52.980120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:52.987771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:52.988296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:52.988779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:52.989480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:52.990032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:52.990524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:53.119373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:53.127176 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e25a286c-c7a5-4d4b-8940-767a8dea3c1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.151551 Aug 30 17:02:53.127759 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3798/7187] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:52 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:54.148898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:54.149521 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:54.157004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:54.157511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:54.157955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:54.158694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:54.159157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:54.159592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:54.291000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:54.299400 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5e66aa15-4da0-4d73-950b-b03fbfe82694 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.154477 Aug 30 17:02:54.299970 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3390/7188] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:54 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:55.320777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:55.321406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:55.328914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:55.329405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:55.329849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:55.330608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:55.331072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:55.331501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:55.461024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:55.469631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bc18b0dd-4848-45c0-b2f4-a1ec5bd7e159 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.151982 Aug 30 17:02:55.470270 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3799/7189] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:55 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:56.492146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:56.492774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:56.499686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:56.500900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:56.501354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:56.502066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:56.502560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:56.502998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:56.648361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:56.657015 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7d776a22-7c0b-4001-b35c-9cebab606489 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1682 microversion: 2.1 time: 0.168541 Aug 30 17:02:56.657648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3391/7190] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:56 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:57.326753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "name": "network-vif-unplugged", "status": "completed", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:02:57.337175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:57.337669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:57.338551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:57.350026 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Creating event network-vif-unplugged:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h1-830883-28 Aug 30 17:02:57.355527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] Instance a46be901-cef9-4498-ab23-2606ec6e695f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:02:57.366552 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c2bd397c-921a-45ee-b8ba-f059a5a78f12 req-a559b1b4-23ef-4c17-bd3e-b534bf1d6bf7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094390 Aug 30 17:02:57.367245 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3800/7191] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:02:57.681720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:57.682264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:57.689976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:57.690532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:57.691028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:57.691813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:57.692278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:57.692717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:57.898654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:57.907590 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2860bb5a-7b7d-4d25-b11d-5c27c2280c41 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1681 microversion: 2.1 time: 0.230492 Aug 30 17:02:57.908183 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3392/7192] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:57 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:58.931911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:02:58.932643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:02:58.939228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:58.939728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:58.940181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:58.940881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:58.941364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:58.941803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:59.077545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:02:59.085437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-feeb20b5-85c8-4426-a751-75ff21cb9999 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1679 microversion: 2.1 time: 0.159006 Aug 30 17:02:59.086016 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3801/7193] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:02:58 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:02:59.382875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:02:59.393401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:02:59.393896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:02:59.394391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:02:59.405768 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Creating event network-changed:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h1-830883-28 Aug 30 17:02:59.411847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] Instance a46be901-cef9-4498-ab23-2606ec6e695f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:02:59.423698 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-52854c2d-51a5-45d0-9b8f-dc6952777cca req-3f41a00f-88c1-486a-813a-70975e26ff54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044566 Aug 30 17:02:59.424289 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3393/7194] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:00.108159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:00.108919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:00.116569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:00.117207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:00.117614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:00.118322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:00.118793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:00.119220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:00.293676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:00.302820 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-98a58af4-90ec-4fe3-a103-bb1c77fd74a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1679 microversion: 2.1 time: 0.199482 Aug 30 17:03:00.317562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3802/7195] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:00 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:01.326689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:01.327422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:01.333931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.334478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.334939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.335971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.336146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.336558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.475972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:01.483746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5404ab1-8264-4a9f-b735-697e670035c6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1676 microversion: 2.1 time: 0.162494 Aug 30 17:03:01.485083 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3394/7196] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:01 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:01.505443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:01.506022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:01.512914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.513407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.513858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.514577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.515043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.515526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.576386 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41323283-0326-4a4f-8d3c-49f1463c92a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/action" status: 204 len: 0 microversion: 2.1 time: 0.074500 Aug 30 17:03:01.577080 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3803/7197] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:03:01 2022] POST /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:03:01.586660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:01.587400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:01.593873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.594414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.594873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.595588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:01.596056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:01.597270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:01.819467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:01.827404 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6aad06d8-8eb1-4b95-846a-19793d8a5fa8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1676 microversion: 2.1 time: 0.245692 Aug 30 17:03:01.828659 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3395/7198] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:01 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:02.851931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:02.852671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:02.859869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:02.860518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:02.860968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:02.861696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:02.862434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:02.862881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:02.879017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:03.009042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:03.018478 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a9c51983-8cb3-48c1-9884-65e129cef3de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.171636 Aug 30 17:03:03.019065 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3804/7199] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:02 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:03.040470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:03.041110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:03.050354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.050865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.051350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.052065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.052534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.052973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.181869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:03.190429 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-475f9e5f-5283-456e-88f6-fd25acbcccfc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.154071 Aug 30 17:03:03.191013 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3396/7200] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:03 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:03.211114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:03.211743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:03.217825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.218354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.218832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.219738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.220207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.220645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.348457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:03.356337 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21177b22-774d-4a26-84f7-956fff33783f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1668 microversion: 2.1 time: 0.149089 Aug 30 17:03:03.357461 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3805/7201] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:03 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:03.377093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:03.377604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:03.383875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.384310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.384756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.385454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.385921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.386406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.411409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:03:03.414126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:03.488822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-83328c43-c804-4f49-91c1-2718916bec0d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 204 len: 0 microversion: 2.1 time: 0.115946 Aug 30 17:03:03.492670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3397/7202] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:03:03 2022] DELETE /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:03:03.497749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:03.498426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:03.505476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.505970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.506441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.507136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:03.507599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:03.508036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:03.638020 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:03.646061 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34715f9c-6d0e-43fa-8a10-85c9ef4e94a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1674 microversion: 2.1 time: 0.152147 Aug 30 17:03:03.646681 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3806/7203] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:03 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:04.223877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "name": "network-vif-plugged", "status": "completed", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:04.234451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:04.235041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:04.235553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:04.245784 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] Creating event network-vif-plugged:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h1-830883-28 Aug 30 17:03:04.251402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d7f5ef07-1cd0-47b7-b861-a9c010655a99 req-cbfc1f2a-3b18-4cc4-99d2-cdc5892bcb79 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082628 Aug 30 17:03:04.251989 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3398/7204] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:03:04.667905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:04.668523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:04.676299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:04.676782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:04.677220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:04.677906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:04.678388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:04.678854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:04.816643 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:04.824495 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5f49cae-1602-446e-9bf2-30eaad42241a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1674 microversion: 2.1 time: 0.160462 Aug 30 17:03:04.825071 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3807/7205] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:04 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:05.758684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a46be901-cef9-4498-ab23-2606ec6e695f", "name": "network-vif-deleted", "tag": "562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:05.769655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:05.770146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:05.770624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:05.783118 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] Creating event network-vif-deleted:562a5bd5-dff6-49c2-aefe-c4b5cb3fe56e for instance a46be901-cef9-4498-ab23-2606ec6e695f on n-h1-830883-28 Aug 30 17:03:05.788880 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d9d51876-d407-41ba-b9fe-f994db06090a req-660bfeeb-9aa7-413f-9d3f-0fe2822a6dbf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Aug 30 17:03:05.789802 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3399/7206] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:05.845964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:05.846740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:05.854941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:05.855512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:05.855958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:05.856702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:05.857164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:05.857659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:05.926615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:05.936480 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6402abb4-5866-46d3-adc1-4af8813ec86a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 200 len: 1323 microversion: 2.1 time: 0.095181 Aug 30 17:03:05.937050 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3808/7207] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:05 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 1323 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:06.959199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:06.959915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:06.961881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:06.967827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:06.968865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:06.969411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:06.970122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:06.970616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:06.971080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:06.985447 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f HTTP/1.1 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a46be901-cef9-4498-ab23-2606ec6e695f'} Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:03:06.987153 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-349677aa-cea0-4bfe-8566-61189a104e01 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 404 len: 111 microversion: 2.1 time: 0.034584 Aug 30 17:03:06.991757 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3400/7208] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:06 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:03:07.002045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:07.002779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:07.009768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:07.010263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:07.010768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:07.011468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:07.011936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:07.012367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:07.026983 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f HTTP/1.1 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a46be901-cef9-4498-ab23-2606ec6e695f'} Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:03:07.028556 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-eda2be13-5ee8-4741-b6ec-4b29149e2729 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 404 len: 111 microversion: 2.1 time: 0.032277 Aug 30 17:03:07.032991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3809/7209] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:06 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:03:07.079596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1509903357", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c1958b40-f05d-48b7-85bd-41b85b3cd243"}], "security_groups": [{"name": "tempest-securitygroup--785179794"}], "key_name": "tempest-keypair-979526234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:07.183728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] validate_networks() for [('c1958b40-f05d-48b7-85bd-41b85b3cd243', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:03:07.626634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:03:07.627070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:03:07.627553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:03:07.628007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:03:07.628431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:03:07.637184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:07.637671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:07.638259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:07.639020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:07.639484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:07.639935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:07.657618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:03:07.663343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:03:07.676449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:03:07.678784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:03:07.726716 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c62a5f53-935b-49e6-b8a0-3dab3eed011b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651932 Aug 30 17:03:07.727376 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3401/7210] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:03:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:03:07.738340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-233f395c-26a8-4436-88ac-0671a4a995d1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:07.738971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-233f395c-26a8-4436-88ac-0671a4a995d1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:07.740873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=45 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:07.797006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-233f395c-26a8-4436-88ac-0671a4a995d1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:07.804214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-233f395c-26a8-4436-88ac-0671a4a995d1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1238 microversion: 2.1 time: 0.069682 Aug 30 17:03:07.804880 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3810/7211] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:07 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:08.827198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:08.828944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:08.837205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:08.837809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:08.838365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:08.839157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:08.839697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:08.840322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:08.917536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:08.926217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b756f97-0e88-4075-83b8-28857047107e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1308 microversion: 2.1 time: 0.103971 Aug 30 17:03:08.926843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3402/7212] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:08 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:09.948828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:09.949677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:09.960587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:09.961271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:09.961739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:09.962489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:09.962954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:09.963384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:10.101456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:10.110179 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-161e6f48-9d4d-457f-9a7e-2869d44d218f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.164566 Aug 30 17:03:10.110866 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3811/7213] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:09 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:10.399856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:10.414344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:10.415102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:10.415550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:10.427416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] Creating event network-changed:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h1-830883-28 Aug 30 17:03:10.432898 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-088d7152-60bf-4542-b74d-b10f57bde224 req-38a46463-047e-4e20-b5af-7ac17b2745df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036765 Aug 30 17:03:10.433719 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3403/7214] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:11.131980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:11.132602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:11.139425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:11.139923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:11.140399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:11.141119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:11.141578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:11.141999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:11.273012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:11.281433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a5c52fba-1058-48e2-ad89-fc97adf408fa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.153255 Aug 30 17:03:11.281998 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3812/7215] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:11 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:12.305365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:12.306116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:12.312574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:12.313152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:12.313608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:12.314329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:12.314806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:12.315247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:12.456472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:12.464511 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e18ce4d-b13d-4969-a791-1034ec701fd4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.164566 Aug 30 17:03:12.465075 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3404/7216] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:12 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:13.487284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:13.488045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:13.497028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:13.497525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:13.497970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:13.498711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:13.499180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:13.500258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:13.644067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:13.652165 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-188f45a7-1ee0-4073-b54f-888e07a312a8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.169631 Aug 30 17:03:13.652752 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3813/7217] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:13 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:14.673708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:14.674993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:14.684491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:14.684990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:14.685440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:14.686168 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:14.686675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:14.687149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:14.820187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:14.828485 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-98c8297b-4be2-41b1-a05a-06313a4ef140 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.158677 Aug 30 17:03:14.829064 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3405/7218] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:14 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:15.849820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:15.850431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:15.857302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:15.857806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:15.858235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:15.859093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:15.859568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:15.860000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:15.989286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:15.997054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3b643df4-4e1c-46a2-85df-a27316298bde tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.151219 Aug 30 17:03:15.997630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3814/7219] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:15 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:16.175490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "name": "network-vif-plugged", "status": "completed", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:16.186148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:16.186768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:16.187788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:16.204207 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] Creating event network-vif-plugged:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h1-830883-28 Aug 30 17:03:16.209409 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4196fea3-0c57-4fbf-a0d6-754b4d92fe8f req-f69b4cc9-df8a-4b5d-a310-7e7f78f183cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037858 Aug 30 17:03:16.210028 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3406/7220] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:17.019424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:17.020042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:17.026919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:17.027398 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:17.027843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:17.028524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:17.028981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:17.029407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:17.160436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:17.168175 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23727918-5d55-490f-98b6-5830181c53d2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1363 microversion: 2.1 time: 0.153264 Aug 30 17:03:17.168685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3815/7221] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:17 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:18.188553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:18.189472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:18.193961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:18.194694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:18.201711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:18.202201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:18.203075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:18.204017 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:18.204114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:18.204532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:18.338489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:18.346969 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ce48efa-a0e8-453e-b892-dd118ef2ebbb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1550 microversion: 2.1 time: 0.160238 Aug 30 17:03:18.347536 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3407/7222] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:18 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:18.368405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:18.368925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:18.370673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:18.376814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:18.377294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:18.377728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:18.378443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:18.378896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:18.379319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:18.461425 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3c0565c-c441-4631-8665-b1e6fc8a3a1f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096886 Aug 30 17:03:18.462023 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3816/7223] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:03:18 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:19.740003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:19.750187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:19.750804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:19.751250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:19.762271 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] Creating event network-changed:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h1-830883-28 Aug 30 17:03:19.767796 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9fd393bd-467a-48be-9727-fd4fe67d1040 req-bb59d66f-950e-4d96-9a3d-5211be78c9dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083307 Aug 30 17:03:19.768706 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3408/7224] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:03:52.522362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=15 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:52.523124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=63 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:52.527503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:03:52.534449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:52.534941 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:52.535384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:52.558012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:03:52.599909 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c0dcd5c9-3e58-4943-bdf6-7f68fc774773 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action" status: 202 len: 0 microversion: 2.1 time: 0.079655 Aug 30 17:03:52.600719 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3817/7225] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:03:52 2022] POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:03:52.607465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:52.608368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:03:52.613034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:52.613781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:52.621575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:52.622038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:52.622525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:52.623354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:52.623746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:52.624186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:52.759505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:52.767536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7a1534fe-5e35-4967-93f3-57ba0f4679b1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.162459 Aug 30 17:03:52.768112 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3409/7226] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:52 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:53.789571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:53.790279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:53.797644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:53.798120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:53.798759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:53.799443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:53.799892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:53.800314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:53.938828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:53.946776 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c83eaa09-e8e6-4850-92ed-f662fe3c0713 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.161475 Aug 30 17:03:53.947366 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3818/7227] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:53 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:54.967856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:54.968687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:54.977658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:54.978147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:54.978689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:54.979386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:54.979848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:54.980283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:55.116838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:55.125200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca50e591-74e1-49af-a080-d0c594a8299a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.160740 Aug 30 17:03:55.125887 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3410/7228] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:54 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:56.147248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:56.147875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:56.154743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:56.155233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:56.155674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:56.157203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:56.157668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:56.158100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:56.287879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:56.295656 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb910d5b-0e57-4d4a-9d37-544635a0c29c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.152384 Aug 30 17:03:56.296227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3819/7229] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:56 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:57.317223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:57.317877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:57.324666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:57.325167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:57.325598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:57.326294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:57.326779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:57.327221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:57.457564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:57.465352 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ec5a55b5-53c4-486e-a315-419b5b7f95dd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.152132 Aug 30 17:03:57.465927 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3411/7230] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:57 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:58.487064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:58.487594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:58.496723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:58.497215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:58.497655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:58.498384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:58.498848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:58.499278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:58.635411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:58.643320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-333b55a8-4a98-46aa-ad38-b5dff1edb908 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.160887 Aug 30 17:03:58.643902 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3820/7231] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:58 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:03:59.665053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:03:59.665679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:03:59.672743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:59.673235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:59.673680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:59.674396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:03:59.674861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:03:59.675297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:03:59.807146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:03:59.815786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5794ec44-5095-4cb3-b1f5-e2d47af05672 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.154662 Aug 30 17:03:59.816368 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3412/7232] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:03:59 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:00.837210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:00.837966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:00.845465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:00.846033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:00.846517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:00.847214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:00.847677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:00.848108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:00.979171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:00.987346 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7eed342-5c0b-4d6a-b039-a9116f3c002f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.154224 Aug 30 17:04:00.987925 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3821/7233] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:00 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:02.009200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:02.009834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:02.017366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:02.017859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:02.018322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:02.019045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:02.019518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:02.019958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:02.150671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:02.159012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-464a1fa7-4264-4e5f-a26d-43792ece77c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.153838 Aug 30 17:04:02.159585 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3413/7234] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:02 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:03.180504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:03.181113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:03.188744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:03.189227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:03.189661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:03.190376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:03.190833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:03.191258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:03.327114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:03.335524 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dab63a27-4475-4e72-b398-510ca8ef786b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.159286 Aug 30 17:04:03.336100 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3822/7235] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:03 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:04.357166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:04.357804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:04.364859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:04.365359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:04.365819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:04.366553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:04.367031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:04.367478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:04.495819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:04.503636 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd498af1-d55a-4001-8eb7-a5f4da37ce3e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.150373 Aug 30 17:04:04.504217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3414/7236] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:04 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:05.525971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:05.526626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:05.534549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:05.535045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:05.535485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:05.536172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:05.536630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:05.537058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:05.668511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:05.676948 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-14687453-efd1-49f6-8ee2-51eb9b4abd12 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.155079 Aug 30 17:04:05.677527 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3823/7237] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:05 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:06.697713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:06.698355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:06.705690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:06.706185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:06.706663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:06.707360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:06.707823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:06.708258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:06.846355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:06.854157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-99d1d8f0-959c-4e38-b294-18170e6ab47f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.160336 Aug 30 17:04:06.854798 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3415/7238] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:06 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:07.875823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:07.876451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:07.883421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:07.883933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:07.884360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:07.885059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:07.885523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:07.885962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:08.026426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:08.034277 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b533b70f-fbb9-44e5-a3d1-0d6304aac959 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.162408 Aug 30 17:04:08.034881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3824/7239] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:07 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:09.056352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:09.056998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:09.064890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.065388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.065842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.066580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.067051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.067490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.200597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:09.209259 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70e00446-a1fd-4bf5-a2c5-22af82434903 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1656 microversion: 2.1 time: 0.157034 Aug 30 17:04:09.209839 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3416/7240] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:09 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:09.229822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:09.232186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:09.239034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.239525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.239972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.240670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.241134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.241571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.270285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:09.276114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Old instance type m1.heat2, new instance type m1.heat {{(pid=122352) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:04:09.282628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:04:09.283060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:04:09.283548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:04:09.283972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:04:09.284391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:04:09.347483 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3295feb3-42e7-48c7-b8a5-5b066242d9cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action" status: 202 len: 0 microversion: 2.1 time: 0.121422 Aug 30 17:04:09.348199 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3825/7241] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:04:09 2022] POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:04:09.356137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:09.356776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:09.362981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.363299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.363767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.364469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:09.364935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:09.365373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:09.541973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:09.550335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b7894b37-eb61-4816-81a7-c74caaae1fbc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.198064 Aug 30 17:04:09.551041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3417/7242] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:09 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:10.576109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:10.576765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:10.584032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:10.584520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:10.584957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:10.585646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:10.586102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:10.586564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:10.726965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:10.735155 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-63a07ddd-7568-422d-8363-bd265ab107e9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1679 microversion: 2.1 time: 0.165281 Aug 30 17:04:10.736036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3826/7243] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:10 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:11.756409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:11.757051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:11.763939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:11.764452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:11.765433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:11.766571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:11.767063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:11.767514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:11.919765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:11.928481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-683f1358-1344-4c28-8b1b-4245096f2f28 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1684 microversion: 2.1 time: 0.175946 Aug 30 17:04:11.929166 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3418/7244] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:11 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:12.950990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:12.951614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:12.959063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:12.959555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:12.960003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:12.960698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:12.961163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:12.961593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:13.097839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:13.105682 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4ea4eed-4dd3-4621-b06a-a8f09b049f03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1684 microversion: 2.1 time: 0.158716 Aug 30 17:04:13.106268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3827/7245] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:12 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:14.131805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:14.132532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:14.141357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:14.141869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:14.142348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:14.143082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:14.143547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:14.143987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:14.340764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:14.349869 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-92eb954d-51dc-48a6-b859-f425d06ca70a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1683 microversion: 2.1 time: 0.224323 Aug 30 17:04:14.350503 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3419/7246] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:14 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:14.399532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "name": "network-vif-unplugged", "status": "completed", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:14.417988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:14.418496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:14.420216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:14.432871 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Creating event network-vif-unplugged:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h2-830883-28 Aug 30 17:04:14.439068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:04:14.454998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-47f3e94e-2890-4a42-9214-d6ae2f222277 req-65ac4775-4e3e-4620-b9da-91b2f8302780 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061469 Aug 30 17:04:14.455625 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3828/7247] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:15.372419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:15.373063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:15.380967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:15.381479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:15.381936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:15.382692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:15.383171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:15.383620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:15.586424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:15.594375 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8c2dc619-eba8-499a-9bb5-79c9e8abb196 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1683 microversion: 2.1 time: 0.225919 Aug 30 17:04:15.594957 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3420/7248] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:15 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:16.488411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:16.497745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:16.498218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:16.498683 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:16.510726 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Creating event network-changed:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h2-830883-28 Aug 30 17:04:16.517221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:04:16.528430 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c1c21434-0081-4b21-993d-57bee2a07231 req-d1806ca1-a052-4080-8edd-16eec69cf73a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Aug 30 17:04:16.529260 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3829/7249] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:16.614770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:16.615409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:16.622314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:16.622826 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:16.623279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:16.624990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:16.626104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:16.626573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:16.709339 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:04:16.709579 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde (ip 10.222.0.47) !!! Aug 30 17:04:16.849206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:16.857096 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5da93ac-d8b4-4fa2-9d0c-9d1dc95d52c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1681 microversion: 2.1 time: 0.246352 Aug 30 17:04:16.857678 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3421/7250] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:16 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:17.880239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:17.880871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:17.883260 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:04:17.883426 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:04:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde (ip 10.222.0.47) !!! Aug 30 17:04:17.892276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:17.892771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:17.893218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:17.893945 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:17.894467 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:17.894927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:18.032130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:18.039980 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d437f75-436b-4157-9318-b013265602e8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1681 microversion: 2.1 time: 0.164153 Aug 30 17:04:18.040575 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3830/7251] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:17 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:19.061337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:19.062814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:19.069686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.070187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.070677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.071387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.071861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.072335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.206229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:19.214022 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3f4e1cd-779a-402d-b930-7a575397de3c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1677 microversion: 2.1 time: 0.156688 Aug 30 17:04:19.214623 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3422/7252] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:19 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:19.234820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:19.235367 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:19.242109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.242631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.243077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.243767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.244230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.244655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.273770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:19.305045 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bfff8149-f1ba-44d6-83f6-84676d4db5df tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action" status: 204 len: 0 microversion: 2.1 time: 0.073710 Aug 30 17:04:19.305736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3831/7253] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:04:19 2022] POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:04:19.314500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:19.315400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:19.321772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.322446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.322899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.323841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:19.324220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:19.324742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:19.531442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:19.539519 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8aed8f24-14d1-4d05-a0eb-3cf7a998f034 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1677 microversion: 2.1 time: 0.229527 Aug 30 17:04:19.540199 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3423/7254] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:19 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:20.563328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:20.564058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:20.570529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:20.571031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:20.571480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:20.572184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:20.572809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:20.573436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:20.710187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:20.718984 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3322786f-8171-48ab-987d-173d970fd1a0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1677 microversion: 2.1 time: 0.161317 Aug 30 17:04:20.719516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3832/7255] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:20 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:21.740557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:21.741193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:21.747712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:21.748215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:21.748673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:21.749519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:21.749997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:21.750477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:21.886425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:21.895546 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3759bb93-c710-4d1f-98b3-2de1f5f0a213 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1656 microversion: 2.1 time: 0.159098 Aug 30 17:04:21.896169 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3424/7256] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:21 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:21.917124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:21.917744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:21.925261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:21.925748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:21.926186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:21.927465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:21.927924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:21.928374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:22.023091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "name": "network-vif-plugged", "status": "completed", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:22.038061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:22.039337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:22.040027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:22.056004 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] Creating event network-vif-plugged:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h2-830883-28 Aug 30 17:04:22.062170 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-33a8149e-d929-4f6c-a2df-086fb4ad8c7b req-40b0d3aa-0882-4371-ac54-27632ea40593 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043568 Aug 30 17:04:22.063391 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3425/7257] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:22.080252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:22.088155 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db4a92a1-66a9-480a-a2c1-fbca604c66a3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1656 microversion: 2.1 time: 0.174996 Aug 30 17:04:22.088736 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3833/7258] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:21 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:04:22.111083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:22.117323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:22.117827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:22.118284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:22.121908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:22.141626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Going to try to start instance {{(pid=122351) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:04:22.182837 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1aa6dce6-2af9-48e6-a7b3-c8aa94706a9f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action" status: 202 len: 0 microversion: 2.1 time: 0.076903 Aug 30 17:04:22.183437 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3426/7259] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:04:22 2022] POST /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:04:22.191757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:22.192382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:22.198832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:22.199615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:22.200275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:22.201171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:22.201818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:22.202519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:22.342665 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:22.351459 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc553509-1543-48e9-8e92-bcf998aea8c0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1665 microversion: 2.1 time: 0.163777 Aug 30 17:04:22.352036 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3834/7260] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:22 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:23.374891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:23.375687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:23.377517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:23.383216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.383720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.384171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.384877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.385344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.385788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.529547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:23.537952 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1ee7746c-b7f0-4183-b026-00ab00c294b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1669 microversion: 2.1 time: 0.168713 Aug 30 17:04:23.538550 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3427/7261] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:23 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:23.559362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:23.559862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:23.562483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:23.567600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.568082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.568521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.569205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.569656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.570080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.595403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:04:23.669282 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5b5b3a6-f427-4d7e-b264-08e94d0a0559 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 204 len: 0 microversion: 2.1 time: 0.113612 Aug 30 17:04:23.669872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3835/7262] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:04:23 2022] DELETE /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:04:23.679674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:23.680345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:23.686403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.687433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.687900 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.688602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:23.689076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:23.689520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:23.815716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:23.823400 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d77685c7-61cd-4619-b8e0-0d8c326d7b6b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1675 microversion: 2.1 time: 0.147919 Aug 30 17:04:23.823977 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3428/7263] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:23 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:04:24.846893 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:24.847612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:24.854432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:24.854915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:24.855349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:24.856046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:24.856486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:24.856905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:24.989050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:24.996880 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7a246229-b975-4e56-a864-de5cead9c18d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1675 microversion: 2.1 time: 0.155098 Aug 30 17:04:24.997460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3836/7264] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:24 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:26.020862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:26.021512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:26.027856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:26.028359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:26.028947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:26.029657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:26.030120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:26.030582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:26.059513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087938d2-2d7d-4b1f-984f-5119a60a1fde", "name": "network-vif-deleted", "tag": "8a56bd07-6fa1-4c37-8230-97b4a6e2af0e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:26.070799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:26.071284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:26.071944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:26.086168 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] Creating event network-vif-deleted:8a56bd07-6fa1-4c37-8230-97b4a6e2af0e for instance 087938d2-2d7d-4b1f-984f-5119a60a1fde on n-h2-830883-28 Aug 30 17:04:26.091673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6bb86fbb-bd1c-42da-bccc-0aa3118b6a3c req-1edb1ba8-a254-4408-b645-267ba22daf85 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035735 Aug 30 17:04:26.092603 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3837/7265] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:26.106016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:26.115009 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bf4cdbdd-49d9-4f9c-9bd1-78221967d70b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 200 len: 1608 microversion: 2.1 time: 0.100148 Aug 30 17:04:26.126478 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3429/7266] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:26 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 1608 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:27.138450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:27.139163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:27.146564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.147049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.147490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.148177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.148637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.149063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.162872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde HTTP/1.1 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '087938d2-2d7d-4b1f-984f-5119a60a1fde'} Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:04:27.164518 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7e6ec796-173e-4fa0-a2e6-bbe6345562f6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 404 len: 111 microversion: 2.1 time: 0.032669 Aug 30 17:04:27.169040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3838/7267] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:27 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:04:27.184591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:27.185223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:27.193278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.193782 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.194233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.194978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.195447 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.195890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.212942 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde HTTP/1.1 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '087938d2-2d7d-4b1f-984f-5119a60a1fde'} Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:04:27.214650 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ed8ef09c-21b2-4400-9298-8e1c06b5bd7e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 404 len: 111 microversion: 2.1 time: 0.035398 Aug 30 17:04:27.220811 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3430/7268] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:27 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:04:27.264960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-62104831", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c1958b40-f05d-48b7-85bd-41b85b3cd243"}], "security_groups": [{"name": "tempest-securitygroup--785179794"}], "key_name": "tempest-keypair-979526234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:27.369241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] validate_networks() for [('c1958b40-f05d-48b7-85bd-41b85b3cd243', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:04:27.819118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:04:27.819541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:04:27.820013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:04:27.820419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:04:27.820859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:04:27.832204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.832689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.833127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.833842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:27.834342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:27.834770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:27.854560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:04:27.859857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:04:27.872756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:04:27.876012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:04:27.924004 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c996b816-644d-417b-8fd0-33e96cabad24 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.662857 Aug 30 17:04:27.924654 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3839/7269] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:04:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:04:27.935784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09cd9f1b-cd65-41a4-aae5-a65b59b2037e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:27.936645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09cd9f1b-cd65-41a4-aae5-a65b59b2037e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:27.995022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-09cd9f1b-cd65-41a4-aae5-a65b59b2037e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:28.004737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09cd9f1b-cd65-41a4-aae5-a65b59b2037e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1236 microversion: 2.1 time: 0.072847 Aug 30 17:04:28.005318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3431/7270] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:27 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:29.027746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:29.028531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:29.037042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:29.037537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:29.037973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:29.038876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:29.039338 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:29.039764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:29.107240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:29.115202 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7d8b2367-5351-420a-866a-799f7eefe5d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1306 microversion: 2.1 time: 0.094050 Aug 30 17:04:29.115793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3840/7271] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:29 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:30.136966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:30.137704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:30.146139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:30.146672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:30.147165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:30.147879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:30.148354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:30.148800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:30.640725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:30.649479 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-728d3a68-98d3-4c56-87d5-cce4b14e7537 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.516445 Aug 30 17:04:30.650061 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3432/7272] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:30 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:30.687737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:30.699516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:30.699994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:30.700440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:30.712506 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] Creating event network-changed:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:04:30.717231 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-e4b11ded-b29d-4511-8a19-e358d7735e3e req-8200d495-406c-4364-a957-dcf5684a34cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Aug 30 17:04:30.717822 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3841/7273] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:31.671538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:31.672176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:31.680229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:31.680728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:31.681182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:31.681923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:31.682426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:31.682870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:31.810031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:31.817786 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3835853e-3dc6-4625-93d9-43cff55b19a2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.150173 Aug 30 17:04:31.818374 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3433/7274] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:31 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:32.840417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:32.841171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:32.848055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:32.848543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:32.848990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:32.849679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:32.850143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:32.850604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:32.980458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:32.988732 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e022826-7c3c-49a3-8f16-25b15bc3c92f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.153477 Aug 30 17:04:32.989296 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3842/7275] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:32 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:34.009818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:34.010380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:34.017320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:34.017813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:34.018262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:34.018995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:34.019577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:34.020018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:34.154941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:34.163157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0ec8cb4-9e42-4743-b93f-53fb6cebeca0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.157295 Aug 30 17:04:34.163731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3434/7276] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:34 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:35.184627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:35.185191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:35.192482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:35.192973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:35.193418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:35.194116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:35.194611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:35.195041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:35.331421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:35.339128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71acb50a-3b2c-4b64-9379-c191c11ecce2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.158478 Aug 30 17:04:35.339705 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3843/7277] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:35 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:36.361760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:36.362405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:36.369288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:36.369780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:36.370224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:36.370943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:36.371411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:36.371844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:36.504944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:36.513431 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a80ae27-5027-45da-a7c3-c49bf78ed256 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.156160 Aug 30 17:04:36.514014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3435/7278] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:36 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:36.625606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "name": "network-vif-plugged", "status": "completed", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:36.636868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:36.637228 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:36.637728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:36.652523 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] Creating event network-vif-plugged:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:04:36.658111 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c97b96de-a73d-4713-b903-f5d438bcb204 req-670b1473-b578-4cf5-9287-bbab6fcf1645 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Aug 30 17:04:36.659250 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3844/7279] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:37.535795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:37.536383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:37.543255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:37.543757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:37.544209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:37.544909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:37.545376 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:37.545817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:37.681758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:37.689822 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac2702d9-883f-47a8-9d73-980db753c919 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1361 microversion: 2.1 time: 0.158350 Aug 30 17:04:37.690416 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3436/7280] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:37 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:38.709382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:38.710185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:38.714707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:38.715402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:38.722485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:38.722967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:38.723407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:38.724088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:38.724569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:38.725022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:38.854462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:04:38.863231 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-458e01fc-2ee9-4876-8f18-b6347a5d4281 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1548 microversion: 2.1 time: 0.155619 Aug 30 17:04:38.863854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3845/7281] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:04:38 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:04:38.884885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:04:38.885430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:04:38.887326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:04:38.893957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:38.894512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:38.894962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:38.895671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:38.896139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:38.896580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:38.978399 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-776fb5ad-2668-46ca-a56e-b89be0ee4eaf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097406 Aug 30 17:04:38.979025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3437/7282] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:04:38 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:04:39.920901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:04:39.931887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:04:39.932378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:04:39.932820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:04:39.944953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] Creating event network-changed:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:04:39.949942 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-842caa4f-90f4-4984-bea9-3aafdb0090db req-98dd9e9e-5edf-4588-a263-811d0a22bc15 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Aug 30 17:04:39.950587 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3846/7283] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:10.173846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=23 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:10.174689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:10.179529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:10.181821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:10.189209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:10.189700 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:10.190148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:10.190866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:10.191329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:10.191759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:10.222350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:10.228524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:05:10.234968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:05:10.235401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:05:10.235882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:05:10.236298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:05:10.236715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:05:10.302659 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-29a680b1-1d19-4155-9340-7201661159eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/action" status: 202 len: 0 microversion: 2.1 time: 0.131585 Aug 30 17:05:10.303569 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3438/7284] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:05:10 2022] POST /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:05:10.312206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:10.313033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:10.315775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:10.316433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:10.322924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:10.323425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:10.323884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:10.324569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:10.325032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:10.325469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:10.461861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:10.470758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-41023a74-1632-486c-8626-b03eb76d2b67 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1676 microversion: 2.1 time: 0.162700 Aug 30 17:05:10.471346 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3847/7285] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:10 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:11.492400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:11.493024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:11.500314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:11.500808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:11.501258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:11.501950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:11.502454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:11.502888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:11.639483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:11.648284 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9c2b80d-c39f-437e-b324-d11d51b6b40d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1676 microversion: 2.1 time: 0.159773 Aug 30 17:05:11.648860 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3439/7286] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:11 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:12.671004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:12.671639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:12.679441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:12.679936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:12.680387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:12.681083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:12.681552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:12.681995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:12.814912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:12.822763 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5fa42015-bb8c-4ce3-9db1-f54b5faa0bb2 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.155618 Aug 30 17:05:12.823344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3848/7287] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:12 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:13.844836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:13.845981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:13.855146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:13.855652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:13.856107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:13.856817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:13.857284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:13.857724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:13.989555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:13.997888 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d9584cb4-8c29-41a9-b2f5-2bd99938c5fd tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.157814 Aug 30 17:05:13.998933 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3440/7288] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:13 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:15.020998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:15.021652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:15.028522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:15.029009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:15.029453 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:15.030140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:15.030641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:15.031073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:15.160172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:15.167956 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25ac2735-f143-4db8-a0be-d0db93f8d8ac tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.150818 Aug 30 17:05:15.168533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3849/7289] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:15 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:05:16.191055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:16.191694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:16.198241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:16.198774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:16.199238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:16.199958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:16.200433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:16.200878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:16.339559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:16.348092 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4f02197e-64b8-4d9e-953d-6f6176ccf4dc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.161367 Aug 30 17:05:16.348670 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3441/7290] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:16 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:17.369496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:17.370118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:17.377949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:17.378483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:17.378931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:17.379629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:17.380095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:17.380558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:17.513293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:17.521722 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e76c91d-e21e-4a3a-81a7-8ecba7b81c5a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.156198 Aug 30 17:05:17.522288 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3850/7291] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:17 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:18.543103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:18.543654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:18.550481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:18.550976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:18.551457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:18.552147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:18.552612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:18.553047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:18.681648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:18.690047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7dff968b-7a6d-4860-8c10-c4e605579d72 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.150977 Aug 30 17:05:18.690648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3442/7292] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:18 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:19.711783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:19.712434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:19.720051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:19.720575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:19.721012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:19.721701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:19.722156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:19.722611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:19.853734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:19.862422 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f9d8307f-5e78-4f3f-9ba1-bdbfa5cb6ae4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.154436 Aug 30 17:05:19.863045 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3851/7293] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:19 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:20.883654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:20.884287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:20.892406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:20.892642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:20.893360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:20.894271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:20.894967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:20.895581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:21.033307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:21.041263 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0009c06-d324-4d08-9f6c-2bb2d17f1801 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.161554 Aug 30 17:05:21.041843 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3443/7294] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:20 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:22.062264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:22.063423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:22.070320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:22.070821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:22.071266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:22.071961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:22.072417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:22.072846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:22.205651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:22.214335 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c55fb1d9-5a48-4f94-94d9-24e72205656f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.155964 Aug 30 17:05:22.214944 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3852/7295] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:22 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:23.236679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:23.237257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:23.244211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:23.244707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:23.245157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:23.245857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:23.246346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:23.246790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:23.376944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:23.384771 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-23a391ad-8d7a-4219-91b7-873869099263 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1681 microversion: 2.1 time: 0.153099 Aug 30 17:05:23.385340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3444/7296] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:23 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:24.407548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:24.408169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:24.414562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:24.415052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:24.415669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:24.416361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:24.416814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:24.417241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:24.554365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:24.562214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f4d6be81-3084-41a0-a139-5207106ca79e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1680 microversion: 2.1 time: 0.158895 Aug 30 17:05:24.563435 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3853/7297] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:24 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:24.665813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "name": "network-vif-unplugged", "status": "completed", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:24.676780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:24.677408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:24.678025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:24.691467 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Creating event network-vif-unplugged:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h2-830883-28 Aug 30 17:05:24.696839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:05:24.707766 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8bfd2784-b650-4a9a-89fc-50409fa3545b req-84bf2873-0c80-48df-80df-57603e02f610 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045656 Aug 30 17:05:24.708452 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3445/7298] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:25.584301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:25.584950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:25.591656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:25.592146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:25.592587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:25.593271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:25.594234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:25.594698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:25.727243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:25.735804 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-141170ae-458e-4962-96b1-bb25bb3fbaed tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1680 microversion: 2.1 time: 0.155394 Aug 30 17:05:25.736399 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3854/7299] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:25 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:26.747293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:26.756629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:26.757255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:26.757919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:26.758440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:26.758887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:26.764136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:26.765633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:26.765633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:26.765863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:26.767090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:26.767407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:26.772620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Creating event network-changed:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h2-830883-28 Aug 30 17:05:26.778166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:05:26.789416 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4a4c5197-e488-4074-86d4-498e3879757b req-841ca0bc-832d-4cde-a2cb-affffcbdf388 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046988 Aug 30 17:05:26.790358 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3446/7300] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:26.909781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:26.917644 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4cc942b4-3163-4d3d-b79e-6840f0206269 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1678 microversion: 2.1 time: 0.164838 Aug 30 17:05:26.918227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3855/7301] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:26 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:27.940740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:27.941380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:27.948161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:27.948655 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:27.949100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:27.949792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:27.950252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:27.950713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:28.085773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:28.093477 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a50432c2-729c-4353-815b-4da7fb02f8f0 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1678 microversion: 2.1 time: 0.157931 Aug 30 17:05:28.094045 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3447/7302] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:27 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:05:29.115451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:29.116077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:29.122983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.123469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.123927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.124677 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.125144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.125568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.265747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:29.273603 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae93498a-3555-40c4-84cb-43c005a41ecf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1675 microversion: 2.1 time: 0.162777 Aug 30 17:05:29.274173 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3856/7303] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:29 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:29.294844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:29.295398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:29.302716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.303264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.303973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.304666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.305134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.305570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.342264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.342781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.343227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.343956 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.344424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.344861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.368300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:05:29.373612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:05:29.474913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eef0f45f-7e74-407b-bd0d-6b629bfd46b8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/action" status: 202 len: 0 microversion: 2.1 time: 0.183741 Aug 30 17:05:29.475448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3448/7304] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:05:29 2022] POST /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:05:29.483512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:29.484145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:29.490837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.491334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.491834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.492535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:29.493000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:29.493452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:29.634692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:29.642498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-794bfd0a-af90-4c37-84c8-2426c6a69358 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1674 microversion: 2.1 time: 0.162771 Aug 30 17:05:29.643085 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3857/7305] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:29 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:30.665858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:30.666605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:30.673631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:30.674128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:30.674611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:30.675310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:30.675784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:30.676223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:30.814510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:30.823051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5ed7cc3-f3cf-40ce-8134-a2ef9015ee7c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1674 microversion: 2.1 time: 0.162928 Aug 30 17:05:30.823638 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3449/7306] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:30 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:31.844272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:31.845422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:31.853977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:31.854744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:31.855204 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:31.855912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:31.856385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:31.856898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:31.990049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:31.997807 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2764ff96-11c8-4b88-853e-02cd57e8436f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1674 microversion: 2.1 time: 0.157475 Aug 30 17:05:31.998410 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3858/7307] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:31 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:32.306059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "name": "network-vif-plugged", "status": "completed", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:32.317726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:32.318846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:32.319311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:32.335149 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Creating event network-vif-plugged:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:05:32.340769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:05:32.352125 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-41937692-0623-45b7-a426-5897b6d7b41a req-b72fed45-950f-461d-ad37-e2fc91f47064 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051099 Aug 30 17:05:32.352758 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3450/7308] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:32.932815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "name": "network-vif-unplugged", "status": "completed", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:32.943263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:32.943735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:32.944175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:32.956928 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Creating event network-vif-unplugged:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:05:32.963127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:05:32.974872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-923bd263-d05b-4079-ac1e-025094eaba7f req-0f399003-4009-430c-9d15-b78a010e1f64 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045820 Aug 30 17:05:32.975495 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3859/7309] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:33.020683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:33.021618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:33.027676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:33.028169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:33.028635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:33.029486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:33.029953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:33.030414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:33.034474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:33.278572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:33.286520 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b07ff77-5623-4eee-97e2-a3e43e5d93ea tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1674 microversion: 2.1 time: 0.270247 Aug 30 17:05:33.287097 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3451/7310] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:33 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:34.309211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:34.309922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:34.316141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:34.316633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:34.317572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:34.318267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:34.318763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:34.319196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:34.450515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:34.459519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fc423ee4-6c0f-4390-9cd3-475c22617e60 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1674 microversion: 2.1 time: 0.155588 Aug 30 17:05:34.460042 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3860/7311] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:34 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:35.017201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:35.027850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:35.028341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:35.028792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:35.041145 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Creating event network-changed:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:05:35.046468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:05:35.058186 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-457c5ae4-e0dc-4401-bbab-950f8d2b334c req-9861ef8a-bbfb-43b3-97fb-945b133c664e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044616 Aug 30 17:05:35.058809 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3452/7312] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:35.480938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:35.481714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:35.488966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:35.489489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:35.489930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:35.490717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:35.491151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:35.491747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:35.638450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:35.647736 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d83a1dc-317d-4b3f-88f9-a073381366da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1667 microversion: 2.1 time: 0.170880 Aug 30 17:05:35.648326 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3861/7313] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:35 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:35.670116 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:35.670963 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:35.678344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:35.679176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:35.679702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:35.680493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:35.681055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:35.681565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.232653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:36.241256 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-43ae30df-7962-490e-8bbc-6ce1e8341bf3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1667 microversion: 2.1 time: 0.575516 Aug 30 17:05:36.241845 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3453/7314] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:35 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1667 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:36.262408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:36.263039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:36.269221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.269741 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.270261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.270999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.271469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.271906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.403926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:36.412535 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-902c348d-736f-4f74-98d0-e1e9a21650c8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1667 microversion: 2.1 time: 0.154142 Aug 30 17:05:36.413122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3862/7315] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:36 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:36.433683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:36.434204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:36.440387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.440892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.441353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.442568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.443054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.443503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.469568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:05:36.558402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2238b686-dc28-4251-b8f1-e93caeafe7d7 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 204 len: 0 microversion: 2.1 time: 0.128192 Aug 30 17:05:36.559014 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3454/7316] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:05:36 2022] DELETE /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:05:36.567549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:36.568179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:36.575686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.576180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.576642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.577328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:36.577786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:36.578211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:36.716992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:36.720638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=100 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:36.726998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-23196249-3467-4554-84f0-93c917905486 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1673 microversion: 2.1 time: 0.163666 Aug 30 17:05:36.727581 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3863/7317] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:36 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:37.749076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:37.749831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:37.756677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:37.757171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:37.757622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:37.758336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:37.758810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:37.759247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:37.888766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:37.897491 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c6e9d3f5-9624-4a59-813d-59a609fb048d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1673 microversion: 2.1 time: 0.152724 Aug 30 17:05:37.898062 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3455/7318] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:37 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:38.920678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:38.921307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:38.928775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:38.929291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:38.929731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:38.930496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:38.930956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:38.931547 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:38.999837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:39.009121 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b9ccf330-0f5d-4ceb-9555-9dd8b0f5bd07 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 200 len: 1606 microversion: 2.1 time: 0.093440 Aug 30 17:05:39.009707 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3864/7319] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:38 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:39.201514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4002884c-0f5a-407a-be03-8415ef17f7a7", "name": "network-vif-deleted", "tag": "4afa7d22-fbef-42b7-9776-096fae6f598a"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:39.215286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:39.215845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:39.216290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:39.232080 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] Creating event network-vif-deleted:4afa7d22-fbef-42b7-9776-096fae6f598a for instance 4002884c-0f5a-407a-be03-8415ef17f7a7 on n-h1-830883-28 Aug 30 17:05:39.239659 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-27650da8-927a-4b41-90ec-9f20f12f2a4c req-b22e5ece-ba96-496c-9dac-0e25d66b4cb6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044344 Aug 30 17:05:39.240823 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3456/7320] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:40.031567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:40.032196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:40.039518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.040017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.040464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.041203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.041871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.042409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.059467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 HTTP/1.1 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4002884c-0f5a-407a-be03-8415ef17f7a7'} Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:05:40.061141 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9fce9383-98e3-45eb-bad8-a136a486514b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 404 len: 111 microversion: 2.1 time: 0.034930 Aug 30 17:05:40.065069 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3865/7321] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:40 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:05:40.080842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:40.081666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:40.083881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:40.090003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.090851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.091341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.092075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.092556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.093000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.111946 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 HTTP/1.1 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '4002884c-0f5a-407a-be03-8415ef17f7a7'} Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:05:40.113559 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f8ced48e-2179-45fa-809c-3d4f15e5ee65 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 404 len: 111 microversion: 2.1 time: 0.039272 Aug 30 17:05:40.118598 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3457/7322] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:40 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:05:40.168585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-952917816", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "c1958b40-f05d-48b7-85bd-41b85b3cd243"}], "security_groups": [{"name": "tempest-securitygroup--785179794"}], "key_name": "tempest-keypair-979526234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:40.276474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] validate_networks() for [('c1958b40-f05d-48b7-85bd-41b85b3cd243', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:05:40.458994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:40.648119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:05:40.648548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:05:40.649022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:05:40.649430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:05:40.649839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:05:40.658522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.659005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.659438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.660155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:40.660779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:40.661394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:40.678436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:05:40.683850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:05:40.696765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:05:40.699019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:05:40.745201 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-60176e7d-7023-4be1-96fe-721d96a53858 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.580498 Aug 30 17:05:40.745874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3866/7323] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:05:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:05:40.757188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96f7aa24-5f86-4738-a7d6-bd8559aba99c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:40.757813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96f7aa24-5f86-4738-a7d6-bd8559aba99c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:40.761327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:40.819181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96f7aa24-5f86-4738-a7d6-bd8559aba99c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:40.828661 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96f7aa24-5f86-4738-a7d6-bd8559aba99c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1237 microversion: 2.1 time: 0.075862 Aug 30 17:05:40.829219 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3458/7324] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:40 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:41.849397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:41.850050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:41.864154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:41.864793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:41.865475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:41.866484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:41.867032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:41.867528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:41.943262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:41.952001 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47b99c48-a3fd-4b81-bf29-3276fa17b9a9 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1297 microversion: 2.1 time: 0.106647 Aug 30 17:05:41.952881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3867/7325] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:41 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:42.974079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:42.975011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:42.982355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:42.983108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:42.983513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:42.984231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:42.984721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:42.985136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:43.192274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:43.200122 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5da3a269-e013-4efd-9585-97d494139eb8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.230647 Aug 30 17:05:43.200713 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3459/7326] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:42 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:43.281437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:43.295154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:43.295624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:43.296255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:43.309123 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] Creating event network-changed:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:05:43.314909 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b22a4507-30d4-4e54-9e35-361eedaece61 req-df7c20ac-cb7b-428f-a6f4-5f99d426b5e1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038316 Aug 30 17:05:43.315839 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3868/7327] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:44.221902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:44.222586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:44.230122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:44.230654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:44.231107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:44.231808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:44.232274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:44.232712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:44.360317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:44.368573 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17455de9-516a-4532-b173-1c98d797f4c3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.150552 Aug 30 17:05:44.369157 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3460/7328] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:44 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:45.391179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:45.391886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:45.399062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:45.399541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:45.399975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:45.400657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:45.401114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:45.401541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:45.541141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:45.548897 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2b6e6db-bc69-48ac-912d-bcd58dc3a5de tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.162040 Aug 30 17:05:45.549481 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3869/7329] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:45 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:46.572080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:46.572762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:46.578703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:46.579200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:46.579649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:46.580339 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:46.580801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:46.581235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:46.708853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:46.716616 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-591cff4f-1359-4da6-9356-082562b4e6ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.149796 Aug 30 17:05:46.717204 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3461/7330] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:46 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:47.737175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:47.737827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:47.745377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:47.745863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:47.746322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:47.747015 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:47.747476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:47.747906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:47.874237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:47.881944 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81af0cb7-b4c5-4d83-a7dd-4afefd32a651 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.148686 Aug 30 17:05:47.882551 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3870/7331] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:47 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:48.903353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:48.903993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:48.911766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:48.912268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:48.912722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:48.913435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:48.913904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:48.914368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:49.055506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-plugged", "status": "completed", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:49.056985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:49.066369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-53a09fc5-2b29-4354-85d0-1c930ff1c6f1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.166847 Aug 30 17:05:49.068315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:49.068470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3462/7332] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:48 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:49.069320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:49.070195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:49.083908 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] Creating event network-vif-plugged:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:05:49.089118 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7d66c6e9-e23d-4cd8-812d-7385e6a2fe18 req-3fce55a9-42e7-4545-a207-a4e462bfac0b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038944 Aug 30 17:05:49.089960 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3871/7333] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:50.088765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:50.089318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:50.096136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:50.096636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:50.097095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:50.098351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:50.098850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:50.099291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:50.232898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:50.241063 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6aecc0ef-2374-475d-b7f8-5dfb7e49f772 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1362 microversion: 2.1 time: 0.156284 Aug 30 17:05:50.241642 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3463/7334] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:50 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:51.260887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:51.261657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:51.266137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:51.266888 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:51.274334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:51.274828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:51.275279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:51.275968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:51.276429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:51.276860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:51.406056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:05:51.414370 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e68e2c82-7f6e-4317-a9d0-5c5d636c9082 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1549 microversion: 2.1 time: 0.155215 Aug 30 17:05:51.414947 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3872/7335] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:05:51 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:05:51.435848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:05:51.436346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:05:51.438216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:05:51.444252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:51.444754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:51.445219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:51.445924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:51.446448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:51.446902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:51.526943 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2381d4c0-0028-4411-9ce4-1a292d6178ce tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094894 Aug 30 17:05:51.527557 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3464/7336] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:05:51 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:05:52.752570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:05:52.763331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:05:52.763788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:05:52.764218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:05:52.777824 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] Creating event network-changed:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:05:52.782801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9f2e8bd9-7006-42c4-a623-2c5234b50539 req-17e77964-9d2b-4d18-961f-e547a7203afc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 Aug 30 17:05:52.783598 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3873/7337] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:06:27.154665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=15 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:27.155496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:27.159421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:27.160056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:27.168162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:27.168644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:27.169098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:27.169840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:27.170272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:27.170810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:27.308851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:27.317241 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7be02285-5f74-4954-84a1-c7869ff0d1d4 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1668 microversion: 2.1 time: 0.164795 Aug 30 17:06:27.317820 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3465/7338] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:27 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:27.339393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b90ac643-9430-4278-867e-320a663569bc"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:06:27.341884 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:27.344880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:27.345568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=40 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:27.351773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:27.352262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:27.352712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:27.353407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:27.353867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:27.354416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:27.614680 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25311f7d-54dc-4251-bd17-7ed1dc55a33a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279493 Aug 30 17:06:27.615453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3874/7339] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:06:27 2022] POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:06:38.316134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:06:38.318569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:38.321340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:38.322012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:38.327988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:38.328483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:38.328932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:38.329629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:38.330093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:38.330554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:38.359690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:38.365432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:06:38.372272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:06:38.372704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:06:38.373188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:06:38.373603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:06:38.374029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:06:38.434990 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-294bf70e-9795-425b-b604-ebc9a5e876ee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/action" status: 202 len: 0 microversion: 2.1 time: 0.122884 Aug 30 17:06:38.435600 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3466/7340] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:06:38 2022] POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:06:38.442038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:38.442984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:06:38.447485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:38.448233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:38.455540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:38.456056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:38.456719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:38.458238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:38.458924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:38.459598 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:38.603043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:38.611873 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e5090304-5522-440e-b03c-f4067a892ad1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1723 microversion: 2.1 time: 0.171818 Aug 30 17:06:38.612431 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3875/7341] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:38 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:39.634032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:39.634692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:39.640890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:39.641382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:39.641831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:39.642720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:39.643893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:39.644361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:39.788666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:39.796989 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5998886-661a-43d3-a64d-8f9c43b322da tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1723 microversion: 2.1 time: 0.168045 Aug 30 17:06:39.797564 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3467/7342] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:39 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:40.818432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:40.819061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:40.825905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:40.826437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:40.826887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:40.827576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:40.828035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:40.828460 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:40.958478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:40.966866 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-528eefb9-f804-47ee-9f3b-0e882e13e14e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.152379 Aug 30 17:06:40.967438 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3876/7343] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:40 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:41.989041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:41.989648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:41.996477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:41.996950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:41.997405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:41.998102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:41.998602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:41.999041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:42.130172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:42.138388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9f39ef5f-99e1-48c4-bb4d-f29c189f4221 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.153301 Aug 30 17:06:42.138963 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3468/7344] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:41 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:43.160262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:43.161977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:43.168969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:43.169461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:43.169902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:43.170689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:43.171151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:43.171580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:43.305723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:43.314022 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e14087c-5535-4023-8b4c-de9be7b70f1a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.157752 Aug 30 17:06:43.314631 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3877/7345] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:43 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:44.335385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:44.336018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:44.342993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:44.343493 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:44.343948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:44.344649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:44.345122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:44.345568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:44.476430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:44.484721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-16f3a1cd-cf85-44e5-9605-6f72651247e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.153267 Aug 30 17:06:44.485296 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3469/7346] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:44 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:45.507153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:45.507783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:45.514610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:45.515104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:45.515540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:45.516233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:45.516687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:45.517111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:45.648852 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:45.657520 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4441827e-a40a-420b-b4cd-71d9c94adb75 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.154633 Aug 30 17:06:45.658212 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3878/7347] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:45 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:46.680223 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:46.680884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:46.687490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:46.687986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:46.688437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:46.689138 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:46.689605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:46.690046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:46.822028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:46.830475 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ecff95e9-1a3b-465d-b910-60e610c55cb1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.154904 Aug 30 17:06:46.831052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3470/7348] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:46 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:47.852043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:47.852670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:47.859525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:47.860021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:47.860464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:47.861169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:47.861636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:47.862351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:48.000421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:48.009284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f6e0ecd-083e-48d1-a7e7-295c6d2492fc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.161338 Aug 30 17:06:48.010106 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3879/7349] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:47 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:49.031104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:49.031694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:49.039395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:49.039918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:49.040366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:49.041057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:49.041520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:49.041954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:49.172364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:49.181008 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-edfa71cb-001f-49da-9d2c-31831a8b979a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.153899 Aug 30 17:06:49.181577 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3471/7350] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:49 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:50.202586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:50.203254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:50.210828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:50.211314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:50.211751 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:50.212438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:50.212897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:50.213321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:50.344268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:50.353365 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2ec1d88-6dfa-41fe-85cf-df43b617faf8 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.154658 Aug 30 17:06:50.353942 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3880/7351] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:50 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:51.374992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:51.375624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:51.382756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:51.383284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:51.383735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:51.384463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:51.384930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:51.385369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:51.516695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:51.525078 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a63b8151-871e-447c-b11a-83de677bee45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.154143 Aug 30 17:06:51.525659 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3472/7352] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:51 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:52.547187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:52.547816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:52.555078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:52.555571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:52.556022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:52.556721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:52.557188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:52.557623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:52.684907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:52.693876 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f421bc4e-2de5-4f5b-a8f6-77a3d44f1f97 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.150671 Aug 30 17:06:52.694483 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3881/7353] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:52 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:53.715133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:53.715767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:53.722637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:53.723696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:53.724190 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:53.724898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:53.725398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:53.725846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:53.856052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:53.864610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e99a1c7-b62b-4f7f-8aec-af7a0d535ada tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.153230 Aug 30 17:06:53.865193 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3473/7354] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:53 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:54.886756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:54.887416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:54.894320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:54.894851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:54.895379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:54.896080 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:54.896548 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:54.896983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:55.030922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:55.039935 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-acc92363-caf5-4682-a521-8866d3a1228d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.157267 Aug 30 17:06:55.040516 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3882/7355] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:54 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:56.061136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:56.061756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:56.068543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:56.069025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:56.069472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:56.070173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:56.070670 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:56.071101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:56.204209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:56.212653 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-853b5a53-b305-4263-b95d-b5fb2b301f93 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.155532 Aug 30 17:06:56.213223 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3474/7356] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:56 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:57.234688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:57.235346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:57.242733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:57.243221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:57.243664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:57.244355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:57.244820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:57.245249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:57.373994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:57.382912 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36d6fcc1-cc8d-49d2-b092-47234ff31879 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.152096 Aug 30 17:06:57.383482 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3883/7357] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:57 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:58.404911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:58.405546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:58.413484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:58.413987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:58.414469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:58.415178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:58.415647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:58.416088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:58.554248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:58.563133 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5de76ce6-7d4a-41ef-8809-226575e29c82 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1728 microversion: 2.1 time: 0.161933 Aug 30 17:06:58.563896 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3475/7358] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:58 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:06:59.585143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:06:59.585768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:06:59.592511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:59.592991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:59.593432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:59.594124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:06:59.594604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:06:59.595035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:06:59.733853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:06:59.743205 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-73798f95-e4ed-4ec8-9388-816b1fe5fd15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1727 microversion: 2.1 time: 0.162566 Aug 30 17:06:59.743791 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3884/7359] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:06:59 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:00.090212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-unplugged", "status": "completed", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:00.101713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:00.102216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:00.102699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:00.116740 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Creating event network-vif-unplugged:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h2-830883-28 Aug 30 17:07:00.122815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:07:00.134608 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f28cea78-42a3-43e7-a4ed-38e78a8bb039 req-4e33c5d6-8a8e-4687-8536-60948e805cc0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048026 Aug 30 17:07:00.135230 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3476/7360] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:07:00.764966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:00.765668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:00.774499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:00.775001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:00.775479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:00.776186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:00.776647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:00.777075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:00.922594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:00.931974 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-36704271-1764-4c97-ad8d-d82d0e7089e3 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1727 microversion: 2.1 time: 0.170772 Aug 30 17:07:00.933129 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3885/7361] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:00 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:01.954846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:01.955567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:01.962148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:01.962619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:01.963069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:01.963760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:01.964222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:01.964662 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:02.103346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:02.111741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c092756f-7df8-43d0-8926-7ce99da2619f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.162021 Aug 30 17:07:02.112334 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3477/7362] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:01 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:02.151509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:02.161602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:02.162649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:02.163290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:02.441808 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Creating event network-changed:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h2-830883-28 Aug 30 17:07:02.448290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:07:02.459359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-a0386902-b78e-44f1-9858-c0e72f31259b req-c44e4527-98cc-4f70-af4a-3a3ebbefd615 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311353 Aug 30 17:07:02.459953 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3886/7363] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:07:03.134719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:03.135743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:03.143765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:03.144266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:03.144810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:03.145804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:03.146912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:03.147306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:03.736661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:03.745731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6f55d81-1255-4f8d-8764-e0de82de263a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.615062 Aug 30 17:07:03.746636 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3478/7364] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:03 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:04.768553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:04.770145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:04.778233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:04.778815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:04.780137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:04.780906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:04.781365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:04.781971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:04.918815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:04.928002 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9d1d791-3ce8-46fc-b287-8fc424d64c6f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.164198 Aug 30 17:07:04.928597 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3887/7365] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:04 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:05.949503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:05.950139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:05.957056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:05.957554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:05.958004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:05.959282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:05.959808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:05.960209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:06.096125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:06.104469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b254e5f-25c6-4332-a5ea-be56188680be tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.158835 Aug 30 17:07:06.105041 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3479/7366] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:05 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:07.126495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:07.127127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:07.134503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:07.134999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:07.135445 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:07.136145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:07.136613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:07.137074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:07.269377 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:07.278485 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e2a1a5a2-ce35-4534-8259-c23036dca43e tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.155921 Aug 30 17:07:07.279060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3888/7367] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:07 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:08.300279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:08.300903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:08.308038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:08.308530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:08.308976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:08.309664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:08.310128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:08.310586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:08.437546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:08.439888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:08.448299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-717f11f2-683e-4630-8130-60849b75078f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.151950 Aug 30 17:07:08.448873 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3480/7368] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:08 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:09.469175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:09.469794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:09.472629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=29 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:09.478674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:09.479166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:09.479614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:09.480311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:09.480776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:09.481203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:09.483806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=83 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:09.609620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:09.618597 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-43b67ad9-94ab-4a08-9548-b280a0100b45 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.153264 Aug 30 17:07:09.619176 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3889/7369] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:09 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:10.640519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:10.641144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:10.643936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=35 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:10.650648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:10.651145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:10.651592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:10.652286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:10.652745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:10.653181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:10.785649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:10.795044 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7865b97a-3a2c-4f1a-a20f-9a8908b6c722 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.158885 Aug 30 17:07:10.795615 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3481/7370] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:10 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:11.816999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:11.817664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:11.824873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:11.825369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:11.825809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:11.826574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:11.827035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:11.827490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:11.962087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:11.970586 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c79bb80-f99e-4273-961a-5f167d02c8c1 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.157434 Aug 30 17:07:11.971097 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3890/7371] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:11 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:12.991678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:12.992307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:12.999211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:12.999688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:13.000132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:13.000829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:13.001295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:13.001734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:13.135407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:13.143732 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6654606-e170-4e19-bdff-e9f815ea1132 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.156027 Aug 30 17:07:13.144303 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3482/7372] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:12 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:14.166014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:14.166666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:14.173471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:14.173959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:14.174440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:14.175130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:14.175595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:14.176023 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:14.313682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:14.322161 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c002bb79-1b5e-4958-bc6b-cb658714cba5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1725 microversion: 2.1 time: 0.160652 Aug 30 17:07:14.322768 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3891/7373] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:14 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:15.343537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:15.344167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:15.351779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.352284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.352738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.353455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.353926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.354396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.489239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:15.498329 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7dc27f2-0882-48f1-8aa7-f4185c7c45ba tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1722 microversion: 2.1 time: 0.158690 Aug 30 17:07:15.498915 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3483/7374] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:15 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:15.518719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:15.519253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:15.526111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.526636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.527089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.527784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.528249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.528681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.568675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.569150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.569594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.570339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.570807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.571236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.591847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:07:15.596982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Getting quotas for user 9477f7f4efc441a18e52c7d56ac3fe10 and project 700cd21209764b4bbaec276e5f796735. Resources: {'cores', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:07:15.694730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f69fc8b-0b90-4312-9c13-fd3b70255b03 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/action" status: 202 len: 0 microversion: 2.1 time: 0.179752 Aug 30 17:07:15.695358 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3892/7375] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:07:15 2022] POST /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:07:15.703669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:15.704401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:15.711757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.712262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.712712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.713490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:15.713968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:15.714492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:15.914945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:15.923363 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2822a6d9-dbcb-478f-9de4-cc388aa21adf tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.223658 Aug 30 17:07:15.924038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3484/7376] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:15 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:07:16.850552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-plugged", "status": "completed", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:16.861292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:16.861787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:16.862232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:16.873591 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Creating event network-vif-plugged:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h2-830883-28 Aug 30 17:07:16.879076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:07:16.890472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0fc5b5b5-3cf1-4920-8aef-67df1c883a9a req-9840ec55-1766-48d5-a10b-4fdf6fbe1efe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044790 Aug 30 17:07:16.891243 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3893/7377] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:07:16.945797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:16.946399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:16.953472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:16.953974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:16.954453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:16.955161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:16.955632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:16.956069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:17.091613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:17.099916 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7f503c11-94b9-4fea-b1ac-477003f68f15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.158690 Aug 30 17:07:17.100491 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3485/7378] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:16 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:18.122718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:18.124171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:18.131866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:18.132438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:18.132881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:18.133575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:18.135026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:18.136191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:18.286819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:18.295688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cdb0417a-6a15-45ef-b628-ddd16ec46640 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.178093 Aug 30 17:07:18.296536 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3894/7379] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:18 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:19.320745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:19.322486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:19.330487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:19.331050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:19.331507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:19.332281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:19.332757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:19.333203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:19.469215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:19.477987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-450e9633-a5bd-48a8-a2d9-ea6eb2da7eff tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.162457 Aug 30 17:07:19.478593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3486/7380] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:19 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:20.499964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:20.500492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:20.507927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:20.508581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:20.509028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:20.509721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:20.510178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:20.510639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:20.649185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:20.657615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9cdefbf4-e0c6-466c-8944-4aec9db8ddca tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.161624 Aug 30 17:07:20.658202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3895/7381] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:20 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:20.834157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-unplugged", "status": "completed", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:20.847422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:20.848150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:20.848866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:20.862620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Creating event network-vif-unplugged:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:07:20.870282 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:07:20.884194 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-53a987ac-578b-4a74-a9ab-511b838ec27e req-1a31682a-2f0f-4126-bc4a-9bc4d6a2f469 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054860 Aug 30 17:07:20.885004 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3487/7382] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:07:21.681048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:21.681593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:21.682526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:21.689629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:21.690754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:21.690889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:21.691250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:21.691403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:21.691681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:21.692735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:21.693212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:21.693723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:21.706228 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Creating event network-changed:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:07:21.713252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:07:21.725772 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-317d4416-71de-4790-a686-70eea770a1f5 req-71341a7e-f1b4-4516-b0d0-99fe8b29d382 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048946 Aug 30 17:07:21.726944 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3488/7383] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:07:21.845840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:21.854481 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a82bbaf-1df7-4d4e-8f76-078c8027dfd6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.178346 Aug 30 17:07:21.855097 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3896/7384] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:21 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:22.877761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:22.878605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:22.886193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:22.886817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:22.887320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:22.888097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:22.888640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:22.889143 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:23.101748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:23.110977 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8e3af555-b819-439b-9478-33781e86ae88 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.238374 Aug 30 17:07:23.111567 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3489/7385] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:22 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:24.133292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:24.133919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:24.140590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:24.141084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:24.141531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:24.142223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:24.142823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:24.143253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:24.283753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:24.292959 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c50f672d-c168-40fa-a667-2388e5ac8a31 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.164440 Aug 30 17:07:24.293544 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3897/7386] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:24 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:25.314540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:25.315172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:25.322606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:25.323103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:25.323553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:25.324259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:25.324715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:25.325148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:25.461596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:25.471051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8f0e89a0-e0b1-4094-ba95-2b6027449bc6 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.160553 Aug 30 17:07:25.472069 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3490/7387] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:25 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:26.493314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:26.493958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:26.496856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:26.502652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:26.503130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:26.503572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:26.504267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:26.504730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:26.505156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:26.639988 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:26.648911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d4e5281-94b1-4961-b439-0855e1364799 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.159734 Aug 30 17:07:26.649481 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3898/7388] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:26 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:27.669768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:27.670434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:27.677270 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:27.678028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:27.679037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:27.679866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:27.680333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:27.680765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:27.813450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:27.823043 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a1a7772-3cae-4f3b-87ae-609afa994525 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.157191 Aug 30 17:07:27.823628 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3491/7389] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:27 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:28.843726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:28.844345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:28.851372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:28.851855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:28.852293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:28.852974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:28.853430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:28.853859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:28.987975 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:28.997214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b86001b-85ce-45af-b1a5-478680c9408b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.157343 Aug 30 17:07:28.997793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3899/7390] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:28 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:30.018394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:30.018947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:30.025992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:30.026543 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:30.027001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:30.027710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:30.028186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:30.028631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:30.157966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:30.167033 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-daf87048-3c07-427a-ae45-da3391a8af0a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.152622 Aug 30 17:07:30.167613 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3492/7391] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:30 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:31.188761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:31.189411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:31.196094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:31.196579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:31.197054 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:31.197749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:31.198205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:31.198661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:31.329109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:31.338029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d54e9b8-8aea-4428-a8a7-d8817ed2d6b5 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.153137 Aug 30 17:07:31.338852 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3900/7392] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:31 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:32.359535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:32.360158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:32.367633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:32.368125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:32.368571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:32.369264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:32.369726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:32.370158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:32.500427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:32.509215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3b70855-2f99-4c11-b824-4c673f457e48 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.153415 Aug 30 17:07:32.509915 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3493/7393] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:32 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:33.530018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:33.530618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:33.538060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:33.538770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:33.539223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:33.539924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:33.540389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:33.540818 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:33.670996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:33.680303 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b92dd41d-0fe1-4405-83a5-fe29c1ce5255 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1721 microversion: 2.1 time: 0.154411 Aug 30 17:07:33.680926 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3901/7394] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:33 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:34.701640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:34.702273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:34.709132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:34.709627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:34.710077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:34.710823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:34.711908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:34.712351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:34.846893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:34.855565 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-96bf6407-e77a-4047-b446-b2a636284986 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1714 microversion: 2.1 time: 0.157865 Aug 30 17:07:34.856185 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3494/7395] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:34 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:34.877114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:34.877750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:34.885513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:34.886003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:34.886482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:34.887176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:34.887639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:34.888067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.021606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:35.030688 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b74feb0-42c1-44bc-95f8-08071627b39b tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1714 microversion: 2.1 time: 0.157367 Aug 30 17:07:35.031263 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3902/7396] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:34 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:35.050650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:35.051292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:35.058117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.058663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.059122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.059829 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.060304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.060788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.187260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:35.196166 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b9002fa-b1af-4535-8c67-833ceb867a09 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1714 microversion: 2.1 time: 0.148797 Aug 30 17:07:35.196951 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3495/7397] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:35 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:35.216046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:35.216552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:35.222650 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.223126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.223566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.224260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.224717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.225143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.227924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:35.253095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:07:35.332128 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5e1d2a74-4c4e-4655-a595-b8de5a0f87eb tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 204 len: 0 microversion: 2.1 time: 0.119671 Aug 30 17:07:35.336556 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3903/7398] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:07:35 2022] DELETE /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:07:35.341680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:35.342375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:35.348250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.348739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.349180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.349872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:35.350367 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:35.350809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:35.530922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:35.539824 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-661eee22-e671-40df-af01-569c4b3d60cc tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1720 microversion: 2.1 time: 0.201483 Aug 30 17:07:35.540639 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3496/7399] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:35 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:07:36.562418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:36.563125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:36.569903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:36.571045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:36.571488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:36.572170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:36.572625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:36.573049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:36.747718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:36.756049 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f11a76ac-c64b-4cc6-90e2-2a5413cdba74 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1720 microversion: 2.1 time: 0.197958 Aug 30 17:07:36.756630 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3904/7400] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:36 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:37.489825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-plugged", "status": "completed", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:37.500523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:37.501023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:37.501472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:37.517785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] Creating event network-vif-plugged:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:07:37.523335 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-89121542-1e53-41e9-ba07-5bdfaf1f3dfd req-054186bf-918e-49f3-9cf4-dffed3cf20a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038585 Aug 30 17:07:37.524835 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3497/7401] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:07:37.779011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:37.779636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:37.786495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:37.786990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:37.787432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:37.788129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:37.788586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:37.789031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:37.859923 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:37.869606 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-11eb0714-8026-4347-b713-efb4a8a3e71c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1653 microversion: 2.1 time: 0.094922 Aug 30 17:07:37.870441 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3905/7402] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:37 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:37.889508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7", "name": "network-vif-deleted", "tag": "50d463dd-5f3d-4b5d-bc9d-06cc28dc839c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:37.900617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:37.901123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:37.901569 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:37.913664 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] Creating event network-vif-deleted:50d463dd-5f3d-4b5d-bc9d-06cc28dc839c for instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 on n-h1-830883-28 Aug 30 17:07:37.919253 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-44b7bbfb-0a42-49da-a65c-db854116b506 req-3ebf05f2-1268-48f5-a716-517b75c59190 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Aug 30 17:07:37.919931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3498/7403] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:07:38.891036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:38.891767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:38.899877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:38.900470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:38.900995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:38.901955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:38.902528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:38.903041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:38.969664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:38.979701 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-21fbde13-e759-49db-a01e-5608d39a0859 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1368 microversion: 2.1 time: 0.092608 Aug 30 17:07:38.980289 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3906/7404] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:38 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:40.003153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:40.003883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:40.011341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:40.011849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:40.012309 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:40.013021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:40.013499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:40.013943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:40.030202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=100 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:40.083139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:40.092189 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a791a097-0166-4920-a0d8-5d3338d592af tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1368 microversion: 2.1 time: 0.094780 Aug 30 17:07:40.092765 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3499/7405] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:39 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:41.113384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:41.114026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:41.117397 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:41.123451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:41.123962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:41.124413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:41.125144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:41.125645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:41.126084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:41.192243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:41.200944 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-58a4c8f0-44b6-4b5c-a67a-fe89dc38cc4c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1368 microversion: 2.1 time: 0.091555 Aug 30 17:07:41.201733 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3907/7406] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:41 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:42.279748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:42.280383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:42.283062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=38 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:42.288419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:42.289421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:42.290108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:42.290870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:42.291343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:42.291789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:42.323357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:42.323852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:42.324305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:42.324766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lazy-loading 'fault' on Instance uuid 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:07:42.368583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477f7f4efc441a18e52c7d56ac3fe10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700cd21209764b4bbaec276e5f796735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:42.377240 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-17134621-575c-47b7-b47b-5d236b9efe90 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 200 len: 1373 microversion: 2.1 time: 0.101434 Aug 30 17:07:42.377822 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3500/7407] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:42 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 1373 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:43.400347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:43.401209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:43.408107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:43.408594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:43.409034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:43.409777 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:43.410240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:43.410691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:43.424157 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 HTTP/1.1 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7'} Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:43.425790 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1c350a4-acaa-4907-aea0-6cd9a5cd4cee tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 404 len: 111 microversion: 2.1 time: 0.030982 Aug 30 17:07:43.431227 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3908/7408] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:43 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:43.487067 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:43.489255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:43.496677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:43.497180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:43.497635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:43.498371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:43.498845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:43.499290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:43.512440 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-volume_attachments HTTP/1.1 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7'} Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:43.514110 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7fd1bae-16f3-40d4-8cd9-ca5e6cf2151a tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032588 Aug 30 17:07:43.517737 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3501/7409] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:07:43 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:46.836745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:46.837375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:46.844566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.845045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.845494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.846202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.846696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.847133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.860694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 HTTP/1.1 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7'} Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:46.862267 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b47ee58-6313-455a-87d8-84144bbff534 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 404 len: 111 microversion: 2.1 time: 0.032019 Aug 30 17:07:46.867373 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3909/7410] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:07:46 2022] DELETE /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:46.872290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:46.872912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:46.879560 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.880069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.880495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.881184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.881648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.882081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.895746 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 HTTP/1.1 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7'} Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.897246 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c41325a1-cbbb-4027-9fe6-c837d8cb061c tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7" status: 404 len: 111 microversion: 2.1 time: 0.031405 Aug 30 17:07:46.902889 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3502/7411] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:46 2022] GET /compute/v2.1/servers/09cec8e0-9ce2-4c43-be04-eb0b56aeb5b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:07:46.908610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:46.909151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:46.917216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.917778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.918224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.918985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.919457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.919900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.935624 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 HTTP/1.1 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '4002884c-0f5a-407a-be03-8415ef17f7a7'} Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:46.937236 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:46.941502 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d87754be-2f01-4634-8c9c-b6965cd5406f tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 404 len: 111 microversion: 2.1 time: 0.034021 Aug 30 17:07:46.943046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3910/7412] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:07:46 2022] DELETE /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:46.948808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:46.949427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 4002884c-0f5a-407a-be03-8415ef17f7a7] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:46.955603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.956103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.956548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.957258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.957721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.958191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.973472 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 HTTP/1.1 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '4002884c-0f5a-407a-be03-8415ef17f7a7'} Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:46.975062 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 4002884c-0f5a-407a-be03-8415ef17f7a7 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6411c465-070c-48ab-a65e-49a18070716d tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 30 17:07:46.980436 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3503/7413] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:46 2022] GET /compute/v2.1/servers/4002884c-0f5a-407a-be03-8415ef17f7a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:46.986288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:46.986834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:46.993268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.994452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.994912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:46.995640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:46.996111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:46.996557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.012832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde HTTP/1.1 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '087938d2-2d7d-4b1f-984f-5119a60a1fde'} Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:47.014674 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.018885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.020251 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:47.021234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d705bce7-5172-4e5c-89e0-2d0f24ef1339 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 404 len: 111 microversion: 2.1 time: 0.038920 Aug 30 17:07:47.021861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3911/7414] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:07:46 2022] DELETE /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:47.031703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:47.032377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: 087938d2-2d7d-4b1f-984f-5119a60a1fde] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:47.038392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.038924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.039373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.040074 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.040536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.040971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.055400 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde HTTP/1.1 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '087938d2-2d7d-4b1f-984f-5119a60a1fde'} Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.056945 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance 087938d2-2d7d-4b1f-984f-5119a60a1fde could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a8555515-865e-464a-b7b3-b760f0941aaa tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde" status: 404 len: 111 microversion: 2.1 time: 0.031717 Aug 30 17:07:47.063742 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3504/7415] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:47 2022] GET /compute/v2.1/servers/087938d2-2d7d-4b1f-984f-5119a60a1fde => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:47.068985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:47.069588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:47.076651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.077216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.077727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.078525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.079085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.079588 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.095922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f HTTP/1.1 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'a46be901-cef9-4498-ab23-2606ec6e695f'} Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:47.097585 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-94f3c691-a71c-4d93-b62b-8f701e7fc866 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 404 len: 111 microversion: 2.1 time: 0.034636 Aug 30 17:07:47.101195 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3912/7416] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:07:47 2022] DELETE /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:47.107975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:47.108611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [instance: a46be901-cef9-4498-ab23-2606ec6e695f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:47.114836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.115337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.115790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.116498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:47.117513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:47.118269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:47.131747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] HTTP exception thrown: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Request method failure captured: Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f HTTP/1.1 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkJTwLiuqvvL6Hm-10BiY48GkyHMkiapIQ1bxaMiAfiBdUfUMYNUVByLWWQZnm0giQ7Hgz0AnpBVwx7vmTt42fTbyoJQeSeJry3ksI-3rf_ALoiXfhZDLsjUL_48yqXY8_Oo0nIH0RW8NnLqVYzA-WAn5IeRJGHpbX5gWkDuOkqm4uI Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_700cd21209764b4bbaec276e5f796735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/700cd21209764b4bbaec276e5f796735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/700cd21209764b4bbaec276e5f796735"}]}] Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 700cd21209764b4bbaec276e5f796735 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServerActionsTestJSON-2084217397 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 9477f7f4efc441a18e52c7d56ac3fe10 Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServerActionsTestJSON-2084217397-project Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'a46be901-cef9-4498-ab23-2606ec6e695f'} Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:07:47.134003 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Returning 404 to user: Instance a46be901-cef9-4498-ab23-2606ec6e695f could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3995d6ed-e3fa-4735-946d-fe85ac0aab15 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f" status: 404 len: 111 microversion: 2.1 time: 0.031453 Aug 30 17:07:47.137731 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3505/7417] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:47 2022] GET /compute/v2.1/servers/a46be901-cef9-4498-ab23-2606ec6e695f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:07:47.144707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cde5afec-b05b-49bf-9ca3-bfbdfcd91e44 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] Calling method '.version_select at 0x7fd35cce4700>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:47.149251 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cde5afec-b05b-49bf-9ca3-bfbdfcd91e44 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [20cd4c3a-6a24-4238-8e45-8efa682ef296] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:07:48.156786 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [None req-cde5afec-b05b-49bf-9ca3-bfbdfcd91e44 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] [20cd4c3a-6a24-4238-8e45-8efa682ef296] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 49604. Aug 30 17:07:48.178169 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cde5afec-b05b-49bf-9ca3-bfbdfcd91e44 tempest-ServerActionsTestJSON-2084217397 tempest-ServerActionsTestJSON-2084217397-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979526234" status: 202 len: 0 microversion: 2.1 time: 1.037510 Aug 30 17:07:48.178772 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3913/7418] 10.222.0.47 () {58 vars in 1218 bytes} [Tue Aug 30 17:07:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979526234 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:07:57.299100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=13 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:57.300478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=21 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:57.431495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1592120733", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "fa58f10f-b693-4ae2-af91-a264a595fb39"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:07:57.491082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] validate_networks() for [('fa58f10f-b693-4ae2-af91-a264a595fb39', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:07:57.981979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:07:57.982491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:07:57.983139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:07:57.983579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:07:57.984041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:07:57.994393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:57.994932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:57.995875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:57.996640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:57.997119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:57.997564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:58.017377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Getting quotas for project 876af2a038f749fb96c581b81fe65cdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:07:58.023787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Getting quotas for user 2f75ec5108ab469db234e361a30aebae and project 876af2a038f749fb96c581b81fe65cdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:07:58.037257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:07:58.040012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:07:58.088802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8dc2d63e-a21f-43ff-9395-6655dc7f220c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795058 Aug 30 17:07:58.089460 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3506/7419] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:07:58.100428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daf21265-54cb-4b4e-a11b-e0fab469299f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:58.101190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daf21265-54cb-4b4e-a11b-e0fab469299f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:58.106076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:07:58.166261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daf21265-54cb-4b4e-a11b-e0fab469299f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:58.173895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daf21265-54cb-4b4e-a11b-e0fab469299f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1217 microversion: 2.1 time: 0.077292 Aug 30 17:07:58.174517 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3914/7420] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:58 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:07:59.196994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:07:59.202465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:07:59.208248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:59.208763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:59.209214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:59.209930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:07:59.210511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:07:59.211041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:07:59.611734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:07:59.620293 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e399bb2a-81d8-4d0f-b654-0fdb450426a0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1277 microversion: 2.1 time: 0.429048 Aug 30 17:07:59.620885 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3507/7421] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:07:59 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:00.646949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:00.648577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:00.658184 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:00.659058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:00.659732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:00.661026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:00.661698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:00.662960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:00.848318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:00.857861 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f1d8e40-5710-49c8-8103-80ec079ec556 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.218147 Aug 30 17:08:00.871122 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3915/7422] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:00 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:01.188071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d60217-2e85-4f1b-8ac0-131cb323ef6d", "tag": "dc8a5855-3fff-4ca8-837c-3f773c8cb82e"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:01.205745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:01.206250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:01.206752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:01.220900 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] Creating event network-changed:dc8a5855-3fff-4ca8-837c-3f773c8cb82e for instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d on n-h1-830883-28 Aug 30 17:08:01.226722 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-213ef44f-5319-4d83-a451-b9c6cec41ae3 req-a453ffb4-e317-4361-bf6f-8ab8889d5faa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123147 Aug 30 17:08:01.227812 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3508/7423] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:01.881283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:01.882014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:01.889618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:01.890207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:01.890711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:01.891409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:01.891869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:01.892299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:02.023907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:02.031998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6036c40-16db-4357-88a7-4d18d99af8ba tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.154730 Aug 30 17:08:02.032586 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3916/7424] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:01 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:03.054175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:03.054961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:03.061043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:03.061534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:03.062024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:03.062754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:03.063240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:03.063674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:03.196407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:03.204215 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffa4732d-86aa-4bcd-9b2b-231406b24835 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.155516 Aug 30 17:08:03.204784 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3509/7425] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:03 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:04.225155 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:04.226619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:04.233697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:04.234187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:04.234663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:04.235365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:04.235832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:04.236269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:04.367293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:04.375208 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fab92c86-02e1-4385-bca0-b77334a68372 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.154098 Aug 30 17:08:04.375819 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3917/7426] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:04 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:05.396096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:05.396721 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:05.403185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:05.403681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:05.404127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:05.404822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:05.405286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:05.405729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:05.544261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:05.552818 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f704bbe3-e5a4-4adc-b30b-c77784c7727b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.160636 Aug 30 17:08:05.553397 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3510/7427] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:05 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:05.684382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d60217-2e85-4f1b-8ac0-131cb323ef6d", "name": "network-vif-plugged", "status": "completed", "tag": "dc8a5855-3fff-4ca8-837c-3f773c8cb82e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:05.693990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:05.694530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:05.695396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:05.705998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] Creating event network-vif-plugged:dc8a5855-3fff-4ca8-837c-3f773c8cb82e for instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d on n-h1-830883-28 Aug 30 17:08:05.711261 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-52a673ea-1b89-4e78-842b-c6083fdf67c2 req-16cf8ec6-6024-444e-bda2-fc42b4ccaa8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092905 Aug 30 17:08:05.711798 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3918/7428] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:06.574863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:06.575488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:06.582296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:06.582820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:06.583266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:06.583957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:06.584422 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:06.584861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:06.715289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:06.723460 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-04e5d352-fb0a-40ae-a802-f58d8982d908 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1317 microversion: 2.1 time: 0.152693 Aug 30 17:08:06.724024 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3511/7429] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:06 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:07.746561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:07.747287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:07.753795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:07.754282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:07.754748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:07.755442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:07.755897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:07.756320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:07.886337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:07.894267 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9afcd564-16e9-45ef-8736-6340c6b33b12 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.153827 Aug 30 17:08:07.894906 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3919/7430] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:07 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:07.955364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-841995397", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "fa58f10f-b693-4ae2-af91-a264a595fb39"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:07.964517 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:08:07.964692 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:08:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.47) !!! Aug 30 17:08:08.005944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:08.020797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] validate_networks() for [('fa58f10f-b693-4ae2-af91-a264a595fb39', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:08:08.030975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:08.391088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:08:08.391558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:08:08.392079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:08:08.392503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:08:08.392932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:08:08.402704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:08.403200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:08.403648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:08.404383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:08.404851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:08.405288 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:08.422588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Getting quotas for project 876af2a038f749fb96c581b81fe65cdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:08:08.428128 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Getting quotas for user 2f75ec5108ab469db234e361a30aebae and project 876af2a038f749fb96c581b81fe65cdf. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:08:08.440633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:08:08.442934 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:08:08.489213 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0671fa55-789f-418e-8370-c71d4cf4d44c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538136 Aug 30 17:08:08.491076 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3512/7431] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:08:08.500718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b426030c-da62-4df1-98f0-1ecc4092ec60 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:08.501369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b426030c-da62-4df1-98f0-1ecc4092ec60 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:08.503476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:08.568422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b426030c-da62-4df1-98f0-1ecc4092ec60 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:08.575896 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b426030c-da62-4df1-98f0-1ecc4092ec60 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1216 microversion: 2.1 time: 0.079073 Aug 30 17:08:08.576688 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3920/7432] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:08 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:09.597415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:09.598054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:09.606117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:09.606791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:09.607238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:09.607949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:09.608497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:09.608853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:09.694374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:09.703402 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-954ad496-a80a-4dbe-92b6-1012884d7412 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1276 microversion: 2.1 time: 0.110904 Aug 30 17:08:09.703981 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3513/7433] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:09 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:10.724749 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:10.725386 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:10.733805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:10.734321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:10.734783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:10.735501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:10.735967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:10.736408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:10.877089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:10.886368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f0f872f6-2247-456c-9f6b-d8402f4199df tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.165514 Aug 30 17:08:10.886973 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3921/7434] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:10 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:10.985411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46499036-f7d5-4d4f-9cc9-43de10ca056e", "tag": "1b599e8b-5cb0-4420-9e2c-20f24dbc20af"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:10.996131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:10.996621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:10.997066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:11.011982 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] Creating event network-changed:1b599e8b-5cb0-4420-9e2c-20f24dbc20af for instance 46499036-f7d5-4d4f-9cc9-43de10ca056e on n-h2-830883-28 Aug 30 17:08:11.017003 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-162e1a5c-54e1-4442-83be-2f20e1226d6b req-d9e7d351-7071-4292-bcec-4ac7a07e75f6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035302 Aug 30 17:08:11.017617 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3514/7435] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:11.908131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:11.908755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:11.911474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:11.918123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:11.918688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:11.919183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:11.919887 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:11.920390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:11.920824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:12.052915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:12.061057 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-03a1ce78-2bde-434f-a517-ae3b4fdf3d03 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.156870 Aug 30 17:08:12.061739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3922/7436] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:11 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:13.082472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:13.083226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:13.090097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:13.090628 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:13.091095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:13.091820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:13.092273 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:13.092715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:13.221060 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:13.229509 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a6fd0d7c-7960-457f-b921-aa5b316ebf8c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.152187 Aug 30 17:08:13.230076 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3515/7437] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:13 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:14.250654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:14.251276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:14.259301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:14.259787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:14.260230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:14.260927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:14.261390 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:14.261822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:14.393742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:14.402449 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0e244ddc-6eff-4387-bdbd-b5a9e5838e98 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.155747 Aug 30 17:08:14.403038 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3923/7438] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:14 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:15.424003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:15.424627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:15.432762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:15.433258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:15.433705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:15.434430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:15.434899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:15.435354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:15.564878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:15.573536 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a893eab-c753-4334-bb02-1a310545d39b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.153437 Aug 30 17:08:15.574112 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3516/7439] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:15 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:16.594493 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:16.595124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:16.602590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:16.603156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:16.603607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:16.604313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:16.604775 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:16.605242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:16.736726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:16.744528 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d60653c-2e5f-4d58-bcdf-47b641b8906f tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.154025 Aug 30 17:08:16.745104 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3924/7440] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:16 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:17.169397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46499036-f7d5-4d4f-9cc9-43de10ca056e", "name": "network-vif-plugged", "status": "completed", "tag": "1b599e8b-5cb0-4420-9e2c-20f24dbc20af"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:17.180943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:17.181446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:17.181889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:17.193291 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] Creating event network-vif-plugged:1b599e8b-5cb0-4420-9e2c-20f24dbc20af for instance 46499036-f7d5-4d4f-9cc9-43de10ca056e on n-h2-830883-28 Aug 30 17:08:17.198910 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-75847110-4cf3-467b-a73e-f516c12e60e5 req-abbcb745-d8e5-41cc-9b02-a7165faf11b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Aug 30 17:08:17.199727 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3517/7441] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:17.765014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:17.765642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:17.772631 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:17.773211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:17.773652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:17.774371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:17.774831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:17.775258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:17.907303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:17.916073 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e04ccfdf-cf05-4510-87ce-b8ae3cd0e897 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1316 microversion: 2.1 time: 0.154975 Aug 30 17:08:17.916653 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3925/7442] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:17 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:18.935213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:18.936112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:18.940444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:18.941160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:18.949087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:18.949593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:18.950049 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:18.950790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:18.951260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:18.951733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:19.083132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:19.091312 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-979b3c2c-7f33-499f-b08d-67dd0fedb20a tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1505 microversion: 2.1 time: 0.157966 Aug 30 17:08:19.091882 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3518/7443] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:18 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:19.111934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:19.112436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:19.114358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:19.121135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:19.121617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:19.122056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:19.122773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:19.123235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:19.123661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:19.149801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:08:19.226072 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-df941290-3646-444a-9e80-40f9de834b17 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 204 len: 0 microversion: 2.1 time: 0.117514 Aug 30 17:08:19.227638 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3926/7444] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:08:19 2022] DELETE /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:08:19.235558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:19.236184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:19.242463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:19.243098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:19.243549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:19.244242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:19.244858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:19.245304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:19.379264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:19.388171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-08296a97-7a1c-417a-b68c-3b72871e38b5 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1511 microversion: 2.1 time: 0.156734 Aug 30 17:08:19.388728 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3519/7445] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:19 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:08:20.409970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:20.410717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:20.422096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:20.422630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:20.423084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:20.423795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:20.424266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:20.424702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:20.563141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:20.571713 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f3b9645a-61a5-4c23-9535-d40424bd148c tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1511 microversion: 2.1 time: 0.166096 Aug 30 17:08:20.572295 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3927/7446] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:20 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:21.176161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46499036-f7d5-4d4f-9cc9-43de10ca056e", "name": "network-vif-deleted", "tag": "1b599e8b-5cb0-4420-9e2c-20f24dbc20af"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:21.190062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:21.190591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:21.191084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:21.209397 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] Creating event network-vif-deleted:1b599e8b-5cb0-4420-9e2c-20f24dbc20af for instance 46499036-f7d5-4d4f-9cc9-43de10ca056e on n-h2-830883-28 Aug 30 17:08:21.220741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-036e60a5-fb1c-46dc-a859-60134a8b136a req-73873a9c-61ee-4507-aa31-6e81779e595c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045843 Aug 30 17:08:21.221744 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3520/7447] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:21.593109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:21.593655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:21.601687 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:21.602206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:21.602681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:21.603380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:21.603838 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:21.604266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:21.636644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:21.637161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:21.637782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:21.638243 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lazy-loading 'fault' on Instance uuid 46499036-f7d5-4d4f-9cc9-43de10ca056e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:08:21.683262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:21.691134 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-472f06d5-203c-493a-ad22-49ff21f14657 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 200 len: 1306 microversion: 2.1 time: 0.101974 Aug 30 17:08:21.691709 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3928/7448] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:21 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:22.714004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:22.714776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:22.721088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.721590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.722044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:22.722811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.723287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.723734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:22.737515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e HTTP/1.1 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '46499036-f7d5-4d4f-9cc9-43de10ca056e'} Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:22.739211 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 404 to user: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-65f1f619-e6d6-496a-8186-ebcd59067e2d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 404 len: 111 microversion: 2.1 time: 0.031836 Aug 30 17:08:22.747481 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3521/7449] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:22 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:08:22.753225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:22.753854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:22.761034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.761530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.761980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:22.762713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.763182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.763619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:22.892055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:22.900317 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81914971-51d2-42bb-8b07-4de67fbe8766 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.151003 Aug 30 17:08:22.900897 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3929/7450] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:22 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:22.920899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:22.923145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 58c9bddf-56c8-4354-860c-e12764b99599] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:22.929641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/58c9bddf-56c8-4354-860c-e12764b99599/action HTTP/1.1 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 32 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: {"resize": {"flavorRef": "452"}} Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '58c9bddf-56c8-4354-860c-e12764b99599', 'body': {'resize': {'flavorRef': '452'}}} Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1167, in _action_resize Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1074, in _resize Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:08:22.931311 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 404 to user: Instance 58c9bddf-56c8-4354-860c-e12764b99599 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3d385f9-bfcc-42ce-a841-ebbd796f9f44 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "POST /compute/v2.1/servers/58c9bddf-56c8-4354-860c-e12764b99599/action" status: 404 len: 111 microversion: 2.1 time: 0.015898 Aug 30 17:08:22.935797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3522/7451] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:08:22 2022] POST /compute/v2.1/servers/58c9bddf-56c8-4354-860c-e12764b99599/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:08:22.941072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:22.941690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:22.947894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.948378 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.948819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:22.949531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:22.949989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:22.950463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.082018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.090657 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-40f838f3-cbed-401a-a80c-ebd791fe6993 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.153411 Aug 30 17:08:23.091242 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3930/7452] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:22 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:08:23.112004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.112604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.119512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.120008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.120453 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.121141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.121603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.122040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.254016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.261902 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f085df69-c301-40fe-845a-0d2689443152 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.153773 Aug 30 17:08:23.262519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3523/7453] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:23 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:23.283191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "76695c0f-1440-44f2-a593-e300c903b2dd"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:23.285479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.291717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.292199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.292635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.293318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.293772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.294197 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.298284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:23.336578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.342000 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: request: POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action HTTP/1.1 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 65 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: {"resize": {"flavorRef": "76695c0f-1440-44f2-a593-e300c903b2dd"}} Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: exception: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c9d60217-2e85-4f1b-8ac0-131cb323ef6d', 'body': {'resize': {'flavorRef': '76695c0f-1440-44f2-a593-e300c903b2dd'}}} Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1081, in _resize Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4210, in resize Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:23.343944 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1167, in _action_resize Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1111, in _resize Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 400 to user: Flavor 76695c0f-1440-44f2-a593-e300c903b2dd could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-094060a6-1c11-40b6-9266-db6d155be64d tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action" status: 400 len: 107 microversion: 2.1 time: 0.066378 Aug 30 17:08:23.348233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3931/7454] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:08:23 2022] POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:08:23.354095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.354811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.360790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.361287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.361740 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.362470 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.362944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.363383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.496480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.504321 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d78f91bc-89d0-4f99-ae6a-e915629c3b95 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.154059 Aug 30 17:08:23.504908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3524/7455] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:23 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:08:23.525240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.525872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.531911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.532407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.532857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.533624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.534019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.534536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.664272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.672368 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a292da6-6f35-472f-a0cd-aa1a7276df7e tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.151149 Aug 30 17:08:23.672949 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3932/7456] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:23 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:23.693440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2eed5190-0464-4fa3-9622-5ac3babe0293 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2eed5190-0464-4fa3-9622-5ac3babe0293 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: request: POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action HTTP/1.1 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 29 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: {"resize": {"flavorRef": ""}} Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'c9d60217-2e85-4f1b-8ac0-131cb323ef6d', 'body': {'resize': {'flavorRef': ''}}} Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise error Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi '' Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.697313 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2eed5190-0464-4fa3-9622-5ac3babe0293 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2eed5190-0464-4fa3-9622-5ac3babe0293 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action" status: 400 len: 113 microversion: 2.1 time: 0.009310 Aug 30 17:08:23.702275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3525/7457] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:08:23 2022] POST /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 17:08:23.706961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.707576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.713977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.714508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.714949 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.715642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.716095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.716520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.851812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:23.859647 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-86e8347b-a175-4c75-bba2-f51532293328 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1506 microversion: 2.1 time: 0.156410 Aug 30 17:08:23.860229 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3933/7458] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:23 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:23.884472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.884979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.892103 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.892602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.893056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.893768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.894240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.894710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.908677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e HTTP/1.1 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '46499036-f7d5-4d4f-9cc9-43de10ca056e'} Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1123, in delete Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:08:23.910226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 404 to user: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9b4a49e-60d1-406a-9ca6-edf16b7049cf tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 404 len: 111 microversion: 2.1 time: 0.032402 Aug 30 17:08:23.915221 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3526/7459] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:08:23 2022] DELETE /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:08:23.921073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.921698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: 46499036-f7d5-4d4f-9cc9-43de10ca056e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.927985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.928472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.929225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.929934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.930436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.930871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.944412 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e HTTP/1.1 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '46499036-f7d5-4d4f-9cc9-43de10ca056e'} Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:23.946102 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 404 to user: Instance 46499036-f7d5-4d4f-9cc9-43de10ca056e could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:23.950581 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-669f4ca8-079f-47e7-bfe1-f57b25a206d7 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e" status: 404 len: 111 microversion: 2.1 time: 0.030278 Aug 30 17:08:23.951112 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3934/7460] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:23 2022] GET /compute/v2.1/servers/46499036-f7d5-4d4f-9cc9-43de10ca056e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:08:23.956124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:23.956646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:23.963512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.964019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.964476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.965183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:23.965656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:23.966102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:23.992234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:08:24.067737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-09c0248c-11da-4a42-b61b-03e4d9260ce0 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 204 len: 0 microversion: 2.1 time: 0.115052 Aug 30 17:08:24.068267 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3527/7461] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:08:23 2022] DELETE /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:08:24.077298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:24.077918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:24.083990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:24.084480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:24.085530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:24.086536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:24.087003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:24.087435 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:24.221461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:24.226954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-379e451c-9144-4843-a940-8ea2b9d83017 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1512 microversion: 2.1 time: 0.153535 Aug 30 17:08:24.227534 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3935/7462] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:24 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:25.249082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:25.249790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:25.257253 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:25.257767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:25.258197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:25.259029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:25.259564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:25.260003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:25.265019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:25.393201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:25.401093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70e05f44-f5f7-450e-93c5-18861791c071 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1512 microversion: 2.1 time: 0.156306 Aug 30 17:08:25.401665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3528/7463] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:25 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:26.293264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d60217-2e85-4f1b-8ac0-131cb323ef6d", "name": "network-vif-deleted", "tag": "dc8a5855-3fff-4ca8-837c-3f773c8cb82e"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:26.305737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:26.306237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:26.306748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:26.321404 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] Creating event network-vif-deleted:dc8a5855-3fff-4ca8-837c-3f773c8cb82e for instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d on n-h1-830883-28 Aug 30 17:08:26.327719 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-efd8cb15-b35d-4650-acfd-54c3e4e284f4 req-88bb2014-5fe5-4627-854e-386279b88447 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037384 Aug 30 17:08:26.328353 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3936/7464] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:26.422106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:26.422769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:26.430458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:26.430961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:26.431410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:26.432118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:26.432578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:26.433016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:26.466661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:26.467272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:26.467788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:26.468796 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lazy-loading 'fault' on Instance uuid c9d60217-2e85-4f1b-8ac0-131cb323ef6d {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:08:26.512576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f75ec5108ab469db234e361a30aebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876af2a038f749fb96c581b81fe65cdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:26.520359 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e316000a-5fbc-4486-bc2e-2e34d0c19e27 tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 200 len: 1307 microversion: 2.1 time: 0.102106 Aug 30 17:08:26.520916 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3529/7465] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:26 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:08:27.542330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:27.542971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] [instance: c9d60217-2e85-4f1b-8ac0-131cb323ef6d] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:27.550126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:27.550657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:27.551106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:27.552078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:27.552541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:27.552970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:27.566902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] HTTP exception thrown: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Request method failure captured: Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d HTTP/1.1 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkPt7qfeMuwTtEpcXDNfsZAVy9mScDFqUxVsqePlpQymurFRHeKk1ZUofyIJ49JCG2IeI9LU71TbDorkr-IyZcuMC_1irsIu6Kd36w5qW0hcBjJQ8EpSZaUEGNLfxtMnBs7WqclUL4QYRJL9bEnv8HGnjGNINFWBIKb_Tm3zzZx-GPQ Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/876af2a038f749fb96c581b81fe65cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/876af2a038f749fb96c581b81fe65cdf"}]}] Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 876af2a038f749fb96c581b81fe65cdf Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1934012689 Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 2f75ec5108ab469db234e361a30aebae Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-ServersNegativeTestJSON-1934012689-project Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c9d60217-2e85-4f1b-8ac0-131cb323ef6d'} Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:08:27.568525 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] Returning 404 to user: Instance c9d60217-2e85-4f1b-8ac0-131cb323ef6d could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a076fc49-e899-4767-bb89-76c8ba10b50b tempest-ServersNegativeTestJSON-1934012689 tempest-ServersNegativeTestJSON-1934012689-project] 10.222.0.47 "GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d" status: 404 len: 111 microversion: 2.1 time: 0.032232 Aug 30 17:08:27.573202 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3937/7466] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:27 2022] GET /compute/v2.1/servers/c9d60217-2e85-4f1b-8ac0-131cb323ef6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:08:58.594844 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:58.596247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:58.770508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-56eda62f-22cf-4285-94e6-e7ccf7289096 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: .version_select at 0x7fd35cc76f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-177743695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL1DJzNBKbFoYJyGmtToNDbKAmfiipI3WH5iXGT6q162Cwb6ReuPGaaW9SmYFIEHyZoeIUWbmV8SK5wrgW2923HJq2oEcasLna8xyCFsMO11yAF9orQjZfbBA/kGXKUyg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:58.787327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-56eda62f-22cf-4285-94e6-e7ccf7289096 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:08:58.793050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-56eda62f-22cf-4285-94e6-e7ccf7289096 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:08:58.822804 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-56eda62f-22cf-4285-94e6-e7ccf7289096 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.233036 Aug 30 17:08:58.823432 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3530/7467] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:08:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:08:58.876526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-556724055", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-177743695", "networks": [{"uuid": "06643751-fbd3-4c8a-a9eb-5651b4715827"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:08:58.886064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:58.886753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=26 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:08:58.936431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] validate_networks() for [('06643751-fbd3-4c8a-a9eb-5651b4715827', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:08:59.326957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:08:59.327391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:08:59.327869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:08:59.328284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:08:59.328700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:08:59.338373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:59.338837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:59.339274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:59.339995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:08:59.340451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:08:59.340878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:08:59.360183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:08:59.365856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:08:59.378533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:08:59.381005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:08:59.428285 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-be08d4a1-ef56-4f2e-a10f-2e3ba4025ac8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555576 Aug 30 17:08:59.428955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3938/7468] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:08:59.439665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aeae3d24-0c02-4ae7-b1ef-663b157f216b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:08:59.440427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aeae3d24-0c02-4ae7-b1ef-663b157f216b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:08:59.495997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aeae3d24-0c02-4ae7-b1ef-663b157f216b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:08:59.503119 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aeae3d24-0c02-4ae7-b1ef-663b157f216b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1261 microversion: 2.1 time: 0.067428 Aug 30 17:08:59.503703 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3531/7469] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:08:59 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:00.529097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:00.530434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:00.540040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:00.540839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:00.541671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:00.542678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:00.543591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:00.544240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:00.624323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:00.636692 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d844751b-28f8-4c70-9159-0faa0ee1155b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1321 microversion: 2.1 time: 0.116105 Aug 30 17:09:00.637966 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3939/7470] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:00 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1321 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:01.662962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:01.663706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:01.672380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:01.673009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:01.673555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:01.674663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:01.675388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:01.676183 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:01.903144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:01.922526 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d2ab8476-b41f-476b-81bc-f7f100d38515 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.264074 Aug 30 17:09:01.930739 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3532/7471] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:01 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:02.414513 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b777b80b-5aa7-4176-9f45-59e137c583b2", "tag": "ecf1410a-eec0-4612-b779-193a213e00a6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:02.436512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:02.437794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:02.438045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:02.465936 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] Creating event network-changed:ecf1410a-eec0-4612-b779-193a213e00a6 for instance b777b80b-5aa7-4176-9f45-59e137c583b2 on n-h1-830883-28 Aug 30 17:09:02.474702 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-48f1fe6f-c57b-41c7-adac-aed902d90286 req-c974e152-a823-49ec-8174-9b55c6a0aa0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069808 Aug 30 17:09:02.476730 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3940/7472] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:02.947200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:02.947854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:02.954904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:02.955399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:02.955874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:02.956657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:02.957124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:02.957556 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:03.097172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:03.105083 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6b3330cd-0007-4c6e-8fbd-2127e9098b44 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.162507 Aug 30 17:09:03.105656 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3533/7473] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:02 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:04.128106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:04.128830 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:04.136669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:04.137180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:04.137956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:04.138716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:04.139183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:04.139800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:04.291005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:04.300836 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a8bbe31b-f040-4ab2-aee4-33479f987e33 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.177958 Aug 30 17:09:04.301698 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3941/7474] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:04 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:05.323328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:05.323950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:05.330813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:05.331305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:05.331749 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:05.332443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:05.332907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:05.333343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:05.467695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:05.477141 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-025d5753-470f-4330-bb86-6943982af6db tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.157676 Aug 30 17:09:05.477754 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3534/7475] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:05 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:06.498837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:06.499506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:06.506415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:06.506911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:06.507358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:06.508060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:06.508527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:06.508962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:06.641690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:06.649636 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b6d0037-0550-440e-bc61-a60282e3f451 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.154741 Aug 30 17:09:06.650248 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3942/7476] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:06 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:07.670455 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:07.671086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:07.679180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:07.679679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:07.680133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:07.680836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:07.681305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:07.681746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:07.814031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:07.823395 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca40bf82-5400-43a8-a524-14d3adbb7996 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.156797 Aug 30 17:09:07.824048 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3535/7477] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:07 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:07.952719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b777b80b-5aa7-4176-9f45-59e137c583b2", "name": "network-vif-plugged", "status": "completed", "tag": "ecf1410a-eec0-4612-b779-193a213e00a6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:07.964172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:07.964451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:07.964892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:07.976409 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] Creating event network-vif-plugged:ecf1410a-eec0-4612-b779-193a213e00a6 for instance b777b80b-5aa7-4176-9f45-59e137c583b2 on n-h1-830883-28 Aug 30 17:09:07.981463 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-698e4c27-48a6-4e14-969d-47bd104a780b req-7f36212a-04ad-4cda-9852-4bb94fb91aa8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032514 Aug 30 17:09:07.982135 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3943/7478] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:08.845112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:08.845661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:08.853495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:08.854035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:08.854526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:08.855235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:08.855706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:08.856148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:08.985751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:08.994216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-abc719b9-ecf4-4e5a-8ddf-6aaa3dc1a6a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1361 microversion: 2.1 time: 0.153063 Aug 30 17:09:08.994814 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3536/7479] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:08 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:10.014170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:10.014986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:10.019355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:10.020001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:10.027246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:10.027733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:10.028177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:10.028867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:10.029326 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:10.029755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:10.164142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:10.172320 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d4694658-ffa9-46ca-8696-80ea2bcdc2d0 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1552 microversion: 2.1 time: 0.159831 Aug 30 17:09:10.172901 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3944/7480] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:10 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:10.193117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:10.193791 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:10.195754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:10.202032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:10.202596 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:10.203057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:10.203776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:10.204678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:10.204678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:10.343188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:10.351592 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c0323d00-ef70-4b3a-b767-6bd07246d3b7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1552 microversion: 2.1 time: 0.162384 Aug 30 17:09:10.352174 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3537/7481] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:10 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:11.972620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3d4b729-ffca-46f9-9e09-ac5199a6665f"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:11.975163 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:11.982011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:11.982543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:11.983003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:11.983706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:11.984173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:11.984610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:12.256943 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7c72fefe-e6b0-4d7c-a36a-3e2bc89c4cc7 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288347 Aug 30 17:09:12.257565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3945/7482] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:09:11 2022] POST /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:09:22.947175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:22.947693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:22.949811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:22.950572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=36 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:22.956759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:22.957258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:22.957712 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:22.958459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:22.958915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:22.960094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:23.040697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'services' on Instance uuid b777b80b-5aa7-4176-9f45-59e137c583b2 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:09:23.114675 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-65066c12-1725-40bd-b310-63f1ff540ddb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments/b3d4b729-ffca-46f9-9e09-ac5199a6665f" status: 202 len: 0 microversion: 2.1 time: 0.171919 Aug 30 17:09:23.115308 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3538/7483] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:09:22 2022] DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments/b3d4b729-ffca-46f9-9e09-ac5199a6665f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:09:23.122610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:23.123402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:23.127658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:23.130146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:23.141120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:23.141549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:23.141995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:23.142737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:23.143200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:23.143635 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:23.176957 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a810a124-cf0a-40f9-afda-bedebb5c8459 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056191 Aug 30 17:09:23.177531 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3946/7484] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:23 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:24.191416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:24.193795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:24.200316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:24.200811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:24.201280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:24.202240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:24.202733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:24.203169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:24.234895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c98c8ef1-cf6e-4291-9271-fd3cf223a216 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048633 Aug 30 17:09:24.235462 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3539/7485] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:24 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:25.247345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:25.249581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:25.257938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:25.258543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:25.258982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:25.259694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:25.260152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:25.260613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:25.294454 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-85565e83-6f50-425a-836a-b7fca67932b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051018 Aug 30 17:09:25.295046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3947/7486] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:25 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:26.306622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:26.308756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:26.315592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:26.316090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:26.316601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:26.317310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:26.317773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:26.318211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:26.350798 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5aac008-b6e4-42e9-8060-ce42a674e373 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Aug 30 17:09:26.351666 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3540/7487] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:26 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:27.363299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:27.365973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:27.372833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:27.373321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:27.373760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:27.374483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:27.374938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:27.375479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:27.409439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a03dd2f0-5631-4dcd-887e-aa8dbb878769 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050123 Aug 30 17:09:27.410030 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3948/7488] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:27 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:28.421511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:28.423754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:28.431723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:28.432234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:28.432680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:28.433385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:28.433854 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:28.434295 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:28.463558 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ce2b4a7-20a5-41ec-aa88-c30e36a28fc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046065 Aug 30 17:09:28.464115 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3541/7489] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:28 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:09:28.476384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:28.476979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:28.484902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:28.485403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:28.485834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:28.486674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:28.487136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:28.487569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:28.569841 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 is not attached to volume b3d4b729-ffca-46f9-9e09-ac5199a6665f Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments/b3d4b729-ffca-46f9-9e09-ac5199a6665f HTTP/1.1 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 is not attached to volume b3d4b729-ffca-46f9-9e09-ac5199a6665f Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': 'b777b80b-5aa7-4176-9f45-59e137c583b2', 'id': 'b3d4b729-ffca-46f9-9e09-ac5199a6665f'} Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b3d4b729-ffca-46f9-9e09-ac5199a6665f. Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 is not attached to volume b3d4b729-ffca-46f9-9e09-ac5199a6665f Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:09:28.579287 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 is not attached to volume b3d4b729-ffca-46f9-9e09-ac5199a6665f Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 is not attached to volume b3d4b729-ffca-46f9-9e09-ac5199a6665f {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f513e7d-aaf7-4668-b044-0960ffa11c07 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments/b3d4b729-ffca-46f9-9e09-ac5199a6665f" status: 404 len: 154 microversion: 2.1 time: 0.109914 Aug 30 17:09:28.584198 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3949/7490] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:09:28 2022] DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2/os-volume_attachments/b3d4b729-ffca-46f9-9e09-ac5199a6665f => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:09:31.920610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:31.921144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:31.929154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:31.929659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:31.930117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:31.930863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:31.931337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:31.931781 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:31.957471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:09:32.042456 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3327e759-b6d5-48ae-9fc8-2363da8e1d5d tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 204 len: 0 microversion: 2.1 time: 0.125191 Aug 30 17:09:32.046217 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3542/7491] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:09:31 2022] DELETE /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:09:32.052085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:32.052942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:32.059692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:32.060187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:32.060633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:32.061332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:32.061790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:32.062219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:32.195095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:32.204901 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-250abad2-b8d0-4249-9c91-7cc06070a081 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1558 microversion: 2.1 time: 0.157375 Aug 30 17:09:32.205487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3950/7492] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:32 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:33.228583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:33.229300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:33.236264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:33.236759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:33.237219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:33.237913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:33.238404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:33.238845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:33.369722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:33.377466 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ffdb2f21-0531-43f3-8ab2-d431f45e4a70 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1558 microversion: 2.1 time: 0.153629 Aug 30 17:09:33.378060 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3543/7493] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:33 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:34.155996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b777b80b-5aa7-4176-9f45-59e137c583b2", "name": "network-vif-deleted", "tag": "ecf1410a-eec0-4612-b779-193a213e00a6"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:34.166746 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:34.167235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:34.167671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:34.179336 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] Creating event network-vif-deleted:ecf1410a-eec0-4612-b779-193a213e00a6 for instance b777b80b-5aa7-4176-9f45-59e137c583b2 on n-h1-830883-28 Aug 30 17:09:34.184544 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6b4f86fb-a5e0-4536-b0ec-3f3afec6dc7e req-f0200b65-3e51-4901-9d3d-e14c7ce07131 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Aug 30 17:09:34.185160 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3951/7494] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:34.399618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:34.400247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:34.407320 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:34.407901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:34.408379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:34.409083 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:34.409550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:34.409986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:34.447342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:34.447842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:34.448294 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:34.448760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'fault' on Instance uuid b777b80b-5aa7-4176-9f45-59e137c583b2 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:09:34.491211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:34.499372 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-600a1bc2-b759-4064-8e95-d6a7c69f54a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 200 len: 1351 microversion: 2.1 time: 0.104127 Aug 30 17:09:34.499980 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3544/7495] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:34 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:35.523146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:35.523801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: b777b80b-5aa7-4176-9f45-59e137c583b2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:35.529948 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:35.530463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:35.530909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:35.531596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:35.532058 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:35.532489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:35.545730 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 HTTP/1.1 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'b777b80b-5aa7-4176-9f45-59e137c583b2'} Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:09:35.547372 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance b777b80b-5aa7-4176-9f45-59e137c583b2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1db46482-6681-40d4-a034-c39580bdc913 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2" status: 404 len: 111 microversion: 2.1 time: 0.031506 Aug 30 17:09:35.552257 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3952/7496] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:35 2022] GET /compute/v2.1/servers/b777b80b-5aa7-4176-9f45-59e137c583b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:09:35.558373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f45f26bd-b13f-4435-b59a-b2f31b0f98f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '.version_select at 0x7fd3578afee0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:35.579160 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f45f26bd-b13f-4435-b59a-b2f31b0f98f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-177743695" status: 202 len: 0 microversion: 2.1 time: 0.024678 Aug 30 17:09:35.579769 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3545/7497] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:09:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-177743695 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:09:35.598010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5bd5e46d-3a85-4570-b14f-2a60007b4796 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: .version_select at 0x7fd35c03f8b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-617175732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVJan1TGQHZuqqRgC4mgjCZ/f3JntQOzSpK+JhtF9yRxcE3NjMPe+wC+hOAJiG/VeZHb36YtKcKZ/+qMOnm+IMpkuy0ytwdMQNVmiQvUXBqPSRMMLd/qR1KHCu45+Oalg=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:35.613766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5bd5e46d-3a85-4570-b14f-2a60007b4796 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:09:35.619350 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-5bd5e46d-3a85-4570-b14f-2a60007b4796 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:09:35.642428 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5bd5e46d-3a85-4570-b14f-2a60007b4796 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048326 Aug 30 17:09:35.643019 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3953/7498] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:09:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:35.692799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-603541257", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-617175732", "networks": [{"uuid": "06643751-fbd3-4c8a-a9eb-5651b4715827"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:35.747449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] validate_networks() for [('06643751-fbd3-4c8a-a9eb-5651b4715827', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:09:36.113008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:09:36.113452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:09:36.113937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:09:36.114383 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:09:36.114810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:09:36.124063 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:36.124555 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:36.125005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:36.125739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:36.126207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:36.126678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:36.144117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:09:36.151041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:09:36.163718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:09:36.166038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:09:36.214507 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-720bddb5-4174-41fa-8d66-81b63a8781fa tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525481 Aug 30 17:09:36.220971 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3546/7499] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:09:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:09:36.226240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c04fd7b-f0ad-4b2e-ac0a-7e1831a188ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:36.226940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c04fd7b-f0ad-4b2e-ac0a-7e1831a188ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:36.285103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c04fd7b-f0ad-4b2e-ac0a-7e1831a188ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:36.293318 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c04fd7b-f0ad-4b2e-ac0a-7e1831a188ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1261 microversion: 2.1 time: 0.071031 Aug 30 17:09:36.293900 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3954/7500] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:36 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:37.314605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:37.315323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:37.324751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:37.325258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:37.325717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:37.326466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:37.326941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:37.327387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:37.432787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:37.441464 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebc8b983-2abb-4380-b0a8-32c0ba1bf366 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1321 microversion: 2.1 time: 0.131152 Aug 30 17:09:37.442046 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3547/7501] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:37 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1321 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:38.464287 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:38.464993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:38.471994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:38.472572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:38.473094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:38.473980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:38.474752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:38.475721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:38.620759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:38.628704 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a084a44f-333f-4f35-afdd-44f05ae3854a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.168516 Aug 30 17:09:38.629286 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3955/7502] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:38 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:38.704895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3b5842-40e2-4bd5-a5b1-6d50a28a550c", "tag": "c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:38.716153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:38.716566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:38.717072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:38.729874 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] Creating event network-changed:c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91 for instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c on n-h1-830883-28 Aug 30 17:09:38.734793 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-f3d2116c-ecdf-4e72-ab7e-d905ab005a81 req-410c4eab-6b42-4e00-abea-b9a5db921dc3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033599 Aug 30 17:09:38.735395 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3548/7503] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:39.650936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:39.651554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:39.658403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:39.658891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:39.659330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:39.660014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:39.660469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:39.660914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:39.789937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:39.797733 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f12c529c-a104-4de4-967a-f90cede4f321 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.151650 Aug 30 17:09:39.798515 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3956/7504] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:39 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:40.820463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:40.821192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:40.827441 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:40.827941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:40.828396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:40.829101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:40.829573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:40.830014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:40.957902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:40.965740 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f3b962ed-671f-4d2c-ae39-a841e2a90abd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.150571 Aug 30 17:09:40.966325 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3549/7505] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:40 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:41.987003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:41.987621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:41.994976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:41.995459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:41.995900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:41.996816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:41.997276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:41.997705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:42.138611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:42.146584 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5ad453c3-b744-4b14-a219-9c3b305c4f85 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.163316 Aug 30 17:09:42.147484 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3957/7506] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:41 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:43.167567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:43.168201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:43.175182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:43.175685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:43.176405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:43.177112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:43.177586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:43.178220 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:43.311432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:43.319737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdd61b70-5640-40cd-b172-05e651423ef3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.156093 Aug 30 17:09:43.320313 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3550/7507] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:43 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:44.198591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3b5842-40e2-4bd5-a5b1-6d50a28a550c", "name": "network-vif-plugged", "status": "completed", "tag": "c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:44.211133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:44.211611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:44.212047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:44.224054 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] Creating event network-vif-plugged:c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91 for instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c on n-h1-830883-28 Aug 30 17:09:44.229758 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-13911260-e1fa-4a0c-9e8c-36bb2d6ab923 req-897c5e8d-ade8-434b-bf0a-9f314b386a4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035618 Aug 30 17:09:44.230395 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3958/7508] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:44.339388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:44.340646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:44.347495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:44.347990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:44.348456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:44.349136 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:44.349602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:44.350038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:44.505139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:44.513012 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-db5b9de0-2bcb-46ac-93e9-58a6e424632e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1361 microversion: 2.1 time: 0.177574 Aug 30 17:09:44.513593 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3551/7509] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:44 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:45.533620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:45.534247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:45.541418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:45.541911 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:45.542387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:45.543089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:45.543546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:45.543979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:45.679989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:45.687801 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1c851065-6057-48dc-99af-55859634943b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1553 microversion: 2.1 time: 0.158498 Aug 30 17:09:45.688368 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3959/7510] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:45 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:45.709710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:45.710365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:45.716821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:45.717324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:45.717780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:45.718523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:45.719000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:45.719445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:46.134892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:46.145499 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:09:46.153956 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a7dfc4a-d378-4b0a-9d71-453d52f1163a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1553 microversion: 2.1 time: 0.448087 Aug 30 17:09:46.154575 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3552/7511] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:09:45 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1553 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:09:47.639577 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec923987-eac4-4ce6-8d2a-f4a3a619bb89"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:09:47.642034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:47.643993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:47.650344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:47.650850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:47.651300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:47.652006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:47.652495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:47.652932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:47.913548 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-933df505-b61e-4ee6-9000-99e16cd5db0c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277053 Aug 30 17:09:47.914208 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3960/7512] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:09:47 2022] POST /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:58.606469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:58.607004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:58.608988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:58.610708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:58.611430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:58.618835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:58.619336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:58.619804 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:58.620512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:58.620978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:58.621420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:58.705087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'services' on Instance uuid 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:09:58.777742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94b8650c-afee-4f0c-9019-7c0d53040fc5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments/ec923987-eac4-4ce6-8d2a-f4a3a619bb89" status: 202 len: 0 microversion: 2.1 time: 0.174923 Aug 30 17:09:58.778472 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3553/7513] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:09:58 2022] DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments/ec923987-eac4-4ce6-8d2a-f4a3a619bb89 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:09:58.784913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:58.785832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:09:58.790970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:58.793329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:58.801536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:58.802031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:58.802508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:58.803214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:58.803871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:58.804308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:58.836909 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8f947101-349d-48b0-bb6f-2423da35f7cd tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053860 Aug 30 17:09:58.837487 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3961/7514] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:58 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:09:59.848821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:09:59.851227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:09:59.858264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:59.858849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:59.859298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:59.859997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:09:59.860457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:09:59.860891 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:09:59.891354 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cc035bfb-fcac-43b2-9f03-8f3a37f58204 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Aug 30 17:09:59.891929 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3554/7515] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:09:59 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:00.904646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:00.907585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:00.915317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:00.915815 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:00.916268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:00.916997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:00.917466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:00.917901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:00.950459 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d7d6f2a4-e208-43a7-ac83-b0f602f78ad1 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050011 Aug 30 17:10:00.951304 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3962/7516] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:00 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:01.963443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:01.965744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:01.972779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:01.973194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:01.973635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:01.974347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:01.974812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:01.975975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:02.008467 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bd3f1881-1bed-4ee8-9705-92db8b95d325 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049498 Aug 30 17:10:02.009037 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3555/7517] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:01 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:03.020760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:03.023702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:03.030768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:03.031261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:03.031707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:03.032410 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:03.032876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:03.033311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:03.066109 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a61bb70f-e2e5-4d80-897b-44caf94fb4a5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049356 Aug 30 17:10:03.066713 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3963/7518] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:03 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:04.078633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:04.080719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:04.088222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:04.088719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:04.089173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:04.089938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:04.090437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:04.090881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:04.120703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a7d1ba73-7896-4ac4-835c-a5775ca1f29e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046226 Aug 30 17:10:04.121263 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3556/7519] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:04 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:10:04.132226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:04.132765 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:04.139561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:04.140045 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:04.140480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:04.141169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:04.141622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:04.142050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:04.219671 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c is not attached to volume ec923987-eac4-4ce6-8d2a-f4a3a619bb89 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: request: DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments/ec923987-eac4-4ce6-8d2a-f4a3a619bb89 HTTP/1.1 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c is not attached to volume ec923987-eac4-4ce6-8d2a-f4a3a619bb89 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'server_id': '9c3b5842-40e2-4bd5-a5b1-6d50a28a550c', 'id': 'ec923987-eac4-4ce6-8d2a-f4a3a619bb89'} Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ec923987-eac4-4ce6-8d2a-f4a3a619bb89. Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c is not attached to volume ec923987-eac4-4ce6-8d2a-f4a3a619bb89 Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:04.221331 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c is not attached to volume ec923987-eac4-4ce6-8d2a-f4a3a619bb89 Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c is not attached to volume ec923987-eac4-4ce6-8d2a-f4a3a619bb89 {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8b1cf0eb-663e-4f19-9d1d-5aa8a59f7392 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments/ec923987-eac4-4ce6-8d2a-f4a3a619bb89" status: 404 len: 154 microversion: 2.1 time: 0.095228 Aug 30 17:10:04.225744 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3964/7520] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:10:04 2022] DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c/os-volume_attachments/ec923987-eac4-4ce6-8d2a-f4a3a619bb89 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:10:07.562256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:07.563111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:07.570365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:07.570866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:07.571318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:07.572028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:07.572497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:07.573065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:07.599283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:10:07.677982 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-20ab297f-a753-4aed-9ba5-a57db24dd9f9 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 204 len: 0 microversion: 2.1 time: 0.119190 Aug 30 17:10:07.678600 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3557/7521] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:10:07 2022] DELETE /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:10:07.687229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:07.687946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:07.695121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:07.695686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:07.696218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:07.696989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:07.697520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:07.698022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:07.831335 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:07.840325 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe7b4d9d-304b-41a7-941f-dffb16c4d991 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1559 microversion: 2.1 time: 0.157227 Aug 30 17:10:07.840899 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3965/7522] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:07 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:08.863043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:08.863760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:08.871914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:08.872408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:08.872879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:08.873578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:08.874044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:08.874525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:09.011659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:09.019475 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f77716ce-d947-4a4f-adfe-697adf2ebaab tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1559 microversion: 2.1 time: 0.160787 Aug 30 17:10:09.020052 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3558/7523] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:08 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:09.841298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3b5842-40e2-4bd5-a5b1-6d50a28a550c", "name": "network-vif-deleted", "tag": "c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:09.854264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:09.854778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:09.855210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:09.868158 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] Creating event network-vif-deleted:c2ea3fe5-3b91-48ae-8b4e-e2aca0b5dc91 for instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c on n-h1-830883-28 Aug 30 17:10:09.873961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c1f0d803-9146-4fa0-9817-bb3985272307 req-b79d3a95-79a9-46a3-99dc-8e7a948117cd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036694 Aug 30 17:10:09.875514 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3966/7524] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:10.042975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:10.043727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:10.050897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:10.051231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:10.051693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:10.052485 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:10.052898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:10.053372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:10.086506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:10.087004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:10.087457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:10.087992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'fault' on Instance uuid 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:10:10.129111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:10.137571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-82444bcd-d79e-4470-b190-0edd706da3a4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 200 len: 1351 microversion: 2.1 time: 0.100641 Aug 30 17:10:10.138147 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3559/7525] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:10 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:11.160114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:11.160848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:11.167469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:11.167962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:11.168408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:11.169104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:11.169562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:11.169995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:11.183567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c HTTP/1.1 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': '9c3b5842-40e2-4bd5-a5b1-6d50a28a550c'} Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:11.185181 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance 9c3b5842-40e2-4bd5-a5b1-6d50a28a550c could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-960eb8e7-ea32-47de-b991-8c724ef3f90c tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c" status: 404 len: 111 microversion: 2.1 time: 0.031700 Aug 30 17:10:11.189558 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3967/7526] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:11 2022] GET /compute/v2.1/servers/9c3b5842-40e2-4bd5-a5b1-6d50a28a550c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:10:11.196599 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-edde8439-8f2e-4463-ac65-984a8696f582 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '.version_select at 0x7fd357951550>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:11.217674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-edde8439-8f2e-4463-ac65-984a8696f582 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-617175732" status: 202 len: 0 microversion: 2.1 time: 0.025976 Aug 30 17:10:11.218275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3560/7527] 10.222.0.47 () {58 vars in 1275 bytes} [Tue Aug 30 17:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-617175732 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:10:11.235365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-835460d2-e492-45e4-b742-b655c8ab79bb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: .version_select at 0x7fd3576100d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1236243073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTFtHs8L4W8za081kIPpFJAAUaD8joZhCtQ0zGqeMDkEGmZxRpN1r+tJp5NEPzXcYIkXzaxMhIinpaAAumXrtlpbmTPe5w+o8k5O/TR1erktw9G03WdWQTdy5TMdPc3MQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:11.251067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-835460d2-e492-45e4-b742-b655c8ab79bb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:10:11.256432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-835460d2-e492-45e4-b742-b655c8ab79bb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:10:11.280489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-835460d2-e492-45e4-b742-b655c8ab79bb tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049032 Aug 30 17:10:11.281090 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3968/7528] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:10:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:11.330433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2034967925", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1236243073", "networks": [{"uuid": "06643751-fbd3-4c8a-a9eb-5651b4715827"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:11.384894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] validate_networks() for [('06643751-fbd3-4c8a-a9eb-5651b4715827', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:10:11.755318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:10:11.755764 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:10:11.756256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:10:11.757364 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:10:11.757798 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:10:11.766566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:11.767068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:11.767523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:11.768268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:11.768742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:11.769187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:11.785724 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:10:11.791568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Getting quotas for user a41c769cd846413586c0238a6dd891a0 and project 5cf8b96a33e04d4fbbdf729665937e97. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:10:11.804637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:10:11.806978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:10:11.852813 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-372604bf-3e5a-4ff7-aabf-ddd539a9d813 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526258 Aug 30 17:10:11.853471 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3561/7529] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:10:11.864208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32f49160-eaa8-41f1-b01f-4f493969d907 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:11.864842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32f49160-eaa8-41f1-b01f-4f493969d907 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:11.924470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32f49160-eaa8-41f1-b01f-4f493969d907 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:11.933432 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32f49160-eaa8-41f1-b01f-4f493969d907 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1263 microversion: 2.1 time: 0.073090 Aug 30 17:10:11.934204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3969/7530] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:11 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:12.954324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:12.955092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:12.964825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:12.965617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:12.966321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:12.967287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:12.967990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:12.968674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:13.044711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:13.052867 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80e9f1c9-db79-4557-b3d2-fbd8a8acb2c8 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1333 microversion: 2.1 time: 0.103165 Aug 30 17:10:13.053476 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3562/7531] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:12 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:14.074129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:14.074807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:14.081908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:14.082505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:14.082954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:14.083667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:14.084138 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:14.084621 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:14.196153 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056f3416-08a8-4961-b77c-6ee7e318799e", "tag": "e4f7ac11-1a10-4536-a06b-3ef53f09390d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:14.208802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:14.209625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:14.210647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:14.223249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:14.229975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] Creating event network-changed:e4f7ac11-1a10-4536-a06b-3ef53f09390d for instance 056f3416-08a8-4961-b77c-6ee7e318799e on n-h1-830883-28 Aug 30 17:10:14.232615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f10e18fa-8492-4b84-aa96-d25b0ab70226 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.162466 Aug 30 17:10:14.233204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3970/7532] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:14 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:14.235848 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4de176b6-87c5-4a14-b55f-8a818117ba0d req-da0d71fd-ef2d-4c2d-b8e8-a38608019dd5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044488 Aug 30 17:10:14.236540 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3563/7533] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:10:15.254919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:15.255540 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:15.263073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:15.263552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:15.263986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:15.264674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:15.265128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:15.265554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:15.394572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:15.402629 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3f833a64-bac4-4287-9389-e9481160fe13 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.151520 Aug 30 17:10:15.403207 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3971/7534] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:15 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:16.424579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:16.425299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:16.433254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:16.433748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:16.434193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:16.434922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:16.435408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:16.435878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:16.566772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:16.574661 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f318274b-b0bd-45c2-9ae9-403a0adb6450 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.154467 Aug 30 17:10:16.575231 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3564/7535] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:16 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:17.595424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:17.596051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:17.604162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:17.604653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:17.605097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:17.605824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:17.606285 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:17.606805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:17.741413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:17.749222 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1152d16-0ca9-4e03-8849-cafb84e4f755 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.157692 Aug 30 17:10:17.749814 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3972/7536] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:17 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:18.770953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:18.771505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:18.778905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:18.779407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:18.779860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:18.780573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:18.781042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:18.781483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:18.914623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:18.922238 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b99ebfdc-e0fb-4cbf-a931-bedf7a76a4b5 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.155324 Aug 30 17:10:18.922833 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3565/7537] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:18 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:19.942855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:19.943476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:19.951226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:19.951723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:19.952161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:19.952845 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:19.953334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:19.953761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:20.084389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:20.092071 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a021c4a7-0183-4f95-94f0-f0f162dda894 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.153112 Aug 30 17:10:20.092646 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3973/7538] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:19 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:20.350058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056f3416-08a8-4961-b77c-6ee7e318799e", "name": "network-vif-plugged", "status": "completed", "tag": "e4f7ac11-1a10-4536-a06b-3ef53f09390d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:20.360614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:20.361100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:20.361624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:20.376025 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] Creating event network-vif-plugged:e4f7ac11-1a10-4536-a06b-3ef53f09390d for instance 056f3416-08a8-4961-b77c-6ee7e318799e on n-h1-830883-28 Aug 30 17:10:20.380939 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-699c5a15-33b7-4913-9ae5-2d27a1b3a09e req-41d4fc13-3088-4a4b-ad06-dea057714444 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 Aug 30 17:10:20.382691 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3566/7539] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:21.113047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:21.113651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:21.121768 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:21.122257 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:21.122734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:21.123430 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:21.123889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:21.124321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:21.257314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:21.265145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-294a2ff4-f638-406d-9df6-a006278a5b04 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1363 microversion: 2.1 time: 0.156022 Aug 30 17:10:21.265722 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3974/7540] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:21 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:22.284857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:22.285634 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:22.290743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:22.291465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:22.298619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:22.299114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:22.299565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:22.300256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:22.300990 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:22.301425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:22.434019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:22.441799 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ac544fc7-f970-4e51-81c3-cd8ed8ed5643 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1554 microversion: 2.1 time: 0.158761 Aug 30 17:10:22.442393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3567/7541] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:22 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:22.463281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:22.463896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:22.465890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:22.472295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:22.472782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:22.473220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:22.473905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:22.474385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:22.474814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:22.607275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:22.614953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-96ab5f80-4633-4445-915e-1e2f10f21c78 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1554 microversion: 2.1 time: 0.155575 Aug 30 17:10:22.615533 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3975/7542] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:22 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:24.099413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "405427b7-b0cc-4aac-b9ac-90aaf7b48219"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:24.102345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:24.109151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:24.109651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:24.110105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:24.110841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:24.111314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:24.111761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:24.353454 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:24.371975 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c767de8-71c9-478a-9a7d-95fbb47d372e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "POST /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276350 Aug 30 17:10:24.372634 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3568/7543] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:10:24 2022] POST /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:35.064806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:35.065300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:35.067661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:35.068359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=70 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:35.075998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:35.076634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:35.077078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:35.077773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:35.078227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:35.078679 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:35.162153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'services' on Instance uuid 056f3416-08a8-4961-b77c-6ee7e318799e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:10:35.233446 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe04bcc5-863e-4397-ad46-994de84b6154 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments/405427b7-b0cc-4aac-b9ac-90aaf7b48219" status: 202 len: 0 microversion: 2.1 time: 0.172410 Aug 30 17:10:35.234060 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3976/7544] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:10:35 2022] DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments/405427b7-b0cc-4aac-b9ac-90aaf7b48219 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:10:35.240442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:35.241806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:10:35.246158 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:35.248578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:35.257460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:35.258238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:35.258745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:35.259458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:35.259926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:35.260397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:35.294823 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b8d1125-bd0b-4ef1-99ad-6ae11cb67f90 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056229 Aug 30 17:10:35.295392 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3569/7545] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:35 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:36.308039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:36.310425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:36.317601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:36.318083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:36.318553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:36.319330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:36.319841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:36.320144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:36.351284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-07b14852-5549-4eb5-a9ae-47689c8ed1ed tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Aug 30 17:10:36.351854 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3977/7546] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:36 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:37.363689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:37.365876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:37.373717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:37.374217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:37.374692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:37.375400 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:37.375862 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:37.376292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:37.408251 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-30750c44-b227-471c-a4e5-7d6234346956 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048501 Aug 30 17:10:37.408815 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3570/7547] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:37 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:38.420602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:38.422764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:38.430776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:38.431265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:38.431708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:38.432403 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:38.432863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:38.433291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:38.466447 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f2ac652b-f6bf-4c8d-b262-821dae74c2c3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049910 Aug 30 17:10:38.467012 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3978/7548] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:38 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:39.479206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:39.481935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:39.489388 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:39.489881 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:39.490340 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:39.491716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:39.492179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:39.492609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:39.522411 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9b1ccd08-5c3b-49be-b7da-b6c9e169412e tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Aug 30 17:10:39.522973 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3571/7549] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:39 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:40.534824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:40.537012 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:40.543977 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:40.544464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:40.544910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:40.545601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:40.546063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:40.546528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:40.576318 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-119139cd-6307-4e98-a670-f82217b20093 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Aug 30 17:10:40.576889 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3979/7550] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:10:40 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:10:40.589592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:40.590131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:40.596913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:40.597404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:40.597846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:40.598571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:40.599038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:40.599473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:40.681170 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance 056f3416-08a8-4961-b77c-6ee7e318799e is not attached to volume 405427b7-b0cc-4aac-b9ac-90aaf7b48219 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments/405427b7-b0cc-4aac-b9ac-90aaf7b48219 HTTP/1.1 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 056f3416-08a8-4961-b77c-6ee7e318799e is not attached to volume 405427b7-b0cc-4aac-b9ac-90aaf7b48219 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '056f3416-08a8-4961-b77c-6ee7e318799e', 'id': '405427b7-b0cc-4aac-b9ac-90aaf7b48219'} Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 405427b7-b0cc-4aac-b9ac-90aaf7b48219. Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056f3416-08a8-4961-b77c-6ee7e318799e is not attached to volume 405427b7-b0cc-4aac-b9ac-90aaf7b48219 Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:40.683152 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056f3416-08a8-4961-b77c-6ee7e318799e is not attached to volume 405427b7-b0cc-4aac-b9ac-90aaf7b48219 Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance 056f3416-08a8-4961-b77c-6ee7e318799e is not attached to volume 405427b7-b0cc-4aac-b9ac-90aaf7b48219 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80e7847b-2522-4389-b415-f668bb7a4f5b tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments/405427b7-b0cc-4aac-b9ac-90aaf7b48219" status: 404 len: 154 microversion: 2.1 time: 0.101292 Aug 30 17:10:40.687794 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3572/7551] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:10:40 2022] DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e/os-volume_attachments/405427b7-b0cc-4aac-b9ac-90aaf7b48219 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:10:44.023031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:44.023533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:44.030370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:44.030859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:44.031300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:44.031990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:44.032448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:44.032876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:44.058937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:10:44.144738 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b4a9b88-16a7-4392-8973-1d365f94021a tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 204 len: 0 microversion: 2.1 time: 0.125239 Aug 30 17:10:44.145033 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3980/7552] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:10:44 2022] DELETE /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:10:44.154911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:44.155533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:44.162637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:44.163134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:44.163576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:44.164463 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:44.164957 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:44.165393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:44.299182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:44.307857 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3555efc4-d50e-4d19-84d8-4bab28dcedf3 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1560 microversion: 2.1 time: 0.156918 Aug 30 17:10:44.308436 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3573/7553] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:44 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:45.330129 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:45.330880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:45.337950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:45.338472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:45.338925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:45.339625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:45.340095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:45.340531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:45.470565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:45.479230 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8780e560-3b23-4865-9291-9679b7e2d814 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1560 microversion: 2.1 time: 0.153369 Aug 30 17:10:45.479821 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3981/7554] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:45 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:46.263292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056f3416-08a8-4961-b77c-6ee7e318799e", "name": "network-vif-deleted", "tag": "e4f7ac11-1a10-4536-a06b-3ef53f09390d"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:10:46.275586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:46.276516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:46.276993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:46.288501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] Creating event network-vif-deleted:e4f7ac11-1a10-4536-a06b-3ef53f09390d for instance 056f3416-08a8-4961-b77c-6ee7e318799e on n-h1-830883-28 Aug 30 17:10:46.295048 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-2c43889b-16a1-406c-929d-5427d0ca6a28 req-090634a4-ca9a-4f42-9fb4-30f579ec2890 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Aug 30 17:10:46.295852 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3574/7555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:10:46.501179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:46.501806 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:46.508676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:46.509169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:46.509611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:46.510332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:46.510799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:46.511234 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:46.542956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:46.543455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:46.543898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:46.544358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lazy-loading 'fault' on Instance uuid 056f3416-08a8-4961-b77c-6ee7e318799e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:10:46.590323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41c769cd846413586c0238a6dd891a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf8b96a33e04d4fbbdf729665937e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:10:46.598473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4550e39-db70-45b5-965b-078e9c27a30f tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 200 len: 1353 microversion: 2.1 time: 0.101128 Aug 30 17:10:46.599079 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3982/7556] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:46 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 1353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:10:47.621816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:47.622572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] [instance: 056f3416-08a8-4961-b77c-6ee7e318799e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:10:47.628846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:47.629351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:47.629808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:47.630541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:10:47.631018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:10:47.631497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:10:47.644745 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] HTTP exception thrown: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Request method failure captured: Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e HTTP/1.1 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkQlYiAv_V_9oL0sErefm7w_i_sOHV2YjG12ff6pdzyJsnuYWEZkevQhoLQkETspGVwBQIlOQT9uIybGUU29xGKqOKy7esEbUi72hGD4TeyVgoFGQRmtp-3ranrQ82aABhR9vVHy1KgTCX0IjTAmmZHbMLBJbbi1DM1GW7qaIamK8uM Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5cf8b96a33e04d4fbbdf729665937e97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5cf8b96a33e04d4fbbdf729665937e97"}]}] Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 5cf8b96a33e04d4fbbdf729665937e97 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-240347335 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: a41c769cd846413586c0238a6dd891a0 Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestEncryptedCinderVolumes-240347335-project Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '056f3416-08a8-4961-b77c-6ee7e318799e'} Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:10:47.646375 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Returning 404 to user: Instance 056f3416-08a8-4961-b77c-6ee7e318799e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-241111cf-9e7b-4e8b-8a30-8faf6fb1e6ec tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e" status: 404 len: 111 microversion: 2.1 time: 0.031352 Aug 30 17:10:47.651832 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3575/7557] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:10:47 2022] GET /compute/v2.1/servers/056f3416-08a8-4961-b77c-6ee7e318799e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:10:47.657102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edbc28a1-8134-4617-9e8e-5a2f39a14cc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] Calling method '.version_select at 0x7fd35c548670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:10:47.677282 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edbc28a1-8134-4617-9e8e-5a2f39a14cc4 tempest-TestEncryptedCinderVolumes-240347335 tempest-TestEncryptedCinderVolumes-240347335-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1236243073" status: 202 len: 0 microversion: 2.1 time: 0.024027 Aug 30 17:10:47.677861 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3983/7558] 10.222.0.47 () {58 vars in 1278 bytes} [Tue Aug 30 17:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1236243073 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:11:14.773387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0dac83f-d11a-43a4-8dc2-e07b18b8c379 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: .version_select at 0x7fd35c0a94c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1018690608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz8qux4x31p4KNtpoK6pJTpVEcm70mqJJOWiOpgHPq25Ba3RWQxmUgO1eb5Ym3JFU8qlVzfOzyiMCKqMcqX+1m4t7v+LdyGELv6UGDEfvApVQlyKSQL6B5zBAJbFYxhMA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:14.779962 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=14 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:14.780626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=34 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:14.793029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a0dac83f-d11a-43a4-8dc2-e07b18b8c379 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:11:14.798093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-a0dac83f-d11a-43a4-8dc2-e07b18b8c379 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for user 48fedf4df69c4e8f8fae6785529b59a3 and project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:11:14.820217 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0dac83f-d11a-43a4-8dc2-e07b18b8c379 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050644 Aug 30 17:11:14.821337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3576/7559] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:11:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:11:14.871509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:14.872283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:14.876532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-468522353", "imageRef": "b52adae7-2daa-4b0e-8996-167ca8d27120", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1018690608", "networks": [{"uuid": "17cd554d-fe65-4368-8222-ea43f3475160"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:14.931622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] validate_networks() for [('17cd554d-fe65-4368-8222-ea43f3475160', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:11:15.399392 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:11:15.399822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:11:15.400306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:11:15.400728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:11:15.401152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:11:15.410037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:15.410562 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:15.411008 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:15.411745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:15.412217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:15.412651 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:15.430858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:11:15.436240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for user 48fedf4df69c4e8f8fae6785529b59a3 and project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:11:15.449151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:11:15.451399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b52adae7-2daa-4b0e-8996-167ca8d27120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:11:15.495309 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:11:16.504801 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50682. Aug 30 17:11:16.509267 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c1628f58-3489-4c90-9741-0841b9e7d5e4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639947 Aug 30 17:11:16.510020 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3984/7560] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:11:16.520606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-124f3336-e398-4369-ad12-84bfc69fe1d5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:16.521243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-124f3336-e398-4369-ad12-84bfc69fe1d5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:16.579365 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-124f3336-e398-4369-ad12-84bfc69fe1d5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:16.586907 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-124f3336-e398-4369-ad12-84bfc69fe1d5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1258 microversion: 2.1 time: 0.069627 Aug 30 17:11:16.591779 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3577/7561] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:16 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:11:17.608719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:17.610032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:17.616846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:17.617394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:17.617798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:17.619087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:17.619549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:17.619976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:17.690628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:17.699131 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4e3b8893-8361-4b2e-92f0-10fd277ea855 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1328 microversion: 2.1 time: 0.095096 Aug 30 17:11:17.699731 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3985/7562] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:17 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:11:18.722073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:18.723625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:18.734066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:18.734644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:18.735131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:18.735914 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:18.736446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:18.736887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:18.897532 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:18.907684 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0a7508e0-ac29-4111-abd3-2ed99d6ed814 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.190685 Aug 30 17:11:18.908909 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3578/7563] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:18 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:19.931130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:19.933277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:19.940767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:19.941372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:19.941890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:19.942732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:19.943413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:19.943912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:20.102224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:20.112019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae580a4d-6273-4fd2-9112-45729c153873 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.184927 Aug 30 17:11:20.113105 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3986/7564] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:19 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:21.134057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:21.134981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:21.142077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:21.142638 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:21.143086 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:21.143800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:21.144259 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:21.145222 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:21.284389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:21.293001 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e5de5d74-9175-4bf4-8e58-53c8e479cabf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.162769 Aug 30 17:11:21.293795 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3579/7565] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:21 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:22.313645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:22.314330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:22.321314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:22.321814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:22.322262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:22.323021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:22.323861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:22.324334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:22.461450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:22.479747 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-110cd2ed-3d63-437b-9817-92c8607d0082 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.168666 Aug 30 17:11:22.480717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3987/7566] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:22 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:23.501418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:23.501969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:23.508965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:23.509397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:23.509848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:23.511187 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:23.511661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:23.512109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:23.664170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:23.673560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-486f20ec-2b24-4c8c-b25b-6e70f8737265 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.176222 Aug 30 17:11:23.674406 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3580/7567] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:23 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:24.695627 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:24.696245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:24.703991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:24.704498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:24.704953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:24.705673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:24.706142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:24.706611 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:24.849142 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:24.858284 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e14759c-3f30-41e0-83a6-ab2d964133f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.166609 Aug 30 17:11:24.859332 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3988/7568] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:24 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:25.879948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:25.880579 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:25.887752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:25.888245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:25.888743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:25.889437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:25.889901 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:25.890369 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:26.020486 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:26.028645 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1a1049a-00a7-4379-8a6f-b515223698a2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.152575 Aug 30 17:11:26.029224 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3581/7569] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:25 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:27.050610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:27.051246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:27.053191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:27.053870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:27.061128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:27.061630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:27.062085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:27.062821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:27.063293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:27.063730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:27.193298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:27.201574 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-936beab2-9926-498f-a7ed-7891fca58050 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.155182 Aug 30 17:11:27.202168 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3989/7570] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:27 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:28.222885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:28.223527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:28.225396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:28.232468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:28.232971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:28.233698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:28.234531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:28.235012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:28.235457 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:28.350235 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:28.364145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:28.364637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:28.365070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:28.378067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] Creating event network-changed:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:11:28.383410 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f7f4aa7e-fff0-484d-97ac-5d4a8c0c2772 req-0b7caa91-81b0-4f02-af83-b49f0f39a33b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037896 Aug 30 17:11:28.384318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3990/7571] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:11:28.467275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:28.475739 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c200ee5f-e474-454a-95a5-4d12fe38b02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.257367 Aug 30 17:11:28.476319 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3582/7572] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:28 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:29.498497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:29.499127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:29.506215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:29.506733 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:29.507171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:29.507859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:29.508317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:29.508743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:29.638331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:29.646104 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6f1ea4af-fb86-4446-9ad8-36963553e401 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.151999 Aug 30 17:11:29.646707 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3991/7573] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:29 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:30.668186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:30.668817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:30.675996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:30.676527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:30.676984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:30.677693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:30.678167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:30.678648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:30.811961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:30.819677 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4545d531-f89a-4e31-8008-a0b9b0110ad0 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.155978 Aug 30 17:11:30.820251 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3583/7574] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:30 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:11:31.840766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:31.841374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:31.848071 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:31.848563 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:31.849011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:31.849716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:31.850192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:31.850653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:31.987232 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:31.995121 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3405e7f5-5498-43c0-93c8-f4f5ead9cf67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.158488 Aug 30 17:11:31.996562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3992/7575] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:31 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:33.016515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:33.017148 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:33.024057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:33.024553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:33.025004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:33.025703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:33.026169 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:33.026632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:33.159373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:33.167110 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2b6d064b-75ff-47d8-8f0c-5128e75aa6d6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.154486 Aug 30 17:11:33.168479 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3584/7576] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:33 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:34.039774 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "name": "network-vif-plugged", "status": "completed", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:34.050609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:34.051104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:34.051536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:34.063715 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] Creating event network-vif-plugged:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:11:34.068678 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-979429d9-140e-4f59-aff2-369a715d7869 req-4faf6715-b605-444e-b353-7ea33a3a781e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Aug 30 17:11:34.069281 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3993/7577] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:11:34.188974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:34.189611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:34.196465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:34.196992 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:34.197452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:34.198164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:34.198759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:34.199251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:34.346647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:34.354623 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ee8ebe9-8236-4e76-9090-435a66f12f20 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.169511 Aug 30 17:11:34.355783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3585/7578] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:34 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:35.377769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:35.378511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:35.384819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:35.385346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:35.385790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:35.387124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:35.387594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:35.388025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:35.521076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:35.529380 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c59075e1-a7a1-400e-a2b2-d48ea13b9cac tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1358 microversion: 2.1 time: 0.156797 Aug 30 17:11:35.529957 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3994/7579] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:35 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:36.549090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:36.549892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:36.556830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.557319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.557766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.558511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.558974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.559410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.687664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:36.695369 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-acc46728-1edf-4ee1-b7bb-450575c8b8bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1548 microversion: 2.1 time: 0.150246 Aug 30 17:11:36.695940 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3586/7580] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:36 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:11:36.716960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:36.717583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:36.724450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.724938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.725387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.726082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.726574 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.727005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.861601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:36.869557 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0421f57f-145e-4ef9-82ae-840486047b12 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1548 microversion: 2.1 time: 0.157673 Aug 30 17:11:36.870133 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3995/7581] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:36 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:36.889883 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:36.894588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:36.895370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Searching by: {'deleted': False, 'project_id': '67d8081bf86c4dfabe351ae562ce810c'} {{(pid=122351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:11:36.900679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.901176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.902131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.902910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.903379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.903822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.935410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.multi_cell_list [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:11:36.962745 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b77a5981-0058-4064-84ce-2a7864fb15bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.076581 Aug 30 17:11:36.963337 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3587/7582] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 17:11:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:11:36.975193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:36.975825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:36.982474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.983038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.983584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:36.984312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:36.984787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:36.985223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:37.113737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:37.121918 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70e146ef-2fef-4798-89a6-cf553712a94b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1548 microversion: 2.1 time: 0.150636 Aug 30 17:11:37.122518 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3996/7583] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:36 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:38.665101 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4c64d4d-13ba-449f-851e-4b4b3f6719f8"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:38.668073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:38.675731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:38.676250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:38.676697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:38.677392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:38.677856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:38.678289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:38.935913 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5b42bd9f-dce3-4073-a76b-2c5b14c10046 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274595 Aug 30 17:11:38.939732 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3588/7584] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:11:38 2022] POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:11:51.975215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:51.975832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:51.978757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:51.980052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=66 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:51.985859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:51.986368 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:51.986832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:51.987527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:51.987984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:51.988411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:52.123327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:52.131720 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-726e96f1-c34d-4bad-a45f-0c14032cc3dd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1594 microversion: 2.1 time: 0.160392 Aug 30 17:11:52.132295 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3997/7585] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:51 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:11:53.772022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:53.772899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:53.773548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:11:53.777824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:53.789323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:53.789792 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:53.790232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:53.803674 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] Creating event network-changed:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:11:53.809395 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-056a6c8a-675f-499f-a092-6575b173fb05 req-a17a6cd1-cf82-43ec-83a3-d34f7dd83845 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039116 Aug 30 17:11:53.813038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3589/7586] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:11:55.195537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-679682495"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:55.196140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:55.203190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:55.203725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:55.204185 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:55.205107 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:55.205568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:55.205997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:55.336840 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.network.security_group_api [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Adding security group 427b1087-54d8-4c44-b489-95115b6bfe2b to port 8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 Aug 30 17:11:55.648621 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69b12e1c-8dc9-43a2-a41a-877e88adac25 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.457210 Aug 30 17:11:55.649246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3998/7587] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:11:55 2022] POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:11:55.659479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:11:55.660336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:11:55.668047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:55.668817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:55.669487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:55.670522 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:55.671262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:55.672026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:55.809795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:11:55.819604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:11:55.820412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:11:55.820962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:11:55.833631 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] Creating event network-changed:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:11:55.839821 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f25baa9d-b70f-4128-b258-83f6de931055 req-dd987318-9dad-4e01-b44a-dfdf64fafbb1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184250 Aug 30 17:11:55.840583 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 3999/7588] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:11:55.867775 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:11:55.877633 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6507da01-3171-4ceb-8758-11eb0c63d3b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1759 microversion: 2.1 time: 0.223708 Aug 30 17:11:55.878838 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3590/7589] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:11:55 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1759 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:14:08.542933 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:14:08.544659 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:14:08.545353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:14:08.546132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:14:08.548523 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 17:14:08.551694 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:14:08.551814 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action (ip 10.222.0.47) !!! Aug 30 17:14:08.559247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:14:08.562200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:14:08.569847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:08.570363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:08.570813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:08.571509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:08.571976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:08.572405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:08.645509 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2160e964-17ab-44e5-a299-84a3d5897d0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.104188 Aug 30 17:14:08.646390 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4000/7590] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:14:08 2022] POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:14:08.653294 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:14:08.653869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:14:08.654890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=8 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:14:08.656084 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:14:08.656283 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f (ip 10.222.0.47) !!! Aug 30 17:14:08.657597 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:14:08.657597 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f (ip 10.222.0.47) !!! Aug 30 17:14:08.663390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:14:08.664042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:14:08.675113 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:08.675613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:08.676064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:08.676772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:08.677375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:08.677820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:09.017297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:14:09.025523 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-97e6940d-0fb8-4c0e-8c48-f44b4cfbcbfa tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1761 microversion: 2.1 time: 0.375085 Aug 30 17:14:09.026099 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3591/7591] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:14:08 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1761 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:14:10.051427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:14:10.052191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:14:10.061428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:10.061913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:10.062414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:10.063112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:14:10.063567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:14:10.063991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:14:10.068037 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50926. Aug 30 17:14:10.068771 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50928. Aug 30 17:14:10.264315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:14:10.272807 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-25b9643d-e385-4e44-a1f5-646d8c5d5330 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1759 microversion: 2.1 time: 0.229854 Aug 30 17:14:10.273382 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4001/7592] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:14:10 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1759 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:15:54.191878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:15:54.192644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:15:54.193505 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:15:54.193690 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action (ip 10.222.0.47) !!! Aug 30 17:15:54.199585 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-679682495"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:15:54.200132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:54.211894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:54.212392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:54.212837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:54.213570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:54.214042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:54.214505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:54.219512 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 50960. Aug 30 17:15:54.345988 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.network.security_group_api [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Removing security group 427b1087-54d8-4c44-b489-95115b6bfe2b from port 8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 Aug 30 17:15:54.645345 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5096fb32-1cf4-4792-847f-eb77fcda303d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.456550 Aug 30 17:15:54.645986 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3592/7593] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:15:54 2022] POST /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:15:54.651314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:15:54.652144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:15:54.735927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:15:54.747667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:54.748168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:54.748612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:54.760666 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] Creating event network-changed:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:15:54.766572 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-18943ff2-52a5-440c-be40-878ea17c4cbc req-6ca0b104-2244-4697-94ed-c15ac89659a8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116821 Aug 30 17:15:54.767338 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4002/7594] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:15:55.711343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:15:55.724243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:55.724745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:55.725196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:55.743742 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] Creating event network-changed:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:15:55.750542 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-e3c8eae8-ced4-4551-9df1-00104f93317c req-7a97d61b-12b0-4a2f-858c-6f9929981347 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042656 Aug 30 17:15:55.751402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3593/7595] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:15:55.757950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:55.758644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:55.766044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:55.766579 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:55.767028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:55.767722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:55.769035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:55.770061 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:55.873126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lazy-loading 'services' on Instance uuid 5c027c8a-1fba-4f5e-a85a-927bf5681f9f {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:15:55.954853 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-102500a5-4bae-40fb-9878-0a1b0dc18dee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments/d4c64d4d-13ba-449f-851e-4b4b3f6719f8" status: 202 len: 0 microversion: 2.1 time: 0.201513 Aug 30 17:15:55.955460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4003/7596] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:15:55 2022] DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments/d4c64d4d-13ba-449f-851e-4b4b3f6719f8 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:15:55.965314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:55.967879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:55.976075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:55.976557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:55.977208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:55.978257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:55.978845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:55.979500 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:56.012137 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cae9d490-62c2-4b83-a829-373526488255 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051210 Aug 30 17:15:56.014470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3594/7597] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:15:55 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:15:57.026856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:57.029214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:57.036258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:57.036745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:57.037186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:57.037891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:57.038365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:57.038796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:57.069403 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32ce8f8d-77dc-4760-9eaf-a14cc88e800c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047899 Aug 30 17:15:57.069979 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4004/7598] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:15:57 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:15:58.082226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:58.084498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:58.091869 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:58.092370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:58.092822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:58.093538 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:58.094007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:58.094478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:58.129226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be568528-074b-47d9-95be-c8a2daf7a4b6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051455 Aug 30 17:15:58.129849 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3595/7599] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:15:58 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:15:59.141807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:15:59.145205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:15:59.152469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:59.152967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:59.153464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:59.154118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:15:59.154839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:15:59.155348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:15:59.189259 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0d048484-f743-48a2-8851-080dc0165cde tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051409 Aug 30 17:15:59.189716 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4005/7600] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:15:59 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:00.201403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:00.204976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:00.212505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:00.213283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:00.214471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:00.214606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:00.218622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:00.218622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:00.249482 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-711addba-0075-454b-bb61-1ee81f6db606 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051981 Aug 30 17:16:00.254076 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3596/7601] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:16:00 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:01.261412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:01.263758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:01.272093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:01.272592 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:01.273039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:01.275808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:01.276292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:01.276959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:01.307895 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16426736-61e3-4ab2-b3f8-deb920b97912 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050567 Aug 30 17:16:01.308465 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4006/7602] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:16:01 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:16:01.319087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:01.319582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:01.326269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:01.326790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:01.327232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:01.327922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:01.328386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:01.328820 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:01.402792 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] HTTP exception thrown: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f is not attached to volume d4c64d4d-13ba-449f-851e-4b4b3f6719f8 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Request method failure captured: Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments/d4c64d4d-13ba-449f-851e-4b4b3f6719f8 HTTP/1.1 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkSj7fZhjpugz1cjqqKai9nSsEHjJg2AsDMnngs6U9hXc88IS0Estp8E9ndgnV1C_C_0rtMSSEo3ff9jMrFkKj-NyUDuTg-JNfKSopEPIDQMWsObnSEhDEzVxiozux8WMSQZpo9rcQIvufxbnUkOzp4UMQ4O5lIDU6xxHj7y79kpNuo Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}] Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 48fedf4df69c4e8f8fae6785529b59a3 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f is not attached to volume d4c64d4d-13ba-449f-851e-4b4b3f6719f8 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': '5c027c8a-1fba-4f5e-a85a-927bf5681f9f', 'id': 'd4c64d4d-13ba-449f-851e-4b4b3f6719f8'} Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d4c64d4d-13ba-449f-851e-4b4b3f6719f8. Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f is not attached to volume d4c64d4d-13ba-449f-851e-4b4b3f6719f8 Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:16:01.404414 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f is not attached to volume d4c64d4d-13ba-449f-851e-4b4b3f6719f8 Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Returning 404 to user: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f is not attached to volume d4c64d4d-13ba-449f-851e-4b4b3f6719f8 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9cc6676-be1a-45c8-9505-9b8b4c5ab2b9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments/d4c64d4d-13ba-449f-851e-4b4b3f6719f8" status: 404 len: 154 microversion: 2.1 time: 0.090911 Aug 30 17:16:01.409605 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3597/7603] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:16:01 2022] DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f/os-volume_attachments/d4c64d4d-13ba-449f-851e-4b4b3f6719f8 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:16:04.740504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:04.741104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:04.748439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:04.748932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:04.749373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:04.750076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:04.750566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:04.751000 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:04.781788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:16:04.864818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18dd145c-0ccc-4cc7-8619-ab5630fed73b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 204 len: 0 microversion: 2.1 time: 0.128077 Aug 30 17:16:04.868674 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4007/7604] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:16:04 2022] DELETE /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:16:04.873944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:04.874684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:04.883125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:04.883545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:04.883996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:04.884703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:04.885173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:04.885611 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:05.020174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:05.028216 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-13a4ab2c-c6d2-43dc-937a-351f1ae8b0e7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1554 microversion: 2.1 time: 0.158152 Aug 30 17:16:05.028777 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3598/7605] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:04 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:06.051726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:06.052442 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:06.059311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:06.059811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:06.060259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:06.060954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:06.061414 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:06.061847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:06.195206 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:06.203035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9d63def-5b65-4b70-adda-1ad736fccd5c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1554 microversion: 2.1 time: 0.156149 Aug 30 17:16:06.204084 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4008/7606] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:06 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:07.224808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:07.225548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:07.232528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:07.233125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:07.233706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:07.234520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:07.235056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:07.235564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:07.715591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:07.724444 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aab29a26-ab60-4028-8d68-07eee9de76ee tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 200 len: 1554 microversion: 2.1 time: 0.503637 Aug 30 17:16:07.725104 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3599/7607] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:07 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 1554 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:07.825432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c027c8a-1fba-4f5e-a85a-927bf5681f9f", "name": "network-vif-deleted", "tag": "8eb4d3dc-5f89-4475-a63b-546cc23dd9f7"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:07.837111 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:07.837686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:07.838149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:07.850833 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] Creating event network-vif-deleted:8eb4d3dc-5f89-4475-a63b-546cc23dd9f7 for instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f on n-h2-830883-28 Aug 30 17:16:07.856145 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-12bbd32b-7a01-4048-9e15-b815f9c2ab7e req-68bfae12-86a1-4924-969f-7cb63c5e419a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034399 Aug 30 17:16:07.856841 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4009/7608] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:08.747636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:08.748356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: 5c027c8a-1fba-4f5e-a85a-927bf5681f9f] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:08.755347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:08.755849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:08.756303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:08.757006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:08.757481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:08.757927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:08.772373 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] HTTP exception thrown: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Request method failure captured: Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f HTTP/1.1 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkSj7fZhjpugz1cjqqKai9nSsEHjJg2AsDMnngs6U9hXc88IS0Estp8E9ndgnV1C_C_0rtMSSEo3ff9jMrFkKj-NyUDuTg-JNfKSopEPIDQMWsObnSEhDEzVxiozux8WMSQZpo9rcQIvufxbnUkOzp4UMQ4O5lIDU6xxHj7y79kpNuo Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}] Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 48fedf4df69c4e8f8fae6785529b59a3 Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5c027c8a-1fba-4f5e-a85a-927bf5681f9f'} Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:16:08.773935 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Returning 404 to user: Instance 5c027c8a-1fba-4f5e-a85a-927bf5681f9f could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-201d1b38-2371-44b9-86d9-43c95db0de78 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f" status: 404 len: 111 microversion: 2.1 time: 0.031718 Aug 30 17:16:08.778446 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3600/7609] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:08 2022] GET /compute/v2.1/servers/5c027c8a-1fba-4f5e-a85a-927bf5681f9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:16:08.785645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a663dc1-0fdb-42c7-8087-fb99ad82b81b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '.version_select at 0x7fd357e5e1f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:08.809162 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a663dc1-0fdb-42c7-8087-fb99ad82b81b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1018690608" status: 202 len: 0 microversion: 2.1 time: 0.028558 Aug 30 17:16:08.809746 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4010/7610] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 17:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1018690608 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:16:17.645748 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:16:17.649286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4e93b078-cf9d-4b33-8009-e7bef8a18851 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: .version_select at 0x7fd357a5d790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2078101153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2QqfDpUvgR1ZPlpiA04d4s66VOCyE1UskKYvwfwWdMQBa4bGZYAZKIODUvGtuHn8ulqcKUnF1kf1Xq4wxRbMUPppB40HLrS8d2q4R20AxkD+owPJJLz+pZuyS4og8pzg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:17.664932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4e93b078-cf9d-4b33-8009-e7bef8a18851 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:16:17.671024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-4e93b078-cf9d-4b33-8009-e7bef8a18851 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for user 48fedf4df69c4e8f8fae6785529b59a3 and project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:16:17.698091 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4e93b078-cf9d-4b33-8009-e7bef8a18851 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053916 Aug 30 17:16:17.698722 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3601/7611] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:16:17 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:17.750572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2099507256", "imageRef": "84167cd2-f88c-4aec-8ae4-4b7f9c38f35a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2078101153", "networks": [{"uuid": "17cd554d-fe65-4368-8222-ea43f3475160"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:17.805915 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] validate_networks() for [('17cd554d-fe65-4368-8222-ea43f3475160', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:16:17.844055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:18.217691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:16:18.218147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:16:18.218690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:16:18.219102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:16:18.219520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:16:18.228353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:18.228836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:18.229271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:18.229992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:18.230498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:18.230928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:18.247660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:16:18.253422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Getting quotas for user 48fedf4df69c4e8f8fae6785529b59a3 and project 67d8081bf86c4dfabe351ae562ce810c. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:16:18.265457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:16:18.268704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='84167cd2-f88c-4aec-8ae4-4b7f9c38f35a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:16:18.312642 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:16:19.321106 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [703d2d1b-0eb3-4c7b-adf6-8dd07d144975] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 51132. Aug 30 17:16:19.325467 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cde150fc-0f05-4834-9276-d1180f7e76f1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580224 Aug 30 17:16:19.326119 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4011/7612] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:16:19.337761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cb975cf7-60a6-491c-990b-90357a05ea8e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:19.338431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cb975cf7-60a6-491c-990b-90357a05ea8e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:19.342811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=44 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:19.350696 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 51136. Aug 30 17:16:19.404663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cb975cf7-60a6-491c-990b-90357a05ea8e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:19.412350 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cb975cf7-60a6-491c-990b-90357a05ea8e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1259 microversion: 2.1 time: 0.078594 Aug 30 17:16:19.412920 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3602/7613] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:19 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:20.439090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:20.440253 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:20.451503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:20.454028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:20.454853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:20.456175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:20.457060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:20.457926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:20.534404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:20.542400 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-976caade-148f-4bbe-b952-12818a643661 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1319 microversion: 2.1 time: 0.112163 Aug 30 17:16:20.542985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4012/7614] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:20 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1319 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:21.566328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:21.567803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:21.577744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:21.578188 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:21.578645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:21.579357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:21.579940 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:21.580445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:21.719545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:21.728117 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80d3a243-9a00-4d9b-86ea-b1b55bea0a28 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.167394 Aug 30 17:16:21.729534 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3603/7615] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:21 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:22.752508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:22.753225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:22.760813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:22.761705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:22.762419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:22.763451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:22.764158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:22.764993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:22.910492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:22.918442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68f861c4-5f82-4374-a304-d50c1f48d594 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.170441 Aug 30 17:16:22.919025 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4013/7616] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:22 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:23.944094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:23.944911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:23.952318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:23.952823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:23.953271 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:23.953977 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:23.954476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:23.955110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:24.118548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:24.126896 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f7498e79-679e-4457-acc6-0e48e7e53e83 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.189698 Aug 30 17:16:24.127486 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3604/7617] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:23 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:25.148833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:25.150405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:25.157314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:25.161494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:25.162016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:25.162523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:25.163256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:25.163725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:25.164179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:25.315529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:25.323960 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edd20247-1252-42a4-9e1f-273bbaeef72a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.179071 Aug 30 17:16:25.335276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4014/7618] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:25 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:26.349913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:26.350600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:26.353793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:26.363789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:26.364452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:26.364906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:26.365629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:26.366098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:26.366565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:26.510518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:26.519392 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebfe3cf0-414e-4b64-b93f-2252c0acc385 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.174620 Aug 30 17:16:26.520163 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3605/7619] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:26 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:27.540336 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:27.541299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:27.551221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:27.551772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:27.552278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:27.553200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:27.553674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:27.554418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:27.700869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:27.709522 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4d355ba-760d-4a6d-97df-9c43a2f4d1e6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.173150 Aug 30 17:16:27.710096 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4015/7620] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:27 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:28.730879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:28.731510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:28.739719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:28.740215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:28.740663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:28.741361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:28.741825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:28.742263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:28.873160 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:28.881341 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ab610af3-7603-4403-b9ae-669eac82b378 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.154362 Aug 30 17:16:28.881913 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3606/7621] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:28 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:29.903240 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:29.903965 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:29.906151 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:29.907033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:29.915074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:29.915279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:29.916098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:29.916820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:29.917290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:29.917726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:29.976362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:29.988598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:29.992659 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:29.994031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:29.994518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:30.007620 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] Creating event network-changed:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:16:30.014543 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-4f6f1211-5d47-4a31-b9a8-b3ead007ea28 req-b58d728d-8ada-468a-9aa8-66bea7fcdc38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043081 Aug 30 17:16:30.016202 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3607/7622] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:30.071485 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:30.080310 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ba14cf4-ca6d-467c-9b34-d5e71b45c023 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.180922 Aug 30 17:16:30.081817 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4016/7623] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:29 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:31.103530 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:31.104157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:31.110326 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:31.110836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:31.111283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:31.112643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:31.113105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:31.113542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:31.246681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:31.254635 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-80b66cc6-0e62-414c-97f5-9aac70cdcd7b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.156235 Aug 30 17:16:31.255203 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3608/7624] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:31 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:32.275570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:32.276202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:32.283301 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:32.284369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:32.284932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:32.285615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:32.286082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:32.286556 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:32.414963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:32.423963 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74c8819c-7bcd-4947-8512-40ef67bec901 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.152285 Aug 30 17:16:32.425116 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4017/7625] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:32 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:33.446000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:33.446649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:33.453434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:33.453971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:33.454680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:33.455451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:33.455969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:33.456507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:33.591876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:33.599600 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-412746b2-1017-4ca8-a20c-f18bda27736d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.157468 Aug 30 17:16:33.600189 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3609/7626] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:33 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:16:34.257697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "name": "network-vif-plugged", "status": "completed", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:34.268657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:34.269652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:34.270089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:34.281282 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] Creating event network-vif-plugged:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:16:34.287068 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-15468e05-fea0-4857-abc8-df70d06a6e58 req-ee29bb91-af7f-4b65-a0b9-dcc74482f6eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091611 Aug 30 17:16:34.287658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4018/7627] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:34.619773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:34.620396 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:34.627239 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:34.627735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:34.628185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:34.629553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:34.630014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:34.630490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:34.760541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:34.768346 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5b1de16-b9a3-433c-8608-46ac0da1ec45 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1359 microversion: 2.1 time: 0.152409 Aug 30 17:16:34.768941 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3610/7628] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:34 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:35.791276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:35.791987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:35.798551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:35.799034 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:35.799481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:35.800250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:35.800674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:35.801098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:35.933458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:35.941341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68dbda22-2dbe-4809-9feb-008fbf6759f3 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1548 microversion: 2.1 time: 0.155928 Aug 30 17:16:35.941916 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4019/7629] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:35 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:35.961591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:35.962251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:35.969360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:35.969857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:35.970324 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:35.971115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:35.971575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:35.972647 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:36.100747 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:36.108539 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-94ede78b-9b42-404e-a534-96f0fbfd49b4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1548 microversion: 2.1 time: 0.150883 Aug 30 17:16:36.109115 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3611/7630] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:35 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:36.128158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:36.133380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:36.134152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Searching by: {'deleted': False, 'project_id': '67d8081bf86c4dfabe351ae562ce810c'} {{(pid=122352) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 17:16:36.139450 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:36.139932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:36.140371 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:36.141086 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:36.141542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:36.141967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:36.165781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.multi_cell_list [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122352) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 17:16:36.196366 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a1be62ed-3f00-4b51-85e3-b7eb3aacd886 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072014 Aug 30 17:16:36.196977 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4020/7631] 10.222.0.47 () {58 vars in 1125 bytes} [Tue Aug 30 17:16:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:36.209096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:36.209717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:36.215762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:36.216264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:36.216711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:36.217411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:36.217877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:36.218328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:36.349458 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:36.357327 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4561a2d7-85fb-4b74-9dff-8bfed148d02a tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1548 microversion: 2.1 time: 0.153009 Aug 30 17:16:36.357914 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3612/7632] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:36 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:16:38.027615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07637eb0-646b-402f-ab43-df9b57a99d16"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:38.029974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:38.036991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:38.037479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:38.037917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:38.038637 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:38.039094 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:38.039520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:38.299941 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-574423d0-a98b-44c6-9c14-ea4705435324 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276003 Aug 30 17:16:38.301212 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4021/7633] 10.222.0.47 () {60 vars in 1323 bytes} [Tue Aug 30 17:16:38 2022] POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:49.056810 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:49.057445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:49.060547 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=15 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:49.061233 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=56 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:49.066855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:49.067359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:49.067816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:49.068525 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:49.069000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:49.069444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:49.201032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:49.209872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa59987b-70b0-46f8-8dd7-cdf69bcfa824 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1594 microversion: 2.1 time: 0.156864 Aug 30 17:16:49.210470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3613/7634] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:49 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:16:51.069089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:51.076308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:51.077144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=15 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:51.078356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:16:51.086264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:51.087169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:51.087910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:51.103053 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] Creating event network-changed:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:16:51.109006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-5654c456-ce6e-445f-941a-54e1895829d2 req-4308e980-5481-49aa-8ffc-6777d5e1e384 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044860 Aug 30 17:16:51.110111 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4022/7635] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:52.087503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1306517324"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:52.088059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:52.095146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:52.095652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:52.096109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:52.096824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:52.097298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:52.098629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:52.239269 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.network.security_group_api [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Adding security group 4496f834-fc55-4da9-a639-4a7957455fbd to port 47bd0db8-0dfe-46ed-b2b3-579db17db90c Aug 30 17:16:52.547642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-84aac56a-d85c-4da4-acc3-a543d885b80d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action" status: 202 len: 0 microversion: 2.1 time: 0.464283 Aug 30 17:16:52.548276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3614/7636] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:16:52 2022] POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:16:52.557613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:16:52.558714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:16:52.559534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:16:52.568689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:52.569209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:52.569636 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:52.575728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:52.576242 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:52.576693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:52.577518 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:16:52.577990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:16:52.578466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:16:52.581385 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] Creating event network-changed:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:16:52.587901 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-fde3f942-2d90-4fda-b5fa-484d4219bab8 req-7abb2a52-e8dd-4020-97fa-df1bf151d2c8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033706 Aug 30 17:16:52.588640 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3615/7637] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:16:52.751974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:16:52.762960 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9e79837d-63aa-48a1-b18d-69e56cb622df tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1759 microversion: 2.1 time: 0.208647 Aug 30 17:16:52.764168 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4023/7638] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:16:52 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:07.714658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:07.715440 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:07.719725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:07.722064 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:07.729034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:07.729524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:07.729974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:07.730696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:07.731159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:07.731590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:07.803304 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b8503734-e364-4e95-a2b8-9cd9866ff946 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action" status: 202 len: 0 microversion: 2.1 time: 0.090475 Aug 30 17:17:07.803946 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3616/7639] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:17:07 2022] POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:17:07.812143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:07.812770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:07.816496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:07.817341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=8 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:07.824365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:07.824865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:07.825330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:07.826060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:07.826546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:07.826982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:07.976504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:07.984768 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-fe4a0b3f-297a-42d0-b284-6b675f9ffaef tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1751 microversion: 2.1 time: 0.176506 Aug 30 17:17:07.985341 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4024/7640] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:07 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:09.013111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:09.013824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:09.021170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:09.021669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:09.022115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:09.022857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:09.023316 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:09.023753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:09.170479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:09.179381 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-52ede3a7-8d81-4096-be54-daa3eb2e09bd tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.171286 Aug 30 17:17:09.179958 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3617/7641] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:09 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:10.201066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:10.201688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:10.208413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:10.208902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:10.209337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:10.210033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:10.210516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:10.210946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:10.353505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:10.361735 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-68eea4b4-2ffe-44fa-8ed0-8b1d1dae1310 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.164992 Aug 30 17:17:10.362323 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4025/7642] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:10 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:11.384127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:11.384757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:11.391649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:11.392142 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:11.392591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:11.393318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:11.393917 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:11.395336 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:11.535235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:11.543342 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-24c42274-3935-4eb4-9535-5d664f10ca67 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.163148 Aug 30 17:17:11.543910 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3618/7643] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:11 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:12.564711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:12.565342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:12.572844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:12.573340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:12.573787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:12.574520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:12.574986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:12.575424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:12.723030 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:12.731397 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-90314ea0-3844-4960-8c2f-cf305abcdaa9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.170597 Aug 30 17:17:12.731978 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4026/7644] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:12 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:13.753552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:13.754290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:13.761161 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:13.761663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:13.762115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:13.762852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:13.763329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:13.763771 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:13.907631 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:13.916050 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-75b5e637-802b-42fa-b101-7eb5d085a9d7 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.166949 Aug 30 17:17:13.916623 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3619/7645] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:13 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:14.938137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:14.938809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:14.946502 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:14.946994 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:14.947458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:14.948147 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:14.948604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:14.949031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:15.097372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:15.106475 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c0ab460-51b7-4886-a343-d84e48486815 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.172205 Aug 30 17:17:15.107276 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4027/7646] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:14 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:16.128021 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:16.129076 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:16.135952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:16.136443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:16.136920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:16.137618 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:16.138084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:16.138552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:16.283479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:16.292393 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5306cca6-8f03-4014-8a4c-12c39732ac0e tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.168259 Aug 30 17:17:16.292953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3620/7647] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:16 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:17.314575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:17.315201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:17.322343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:17.322841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:17.323288 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:17.323989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:17.324455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:17.324895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:17.467986 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:17.477146 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-db22fe2c-a637-4f71-a626-50f8c334ae07 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.166619 Aug 30 17:17:17.477739 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4028/7648] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:17 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:18.499589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:18.500245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:18.507969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:18.508471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:18.508925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:18.509629 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:18.510102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:18.510583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:18.654846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:18.663112 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7319fc3-3b94-4839-a7b7-9b75ef816153 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1756 microversion: 2.1 time: 0.167411 Aug 30 17:17:18.663693 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3621/7649] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:18 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:19.685745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:19.686399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:19.693912 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:19.694423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:19.694868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:19.695559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:19.696016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:19.696446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:19.838519 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:17:19.847197 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-81afa218-4d2a-4898-8b78-fcc83ea32906 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1759 microversion: 2.1 time: 0.165346 Aug 30 17:17:19.849038 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4029/7650] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:17:19 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:17:52.109412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1306517324"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:52.110024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:52.112474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:52.113149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:52.113980 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:17:52.114129 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:17:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action (ip 10.222.0.47) !!! Aug 30 17:17:52.123186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:52.123739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:52.124186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:52.124885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:52.125351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:52.125783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:52.257465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.network.security_group_api [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Removing security group 4496f834-fc55-4da9-a639-4a7957455fbd from port 47bd0db8-0dfe-46ed-b2b3-579db17db90c Aug 30 17:17:52.567502 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-132db6aa-43db-4859-840d-5f61d59c3bf6 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action" status: 202 len: 0 microversion: 2.1 time: 0.462315 Aug 30 17:17:52.570034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3622/7651] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:17:52 2022] POST /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:17:52.577803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:52.588642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=12 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:52.589517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:17:52.593602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:52.594078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:52.594591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:52.612333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] Creating event network-changed:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:17:52.619534 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-d3696406-1d46-4b6e-8f5f-88cf8db6529c req-aaac5ad3-5f3a-439b-9ec7-133c38f58b54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045214 Aug 30 17:17:52.620719 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4030/7652] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:17:54.032919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:54.033540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:54.040314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:54.040894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:54.041437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:54.042348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:54.042847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:54.043285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:54.132866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lazy-loading 'services' on Instance uuid dd667be8-84ee-4524-9094-2e826d626e15 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:17:54.210686 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c772569-2ff3-4975-9be0-a21f378bb8b2 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments/07637eb0-646b-402f-ab43-df9b57a99d16" status: 202 len: 0 microversion: 2.1 time: 0.182475 Aug 30 17:17:54.211345 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3623/7653] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:17:54 2022] DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments/07637eb0-646b-402f-ab43-df9b57a99d16 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:17:54.221463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:54.224524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:54.232072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:54.232512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:54.232972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:54.233761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:54.234136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:54.234791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:54.269292 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e6f90e97-3be1-4eab-91b9-c88141122ad9 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053192 Aug 30 17:17:54.269876 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4031/7654] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:54 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:54.636719 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:17:54.647669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:54.648126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:54.648567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:54.659954 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] Creating event network-changed:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:17:54.665459 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-57121818-180d-48ca-88f5-8efb66e885b0 req-a4c9eb86-6125-4abe-bf4a-abb9c41957d0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032875 Aug 30 17:17:54.666061 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3624/7655] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:55.282968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:55.285187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:55.292332 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:55.292826 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:55.293267 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:55.293967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:55.294723 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:55.295154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:55.327461 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-47333eca-c365-4a33-a0a9-b15d97d7a479 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048603 Aug 30 17:17:55.328542 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4032/7656] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:55 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:56.342025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:56.345035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:56.352117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:56.352623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:56.353078 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:56.353794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:56.354262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:56.354731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:56.387790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-54b9727c-5a57-489c-b3a2-93a1729d1099 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050948 Aug 30 17:17:56.388392 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3625/7657] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:56 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:57.399858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:57.402006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:57.408927 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:57.409413 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:57.409854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:57.410572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:57.411036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:57.412164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:57.442033 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50500b15-e99b-4f3e-b8d6-066914d14ed4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 30 17:17:57.442768 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4033/7658] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:57 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:58.455082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:58.457232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:58.465172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:58.465672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:58.466127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:58.466942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:58.467406 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:58.467846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:58.496769 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e9b748f8-9b02-41c5-91dc-984646e2afa4 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 30 17:17:58.497333 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3626/7659] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:58 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:17:59.509174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:59.511302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:59.518791 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:59.519275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:59.519718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:59.520405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:59.521662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:59.522105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:59.554466 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dfa65da6-7fb2-4c5f-84f7-ad39208a11bf tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049421 Aug 30 17:17:59.555031 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4034/7660] 10.222.0.47 () {58 vars in 1302 bytes} [Tue Aug 30 17:17:59 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 17:17:59.565448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:17:59.565965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:17:59.573225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:59.573723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:59.574185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:59.574911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:17:59.575392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:17:59.575825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:17:59.650641 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] HTTP exception thrown: Instance dd667be8-84ee-4524-9094-2e826d626e15 is not attached to volume 07637eb0-646b-402f-ab43-df9b57a99d16 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Request method failure captured: Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: request: DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments/07637eb0-646b-402f-ab43-df9b57a99d16 HTTP/1.1 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkSj7fZhjpugz1cjqqKai9nSsEHjJg2AsDMnngs6U9hXc88IS0Estp8E9ndgnV1C_C_0rtMSSEo3ff9jMrFkKj-NyUDuTg-JNfKSopEPIDQMWsObnSEhDEzVxiozux8WMSQZpo9rcQIvufxbnUkOzp4UMQ4O5lIDU6xxHj7y79kpNuo Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}] Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 48fedf4df69c4e8f8fae6785529b59a3 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance dd667be8-84ee-4524-9094-2e826d626e15 is not attached to volume 07637eb0-646b-402f-ab43-df9b57a99d16 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'server_id': 'dd667be8-84ee-4524-9094-2e826d626e15', 'id': '07637eb0-646b-402f-ab43-df9b57a99d16'} Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 07637eb0-646b-402f-ab43-df9b57a99d16. Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd667be8-84ee-4524-9094-2e826d626e15 is not attached to volume 07637eb0-646b-402f-ab43-df9b57a99d16 Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:17:59.652281 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd667be8-84ee-4524-9094-2e826d626e15 is not attached to volume 07637eb0-646b-402f-ab43-df9b57a99d16 Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Returning 404 to user: Instance dd667be8-84ee-4524-9094-2e826d626e15 is not attached to volume 07637eb0-646b-402f-ab43-df9b57a99d16 {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eb5d8d2c-3dcf-47c7-bd94-e38400b2583d tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments/07637eb0-646b-402f-ab43-df9b57a99d16" status: 404 len: 154 microversion: 2.1 time: 0.092295 Aug 30 17:17:59.656606 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3627/7661] 10.222.0.47 () {58 vars in 1416 bytes} [Tue Aug 30 17:17:59 2022] DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15/os-volume_attachments/07637eb0-646b-402f-ab43-df9b57a99d16 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:18:02.902113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:02.902690 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:02.909568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:02.910057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:02.910545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:02.911748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:02.912209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:02.912647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:02.938578 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:18:03.021796 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74164307-a6b9-41a2-ae05-0986502012b5 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 204 len: 0 microversion: 2.1 time: 0.123106 Aug 30 17:18:03.026040 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4035/7662] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:18:02 2022] DELETE /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:18:03.030669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:03.031306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:03.040667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:03.041298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:03.041759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:03.042504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:03.042976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:03.043417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:03.176550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:03.185197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2e59a07b-ef47-49a8-8ba1-1c95421d8964 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1554 microversion: 2.1 time: 0.158422 Aug 30 17:18:03.185776 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3628/7663] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:03 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:04.207302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:04.208019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:04.215429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:04.215918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:04.216363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:04.217065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:04.217529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:04.217960 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:04.346295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:04.354098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-748012cd-c041-44fe-a7c0-aa1771170fe1 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1554 microversion: 2.1 time: 0.151778 Aug 30 17:18:04.354712 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4036/7664] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:04 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:05.286571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd667be8-84ee-4524-9094-2e826d626e15", "name": "network-vif-deleted", "tag": "47bd0db8-0dfe-46ed-b2b3-579db17db90c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:05.299548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:05.300046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:05.300492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:05.313201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] Creating event network-vif-deleted:47bd0db8-0dfe-46ed-b2b3-579db17db90c for instance dd667be8-84ee-4524-9094-2e826d626e15 on n-h1-830883-28 Aug 30 17:18:05.319242 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-51dbcdf3-63f8-427e-9fb8-0da45632dccc req-07641251-8d94-40ea-afa8-4a99372f6107 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Aug 30 17:18:05.320024 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3629/7665] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:18:05.375024 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:05.375626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:05.382946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:05.383439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:05.383886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:05.384593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:05.385052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:05.385582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:05.419341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:05.419844 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:05.420289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:05.420750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lazy-loading 'fault' on Instance uuid dd667be8-84ee-4524-9094-2e826d626e15 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:18:05.466344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48fedf4df69c4e8f8fae6785529b59a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d8081bf86c4dfabe351ae562ce810c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:05.475423 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b88ae2f5-425c-4ae2-a80d-1a9d75f0b71b tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 200 len: 1349 microversion: 2.1 time: 0.104375 Aug 30 17:18:05.476215 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4037/7666] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:05 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:06.498052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:06.498797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] [instance: dd667be8-84ee-4524-9094-2e826d626e15] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:06.506130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:06.506668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:06.507119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:06.507839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:06.508289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:06.508729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:06.523061 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] HTTP exception thrown: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Request method failure captured: Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 HTTP/1.1 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkSj7fZhjpugz1cjqqKai9nSsEHjJg2AsDMnngs6U9hXc88IS0Estp8E9ndgnV1C_C_0rtMSSEo3ff9jMrFkKj-NyUDuTg-JNfKSopEPIDQMWsObnSEhDEzVxiozux8WMSQZpo9rcQIvufxbnUkOzp4UMQ4O5lIDU6xxHj7y79kpNuo Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/67d8081bf86c4dfabe351ae562ce810c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67d8081bf86c4dfabe351ae562ce810c"}]}] Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: 67d8081bf86c4dfabe351ae562ce810c Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1517152779 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 48fedf4df69c4e8f8fae6785529b59a3 Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestMinimumBasicScenario-1517152779-project Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'dd667be8-84ee-4524-9094-2e826d626e15'} Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:18:06.524683 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Returning 404 to user: Instance dd667be8-84ee-4524-9094-2e826d626e15 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a257d21e-4538-4ed6-85c8-4dca071f2c52 tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15" status: 404 len: 111 microversion: 2.1 time: 0.033272 Aug 30 17:18:06.529226 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3630/7667] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:06 2022] GET /compute/v2.1/servers/dd667be8-84ee-4524-9094-2e826d626e15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:18:06.534970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c365260a-5435-4dfa-be20-5509ac2d9d1c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] Calling method '.version_select at 0x7fd35c474820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:06.556044 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c365260a-5435-4dfa-be20-5509ac2d9d1c tempest-TestMinimumBasicScenario-1517152779 tempest-TestMinimumBasicScenario-1517152779-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078101153" status: 202 len: 0 microversion: 2.1 time: 0.024896 Aug 30 17:18:06.556618 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4038/7668] 10.222.0.47 () {58 vars in 1272 bytes} [Tue Aug 30 17:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078101153 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:18:15.851918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3980132f-b48a-4bf3-af36-46f030dd3dfa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: .version_select at 0x7fd3347c94c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-509346311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODueHNX5TjrkSLqXCUlil/LiSirFaoKegTfSRYeHNyvAECu1ZF6VHoVmiLX5L9NevCbW+knjz9L7anZTwOkb6IQUrTwAqqRa+QfSiFmgkb89wO46nLWfFHDMQDEhumAtg=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:15.868561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3980132f-b48a-4bf3-af36-46f030dd3dfa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:18:15.873608 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-3980132f-b48a-4bf3-af36-46f030dd3dfa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:18:15.898855 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3980132f-b48a-4bf3-af36-46f030dd3dfa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.224860 Aug 30 17:18:15.899461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3631/7669] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:18:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:18:21.831688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:21.832542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:21.837391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301191419", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "13a45a22-4c87-4a66-820f-c952aea3d424"}], "key_name": "tempest-TestNetworkAdvancedServerOps-509346311", "security_groups": [{"name": "tempest-secgroup-smoke-1256971313"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:21.971174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] validate_networks() for [('13a45a22-4c87-4a66-820f-c952aea3d424', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:18:22.381181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:18:22.381872 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:18:22.382590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:18:22.383017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:18:22.383447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:18:22.392441 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:22.392937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:22.393387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:22.394130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:22.394638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:22.395291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:22.415489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:18:22.421869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:18:22.436938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:18:22.439310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:18:22.485896 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-78ac837b-196a-4ba1-b177-dabba62e4cbb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656182 Aug 30 17:18:22.493123 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4039/7670] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:18:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:18:22.495205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:22.500983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-635bde82-33c6-46a6-b8ea-c29b65e95726 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:22.501831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-635bde82-33c6-46a6-b8ea-c29b65e95726 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:22.510003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:22.589059 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-635bde82-33c6-46a6-b8ea-c29b65e95726 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:22.596291 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-635bde82-33c6-46a6-b8ea-c29b65e95726 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1266 microversion: 2.1 time: 0.101830 Aug 30 17:18:22.597473 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3632/7671] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:22 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:23.619825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:23.620449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:23.633075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:23.633657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:23.634188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:23.635031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:23.635668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:23.636164 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:23.710693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:23.720082 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6089f4f9-88f2-456c-9e0c-175a059b1d09 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1318 microversion: 2.1 time: 0.105587 Aug 30 17:18:23.720679 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4040/7672] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:23 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:24.742601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:24.743238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:24.754907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:24.755714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:24.756687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:24.757581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:24.758327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:24.759329 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:24.994993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:25.002694 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0116f1a2-7762-426b-b81e-ff0fb1cb6513 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.265331 Aug 30 17:18:25.003275 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3633/7673] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:24 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:25.263616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c070c80b-731c-4786-8db3-e04f251edd77", "tag": "2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:25.275868 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:25.276356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:25.276810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:25.291815 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] Creating event network-changed:2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd for instance c070c80b-731c-4786-8db3-e04f251edd77 on n-h2-830883-28 Aug 30 17:18:25.296979 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-95ee811f-6a79-42ce-ac35-5c2a8fa70e9a req-f6a631f2-faaf-4a6d-a7c8-29acff028d9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037232 Aug 30 17:18:25.297800 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4041/7674] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:18:26.025031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:26.025651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:26.032726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:26.033214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:26.033657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:26.034387 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:26.034851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:26.035287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:26.186783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:26.195221 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a5b5ded8-b925-439b-b67c-08febad0598a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.174341 Aug 30 17:18:26.196025 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3634/7675] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:26 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:27.219055 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:27.219839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:27.226210 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:27.226822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:27.227318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:27.228041 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:27.228516 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:27.228953 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:27.367247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:27.375016 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f31b95a-8edd-496c-ac5e-e073b81cf696 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.161065 Aug 30 17:18:27.375600 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4042/7676] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:27 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:28.397507 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:28.398321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:28.405125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:28.405632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:28.406090 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:28.406824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:28.407296 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:28.407789 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:28.536292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:28.544272 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fdfcee3e-3132-40a5-95e0-55258ae466d6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.151090 Aug 30 17:18:28.544847 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3635/7677] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:28 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:29.565146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:29.565763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:29.574782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:29.575274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:29.575714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:29.576407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:29.576863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:29.577292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:29.712356 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:29.720055 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4878b82-22e1-466e-8f25-3ca601e8dfe4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.159181 Aug 30 17:18:29.720620 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4043/7678] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:29 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:30.740527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:30.741251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:30.748362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:30.748863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:30.749313 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:30.750013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:30.750559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:30.751008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:30.886399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:30.894025 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7c3d9c32-d4f7-4019-a065-1000e27c3f92 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.157503 Aug 30 17:18:30.894619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3636/7679] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:30 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:31.914419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:31.915072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:31.922187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:31.922710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:31.923154 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:31.923847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:31.924309 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:31.924738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:32.063748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:32.071911 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a4b26dae-a961-4917-b11a-b26c19a5a01b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.161958 Aug 30 17:18:32.072530 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4044/7680] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:31 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:32.148562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c070c80b-731c-4786-8db3-e04f251edd77", "name": "network-vif-plugged", "status": "completed", "tag": "2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:32.159979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:32.161404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:32.161852 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:32.173924 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] Creating event network-vif-plugged:2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd for instance c070c80b-731c-4786-8db3-e04f251edd77 on n-h2-830883-28 Aug 30 17:18:32.180112 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-452e0fe9-3c5a-49b6-97d7-de8de1c6d3e4 req-9b3187da-07f8-4ef3-8f31-ff5713d9f58e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Aug 30 17:18:32.180919 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3637/7681] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:18:33.093664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:33.094292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:33.096312 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:33.096979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:33.104532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:33.105017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:33.105492 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:33.106209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:33.106697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:33.107127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:33.241454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:33.249773 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f89d3e7-3a09-4478-a412-21d98b0d1297 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1392 microversion: 2.1 time: 0.160257 Aug 30 17:18:33.250380 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4045/7682] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:33 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:34.271360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:34.272612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:34.274633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:18:34.281150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:34.281651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:34.282108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:34.282845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:34.283319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:34.283762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:34.415544 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:34.423562 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-472e8439-4539-4f27-b105-d2cff60653e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1565 microversion: 2.1 time: 0.156462 Aug 30 17:18:34.424131 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3638/7683] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:34 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:34.444967 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:34.445618 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:34.452722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:34.453211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:34.453653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:34.454421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:34.454886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:34.455313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:34.588766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:34.596579 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b6757f77-fc3a-418a-ba79-4fc7df538cfd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1565 microversion: 2.1 time: 0.155922 Aug 30 17:18:34.597150 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4046/7684] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:34 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:18:36.494541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:18:36.495301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:18:36.498890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c070c80b-731c-4786-8db3-e04f251edd77", "tag": "2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:18:36.502902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:36.503411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:36.503861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:36.504801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:36.505272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:36.505734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:36.511404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:18:36.511895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:18:36.512333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:18:36.525218 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] Creating event network-changed:2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd for instance c070c80b-731c-4786-8db3-e04f251edd77 on n-h2-830883-28 Aug 30 17:18:36.530717 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6f5401f2-2353-431b-818f-73c1665f5282 req-b2e93d29-4c7e-4d84-b55a-fb4632f4ab87 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036010 Aug 30 17:18:36.531651 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4047/7685] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:18:36.742092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:18:36.750515 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d6b006d3-a345-45c2-9648-5dd0ff106e6c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1565 microversion: 2.1 time: 0.260404 Aug 30 17:18:36.751428 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3639/7686] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:18:36 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1565 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:10.036004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:10.036783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=42 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:10.042270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:10.044810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:10.052374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:10.052861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:10.053307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:10.053997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:10.054638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:10.055076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:10.127341 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a753bc7-c677-4742-bcf8-4512558494bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action" status: 200 len: 24564 microversion: 2.1 time: 0.093202 Aug 30 17:19:10.128053 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4048/7687] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:19:10 2022] POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action => generated 24564 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:19:40.333715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=17 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:40.334663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=38 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:40.339755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:40.340304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:40.347252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:40.347696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:40.348154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:40.348870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:40.349345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:40.350356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:40.417413 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-836de001-1357-4cf8-92a7-f07f8df46067 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action" status: 202 len: 0 microversion: 2.1 time: 0.085329 Aug 30 17:19:40.418456 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3640/7688] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:19:40 2022] POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:19:40.428654 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:40.429842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:40.432854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:40.433676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:40.441744 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:40.442246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:40.443006 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:40.445172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:40.445995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:40.446481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:40.660376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:40.670023 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a495794-5aae-41db-857f-b13154002e05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1688 microversion: 2.1 time: 0.247072 Aug 30 17:19:40.670665 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4049/7689] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:40 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1688 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:41.694759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:41.695509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:41.701944 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:41.702505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:41.702968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:41.703673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:41.704145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:41.704590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:41.897938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:41.905935 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ce77a0e1-a476-4ee9-bcb0-c346cab7818e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1668 microversion: 2.1 time: 0.216757 Aug 30 17:19:41.906558 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3641/7690] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:41 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:43.002169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:43.006063 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:43.015412 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.015908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.016347 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.017036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.017495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.017918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.085006 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-980c81e4-3be7-41b4-80b2-ca1fdddb0556 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action" status: 200 len: 32633 microversion: 2.1 time: 0.088764 Aug 30 17:19:43.085685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4050/7691] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:19:42 2022] POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action => generated 32633 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:19:43.097744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:43.098315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:43.105954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.106510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.106971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.107699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.108155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.108601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.175175 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21797db3-0314-4137-ab7c-7e80200ea645 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action" status: 202 len: 0 microversion: 2.1 time: 0.081206 Aug 30 17:19:43.178253 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3642/7692] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:19:43 2022] POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:19:43.185486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:43.186205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:43.194026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.194851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.195321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.196042 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:43.196526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:43.201593 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:43.341113 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:43.349354 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-17fa0c7c-a273-4d99-bf1a-6e31bb3e6da8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1675 microversion: 2.1 time: 0.168168 Aug 30 17:19:43.350004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4051/7693] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:43 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:44.374205 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:44.374993 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:44.382085 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:44.382531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:44.382986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:44.383698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:44.384209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:44.384648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:44.526370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:44.534235 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0384953d-5803-49ac-b18f-b93434d2b143 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1683 microversion: 2.1 time: 0.165353 Aug 30 17:19:44.534837 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3643/7694] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:44 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:44.630343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:44.632732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:44.640644 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:44.641146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:44.641602 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:44.642323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:44.642798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:44.643236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:44.705309 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2d82cefe-0cd7-4544-84bf-0d34900ca521 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action" status: 200 len: 38474 microversion: 2.1 time: 0.078862 Aug 30 17:19:44.705977 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4052/7695] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:19:44 2022] POST /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77/action => generated 38474 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:19:45.714583 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:45.715132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:45.716731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c070c80b-731c-4786-8db3-e04f251edd77", "tag": "2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:45.722357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:45.722872 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:45.723446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:45.724166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:45.725491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:45.725950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:45.728892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:45.729487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:45.730199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:45.742941 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] Creating event network-changed:2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd for instance c070c80b-731c-4786-8db3-e04f251edd77 on n-h2-830883-28 Aug 30 17:19:45.748310 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-12fa7178-a9b9-43ef-8806-13ef05f6f0d2 req-72c1f403-3896-499a-ad29-12c9436bbd05 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035690 Aug 30 17:19:45.748935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4053/7696] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:19:45.757306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:19:45.845034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-299d6d3f-1106-44fa-a3d4-a2128f9b8da6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 204 len: 0 microversion: 2.1 time: 0.135426 Aug 30 17:19:45.846291 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3644/7697] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:19:45 2022] DELETE /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:19:45.855652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:45.856569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:45.863535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:45.864032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:45.864482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:45.865446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:45.866292 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:45.866767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:46.004668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:46.013832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f5b38262-f34a-441d-b1c2-d5b8498b5c68 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1689 microversion: 2.1 time: 0.162677 Aug 30 17:19:46.014712 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4054/7698] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:45 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:47.037504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:47.038164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:47.045935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:47.046462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:47.046916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:47.047632 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:47.048102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:47.048540 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:47.251208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:47.261099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9ccaad9-a16f-49e9-85e3-1f03fe2a50c0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1689 microversion: 2.1 time: 0.228011 Aug 30 17:19:47.261685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3645/7699] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:47 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:19:48.282696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:48.283348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:48.290119 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:48.290662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:48.291106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:48.291816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:48.292318 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:48.292993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:48.371302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:48.371675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c070c80b-731c-4786-8db3-e04f251edd77", "name": "network-vif-deleted", "tag": "2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:48.379482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dce527ee-1832-4df0-9af1-8011705716a1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 200 len: 1503 microversion: 2.1 time: 0.100559 Aug 30 17:19:48.380459 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4055/7700] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:48 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 1503 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:19:48.382755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:48.383258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:48.383707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:48.395606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] Creating event network-vif-deleted:2f54b5ab-dca2-4a15-b9a5-40df77d4d1fd for instance c070c80b-731c-4786-8db3-e04f251edd77 on n-h2-830883-28 Aug 30 17:19:48.401435 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d34332b0-e1ae-4a79-8a91-6a2be6a4c5d5 req-4bca9833-d0e7-42fe-935b-f753de6fe7f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033421 Aug 30 17:19:48.402044 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3646/7701] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:19:49.401881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:49.402567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: c070c80b-731c-4786-8db3-e04f251edd77] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:49.409465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:49.409956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:49.410434 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:49.411139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:49.411605 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:49.412669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:49.426612 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] HTTP exception thrown: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Request method failure captured: Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 HTTP/1.1 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkZXPJ6hTx-88qQuYi-2s2VlRnymK_bTgqYIrhKtb4MHt5jfOIBXNn5jfrSca-aZwIG-ETdefOu4u642_cBSg7f4oIbSvF4dG1F4ChSXZHgWC8a3wYZNqXvbGLMdqTEeez07Z3-UJfbKTWD8HVZSP-v5RvUSz3XhFRvhsAnFwfab10A Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}] Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aa84109906174f48ae12969761161099 Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'c070c80b-731c-4786-8db3-e04f251edd77'} Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:19:49.429083 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Returning 404 to user: Instance c070c80b-731c-4786-8db3-e04f251edd77 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-50a23e9d-2932-440b-a744-f8b747f1f561 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77" status: 404 len: 111 microversion: 2.1 time: 0.032861 Aug 30 17:19:49.433885 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4056/7702] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:49 2022] GET /compute/v2.1/servers/c070c80b-731c-4786-8db3-e04f251edd77 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 17:19:53.103003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5ff73f50-fce0-4ec2-8512-8f49ebb66015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '.version_select at 0x7fd3347c9dc0>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:53.123700 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5ff73f50-fce0-4ec2-8512-8f49ebb66015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-509346311" status: 202 len: 0 microversion: 2.1 time: 0.027546 Aug 30 17:19:53.128964 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3647/7703] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 17:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-509346311 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:19:53.153891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a334fea3-db2a-460e-9040-622f7ca410f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: .version_select at 0x7fd35cc53700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1266817486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEemujFxE8R9Fd4Q7oUISyWpCFpi7q/21+ZvF8/XxXYU+Rz5hZa5XHi+6ZJtm7r73nUP5BgtPxvoMoGJyIKF+hC4w+e1a2cXogXaN19Dsy508WhyNUZ/jv0u4mBSY62wTQ=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:53.173490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a334fea3-db2a-460e-9040-622f7ca410f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:19:53.181684 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a334fea3-db2a-460e-9040-622f7ca410f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:19:53.207838 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a334fea3-db2a-460e-9040-622f7ca410f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057798 Aug 30 17:19:53.208446 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4057/7704] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:19:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:19:58.634893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:58.640030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1683647416", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "4ddc883f-e68f-4881-85e9-114c00524922"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1266817486", "security_groups": [{"name": "tempest-secgroup-smoke-259551749"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:19:58.770343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] validate_networks() for [('4ddc883f-e68f-4881-85e9-114c00524922', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:19:59.286035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:19:59.287301 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:19:59.287888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:19:59.288403 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:19:59.288755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:19:59.300418 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:59.300925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:59.301379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:59.302129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:19:59.303266 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:19:59.303893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:19:59.324279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:19:59.332269 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:19:59.350746 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:19:59.354518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:19:59.416295 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-19515a76-39b7-47f9-8fd1-90056d32000a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.783093 Aug 30 17:19:59.423321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3648/7705] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:19:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:19:59.427902 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:19:59.434873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cc3ccb6f-7d6e-4481-9259-aaf1d1e9f720 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:19:59.435979 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cc3ccb6f-7d6e-4481-9259-aaf1d1e9f720 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:19:59.534120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cc3ccb6f-7d6e-4481-9259-aaf1d1e9f720 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:19:59.544031 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cc3ccb6f-7d6e-4481-9259-aaf1d1e9f720 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1267 microversion: 2.1 time: 0.118342 Aug 30 17:19:59.561268 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4058/7706] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:19:59 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:00.568210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:00.568845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:00.596580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:00.598036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:00.598623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:00.600053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:00.600624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:00.601173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:00.678401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:00.696268 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e3b9fb37-38e2-4c8c-9374-1537c4f1a275 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1319 microversion: 2.1 time: 0.132869 Aug 30 17:20:00.697453 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3649/7707] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:00 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1319 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:01.718882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:01.719632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:01.727278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:01.727773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:01.729925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:01.729925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:01.729925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:01.730488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:01.902247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:01.911628 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-469a1ae8-a61e-4e74-bea8-c577712c37fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.196629 Aug 30 17:20:01.912658 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4059/7708] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:01 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:02.410960 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e36dc82-f01d-4a1b-ac2e-63f4d88ab360", "tag": "d9b63eae-907c-4284-8b33-cc531ca7163f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:20:02.424467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:02.425251 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:02.425855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:02.442011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] Creating event network-changed:d9b63eae-907c-4284-8b33-cc531ca7163f for instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 on n-h1-830883-28 Aug 30 17:20:02.450057 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-3a0dc901-dd75-4c49-8154-604d93de4741 req-086bc99e-9196-4722-b754-e87a7359c1f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042309 Aug 30 17:20:02.451141 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3650/7709] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:20:02.935296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:02.936073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:02.943370 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:02.943950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:02.944393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:02.945095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:02.945557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:02.945983 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:03.083088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:03.091694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e4fb2df6-af48-4868-8145-c04ec71624df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.161163 Aug 30 17:20:03.092287 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4060/7710] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:02 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:04.115664 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:04.116514 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:04.123680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:04.124292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:04.124623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:04.125523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:04.125995 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:04.126473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:04.361279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:04.369631 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-055b47a2-7577-461a-8a1f-6cd290829c7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.259532 Aug 30 17:20:04.370448 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3651/7711] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:04 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:05.392159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:05.392752 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:05.400369 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:05.400856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:05.401299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:05.401999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:05.402499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:05.402930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:05.542291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:05.550241 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9b980236-a17d-493d-ac5d-653d2a0ab069 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.162045 Aug 30 17:20:05.550831 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4061/7712] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:05 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:06.571306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:06.572068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:06.579843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:06.580338 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:06.580783 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:06.581478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:06.581935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:06.582402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:06.718524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:06.727599 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6ade04a9-d995-4c94-8a8b-08e308bba1ad tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.160385 Aug 30 17:20:06.728166 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3652/7713] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:06 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:07.757841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:07.758853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:07.766856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:07.767344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:07.767786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:07.768475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:07.768932 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:07.769358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:07.906937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:07.914847 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6e9ab935-a4b6-44b5-aa88-abbef3356603 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.161782 Aug 30 17:20:07.915425 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4062/7714] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:07 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:20:08.937967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:08.938620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:08.945915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:08.946446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:08.946889 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:08.947586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:08.948057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:08.948491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:09.050814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e36dc82-f01d-4a1b-ac2e-63f4d88ab360", "name": "network-vif-plugged", "status": "completed", "tag": "d9b63eae-907c-4284-8b33-cc531ca7163f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:20:09.061534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:09.062173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:09.062710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:09.078377 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] Creating event network-vif-plugged:d9b63eae-907c-4284-8b33-cc531ca7163f for instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 on n-h1-830883-28 Aug 30 17:20:09.083507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-69de4cc0-f124-46d1-a7a8-1547283cc6cc req-7b7c0e50-44ab-4840-a78a-a26ed8ba5e7e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Aug 30 17:20:09.085230 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4063/7715] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:20:09.097657 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:09.106434 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8cb8a223-1717-47c0-95d8-72d5e7775d6b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.173330 Aug 30 17:20:09.107039 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3653/7716] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:08 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:10.125730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:10.131601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:10.132304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:10.138930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:10.139418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:10.139857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:10.140545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:10.141004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:10.141431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:10.283218 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:10.292164 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-247661f9-2103-4baa-8ef2-bf983a1986c5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1392 microversion: 2.1 time: 0.167332 Aug 30 17:20:10.293011 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4064/7717] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:10 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:11.313287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:11.313935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:11.316028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:11.316726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:11.319471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:11.327717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:11.328334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:11.328840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:11.329526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:11.329988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:11.330451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:11.486275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:11.494453 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-896fb52c-6a88-4ed7-941e-f45acef78ed9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1564 microversion: 2.1 time: 0.184997 Aug 30 17:20:11.495050 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3654/7718] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:11 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:11.522685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:11.523619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:11.526886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:11.533571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:11.534087 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:11.534555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:11.535466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:11.535970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:11.536477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:11.695316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:11.705439 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ee466188-363b-443a-92fb-994115cda3a3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1564 microversion: 2.1 time: 0.187979 Aug 30 17:20:11.706062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4065/7719] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:11 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1564 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:20:13.531715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e36dc82-f01d-4a1b-ac2e-63f4d88ab360", "tag": "d9b63eae-907c-4284-8b33-cc531ca7163f"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:20:13.536276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:13.536985 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:13.547782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:13.548489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:13.548999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:13.551054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:13.551567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:13.552043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:13.552991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:13.553472 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:13.554055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:13.563419 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] Creating event network-changed:d9b63eae-907c-4284-8b33-cc531ca7163f for instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 on n-h1-830883-28 Aug 30 17:20:13.570615 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-dc192f1c-9059-44f4-a9d9-8eb4beef3302 req-bfdf8628-c9d6-44f3-acb6-a4496a026fd2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 Aug 30 17:20:13.571583 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4066/7720] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:20:13.796154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:13.804232 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4bc2800c-ea54-43ed-a5f6-fc41510459fb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1564 microversion: 2.1 time: 0.282261 Aug 30 17:20:13.805059 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3655/7721] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:13 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1564 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:35.107692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:35.108481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=40 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:35.112846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:20:35.115380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:35.122787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:35.123284 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:35.123731 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:35.124423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:35.124889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:35.125360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:35.202018 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b0df050e-79cd-4b88-bf2e-73a0ab0c8d85 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action" status: 200 len: 24562 microversion: 2.1 time: 0.095943 Aug 30 17:20:35.202881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4067/7722] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:20:35 2022] POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action => generated 24562 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:20:41.551141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:20:41.553630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:41.556595 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:41.557351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=40 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:20:41.564291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:41.564825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:41.565345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:41.566109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:41.566674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:41.567166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:41.653141 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-eac7f192-c976-437f-b94e-e7084d1b959c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action" status: 202 len: 0 microversion: 2.1 time: 0.106461 Aug 30 17:20:41.653863 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3656/7723] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:20:41 2022] POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:20:41.663313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:41.664096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:41.672033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:41.672541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:41.672998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:41.673730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:41.674198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:41.674667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:42.129833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:42.138567 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-45c52616-89e1-4830-94ce-577010abc168 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1675 microversion: 2.1 time: 0.479743 Aug 30 17:20:42.142989 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4068/7724] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:41 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1675 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:43.163836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:43.164609 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:43.172407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:43.172912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:43.173381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:43.174144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:43.174688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:43.175147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:43.326827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:43.337303 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b24587ca-68ec-4f16-8281-08ecd93d9fc6 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.178298 Aug 30 17:20:43.338545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3657/7725] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:43 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:44.365002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:44.365639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:44.375096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:44.375589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:44.376040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:44.376760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:44.377215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:44.377645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:44.521415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:44.531973 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-317c66a6-997f-45d1-9d91-90c012b61293 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.170824 Aug 30 17:20:44.532908 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4069/7726] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:44 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:45.556355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:45.556906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:45.564814 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:45.565308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:45.565753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:45.566488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:45.566949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:45.567381 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:45.716953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:45.725131 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-917e7cd5-b956-4047-a971-d079762a1ae4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.172694 Aug 30 17:20:45.725733 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3658/7727] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:45 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:46.746862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:46.747514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:46.755166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:46.755658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:46.756098 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:46.756804 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:46.757268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:46.757696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:46.908721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:46.915192 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5c10b24f-7d13-4c2b-8d70-f1b393cb5ba4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.172183 Aug 30 17:20:46.917573 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4070/7728] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:46 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:20:47.940304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:47.940943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:47.948401 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:47.948905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:47.950105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:47.950250 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:47.950744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:47.951189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:48.098112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:48.106704 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9c67ead2-5ec2-4494-b8db-da3d0d88840c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.170427 Aug 30 17:20:48.107295 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3659/7729] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:47 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:49.129897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:49.130550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:49.138821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:49.139317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:49.139758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:49.140462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:49.140926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:49.141353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:49.286865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:49.296434 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-75a5cb89-4aec-4344-8457-adedc3c3aad0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.170702 Aug 30 17:20:49.297034 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4071/7730] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:49 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:50.319119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:50.319743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:50.327232 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:50.327730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:50.328176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:50.328878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:50.329341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:50.329776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:50.472666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:50.480853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-25380a1b-2e8f-4fa3-beff-4539e6d626c1 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.165544 Aug 30 17:20:50.481456 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3660/7731] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:50 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:51.503426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:51.503980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:51.511208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:51.511708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:51.512156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:51.512863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:51.513330 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:51.513771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:51.653491 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:51.661519 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27625a93-7a8f-4c21-94a9-992be9dd686e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.162090 Aug 30 17:20:51.662101 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4072/7732] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:51 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:52.685800 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:52.686483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:52.693344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:52.693838 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:52.694285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:52.694999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:52.695461 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:52.695895 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:52.834117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:52.842691 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-cd147394-ed6a-4900-9bcc-badc6d5e7059 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1680 microversion: 2.1 time: 0.161213 Aug 30 17:20:52.843294 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3661/7733] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:52 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:20:53.864472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:20:53.865100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:20:53.872878 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:53.873376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:53.873821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:53.874553 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:20:53.875019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:20:53.875451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:20:54.009533 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:20:54.018783 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-88b6c0b7-91f2-4d34-a50f-ab0e02d6adae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1683 microversion: 2.1 time: 0.158154 Aug 30 17:20:54.019374 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4073/7734] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:20:53 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:18.212044 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:18.214261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:18.217245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:18.217939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:18.224020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:18.224519 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:18.224967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:18.225672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:18.226135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:18.226603 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:18.304301 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-528141b2-bb00-4e90-be5d-ea5257074015 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action" status: 200 len: 69112 microversion: 2.1 time: 0.095855 Aug 30 17:21:18.305232 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3662/7735] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:21:18 2022] POST /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360/action => generated 69112 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:21:25.664991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:25.665527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:25.676514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=14 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:25.677196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=40 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:25.678059 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:21:25.678470 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 (ip 10.222.0.47) !!! Aug 30 17:21:25.685978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:25.686793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:25.687270 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:25.687995 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:25.688458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:25.688892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:25.719408 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:21:25.736622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e36dc82-f01d-4a1b-ac2e-63f4d88ab360", "tag": "d9b63eae-907c-4284-8b33-cc531ca7163f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:25.748110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:25.748615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:25.749071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:25.761379 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] Creating event network-changed:d9b63eae-907c-4284-8b33-cc531ca7163f for instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 on n-h1-830883-28 Aug 30 17:21:25.767403 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-42015f54-7728-4d62-b601-afc070916709 req-2f440d2e-f9b7-422e-b4d2-573903b16f2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099320 Aug 30 17:21:25.768034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3663/7736] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:21:25.817498 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-27ac99ce-b75c-495b-a5bd-8e411e647c32 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 204 len: 0 microversion: 2.1 time: 0.155865 Aug 30 17:21:25.822613 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4074/7737] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:21:25 2022] DELETE /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:21:25.829723 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:25.830873 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:25.838806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:25.839744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:25.840580 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:25.841489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:25.842768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:25.843414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:25.988206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:25.996226 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bb55ecd7-957e-45d8-b788-351bdcd94623 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1689 microversion: 2.1 time: 0.171995 Aug 30 17:21:25.996841 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3664/7738] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:25 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:27.019296 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:27.019920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:27.027272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:27.027745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:27.028188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:27.028894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:27.030715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:27.030715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:27.183472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:27.191902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-32ff65da-bbeb-40a3-bdea-dfac0fcebc17 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1689 microversion: 2.1 time: 0.177155 Aug 30 17:21:27.192510 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4075/7739] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:27 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:28.049024 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e36dc82-f01d-4a1b-ac2e-63f4d88ab360", "name": "network-vif-deleted", "tag": "d9b63eae-907c-4284-8b33-cc531ca7163f"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:28.059279 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:28.060077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:28.061115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:28.073802 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] Creating event network-vif-deleted:d9b63eae-907c-4284-8b33-cc531ca7163f for instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 on n-h1-830883-28 Aug 30 17:21:28.079887 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-da7b7bb0-0fd5-475f-9704-efb7794d08da req-e6a166d2-0831-45ba-8a16-2fe3dfb0e137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107606 Aug 30 17:21:28.079887 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3665/7740] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:21:28.215366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:28.216193 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:28.224191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:28.224835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:28.225325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:28.226346 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:28.226813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:28.227254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:28.271583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:28.272079 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:28.272646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:28.272966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lazy-loading 'fault' on Instance uuid 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:21:28.329245 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:28.338122 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e9e95499-7025-4aff-9fb2-96934d63b17e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 200 len: 1357 microversion: 2.1 time: 0.126683 Aug 30 17:21:28.338808 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4076/7741] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:28 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 1357 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:21:29.362111 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:29.362849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:29.369084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:29.369582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:29.370032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:29.370770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:29.371241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:29.371682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:29.386243 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] HTTP exception thrown: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Request method failure captured: Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 HTTP/1.1 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkZXPJ6hTx-88qQuYi-2s2VlRnymK_bTgqYIrhKtb4MHt5jfOIBXNn5jfrSca-aZwIG-ETdefOu4u642_cBSg7f4oIbSvF4dG1F4ChSXZHgWC8a3wYZNqXvbGLMdqTEeez07Z3-UJfbKTWD8HVZSP-v5RvUSz3XhFRvhsAnFwfab10A Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}] Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: aa84109906174f48ae12969761161099 Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '5e36dc82-f01d-4a1b-ac2e-63f4d88ab360'} Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:21:29.387921 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Returning 404 to user: Instance 5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1eb81d9e-e5ec-4fd4-ba68-656b29ac5c63 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360" status: 404 len: 111 microversion: 2.1 time: 0.033840 Aug 30 17:21:29.393922 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3666/7742] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:29 2022] GET /compute/v2.1/servers/5e36dc82-f01d-4a1b-ac2e-63f4d88ab360 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:21:32.760468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8816b2f7-4e1e-4c46-8429-9363347d789c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '.version_select at 0x7fd35c5231f0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:32.782990 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8816b2f7-4e1e-4c46-8429-9363347d789c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1266817486" status: 202 len: 0 microversion: 2.1 time: 0.026398 Aug 30 17:21:32.783585 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4077/7743] 10.222.0.47 () {58 vars in 1284 bytes} [Tue Aug 30 17:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1266817486 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:21:32.814129 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f6e9d85-6901-498a-a5a0-88ead4045411 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: .version_select at 0x7fd3579aa1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2096823896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1hJpY8vB6GKslXvKVqOoaNPn900fdlOEo0ZKeSWB8xjy0Fi6lSjAtoJ6IUH3jREtpsNE7V2GoXBYs+Hf8oC+sxv1gWXw3U1yQF+cBIvf0pNA9VigZIWdErdhrgAoVWwQ=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:32.831902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2f6e9d85-6901-498a-a5a0-88ead4045411 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:21:32.837199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-2f6e9d85-6901-498a-a5a0-88ead4045411 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:21:32.865610 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f6e9d85-6901-498a-a5a0-88ead4045411 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055476 Aug 30 17:21:32.872055 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3667/7744] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:21:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:21:38.563632 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:38.569873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-305442169", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "a2cbee45-0b8a-4d90-8bcb-ab29e182ead9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2096823896", "security_groups": [{"name": "tempest-secgroup-smoke-1621978087"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:38.695808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] validate_networks() for [('a2cbee45-0b8a-4d90-8bcb-ab29e182ead9', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:21:39.243682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:21:39.244122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:21:39.245498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:21:39.245925 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:21:39.246382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:21:39.258191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:39.258926 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:39.259383 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:39.260137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:39.260825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:39.261268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:39.281254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:21:39.287205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:21:39.305409 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:21:39.307828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:21:39.365210 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8818c376-2c0e-4971-bf00-a12822b1e7b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804326 Aug 30 17:21:39.372128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4078/7745] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:21:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:21:39.378696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-adfcc482-ca07-4c11-832e-e47cc8f7767a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:39.379322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-adfcc482-ca07-4c11-832e-e47cc8f7767a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:39.396390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=16 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:39.453627 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-adfcc482-ca07-4c11-832e-e47cc8f7767a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:39.461584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-adfcc482-ca07-4c11-832e-e47cc8f7767a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1266 microversion: 2.1 time: 0.087215 Aug 30 17:21:39.462519 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3668/7746] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:39 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:40.485718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:40.487026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:40.494841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:40.495696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:40.496363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:40.497269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:40.497982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:40.499431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:40.582444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:40.591826 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8a12834e-c7b6-44d0-8ecd-761046936ca9 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1326 microversion: 2.1 time: 0.111131 Aug 30 17:21:40.594206 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4079/7747] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:40 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:41.618843 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:41.619770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:41.638141 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:41.638813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:41.640098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:41.641151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:41.642019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:41.642527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:41.945748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:41.961605 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e79bf960-7d89-4588-85a7-17c9b3df3cd5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.349771 Aug 30 17:21:41.962576 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3669/7748] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:41 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:42.899319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:42.915254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:42.916612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:42.917509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:42.932150 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] Creating event network-changed:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h2-830883-28 Aug 30 17:21:42.944691 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-9301f90d-dd56-4951-b972-bbfe7ee3c82d req-d9c7a126-4935-4cb5-898e-40cbac373ce5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043912 Aug 30 17:21:42.945785 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4080/7749] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:21:42.993853 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:42.994661 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:43.004667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:43.005407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:43.006147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:43.007053 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:43.007707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:43.008321 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:43.275842 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:43.288062 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-af211df5-9151-4192-9d93-b895714bdef2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.297693 Aug 30 17:21:43.289244 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3670/7750] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:42 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:44.320105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:44.321205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:44.329464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:44.330128 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:44.330747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:44.331789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:44.332475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:44.333084 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:44.506691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:44.517472 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6b82e745-2a12-4417-9e92-c3106f0e794b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.204635 Aug 30 17:21:44.518626 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4081/7751] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:44 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:45.542706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:45.543291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:45.549451 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:45.549945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:45.550432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:45.551133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:45.551597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:45.552035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:45.702654 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:45.711121 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e45ed8ee-3631-43c7-bad3-299b978f0f5d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.175305 Aug 30 17:21:45.711711 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3671/7752] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:45 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:46.733614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:46.734176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:46.741198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:46.741689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:46.742130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:46.742859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:46.743315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:46.743745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:46.893110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:46.902021 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-400ca9e4-249e-4742-8db6-954e829b9a9d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.172530 Aug 30 17:21:46.902659 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4082/7753] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:46 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:47.923725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:47.924349 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:47.933350 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:47.933890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:47.934374 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:47.935102 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:47.936255 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:47.937001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:48.083645 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:48.091737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2d791783-639c-4872-b35c-8c628d2dd355 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.171972 Aug 30 17:21:48.092393 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3672/7754] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:47 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:21:49.113914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:49.114582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:49.121668 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:49.122170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:49.122646 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:49.123594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:49.124131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:49.124669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:49.270670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:49.289544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:49.301536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:49.306229 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65a7c23f-4e51-4dda-8aef-8d2ddfdfd46f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.196176 Aug 30 17:21:49.307233 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4083/7755] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:49 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:50.331506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:50.332224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:50.334495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:50.335176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:50.340776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:50.341299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:50.341824 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:50.343193 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:50.343666 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:50.344107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:50.489411 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:50.497737 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-34b5f23a-1941-438f-b39f-98d27b3be961 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.170478 Aug 30 17:21:50.498962 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3673/7756] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:50 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:51.367343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "name": "network-vif-plugged", "status": "completed", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:51.378856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:51.379353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:51.379794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:51.392263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] Creating event network-vif-plugged:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h2-830883-28 Aug 30 17:21:51.397351 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-590c6813-e0ce-4efd-bb95-a7e4c3c49394 req-05ceedcb-38e0-445e-810e-ecdb912eebe3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110883 Aug 30 17:21:51.397985 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4084/7757] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:21:51.520363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:51.521653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:51.529019 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:51.529524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:51.530264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:51.531998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:51.532481 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:51.532929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:51.700234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:51.708994 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-059bdc0e-2eb3-462e-8f78-7d55454f7d82 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.192589 Aug 30 17:21:51.709576 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3674/7758] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:51 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:52.732124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:52.732858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:52.740317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:52.740803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:52.741244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:52.741950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:52.742458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:52.742891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:52.890047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:52.901012 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5574f93f-6cef-4ac4-8e51-a11d910dfdf8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1392 microversion: 2.1 time: 0.173467 Aug 30 17:21:52.902246 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4085/7759] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:52 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:53.925743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:53.927097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:53.933334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:53.933833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:53.934285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:53.935057 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:53.935473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:53.935905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:54.366236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:54.380208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b9c4956e-b9a4-4a48-bd95-c375dc4bf25d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1563 microversion: 2.1 time: 0.459845 Aug 30 17:21:54.380812 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3675/7760] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:53 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1563 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:21:54.401559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:54.402382 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:54.409712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:54.410203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:54.410676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:54.411385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:54.411843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:54.412273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:54.552480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:54.560864 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e0955ff7-4a24-4279-a552-296e2ce081fd tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1563 microversion: 2.1 time: 0.163670 Aug 30 17:21:54.561461 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4086/7761] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:54 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:21:56.342709 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:21:56.343892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:21:56.345545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:21:56.351482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:21:56.352923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:56.354112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:56.354937 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:56.355988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:56.356663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:56.357331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:56.358219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:21:56.359048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:21:56.362014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:21:56.375861 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] Creating event network-changed:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h2-830883-28 Aug 30 17:21:56.381771 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-99681b73-c52d-418c-92bc-8d55fb7b708f req-2522d1f3-7eab-4462-9848-cb11a5da8137 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040361 Aug 30 17:21:56.382943 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4087/7762] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:21:56.631680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:21:56.640570 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f362c2ac-6387-42bc-a208-c8ac02926c15 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1563 microversion: 2.1 time: 0.301762 Aug 30 17:21:56.642036 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3676/7763] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:21:56 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1563 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:22:27.944325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=44 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:22:27.949047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:22:27.951394 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:22:27.959321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:27.959817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:27.960258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:27.960963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:27.961417 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:27.961919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:28.033138 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2080c40-14d7-474e-beb4-40347a5b8da2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action" status: 200 len: 24573 microversion: 2.1 time: 0.090642 Aug 30 17:22:28.033887 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4088/7764] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:22:27 2022] POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action => generated 24573 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:22:58.429969 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=7 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:22:58.430769 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=48 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:22:58.435058 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:22:58.437394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:22:58.444885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:58.445385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:58.445827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:58.446566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:58.447033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:58.447465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:58.490135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:22:58.497178 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Old instance type m1.heat2, new instance type m1.heat {{(pid=122351) resize /opt/stack/nova/nova/compute/api.py:4230}} Aug 30 17:22:58.504959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:22:58.505398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:22:58.505882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:22:58.506322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:22:58.506758 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:22:58.577357 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [05bd32bc-5bd5-4c56-9fd6-5c5a33294472] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:22:59.586159 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [05bd32bc-5bd5-4c56-9fd6-5c5a33294472] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52014. Aug 30 17:22:59.589687 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9ca26405-e5db-4f3d-9651-a06c773884e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action" status: 202 len: 0 microversion: 2.1 time: 1.161626 Aug 30 17:22:59.590342 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3677/7765] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:22:58 2022] POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:22:59.600829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:22:59.601550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:22:59.604216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:22:59.605542 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:22:59.611388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:59.611885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:59.612331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:59.613057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:22:59.613522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:22:59.615395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:22:59.782833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:22:59.796159 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ed6848fc-4f5a-490e-8a7d-7e2d398734b7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1690 microversion: 2.1 time: 0.199556 Aug 30 17:22:59.797124 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4089/7766] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:22:59 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:00.827790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:00.828578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:00.836333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:00.837299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:00.838056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:00.839095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:00.839646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:00.840137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:01.000465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:01.011642 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3bb0a9d8-022a-4f30-babe-662c98e2476c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1690 microversion: 2.1 time: 0.193040 Aug 30 17:23:01.012983 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3678/7767] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:00 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:02.037586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:02.038352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:02.050244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:02.050769 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:02.051454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:02.052177 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:02.052638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:02.053069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:02.219481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:02.229396 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0415b3b9-8a76-4bb7-93fe-0d6ebd33396a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1690 microversion: 2.1 time: 0.197033 Aug 30 17:23:02.230004 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4090/7768] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:02 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1690 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:03.252884 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:03.253512 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:03.261691 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:03.262194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:03.262676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:03.263386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:03.263907 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:03.264371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:03.412119 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:03.421184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9cff040-bed8-4f83-b491-e1e527f040f2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.172305 Aug 30 17:23:03.421692 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3679/7769] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:03 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:04.445029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:04.445739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:04.452913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:04.453399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:04.453903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:04.454568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:04.455031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:04.455459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:04.605881 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:04.614627 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a3c59418-3f96-4335-ae6a-de92fcaec4e5 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.174323 Aug 30 17:23:04.615421 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4091/7770] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:04 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:05.637199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:05.637983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:05.645066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:05.645561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:05.646037 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:05.646766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:05.647237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:05.647678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:05.794013 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:05.802705 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aa3dcca0-1189-41f0-b882-2d0f9f91248d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.169509 Aug 30 17:23:05.803286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3680/7771] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:05 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:06.825300 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:06.825980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:06.834630 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:06.835134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:06.835591 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:06.836316 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:06.836782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:06.837220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:06.979798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:06.987922 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0b56127a-570c-4b3f-b92f-72b879dbfe7d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.166693 Aug 30 17:23:06.989277 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4092/7772] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:06 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:08.014392 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:08.015038 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:08.022933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:08.023459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:08.023913 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:08.024619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:08.025084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:08.025593 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:08.167267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:08.175041 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aec7ecb8-b1da-4f2c-8533-ed1be03bb5ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.168735 Aug 30 17:23:08.175607 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3681/7773] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:08 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:09.197166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:09.197803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:09.204875 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:09.205376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:09.205829 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:09.206564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:09.207033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:09.207976 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:09.355834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:09.363673 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f93b60de-484c-4afc-a5f2-41f628fd7eed tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.170499 Aug 30 17:23:09.364244 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4093/7774] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:09 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:10.385630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:10.386272 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:10.393354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:10.393861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:10.394344 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:10.395213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:10.395693 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:10.396170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:10.533192 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:10.542191 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-932c2280-b02d-4f42-b43f-92160e7b7752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.160505 Aug 30 17:23:10.542836 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3682/7775] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:10 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:11.565153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:11.565715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:11.573131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:11.573619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:11.574090 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:11.574817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:11.575366 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:11.575713 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:11.711122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:11.720150 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-daedb1df-6bc2-42de-92d9-77cdf26ef999 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.158984 Aug 30 17:23:11.720740 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4094/7776] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:11 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:12.742362 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:12.742991 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:12.749892 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:12.750421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:12.750876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:12.751575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:12.752039 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:12.752478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:12.896098 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:12.903979 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ca7549d8-b5b5-402f-92df-8c7226c5f108 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.165806 Aug 30 17:23:12.904545 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3683/7777] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:12 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:13.926407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:13.927162 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:13.934067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:13.934594 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:13.935029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:13.935722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:13.936176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:13.936599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:14.084183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:14.092613 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-128ad3e4-f99d-4dd2-abf3-3f109c103ee8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1695 microversion: 2.1 time: 0.170614 Aug 30 17:23:14.093238 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4095/7778] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:13 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:14.946287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "name": "network-vif-unplugged", "status": "completed", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:14.956856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:14.957345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:14.957871 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:14.971762 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Creating event network-vif-unplugged:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h1-830883-28 Aug 30 17:23:14.977743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] Instance bbb0fcce-5524-430d-9211-c2b8d2da83de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122351) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:23:14.988883 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-745cf1ce-11f5-4304-8d8a-91fb871f0258 req-d63fabf2-8efd-4628-92f7-d959c708e4c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047110 Aug 30 17:23:14.989708 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3684/7779] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:23:15.116064 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:15.116607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:15.123972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:15.124466 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:15.124907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:15.125612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:15.126074 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:15.126532 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:15.374702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:15.382907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0518e3cc-66d6-49ca-86b7-9810f072021d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1694 microversion: 2.1 time: 0.272605 Aug 30 17:23:15.383717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4096/7780] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:15 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1694 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:16.406674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:16.407446 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:16.414837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:16.415355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:16.415812 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:16.416526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:16.417001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:16.417444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:16.572224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:16.580545 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1f39b743-7ca8-4f06-9b0e-7282910e1f1c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1692 microversion: 2.1 time: 0.179001 Aug 30 17:23:16.594281 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3685/7781] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:16 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:17.022272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:17.032809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:17.033293 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:17.033726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:17.046877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Creating event network-changed:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h1-830883-28 Aug 30 17:23:17.052348 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] Instance bbb0fcce-5524-430d-9211-c2b8d2da83de is migrating within the same cell, copying events to all relevant hosts: {'n-h2-830883-28', 'n-h1-830883-28'} {{(pid=122352) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Aug 30 17:23:17.063333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2efc943b-3eb2-4ab6-914a-4d190c82dddf req-65a0f450-8499-43ea-b0be-f60a34e5a95b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045374 Aug 30 17:23:17.063942 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4097/7782] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:23:17.604708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:17.606071 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:17.613357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:17.613880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:17.614462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:17.615614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:17.616307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:17.616965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:17.773465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:17.781667 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8d937284-8823-45c4-972d-e4b29fb3c09f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1692 microversion: 2.1 time: 0.181236 Aug 30 17:23:17.782452 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3686/7783] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:17 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:18.806198 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:18.806924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:18.813103 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:18.813582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:18.814027 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:18.814750 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:18.815211 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:18.815636 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:18.949812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:18.958067 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c7f5cccf-fcbc-4a1a-b2df-985e70f83718 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1689 microversion: 2.1 time: 0.157003 Aug 30 17:23:18.960955 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4098/7784] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:18 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:18.979020 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:18.979677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:18.987005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:18.987669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:18.989262 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:18.990598 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:18.991319 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:18.991850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:19.053599 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0f03958d-a1e7-4d92-ae7c-826eed8d9933 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action" status: 204 len: 0 microversion: 2.1 time: 0.078363 Aug 30 17:23:19.054262 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3687/7785] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:23:18 2022] POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:23:19.062803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:19.063357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:19.070105 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:19.070639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:19.071092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:19.071802 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:19.072266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:19.072758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:19.214604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:19.224254 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4042b463-f5b8-4e0b-8075-984486ddb752 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1689 microversion: 2.1 time: 0.165605 Aug 30 17:23:19.224843 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4099/7786] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:19 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:19.245640 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:19.246467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:19.252846 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:19.253424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:19.253424 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:19.255236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:19.255715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:19.256154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:19.485371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:19.494915 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7ab31b78-83c7-4e4c-9830-bfd6a4cf49cb tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1689 microversion: 2.1 time: 0.253362 Aug 30 17:23:19.495550 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3688/7787] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:19 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:20.517732 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:20.519051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:20.527195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:20.527686 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:20.528165 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:20.528857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:20.529349 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:20.529784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:20.668601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:20.676919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69887883-8e34-40a9-b124-18b91d3ae17d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1681 microversion: 2.1 time: 0.164780 Aug 30 17:23:20.677491 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4100/7788] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:20 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:21.963806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "name": "network-vif-plugged", "status": "completed", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:21.975474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:21.975976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:21.976431 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:21.988703 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] Creating event network-vif-plugged:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h1-830883-28 Aug 30 17:23:21.993885 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8fc5ac2c-c4b8-40a6-9d3d-4985886c6101 req-450b967e-593b-4ebf-8a56-3079af5c91ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Aug 30 17:23:21.994542 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3689/7789] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:23:40.850286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:40.852543 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:40.855126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=24 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:23:40.855798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=70 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:23:40.861745 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:40.862241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:40.863322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:40.864040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:40.864506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:40.864939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:40.932926 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-993e5bd5-bf3a-4c31-b5e7-44310956913c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action" status: 200 len: 24583 microversion: 2.1 time: 0.088326 Aug 30 17:23:40.933609 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4101/7790] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:23:40 2022] POST /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de/action => generated 24583 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:23:47.991554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=30 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:23:47.993402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:23:47.997333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:47.997959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:47.998643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:48.007938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:48.008788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:48.009248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:48.010036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:48.010727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:48.011342 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:48.012916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:48.013399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:48.013832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:48.027834 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] Creating event network-changed:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h1-830883-28 Aug 30 17:23:48.033124 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-1d85e4e7-fcb8-4dc9-a484-058ad33b14b3 req-af704a3c-dc52-4bca-a891-0c8bdac354fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Aug 30 17:23:48.033991 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4102/7791] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:23:48.042122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:23:48.134551 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3e583509-1423-44d2-8109-ff02a46b8470 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 204 len: 0 microversion: 2.1 time: 0.144207 Aug 30 17:23:48.135630 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3690/7792] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:23:47 2022] DELETE /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 17:23:48.145730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:48.146484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:48.153448 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:48.153940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:48.154407 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:48.155114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:48.155600 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:48.156003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:48.337659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:48.345597 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-823ce33a-9a30-4c29-9423-fa49e4d95c0d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1687 microversion: 2.1 time: 0.205386 Aug 30 17:23:48.346170 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4103/7793] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:48 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:23:49.368588 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:49.369312 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:49.375887 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:49.376382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:49.376831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:49.377533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:49.378986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:49.379448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:49.519930 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:23:49.527919 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4969ddff-791c-43f9-abf7-05fa217d65af tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 200 len: 1687 microversion: 2.1 time: 0.163693 Aug 30 17:23:49.528497 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3691/7794] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:49 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:23:50.047714 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb0fcce-5524-430d-9211-c2b8d2da83de", "name": "network-vif-deleted", "tag": "f90971a7-f0cf-41bb-99dc-d3f77350fdbd"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:50.058702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:50.059203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:50.059653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:50.071995 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] Creating event network-vif-deleted:f90971a7-f0cf-41bb-99dc-d3f77350fdbd for instance bbb0fcce-5524-430d-9211-c2b8d2da83de on n-h1-830883-28 Aug 30 17:23:50.076877 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-53932157-b25a-44ec-928b-86d32a3350f4 req-7fa7530d-dd91-4a19-93d2-81d6d03d3e57 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032980 Aug 30 17:23:50.077549 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4104/7795] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:23:50.552761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:50.553577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: bbb0fcce-5524-430d-9211-c2b8d2da83de] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:23:50.560696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:50.561196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:50.561648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:50.562384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:23:50.562855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:23:50.563292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:23:50.577442 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] HTTP exception thrown: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Request method failure captured: Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de HTTP/1.1 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkZXPJ6hTx-88qQuYi-2s2VlRnymK_bTgqYIrhKtb4MHt5jfOIBXNn5jfrSca-aZwIG-ETdefOu4u642_cBSg7f4oIbSvF4dG1F4ChSXZHgWC8a3wYZNqXvbGLMdqTEeez07Z3-UJfbKTWD8HVZSP-v5RvUSz3XhFRvhsAnFwfab10A Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}] Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: aa84109906174f48ae12969761161099 Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': 'bbb0fcce-5524-430d-9211-c2b8d2da83de'} Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:23:50.579082 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Returning 404 to user: Instance bbb0fcce-5524-430d-9211-c2b8d2da83de could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f27066a-4a3c-487e-9a29-7faac8f2084e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de" status: 404 len: 111 microversion: 2.1 time: 0.034026 Aug 30 17:23:50.584606 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3692/7796] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:23:50 2022] GET /compute/v2.1/servers/bbb0fcce-5524-430d-9211-c2b8d2da83de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:23:54.222353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d88adeb-d7ff-4ed5-8b06-21f193a1deac tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '.version_select at 0x7fd35d2428b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:23:54.250907 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d88adeb-d7ff-4ed5-8b06-21f193a1deac tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2096823896" status: 202 len: 0 microversion: 2.1 time: 0.033739 Aug 30 17:23:54.251663 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4105/7797] 10.222.0.47 () {58 vars in 1284 bytes} [Tue Aug 30 17:23:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2096823896 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:23:54.281000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-474a0664-be82-4b2a-8d62-16327a85fbb7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: .version_select at 0x7fd3578d41f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1979770271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGsMAa9snuuHDoi2tVVvn66/ZpdQ74IJNMVGGC1+DcPHKG3CevZwDnb8pXdKmVTCLZQ5f81CdC25TtzDCGlvpviH4EotLgpcCvQYF32SaoclkKwWXN/fyIBUHuS8MJiA=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:23:54.299122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-474a0664-be82-4b2a-8d62-16327a85fbb7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:23:54.305975 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-474a0664-be82-4b2a-8d62-16327a85fbb7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:23:54.334700 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-474a0664-be82-4b2a-8d62-16327a85fbb7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057742 Aug 30 17:23:54.335323 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3693/7798] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:23:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:24:00.283675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=14 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:00.292025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1173415345", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "1054ceb6-d729-439e-8032-c46d8b0c78a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1979770271", "security_groups": [{"name": "tempest-secgroup-smoke-912237753"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:00.508474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] validate_networks() for [('1054ceb6-d729-439e-8032-c46d8b0c78a4', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:24:01.109224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:24:01.109998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:24:01.111334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:24:01.112566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:24:01.114352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:24:01.128357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:01.129322 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:01.130148 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:01.131757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:01.132568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:01.133173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:01.155561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:24:01.161355 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:24:01.176213 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:24:01.178674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:24:01.237394 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8c87dcc9-c338-4093-bade-ae23b144f6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.955424 Aug 30 17:24:01.238400 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4106/7799] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:24:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 17:24:01.247643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:01.251797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ee2bf8ed-0acf-4ee8-a4e6-7cc92b804b05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:01.253357 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ee2bf8ed-0acf-4ee8-a4e6-7cc92b804b05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:01.334735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ee2bf8ed-0acf-4ee8-a4e6-7cc92b804b05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:01.342589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ee2bf8ed-0acf-4ee8-a4e6-7cc92b804b05 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1267 microversion: 2.1 time: 0.096844 Aug 30 17:24:01.344340 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3694/7800] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:01 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:24:02.367298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:02.368554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:02.378530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:02.382796 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:02.383289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:02.384050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:02.384503 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:02.384942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:02.470035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:02.497635 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e0eae238-8529-4f82-b69d-6f73dfd001ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1319 microversion: 2.1 time: 0.137238 Aug 30 17:24:02.498799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4107/7801] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:02 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:03.519912 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:03.520548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:03.531043 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:03.531827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:03.532284 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:03.533026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:03.533495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:03.534692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:03.763194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:03.771864 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-01944846-75ab-492f-83e6-4254a5b5f969 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.256020 Aug 30 17:24:03.772724 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3695/7802] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:03 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:04.065144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5e1902-1075-4b28-9e75-c7d6e534fc8e", "tag": "486681c5-5183-43c6-a46a-5fd63f7fcff5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:04.078790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:04.079380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:04.079897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:04.093965 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] Creating event network-changed:486681c5-5183-43c6-a46a-5fd63f7fcff5 for instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e on n-h1-830883-28 Aug 30 17:24:04.101347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b2fe928b-c7e3-4e46-8cd6-b1fcdc8dc10d req-651ba74b-2bd2-40e0-8647-4aa6fc4a8c1b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041987 Aug 30 17:24:04.102174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4108/7803] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:24:04.793650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:04.794274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:04.801818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:04.802345 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:04.802802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:04.803517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:04.803976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:04.804464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:04.939252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:04.947838 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-02f5ff25-7645-48a1-8f6b-30a2fb92ddc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.158126 Aug 30 17:24:04.948411 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3696/7804] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:04 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:05.969423 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:05.970131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:05.977487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:05.977973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:05.978451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:05.979152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:05.979615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:05.980047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:06.113719 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:06.121671 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ae4ff7b7-02c2-4b00-964e-576d6c2ddb65 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.156499 Aug 30 17:24:06.122261 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4109/7805] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:05 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:07.143902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:07.144713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:07.151864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:07.152360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:07.152816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:07.153516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:07.153981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:07.154449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:07.294656 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:07.303016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c64c362c-eb6a-4a37-89da-c4601a70c192 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.163640 Aug 30 17:24:07.303596 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3697/7806] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:07 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:08.324797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:08.325425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:08.333689 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:08.334167 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:08.334641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:08.335344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:08.335808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:08.336236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:08.475260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:08.483029 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d8aad64b-844e-4710-8515-a949025f3161 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.162104 Aug 30 17:24:08.483619 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4110/7807] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:08 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:09.505874 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:09.506531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:09.513305 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:09.513808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:09.514267 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:09.514998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:09.515469 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:09.515911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:09.652370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:09.661033 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2f6b71a1-91c9-42b9-9ae6-2e04033dfecc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.160215 Aug 30 17:24:09.661619 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3698/7808] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:09 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:10.215405 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5e1902-1075-4b28-9e75-c7d6e534fc8e", "name": "network-vif-plugged", "status": "completed", "tag": "486681c5-5183-43c6-a46a-5fd63f7fcff5"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:10.227537 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:10.228028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:10.228469 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:10.240881 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] Creating event network-vif-plugged:486681c5-5183-43c6-a46a-5fd63f7fcff5 for instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e on n-h1-830883-28 Aug 30 17:24:10.246441 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-72756d96-7198-4402-981a-75ea38a3b7e9 req-5ead3d9b-2a01-4295-93de-be8662619105 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Aug 30 17:24:10.247062 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4111/7809] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:24:10.683630 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:10.684180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:10.691973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:10.692478 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:10.692933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:10.693644 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:10.694112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:10.694586 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:10.825761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:10.833949 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ae595188-13c0-49f9-8370-da10414d96b0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1392 microversion: 2.1 time: 0.154321 Aug 30 17:24:10.834559 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3699/7810] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:10 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:11.851836 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:11.852623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:11.858078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:11.858840 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:11.861132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:11.869072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:11.869572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:11.870013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:11.870764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:11.871221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:11.871655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:12.027512 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:12.036611 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-076d1866-cdbe-424e-8dc7-80d2759720c4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1565 microversion: 2.1 time: 0.185639 Aug 30 17:24:12.037236 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4112/7811] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:11 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:12.058393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:12.059032 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:12.061202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:12.069199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:12.069714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:12.070175 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:12.070941 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:12.071414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:12.071888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:12.221134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:12.229109 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-79935f93-c633-43ac-9749-126c0614ac06 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1565 microversion: 2.1 time: 0.174726 Aug 30 17:24:12.229700 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3700/7812] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:12 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:14.134480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:14.135112 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:14.141676 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:14.142135 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5e1902-1075-4b28-9e75-c7d6e534fc8e", "tag": "486681c5-5183-43c6-a46a-5fd63f7fcff5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:14.144182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:14.144834 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:14.145564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:14.146220 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:14.146693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:14.166042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:14.166570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:14.167231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:14.182902 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] Creating event network-changed:486681c5-5183-43c6-a46a-5fd63f7fcff5 for instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e on n-h1-830883-28 Aug 30 17:24:14.188514 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-515a7ea8-e5ab-4295-b91d-27ac202ce97e req-6bad1b6f-caa6-4a1d-85bb-ca738d4179ed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055793 Aug 30 17:24:14.189848 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3701/7813] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:24:14.302675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:14.311125 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3536137-eaf5-40df-9848-02540428bea4 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1565 microversion: 2.1 time: 0.180433 Aug 30 17:24:14.312433 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4113/7814] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:14 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:35.559729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:35.561924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:35.564241 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:35.564911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=38 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:35.571007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:35.571663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:35.572343 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:35.573275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:35.573756 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:35.574198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:35.644990 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6dd78d82-88be-4c77-9c5f-d8f497f2f17b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action" status: 200 len: 24569 microversion: 2.1 time: 0.089887 Aug 30 17:24:35.645887 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3702/7815] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:24:35 2022] POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action => generated 24569 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:24:46.644582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:24:46.646870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:46.647529 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:46.653736 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:46.654229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:46.654696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:46.678173 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Going to try to stop instance {{(pid=122352) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 17:24:46.719910 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-74fa964b-a188-4a3b-867a-b4f901f227bf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action" status: 202 len: 0 microversion: 2.1 time: 0.080190 Aug 30 17:24:46.720574 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4114/7816] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:24:46 2022] POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:24:46.730001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:46.730785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:46.733689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:46.734490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:24:46.744303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:46.744807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:46.745263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:46.745987 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:46.746491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:46.746936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:46.981568 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:46.989617 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-995c01bf-3343-4920-a809-c1981936a7df tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.263890 Aug 30 17:24:46.990205 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3703/7817] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:46 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:48.014614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:48.015314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:48.022584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:48.023070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:48.023511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:48.024192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:48.024645 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:48.025068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:48.212552 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:48.220506 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2e61f3b-0781-4ff3-a43e-16fdb6479c3c tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.211623 Aug 30 17:24:48.221091 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4115/7818] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:48 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:49.243352 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:49.244592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:49.251433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:49.251931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:49.253104 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:49.253972 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:49.254475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:49.254919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:49.384591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:49.392373 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3cb64bc1-2968-480d-bd49-94ffe0aca4f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.152948 Aug 30 17:24:49.392952 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3704/7819] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:49 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:50.413436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:50.414100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:50.421187 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:50.421711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:50.422161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:50.422992 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:50.423454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:50.423885 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:50.580858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:50.588867 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4f7fd0c2-9b5f-4a08-b717-10ae2d2580aa tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.179672 Aug 30 17:24:50.589458 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4116/7820] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:50 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:51.610745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:51.611297 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:51.618286 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:51.618833 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:51.619293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:51.620006 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:51.620480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:51.620932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:51.759651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:51.767615 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9c3b5a9-0673-4331-88bb-1c4e5603e072 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.161100 Aug 30 17:24:51.768954 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3705/7821] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:51 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:52.789783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:52.790427 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:52.797429 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:52.797851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:52.798290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:52.799002 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:52.799506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:52.799928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:52.938798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:52.947530 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b092c7be-ba4d-4857-bce8-f84682578915 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.161844 Aug 30 17:24:52.948109 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4117/7822] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:52 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:53.969409 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:53.970042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:53.978131 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:53.978675 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:53.979132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:53.979856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:53.980327 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:53.980770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:54.115551 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:54.123465 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1fa349e0-b3fb-49db-b01c-6fe54f2e66f0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.158083 Aug 30 17:24:54.124043 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3706/7823] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:53 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:55.145384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:55.146010 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:55.152950 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:55.153443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:55.153889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:55.154616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:55.155077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:55.155511 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:55.293029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:55.301546 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-385c1282-7d89-4796-b2fd-59cf6b3ecdb2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.160375 Aug 30 17:24:55.302125 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4118/7824] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:55 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:56.323152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:56.323822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:56.331246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:56.332308 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:56.332770 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:56.333487 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:56.333961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:56.334436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:56.473416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:56.481201 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8aeca91e-79bb-479b-8e9c-5381820b0187 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.162258 Aug 30 17:24:56.481894 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3707/7825] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:56 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:57.504682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:57.505248 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:57.512221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:57.512707 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:57.513152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:57.513842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:57.514325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:57.514761 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:57.654896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:57.662973 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ac00067e-d6d1-4a9d-8c9e-bd810ab09a39 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.163213 Aug 30 17:24:57.663834 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4119/7826] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:57 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:58.684361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:58.685045 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:58.693100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.693610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.694092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.694836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:58.695311 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:58.695761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:58.836430 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:24:58.844399 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-398176b6-6545-4c94-b458-700912584631 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.164101 Aug 30 17:24:58.844995 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3708/7827] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:58 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:24:59.865860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:24:59.866551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:24:59.874088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:59.874613 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:59.875076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:24:59.875776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:24:59.876233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:24:59.876659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:00.015279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:00.023433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7117035f-cb84-461d-baac-0c092b44ccd0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.162095 Aug 30 17:25:00.024026 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4120/7828] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:24:59 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:01.045194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:01.045743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:01.053861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:01.054399 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:01.054893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:01.055610 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:01.056084 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:01.056527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:01.192196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:01.200514 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3fe82d9a-46ed-4e79-9f52-57f941d462e2 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1693 microversion: 2.1 time: 0.159184 Aug 30 17:25:01.201362 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3709/7829] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:01 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:02.223134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:02.223755 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:02.231083 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:02.231580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:02.232021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:02.232724 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:02.233181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:02.233609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:02.370072 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:02.378608 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-199b3de5-078a-4815-b7c7-ede184f4d4d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1670 microversion: 2.1 time: 0.159499 Aug 30 17:25:02.379216 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4121/7830] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:02 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:03.483564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:03.485817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:03.497248 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:03.498280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:03.498280 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:03.499360 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:03.499590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:03.500077 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:03.565051 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-074b9fac-8bc3-4339-b2d2-f8fc39a0eee0 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action" status: 200 len: 38409 microversion: 2.1 time: 0.085556 Aug 30 17:25:03.565738 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3710/7831] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:25:03 2022] POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action => generated 38409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:03.578137 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:03.585372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:03.585854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:03.586289 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:03.611431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Going to try to start instance {{(pid=122352) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 17:25:03.654484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3a104bad-b86a-4e0a-ab51-a4ab8a8913cc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action" status: 202 len: 0 microversion: 2.1 time: 0.080156 Aug 30 17:25:03.655108 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4122/7832] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:25:03 2022] POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:03.665230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:03.666000 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:03.674249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:03.674856 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:03.676056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:03.677809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:03.678496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:03.679070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:03.852652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:03.860785 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e8e6f9cb-8cce-4e3c-ada9-e81d7de18bc8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1679 microversion: 2.1 time: 0.200722 Aug 30 17:25:03.861390 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3711/7833] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:03 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:04.886035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:04.886877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:04.893130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:04.893642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:04.894099 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:04.894799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:04.895256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:04.895682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:05.042859 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:05.050703 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a7ed0ae4-fed8-4a23-9ba0-db5e7a23d105 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1683 microversion: 2.1 time: 0.171019 Aug 30 17:25:05.051270 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4123/7834] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:04 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:29.245125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:29.247355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:29.249994 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=18 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:29.250697 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=52 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:29.256672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:29.257718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:29.258444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:29.259150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:29.259620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:29.260061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:29.332261 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-295af209-7b74-4f1d-905f-5685e3255f18 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action" status: 200 len: 62977 microversion: 2.1 time: 0.091118 Aug 30 17:25:29.332957 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3712/7835] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:25:29 2022] POST /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e/action => generated 62977 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:25:36.629680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:36.630237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:36.635952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5e1902-1075-4b28-9e75-c7d6e534fc8e", "tag": "486681c5-5183-43c6-a46a-5fd63f7fcff5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:36.646675 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=20 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:36.647809 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:36.649589 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:36.650275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:36.651144 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:36.651753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:36.652452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:36.652907 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:36.653624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:36.654376 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:36.654897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:36.663721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] Creating event network-changed:486681c5-5183-43c6-a46a-5fd63f7fcff5 for instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e on n-h1-830883-28 Aug 30 17:25:36.669999 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-49aa3f98-a0ec-4e01-9061-71640c5a9eac req-1d3c1a14-fd56-4bb7-9423-56162e925ef0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038110 Aug 30 17:25:36.670654 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3713/7836] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:36.688951 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:25:36.777347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-beee97dc-6803-43d9-84a7-4de41ee5ebf7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 204 len: 0 microversion: 2.1 time: 0.151283 Aug 30 17:25:36.779055 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4124/7837] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:25:36 2022] DELETE /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:25:36.789996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:36.790755 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:36.797405 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:36.797916 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:36.799624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:36.800489 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:36.801432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:36.801432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:36.982923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:36.991317 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-39541590-8de2-4937-91c8-f1da90ccfa7a tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1689 microversion: 2.1 time: 0.207449 Aug 30 17:25:36.992183 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3714/7838] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:36 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1689 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:38.015266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:38.016587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:38.024471 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:38.024971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:38.025418 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:38.026144 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:38.026620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:38.027052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:38.170365 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:38.178188 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba9324db-58ec-49ba-a889-2ca6d509874e tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1689 microversion: 2.1 time: 0.167454 Aug 30 17:25:38.178793 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4125/7839] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:38 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:38.848677 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5e1902-1075-4b28-9e75-c7d6e534fc8e", "name": "network-vif-deleted", "tag": "486681c5-5183-43c6-a46a-5fd63f7fcff5"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:38.859559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:38.860065 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:38.860517 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:38.873114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] Creating event network-vif-deleted:486681c5-5183-43c6-a46a-5fd63f7fcff5 for instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e on n-h1-830883-28 Aug 30 17:25:38.878273 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-acb70ba2-f9e7-4983-ba86-5ff7b221397b req-b30d1b74-4c78-4f7a-93f6-b6cc3066d251 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 30 17:25:38.878908 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3715/7840] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:39.201082 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:39.201865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:39.209329 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:39.209937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:39.210524 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:39.211302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:39.211832 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:39.212327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:39.250158 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:39.250827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:39.251337 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:39.251863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lazy-loading 'fault' on Instance uuid 7a5e1902-1075-4b28-9e75-c7d6e534fc8e {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:25:39.301805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:39.310590 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3c9e2841-f1d6-4796-8f5b-712504217326 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 200 len: 1357 microversion: 2.1 time: 0.113610 Aug 30 17:25:39.311187 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4126/7841] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:39 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 1357 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:40.336197 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:40.336966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: 7a5e1902-1075-4b28-9e75-c7d6e534fc8e] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:40.343333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.343841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.344287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:40.345014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:40.345509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:40.345948 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:40.360263 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] HTTP exception thrown: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Request method failure captured: Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e HTTP/1.1 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkZXPJ6hTx-88qQuYi-2s2VlRnymK_bTgqYIrhKtb4MHt5jfOIBXNn5jfrSca-aZwIG-ETdefOu4u642_cBSg7f4oIbSvF4dG1F4ChSXZHgWC8a3wYZNqXvbGLMdqTEeez07Z3-UJfbKTWD8HVZSP-v5RvUSz3XhFRvhsAnFwfab10A Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}] Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: aa84109906174f48ae12969761161099 Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7a5e1902-1075-4b28-9e75-c7d6e534fc8e'} Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:25:40.361951 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Returning 404 to user: Instance 7a5e1902-1075-4b28-9e75-c7d6e534fc8e could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6dcc2020-ad56-4ac4-b9cd-ff43f93c038d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e" status: 404 len: 111 microversion: 2.1 time: 0.032579 Aug 30 17:25:40.367261 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3716/7842] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:40 2022] GET /compute/v2.1/servers/7a5e1902-1075-4b28-9e75-c7d6e534fc8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:25:43.825097 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4018c30f-dd17-4873-9282-66692e9ee39b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '.version_select at 0x7fd35c4d4670>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:43.847516 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4018c30f-dd17-4873-9282-66692e9ee39b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1979770271" status: 202 len: 0 microversion: 2.1 time: 0.027442 Aug 30 17:25:43.848296 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4127/7843] 10.222.0.47 () {58 vars in 1284 bytes} [Tue Aug 30 17:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1979770271 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:25:43.882926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7fa36284-c7e6-4ee1-9e4c-ee1cd14b14ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: .version_select at 0x7fd357951040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-181177231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSw8vJWo9MbgrVDcZO4D5fcc40p/cK4ACUpiw/0XOrTv+oW30LrsXStnnv4Qm3srqYZAAKr1F6Qd81sEQ7oj/9u8qYmlV8FZ7KRNa8jLZUxkchswGB8CLjAuhB66qB7ag=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:43.901306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7fa36284-c7e6-4ee1-9e4c-ee1cd14b14ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:25:43.906605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-7fa36284-c7e6-4ee1-9e4c-ee1cd14b14ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:25:43.930790 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7fa36284-c7e6-4ee1-9e4c-ee1cd14b14ff tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051886 Aug 30 17:25:43.931366 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3717/7844] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:25:43 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:49.765857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:49.770716 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1876842037", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "networks": [{"uuid": "8daa080d-88ff-4c65-ac97-8bb220a2a49a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-181177231", "security_groups": [{"name": "tempest-secgroup-smoke-888710327"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:49.904059 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] validate_networks() for [('8daa080d-88ff-4c65-ac97-8bb220a2a49a', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:25:50.314860 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:25:50.316508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:25:50.317581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:25:50.317939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:25:50.318484 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:25:50.327710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:50.328201 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:50.328702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:50.329431 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:50.330482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:50.330482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:50.353696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:25:50.360698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Getting quotas for user aa84109906174f48ae12969761161099 and project c14d497011d447aaa55d48ce6c4cf255. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:25:50.375200 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:25:50.378372 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:25:50.427042 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9ec368cf-9994-4d00-ae36-45f907f4f1d7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.662907 Aug 30 17:25:50.434933 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4128/7845] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:25:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:25:50.442310 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cbefec4-837b-4e51-9137-aa2145ead6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:50.443323 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cbefec4-837b-4e51-9137-aa2145ead6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:50.447154 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=16 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:25:50.508450 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7cbefec4-837b-4e51-9137-aa2145ead6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:50.516711 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7cbefec4-837b-4e51-9137-aa2145ead6b3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1266 microversion: 2.1 time: 0.079810 Aug 30 17:25:50.517501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3718/7846] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:50 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:51.541339 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:51.543039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:51.549711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:51.550496 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:51.551110 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:51.552026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:51.552789 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:51.553259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:51.653359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:51.664832 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2614f559-02a5-454f-b911-455c9c1b8c80 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1326 microversion: 2.1 time: 0.128123 Aug 30 17:25:51.671431 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4129/7847] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:51 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:52.692256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:52.692906 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:52.718526 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.719679 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.720708 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:52.721870 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:52.723575 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:52.730371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:53.053902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:53.068160 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b340b01e-e6f6-440b-8746-cfb92d09b31b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.380792 Aug 30 17:25:53.069949 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3719/7848] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:52 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:53.405419 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e4b64a-54a2-4357-9ad3-7d7d011347d2", "tag": "7dc2c18f-c674-46ac-bc9c-866a90919ee3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:25:53.417980 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:53.418505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:53.418943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:53.430694 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] Creating event network-changed:7dc2c18f-c674-46ac-bc9c-866a90919ee3 for instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 on n-h2-830883-28 Aug 30 17:25:53.436818 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-01722b0e-5bbf-4412-95ca-e86e6a5a58e6 req-b74220c4-8f58-4416-8572-26710f0624c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035416 Aug 30 17:25:53.437589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4130/7849] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:25:54.099436 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:54.100061 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:54.108203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.108705 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.109194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.110018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:54.110515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:54.110955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:54.264285 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:54.272668 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fca7bf7a-ed36-47eb-af27-06d7b86bd428 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.177047 Aug 30 17:25:54.273265 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3720/7850] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:54 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:55.296559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:55.297175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:55.303555 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.304043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.304478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:55.305172 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:55.305626 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:55.306050 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:55.448942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:55.456751 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-af06df6b-adba-4266-9d18-00d7faa2d844 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.166228 Aug 30 17:25:55.457344 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4131/7851] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:55 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:56.477915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:56.478682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:56.485927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.486474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.486929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.487865 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:56.488236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:56.488897 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:56.708866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:56.718113 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7cf515bc-fd73-4bb5-9665-77613fb2cce8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.244178 Aug 30 17:25:56.718760 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3721/7852] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:56 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:57.740070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:57.740701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:57.748966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.749506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.749921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.750682 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:57.751149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:57.751583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:57.901278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:57.909902 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16c027d1-05bc-4c3d-8c09-cfbbaf55f5ae tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.173741 Aug 30 17:25:57.910570 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4132/7853] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:57 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:25:58.933701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:25:58.934561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:25:58.942761 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.943702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.944224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:58.945015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:25:58.945726 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:25:58.946559 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:25:59.103527 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:25:59.115969 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9e7944c8-b722-417e-a58f-b22127501222 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.187178 Aug 30 17:25:59.116573 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3722/7854] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:25:58 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:26:00.138324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:00.138982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:00.146673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.147175 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.147614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.148344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.148803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.149249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.319966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:00.335105 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0953b46c-5f4b-4944-873a-885d68a6a4f8 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.200569 Aug 30 17:26:00.350562 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4133/7855] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:00 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:00.483117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e4b64a-54a2-4357-9ad3-7d7d011347d2", "name": "network-vif-plugged", "status": "completed", "tag": "7dc2c18f-c674-46ac-bc9c-866a90919ee3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:00.497918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:00.508328 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:00.509025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:00.510240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:00.520681 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:00.531999 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] Creating event network-vif-plugged:7dc2c18f-c674-46ac-bc9c-866a90919ee3 for instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 on n-h2-830883-28 Aug 30 17:26:00.538584 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-89d90d10-f2f3-4e82-9ae7-550fb4bc1057 req-823cb5d2-e062-420f-8061-3ea03dc53b46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061385 Aug 30 17:26:00.539419 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3723/7856] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:26:01.372604 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:01.373759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:01.377261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:01.378638 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:01.390549 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.391069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.391522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.392260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:01.392729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:01.393166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:01.541896 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:01.550098 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-34ea40e5-9a18-47c5-ad1b-108391e75790 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1391 microversion: 2.1 time: 0.185650 Aug 30 17:26:01.550758 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4134/7857] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:01 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:02.573484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.574216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:02.580545 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.581050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.581510 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.582216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.582718 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.583159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.723910 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:02.732420 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6cd7c028-30f8-47b7-af0d-a93f48151840 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1563 microversion: 2.1 time: 0.164145 Aug 30 17:26:02.733097 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3724/7858] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:02.754131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:02.754782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:02.762088 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.762616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.763057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.763767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:02.764226 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:02.764653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:02.900586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:02.908689 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33125f77-734e-4b6e-9dd5-758d216b57ec tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1563 microversion: 2.1 time: 0.158370 Aug 30 17:26:02.909272 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4135/7859] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:02 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:04.886978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:26:04.888211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:04.890149 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e4b64a-54a2-4357-9ad3-7d7d011347d2", "tag": "7dc2c18f-c674-46ac-bc9c-866a90919ee3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:04.895899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.896676 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.897302 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.898031 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.898784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.899395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.899728 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:04.900225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:04.903051 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:04.913715 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] Creating event network-changed:7dc2c18f-c674-46ac-bc9c-866a90919ee3 for instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 on n-h2-830883-28 Aug 30 17:26:04.919947 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-90da48a1-0f05-4365-8d73-0560227a2a38 req-5b03e73a-1838-4cd5-9046-82c45eefc459 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035182 Aug 30 17:26:04.920651 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4136/7860] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:26:05.133247 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:26:05.143088 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-d0ef1e11-1520-4141-a3d0-fc076e2dfe1f tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1563 microversion: 2.1 time: 0.261281 Aug 30 17:26:05.143685 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3725/7861] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:26:04 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:26:38.479795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:38.480557 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=42 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:26:38.485901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:26:38.488233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:26:38.497748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.498717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.499174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.499894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:26:38.500360 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:26:38.500798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:26:38.571769 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-577eb383-37b4-476b-8dec-1e7cd7704612 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action" status: 200 len: 24565 microversion: 2.1 time: 0.093803 Aug 30 17:26:38.572453 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4137/7862] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:26:38 2022] POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action => generated 24565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:08.957475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=5 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:08.958254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=38 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:08.960337 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 17:27:08.960549 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:27:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action (ip 10.222.0.47) !!! Aug 30 17:27:08.967358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:08.967915 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:08.978151 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:08.978695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:08.979145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:08.979860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:08.980347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:08.980784 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.006009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.objects.instance [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lazy-loading 'flavor' on Instance uuid e5e4b64a-54a2-4357-9ad3-7d7d011347d2 {{(pid=122351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:27:09.081571 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-89dc4242-a2bd-478e-96e5-bbed49b9b201 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action" status: 202 len: 0 microversion: 2.1 time: 0.125872 Aug 30 17:27:09.082249 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3726/7863] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:08 2022] POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:27:09.091325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:09.092037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:09.095291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=4 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:09.096190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:09.103670 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.104176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.104629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.105352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:09.106016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:09.106561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:09.261166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:09.270328 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c2ca5787-3478-48da-b01f-a23efb94d074 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1688 microversion: 2.1 time: 0.183515 Aug 30 17:27:09.270919 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4138/7864] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:09 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:10.295734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:10.296590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:10.304537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.305048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.305488 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.306199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:10.306785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:10.307219 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:10.454795 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:10.463026 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a99871ea-9f38-47aa-9a9d-dec373fc3953 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1688 microversion: 2.1 time: 0.172931 Aug 30 17:27:10.463625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3727/7865] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:10 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:11.485792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:11.486456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:11.492942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.493438 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.493883 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.494623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:11.495089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:11.495565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:11.632655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:11.641644 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0c5f83e9-735b-44d8-9bf1-78dd75842a31 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1671 microversion: 2.1 time: 0.160091 Aug 30 17:27:11.642275 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4139/7866] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:11 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:12.740290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:12.742557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:12.750034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.750926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.751390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.752105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.752573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.753014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.816564 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8106b581-e023-479f-8dca-bcde6cc29762 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action" status: 200 len: 38298 microversion: 2.1 time: 0.080123 Aug 30 17:27:12.817286 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3728/7867] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:12 2022] POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action => generated 38298 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:12.830224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:12.830822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:12.838062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.838597 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.839049 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.839794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.840259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.840694 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.913422 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0ad322f3-3a2d-46e4-82e2-42688c83cedf tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action" status: 202 len: 0 microversion: 2.1 time: 0.087893 Aug 30 17:27:12.914088 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4140/7868] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:12 2022] POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:27:12.923845 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:12.924567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:12.932553 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.933075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.933537 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:12.934276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:12.934802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:12.935245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:13.177314 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:13.185474 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-111681e8-b451-4e54-a664-003bca5bcf35 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1677 microversion: 2.1 time: 0.266545 Aug 30 17:27:13.186194 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3729/7869] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:12 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:14.208558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:14.209387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:14.217021 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.217827 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.218981 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.219619 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:14.220261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:14.220851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:14.373571 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:14.383274 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a56c826-02ce-4ab3-b7cd-4b1c90955269 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1677 microversion: 2.1 time: 0.179656 Aug 30 17:27:14.383872 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4141/7870] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:14 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:15.405018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:15.405642 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:15.413754 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.414257 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.414733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.415448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.415909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.416351 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.564816 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:15.574805 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-652f441a-f5c1-4758-9753-7559c30703c3 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1680 microversion: 2.1 time: 0.173228 Aug 30 17:27:15.575467 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3730/7871] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:15 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:15.682212 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:15.684489 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:15.692545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.693037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.693481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.694192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:15.694692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:15.695126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:15.767248 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7af8bae9-22e4-4819-b16b-5876b17d139b tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action" status: 200 len: 38298 microversion: 2.1 time: 0.088736 Aug 30 17:27:15.768016 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4142/7872] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:27:15 2022] POST /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2/action => generated 38298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 17:27:16.793535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:16.794097 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:16.809124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.809866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.810354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.811087 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.811687 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.812949 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.844172 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Going to try to terminate instance {{(pid=122351) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:27:16.865880 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e4b64a-54a2-4357-9ad3-7d7d011347d2", "tag": "7dc2c18f-c674-46ac-bc9c-866a90919ee3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:16.879196 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.879685 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.880420 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.894019 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] Creating event network-changed:7dc2c18f-c674-46ac-bc9c-866a90919ee3 for instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 on n-h2-830883-28 Aug 30 17:27:16.902753 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-cd1a6772-7c22-4525-9f3e-b3f784e410a4 req-bedaa1e8-f60f-4ba2-8e1b-30583aaab40c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101766 Aug 30 17:27:16.903408 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4143/7873] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:16.945772 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-625da8f3-dd2f-4eed-9bde-56d13a3f6a04 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 204 len: 0 microversion: 2.1 time: 0.155917 Aug 30 17:27:16.949937 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3731/7874] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:27:16 2022] DELETE /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:27:16.957655 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:16.959194 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:16.967026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.970437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.970437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:16.970437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:16.970437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:16.970854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:17.122320 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:17.133448 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-70a093a5-8245-4295-98be-1e6d9ad4eae7 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1686 microversion: 2.1 time: 0.181805 Aug 30 17:27:17.134160 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4144/7875] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:16 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:18.161837 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:18.162587 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:18.168695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:18.169195 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:18.169646 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:18.170382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:18.170851 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:18.171896 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:18.379707 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:18.387976 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e31c938e-28dc-44c3-9a14-6d4b623a4fbc tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1686 microversion: 2.1 time: 0.232068 Aug 30 17:27:18.388665 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3732/7876] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:18 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1686 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:19.412698 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:19.413691 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:19.421170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:19.421674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:19.422115 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:19.422855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:19.423317 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:19.423742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:19.519530 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84109906174f48ae12969761161099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14d497011d447aaa55d48ce6c4cf255', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:19.527761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ba61c4b-273a-485e-8e53-3727ecc2ca03 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 200 len: 1502 microversion: 2.1 time: 0.120981 Aug 30 17:27:19.528364 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4145/7877] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:19 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 1502 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:19.613421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e4b64a-54a2-4357-9ad3-7d7d011347d2", "name": "network-vif-deleted", "tag": "7dc2c18f-c674-46ac-bc9c-866a90919ee3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:19.628660 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:19.629167 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:19.629622 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:19.642555 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] Creating event network-vif-deleted:7dc2c18f-c674-46ac-bc9c-866a90919ee3 for instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 on n-h2-830883-28 Aug 30 17:27:19.647933 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-c1129b4a-de49-4d31-b826-a266f090888f req-fdfa6e3a-a3d5-4ba5-9130-32a0607647eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093692 Aug 30 17:27:19.648743 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3733/7878] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:20.550362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:20.551028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] [instance: e5e4b64a-54a2-4357-9ad3-7d7d011347d2] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:20.558168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.558833 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.559279 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.559984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:20.560443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:20.560876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:20.575881 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] HTTP exception thrown: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Request method failure captured: Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 HTTP/1.1 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkZXPJ6hTx-88qQuYi-2s2VlRnymK_bTgqYIrhKtb4MHt5jfOIBXNn5jfrSca-aZwIG-ETdefOu4u642_cBSg7f4oIbSvF4dG1F4ChSXZHgWC8a3wYZNqXvbGLMdqTEeez07Z3-UJfbKTWD8HVZSP-v5RvUSz3XhFRvhsAnFwfab10A Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c14d497011d447aaa55d48ce6c4cf255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c14d497011d447aaa55d48ce6c4cf255"}]}] Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: c14d497011d447aaa55d48ce6c4cf255 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1300931689 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: aa84109906174f48ae12969761161099 Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1300931689-project Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'e5e4b64a-54a2-4357-9ad3-7d7d011347d2'} Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:27:20.577854 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Returning 404 to user: Instance e5e4b64a-54a2-4357-9ad3-7d7d011347d2 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-54e3c5c8-cb87-4ebc-97c1-ada6025d0284 tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2" status: 404 len: 111 microversion: 2.1 time: 0.033674 Aug 30 17:27:20.581998 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4146/7879] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:20 2022] GET /compute/v2.1/servers/e5e4b64a-54a2-4357-9ad3-7d7d011347d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:27:23.795088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c7178be5-288f-411e-b1c3-e2b726f8e05d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] Calling method '.version_select at 0x7fd357ab1310>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:23.825114 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c7178be5-288f-411e-b1c3-e2b726f8e05d tempest-TestNetworkAdvancedServerOps-1300931689 tempest-TestNetworkAdvancedServerOps-1300931689-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181177231" status: 202 len: 0 microversion: 2.1 time: 0.035365 Aug 30 17:27:23.831412 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3734/7880] 10.222.0.47 () {58 vars in 1281 bytes} [Tue Aug 30 17:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181177231 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:27:35.801425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=18 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:35.802192 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:35.993843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f95321c5-7cbe-49f8-8c56-ef0e328d3cd0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'create', calling method: .version_select at 0x7fd35c0ec160>, body: {"keypair": {"name": "tempest-TestShelveInstance-395417161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeyMpdbdMtCN9RvmezfVmjsFJkaNPYkPmKNOr0e79lsdzycOcIFR+wQFJgUN7jjN4eSH2RBeyHJ2N8H/Lcdo3IgLHSijRXGkBjoV3bmNIr+W3vEN5IO/3Sbk0N5NkkS/g=="}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:36.010559 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f95321c5-7cbe-49f8-8c56-ef0e328d3cd0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for project be2dba2127a34ca38d3e387c6f42377d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:36.016964 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-f95321c5-7cbe-49f8-8c56-ef0e328d3cd0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for user f423f2d781644f4bb5f8b53225ff587d and project be2dba2127a34ca38d3e387c6f42377d. Resources: {'key_pairs'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:36.051182 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f95321c5-7cbe-49f8-8c56-ef0e328d3cd0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.255389 Aug 30 17:27:36.052757 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4147/7881] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:27:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:37.165692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:37.166497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:37.171667 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-900526063", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-395417161", "security_groups": [{"name": "tempest-secgroup-smoke-1219449291"}], "networks": [{"uuid": "4725cfe8-d47b-4380-bf5d-09cae5e3df21"}]}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:37.325733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.network.neutron [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] validate_networks() for [('4725cfe8-d47b-4380-bf5d-09cae5e3df21', None, None, None, None, None)] {{(pid=122351) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:27:37.864653 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Flavor limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:27:37.865105 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Image limits 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:27:37.865602 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Flavor pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:27:37.866073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Image pref 0:0:0 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:27:37.866549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.virt.hardware [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:27:37.876882 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.877420 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.877878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.878673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:37.879147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:37.879592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:37.898578 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for project be2dba2127a34ca38d3e387c6f42377d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:27:37.904491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for user f423f2d781644f4bb5f8b53225ff587d and project be2dba2127a34ca38d3e387c6f42377d. Resources: {'cores', 'instances', 'ram'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:27:37.919120 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Going to run 1 instances... {{(pid=122351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:27:37.922337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:27:37.972180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-be2f6d8c-42e7-468b-bb17-0151e58fb903 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808311 Aug 30 17:27:37.972846 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3735/7882] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:27:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:27:37.983614 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ede1101d-84fa-416e-a073-5a43e0fb6272 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:37.984837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ede1101d-84fa-416e-a073-5a43e0fb6272 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:38.041510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ede1101d-84fa-416e-a073-5a43e0fb6272 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:38.049972 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ede1101d-84fa-416e-a073-5a43e0fb6272 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1245 microversion: 2.1 time: 0.070229 Aug 30 17:27:38.050582 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4148/7883] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:37 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:39.072275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:39.072980 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:39.082117 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.082864 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.083317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:39.084040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:39.084506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:39.084945 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:39.178548 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:39.187731 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e919f4b4-0fdb-499f-9315-86108f168096 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1297 microversion: 2.1 time: 0.120484 Aug 30 17:27:39.188583 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3736/7884] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:39 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:40.209100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:40.209722 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:40.225914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.226738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.227341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.228223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.228839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.229425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.481388 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:40.491214 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c64e0004-ac91-4efc-90b2-d3736c24c3f2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.285839 Aug 30 17:27:40.492318 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4149/7885] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:40 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:40.856911 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:40.869790 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:40.879023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:40.879710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:40.891982 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] Creating event network-changed:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h1-830883-28 Aug 30 17:27:40.897299 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-66c42f66-4ea0-405a-bab5-b767cd137de1 req-f28cb404-79bd-4cae-9ad9-a4c6dc86497c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043976 Aug 30 17:27:40.897924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3737/7886] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:41.513306 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:41.513924 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:41.521334 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:41.522272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:41.522272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:41.522972 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:41.523425 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:41.523851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:41.658131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:41.666219 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f1421b90-5a72-473e-87ff-adc8b33ec59d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.157150 Aug 30 17:27:41.666826 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4150/7887] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:41 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:42.689591 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:42.690230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:42.697035 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.697550 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.698008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:42.698772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:42.699254 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:42.699699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:43.155433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:43.163649 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-722b1672-e54c-46ca-a801-7ed9e9dace0f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.480137 Aug 30 17:27:43.164231 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3738/7888] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:42 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:44.185070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:44.185692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:44.192782 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.193266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.193705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.194459 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:44.194916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:44.195340 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:44.332269 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:44.340092 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7bd4313c-8b8b-48b5-9d7d-ef10a2282259 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.158949 Aug 30 17:27:44.340663 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4151/7889] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:44 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:45.362115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:45.362768 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:45.369738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.370353 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.370815 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.371793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:45.372263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:45.372955 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:45.514692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:45.522889 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6170c8ef-2fbb-4436-b0ad-81e65274edc2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.164768 Aug 30 17:27:45.523494 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3739/7890] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:45 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:46.544835 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:46.545735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:46.552738 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.553227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.553672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.554416 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:46.554882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:46.555314 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:46.698639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:46.707290 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77245a44-8166-4b44-9c3d-a967c3a5a13d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.166555 Aug 30 17:27:46.707881 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4152/7891] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:46 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:27:47.236068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "name": "network-vif-plugged", "status": "completed", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:47.245877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:47.246402 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:47.246860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.258181 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] Creating event network-vif-plugged:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h1-830883-28 Aug 30 17:27:47.263207 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5532b3d3-17c7-4869-b2ec-93915d1c1783 req-cc07e6d8-bb2a-4b7b-a1b2-aa610814468a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108064 Aug 30 17:27:47.263805 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3740/7892] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:27:47.728857 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:47.729534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:47.736784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:47.737282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:47.737730 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.738561 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:47.738942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:47.739375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:47.885704 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:47.895318 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-04dd1334-cd70-4dec-b4b1-91d32cff112c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1371 microversion: 2.1 time: 0.170350 Aug 30 17:27:47.895930 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4153/7893] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:47 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:48.919592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:48.921145 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:48.926604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:48.928109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:48.935375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.936752 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.937214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:48.937938 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:48.938444 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:48.938888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.083968 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:49.093322 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4a390d73-9a5f-4aef-bef5-08be042fc8c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1554 microversion: 2.1 time: 0.173581 Aug 30 17:27:49.093921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3741/7894] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:48 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:49.114640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:27:49.115263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:27:49.117278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:27:49.124029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:49.124520 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:49.124959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.125664 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:49.126122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:49.126567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:49.288499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:27:49.297905 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c80ba44-1862-4b78-9e2c-d4a42d58d25c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1554 microversion: 2.1 time: 0.187165 Aug 30 17:27:49.298521 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4154/7895] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:27:49 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:27:51.096858 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:27:51.109075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:27:51.109743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:27:51.110275 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:27:51.122497 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] Creating event network-changed:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h1-830883-28 Aug 30 17:27:51.128011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-9c89f0ea-8c3c-483a-8340-5e874f4d223a req-6c7a8e7d-16d1-4311-a33c-fdec9e4ec833 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036083 Aug 30 17:27:51.128717 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3742/7896] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:29:46.169570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:46.170426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:46.171888 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:29:46.172033 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:29:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a/action (ip 10.222.0.47) !!! Aug 30 17:29:46.178156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:29:46.178725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.187224 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.187712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.188150 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.188856 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.189313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.189737 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.215424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lazy-loading 'flavor' on Instance uuid 7a6be7f3-3570-4166-a017-50b6abd8563a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:29:46.419489 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d5dd0c5d-def0-4ce1-b7bc-7389dc693e6c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a/action" status: 202 len: 0 microversion: 2.1 time: 0.251746 Aug 30 17:29:46.420204 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4155/7897] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:29:46 2022] POST /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 17:29:46.427548 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:29:46.428568 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 17:29:46.429234 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:46.430014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=32 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:29:46.435834 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:46.436570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:46.446817 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.447330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.447787 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.448520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:46.448997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:46.449442 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:46.610651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:46.619540 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e03673e9-53b8-41f4-8494-679fad68bac9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.194736 Aug 30 17:29:46.620144 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3743/7898] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:46 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:47.642867 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:47.645239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:47.652381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.652876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.653321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.654025 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:47.654523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:47.654958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:47.870639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:47.879238 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-646c3629-3732-42d8-8691-5839f9d35082 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.241824 Aug 30 17:29:47.879837 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4156/7899] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:47 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:48.901155 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:48.901774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:48.912318 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.912822 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.913278 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.913998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:48.914496 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:48.914936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:48.922079 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52750. Aug 30 17:29:48.922843 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52752. Aug 30 17:29:49.119303 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:49.127338 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70ff3c14-d3be-497b-8993-694fccbcd7bb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.230223 Aug 30 17:29:49.128664 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3744/7900] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:48 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:50.149910 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:50.150566 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:50.157681 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.158156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.159696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.160501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:50.160961 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:50.161615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:50.301311 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:50.309445 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-76e65e61-cec1-4a2c-acff-4f3330c21780 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.163528 Aug 30 17:29:50.310142 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4157/7901] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:50 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:29:51.332701 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:51.333445 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:51.340501 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.341008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.341462 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.342182 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:51.342685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:51.343127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:51.486452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:51.494560 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b641bdbf-30fe-491a-9044-72038660fdcb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.166637 Aug 30 17:29:51.495140 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3745/7902] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:51 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:52.516658 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:52.517276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:52.524345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.524828 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.525268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.526019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:52.526507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:52.526935 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:52.670710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:52.679442 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1f6190fb-d7f8-412d-9d82-eaea94cbf9d4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.166614 Aug 30 17:29:52.680322 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4158/7903] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:52 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:53.701460 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:53.702089 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:53.709706 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.710210 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.710684 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.711554 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:53.712096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:53.712535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:53.851880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:53.859897 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b3c207a1-4fb1-49c9-baae-c7c7781beddb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.162308 Aug 30 17:29:53.860500 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3746/7904] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:53 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:54.884214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:54.884823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:54.892029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.892528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.892971 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:54.894551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:54.895188 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:54.895535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:55.036616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:55.046327 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-484144b9-5b68-4587-85b5-122b14985e82 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.165986 Aug 30 17:29:55.046931 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4159/7905] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:54 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:56.067605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:56.068240 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:56.075503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.076011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.076465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.077184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:56.077943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:56.078415 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:56.220246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:56.229161 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6a0e4b8c-3732-45a7-8875-6b4fad700768 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1678 microversion: 2.1 time: 0.165442 Aug 30 17:29:56.229753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3747/7906] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:56 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:57.251286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:57.251842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:57.259545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.260035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.260480 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.261186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:57.261647 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:57.262095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:57.402708 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:57.413047 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5a36b6bc-cb24-4fbe-998f-2b5e5d974f9c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1699 microversion: 2.1 time: 0.165349 Aug 30 17:29:57.414059 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4160/7907] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:57 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:58.439393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:58.440033 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:58.447785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.448293 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.448773 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.449495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:58.449967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:58.450448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:58.590209 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:58.598650 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-7252ae24-ab43-418f-b776-79320655b7c1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1699 microversion: 2.1 time: 0.163154 Aug 30 17:29:58.599276 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3748/7908] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:58 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:29:59.621906 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:29:59.622706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:29:59.636199 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:59.636710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:59.637357 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:59.638282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:29:59.638817 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:29:59.639256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:29:59.818660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:29:59.841324 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-65c39a38-95f2-4a27-ace2-4c4d132ec620 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.223509 Aug 30 17:29:59.844738 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4161/7909] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:29:59 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:00.869201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:00.869690 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:00.877003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.878692 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.879419 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:00.880398 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:00.880879 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:00.881515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.068898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:01.077805 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a41b7a69-dbaa-47f6-8632-d68ee3f8c78c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.212901 Aug 30 17:30:01.080932 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3749/7910] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:00 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:01.934127 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "name": "network-vif-plugged", "status": "completed", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:01.949454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:01.950395 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:01.950864 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:01.966989 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] Creating event network-vif-plugged:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h1-830883-28 Aug 30 17:30:01.974484 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-039576f4-82c5-4438-8fa5-c7670a7c17ca req-87a96f0b-eef1-4cd8-bbc9-72433b4e4d56 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044022 Aug 30 17:30:01.975127 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4162/7911] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:02.103115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:02.103482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:02.113235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.113836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.114619 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.115613 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:02.116157 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:02.116788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:02.309052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:02.319218 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-1e0523f1-7037-438b-af93-147d31a3fbb9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.222424 Aug 30 17:30:02.320446 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3750/7912] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:02 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:03.347666 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:03.348582 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:03.356456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:03.357424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:03.359443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:03.360653 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:03.361458 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:03.363263 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:03.540721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:03.552955 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-3ce037d2-49d3-4198-9ac6-53b02e2fc0b7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.211052 Aug 30 17:30:03.553868 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4163/7913] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:03 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:04.576751 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:04.579007 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:04.609971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.611639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.615806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.618041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:04.618614 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:04.619107 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:04.790899 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:04.799047 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-74b6ff1b-8799-471a-aeda-9bb4d0820e97 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.227007 Aug 30 17:30:04.814624 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3751/7914] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:04 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:05.822819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:05.823569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:05.832075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.833159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.833781 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:05.835152 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:05.835649 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:05.836324 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:06.013182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:06.024276 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0dc6bc91-af88-47af-9238-f9038eb5bf21 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.205194 Aug 30 17:30:06.026866 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4164/7915] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:05 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:07.047905 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:07.050720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:07.058765 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.059408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.059943 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.060759 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:07.061317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:07.062012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:07.255224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:07.263757 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e0ed8c77-6038-44d8-9ef0-518d6879b198 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.220497 Aug 30 17:30:07.274931 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3752/7916] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:07 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:08.289497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:08.290033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:08.297472 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.297968 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.298439 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.299145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:08.300203 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:08.300996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:08.443901 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:08.451982 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4ec7131-ab6e-4c38-a13d-5dda55300230 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1694 microversion: 2.1 time: 0.166412 Aug 30 17:30:08.452589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4165/7917] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:08 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:09.474221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:09.474828 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:09.482227 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.482763 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.483212 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.483965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:09.484432 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:09.484868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:09.639875 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:09.648394 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4380d3ab-ee52-4158-841c-008a69c9f8b6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1676 microversion: 2.1 time: 0.179092 Aug 30 17:30:09.649007 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3753/7918] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:09 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:10.670706 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:10.671323 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:10.677813 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.678328 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.678771 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.679478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:10.679936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:10.680359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:10.818044 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:10.826143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-efb2d42b-ccb2-459b-87a0-7b30af5f3145 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1676 microversion: 2.1 time: 0.159378 Aug 30 17:30:10.826769 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4166/7919] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:10 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:11.847819 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:11.848471 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:11.855678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:11.856179 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:11.856625 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.857337 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:11.857803 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:11.858238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.915066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "name": "network-vif-unplugged", "status": "completed", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:11.931374 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:11.931861 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:11.932742 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:11.946841 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_external_events [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] Unable to find a host for instance 7a6be7f3-3570-4166-a017-50b6abd8563a. Dropping event network-vif-unplugged {{(pid=122352) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Aug 30 17:30:11.947778 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-2ce5c4b2-a0c1-4516-bf1e-2787122c4c55 req-902b83b9-342c-433d-a464-9bf6428361f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037190 Aug 30 17:30:11.948565 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4167/7920] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 17:30:12.014686 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:12.023395 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-21df9834-6d90-42dd-a377-bebe7454d570 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1619 microversion: 2.1 time: 0.179876 Aug 30 17:30:12.023991 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3754/7921] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:11 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:12.048506 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:12.049465 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:12.056877 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.057361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.057801 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.058541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.058999 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.059428 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.150879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122352) unshelve /opt/stack/nova/nova/compute/api.py:4603}} Aug 30 17:30:12.232720 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-caed71a9-5f1a-43d5-be62-3f2692eae23e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a/action" status: 202 len: 0 microversion: 2.1 time: 0.191320 Aug 30 17:30:12.233460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4168/7922] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:30:12 2022] POST /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:30:12.243473 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:12.244207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:12.250929 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.251513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.252066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.253373 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:12.253966 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:12.254276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:12.399363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:12.407446 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3531df04-21ac-42dd-bff8-f82c18352a9f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1627 microversion: 2.1 time: 0.168418 Aug 30 17:30:12.408035 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3755/7923] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:12 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1627 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:13.430871 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:13.431505 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:13.438275 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.438823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.439308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.440039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:13.440610 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:13.440942 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:13.589032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:13.592712 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:13.597828 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8d04a9a5-39ff-405b-8943-c50b45caadcf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.171735 Aug 30 17:30:13.598448 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4169/7924] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:13 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:14.538041 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:14.550503 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:14.551016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:14.551465 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:14.569514 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] Creating event network-changed:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h2-830883-28 Aug 30 17:30:14.573136 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] [f8f594ef-4241-4496-b3a3-0c0a049941c8] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:30:14.619824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:14.620446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:14.630250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:14.630778 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:14.631217 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:14.631921 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:14.632375 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:14.632799 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:14.870933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:14.880353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cd28748e-285b-4829-a460-e061b847b1a3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.264774 Aug 30 17:30:14.880963 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4170/7925] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:14 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:30:15.580152 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] [f8f594ef-4241-4496-b3a3-0c0a049941c8] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52888. Aug 30 17:30:15.586174 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-6cc1bab1-e619-4c42-8845-da5db1685cc4 req-0d6475f9-99cd-4c6f-9862-1bc07e1100b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.051985 Aug 30 17:30:15.587044 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3756/7926] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:30:15.903440 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:15.904792 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:15.913642 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:15.914139 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:15.914615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:15.915680 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:15.916307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:15.916987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:16.099399 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:16.109507 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-200509dc-5690-4867-969b-231ab85d0376 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.210543 Aug 30 17:30:16.110632 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4171/7927] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:15 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:17.133347 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:17.134427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:17.137028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=29 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:17.143194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.143710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.144731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.145497 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:17.145996 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:17.146623 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:17.150050 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=81 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:17.323541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:17.333993 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f6add7e4-1686-4fbf-9b3b-04ea91b3e7c0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.205958 Aug 30 17:30:17.335250 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3757/7928] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:17 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:18.356550 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:18.357822 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:18.361461 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:30:18.371479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.372325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.372739 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.373661 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:18.374171 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:18.374754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:18.607343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:18.619269 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ebea89b9-d04c-4c0b-885d-76f543cf6295 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.266726 Aug 30 17:30:18.634724 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4172/7929] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:18 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:19.643539 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:19.645425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:19.651048 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.651561 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.652018 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.652744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:19.653231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:19.653663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:19.825663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:19.836157 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03ddb095-0c9d-442f-a60c-4cdcdac49f98 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.197144 Aug 30 17:30:19.851571 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3758/7930] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:19 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:20.862517 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:20.864081 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:20.871848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.872345 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.872819 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:20.873528 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:20.873989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:20.874535 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:21.027721 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:21.036954 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8e8886eb-ef5f-4137-b802-cc447a038b63 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.180669 Aug 30 17:30:21.037547 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4173/7931] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:20 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:22.062380 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:22.063243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:22.071745 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:22.072264 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:22.072722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:22.073448 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:22.073924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:22.074390 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:22.258850 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:22.272552 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-49d7a9b2-b16b-4545-ad3c-8901ec050f7e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.214210 Aug 30 17:30:22.274107 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3759/7932] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:22 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:23.297106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:23.297740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:23.305882 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.306404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.306853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.307570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:23.308031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:23.308463 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:23.449903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:23.458536 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b16bffeb-2f7f-4f0b-8a2c-ea5e775db070 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.165296 Aug 30 17:30:23.459128 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4174/7933] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:23 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:24.480668 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:24.481263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:24.489434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:24.489931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:24.490412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:24.491126 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:24.491590 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:24.492025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:24.633137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:24.641197 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-5f4144dc-d6ea-4712-952a-4fcdead7c04e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.164554 Aug 30 17:30:24.641783 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3760/7934] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:24 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:25.663455 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:25.664102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:25.671715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.672109 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.672554 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.673266 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:25.673725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:25.677385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:25.822159 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:25.831319 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-19b23322-beab-4c51-af7e-7e116157707f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.171346 Aug 30 17:30:25.832024 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4175/7935] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:25 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:26.853173 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:26.853762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:26.860903 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.861495 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.861951 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:26.862715 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:26.863186 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:26.863648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:27.009443 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:27.018149 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-38d48a00-51d0-4e00-b95e-e5f0473afe6f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.168442 Aug 30 17:30:27.018776 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3761/7936] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:26 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:28.040586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:28.041207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:28.048276 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:28.049608 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:28.050114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:28.050904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:28.051359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:28.051784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:28.194295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:28.204433 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f7a2d6f1-bdbe-4307-8c51-2ad28445497f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.167689 Aug 30 17:30:28.205572 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4176/7937] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:28 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:29.227456 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:29.228093 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:29.235184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.235688 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.236166 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:29.236998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:29.237713 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:29.238163 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:29.379584 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:29.387719 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f1f7838b-c772-4f2c-9d70-b6203edbe9a6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.164236 Aug 30 17:30:29.388322 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3762/7938] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:29 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:30.410696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:30.411494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:30.419633 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:30.420131 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:30.420585 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:30.421298 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:30.421759 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:30.422191 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:30.569468 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:30.577515 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2a563857-dd65-4527-aeb4-815a9072b7cd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.171687 Aug 30 17:30:30.578098 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4177/7939] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:30 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:31.600830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:31.601696 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:31.608857 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:31.609358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:31.609807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:31.610546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:31.611011 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:31.612147 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:31.757109 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:31.765388 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-70b7569a-06dc-469d-bf15-fd2318adfaa9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.168578 Aug 30 17:30:31.765988 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3763/7940] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:31 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:31.821760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "name": "network-vif-plugged", "status": "completed", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:30:31.834715 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:31.835422 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:31.835898 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:31.848216 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] Creating event network-vif-plugged:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h2-830883-28 Aug 30 17:30:31.854279 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-ed592c0d-7a0c-4748-9ecc-717ea979c7cc req-2a2c76f4-52c7-4e6d-8224-793502ce554d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 Aug 30 17:30:31.855174 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4178/7941] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:30:32.789621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:32.790185 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:32.797213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.797717 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.798171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.799651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:32.800180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:32.800635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:32.945780 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:32.962861 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dccfb79e-2209-470d-98bb-6b600547f513 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.177064 Aug 30 17:30:32.963461 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3764/7942] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:32 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:33.986499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:33.987256 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:33.993842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:33.994364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:33.994812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:33.995521 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:33.995984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:33.996415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:34.147310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:34.156194 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-33c11fdc-ee8d-4787-acd0-680c008a27e9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1685 microversion: 2.1 time: 0.175042 Aug 30 17:30:34.156796 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4179/7943] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:33 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:30:35.178738 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:30:35.179372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:30:35.186552 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:35.187056 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:35.187509 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:35.188225 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:30:35.188695 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:30:35.189213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:30:35.338407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:30:35.346844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3a2d3893-559a-4725-9515-ec801c19245c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1672 microversion: 2.1 time: 0.172042 Aug 30 17:30:35.347445 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3765/7944] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:30:35 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:20.364920 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:32:20.365838 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:32:20.370174 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:20.370729 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:20.372807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=15 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:20.373449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=56 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:20.375001 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=17 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:20.375774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=53 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:20.377593 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:32:20.377738 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:32:20.379393 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:32:20.379715 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:32:20.383271 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:32:20.383271 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a (ip 10.222.0.47) !!! Aug 30 17:32:20.400089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.400620 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.401062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.401962 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.402599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.403207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.435952 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:32:20.453122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:20.465449 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.466014 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.466566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.479880 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] Creating event network-changed:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h2-830883-28 Aug 30 17:32:20.485345 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-557cec4a-f7a7-45e4-b6ab-05e5cf91e274 req-181a75b2-ded7-41fd-9e72-a09e9023cc5f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126952 Aug 30 17:32:20.486038 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3766/7945] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:20.522920 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-265733de-f9f9-4ddb-b532-fc4161d68d64 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 204 len: 0 microversion: 2.1 time: 0.166657 Aug 30 17:32:20.523819 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4180/7946] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:32:20 2022] DELETE /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:32:20.534176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:20.535217 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:20.542237 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.542868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.543322 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.544042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:20.544542 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:20.544984 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:20.689235 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:20.697962 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0ac0dcd9-35bf-4e2d-b10a-6c5092f8ea7c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1560 microversion: 2.1 time: 0.168875 Aug 30 17:32:20.698574 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3767/7947] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:20 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:21.720457 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:21.721180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:21.729843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.730353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.730807 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.731510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:21.731970 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:21.732402 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:21.759746 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53044. Aug 30 17:32:21.768496 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53046. Aug 30 17:32:21.959890 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:21.967787 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-786ad2e4-7bbc-4f03-b4a1-04479e32c8f9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1560 microversion: 2.1 time: 0.251585 Aug 30 17:32:21.968388 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4181/7948] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:21 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1560 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:22.848242 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6be7f3-3570-4166-a017-50b6abd8563a", "name": "network-vif-deleted", "tag": "4a442bbd-3645-4a78-b127-211d5aae0da3"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:22.857952 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.858567 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.859094 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.873810 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] Creating event network-vif-deleted:4a442bbd-3645-4a78-b127-211d5aae0da3 for instance 7a6be7f3-3570-4166-a017-50b6abd8563a on n-h2-830883-28 Aug 30 17:32:22.879609 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5e2ec7e7-2e6e-484e-a04f-8ecfd0355e10 req-82408f52-6da1-4665-94ff-3fa5b3b14447 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094901 Aug 30 17:32:22.880924 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3768/7949] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:22.989258 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:22.989816 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:22.997389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.997874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.998333 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:22.999022 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:22.999478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:22.999904 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.031205 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:23.031947 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:23.032380 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:23.032825 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lazy-loading 'fault' on Instance uuid 7a6be7f3-3570-4166-a017-50b6abd8563a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:32:23.076077 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:23.084172 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d80fe779-8a31-4c5e-848f-2ceaa91b65fe tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 200 len: 1335 microversion: 2.1 time: 0.098771 Aug 30 17:32:23.084762 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4182/7950] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:22 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:24.107416 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:24.108180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 7a6be7f3-3570-4166-a017-50b6abd8563a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:24.115243 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.115734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.116230 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.117009 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:24.117476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:24.117918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:24.131317 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] HTTP exception thrown: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Request method failure captured: Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a HTTP/1.1 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkiCJxQFGf56O22f1g00EDLypvCjroP17e4YQAmBe4x6pK7PbCgkeBSbFM8CxSzeHBpD8OfFaFxLwQtv0bPKpMo8S2httY9H9LFrX6VG5RukLK9UkZ-VYultoG-aM6v8YG9u09Dz9iD3GIu4LmhAuKbgny1LBcaTyObBHvI7RPdqPQM Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: be2dba2127a34ca38d3e387c6f42377d Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestShelveInstance-1718121814 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be2dba2127a34ca38d3e387c6f42377d"}]}] Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestShelveInstance-1718121814 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: be2dba2127a34ca38d3e387c6f42377d Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestShelveInstance-1718121814 Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestShelveInstance-1718121814-project Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f423f2d781644f4bb5f8b53225ff587d Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestShelveInstance-1718121814-project Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '7a6be7f3-3570-4166-a017-50b6abd8563a'} Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:32:24.133482 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Returning 404 to user: Instance 7a6be7f3-3570-4166-a017-50b6abd8563a could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8a5d187f-a681-4f3f-a2d2-f9c7bc1ae1e1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a" status: 404 len: 111 microversion: 2.1 time: 0.031783 Aug 30 17:32:24.138767 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3769/7951] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:24 2022] GET /compute/v2.1/servers/7a6be7f3-3570-4166-a017-50b6abd8563a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:32:24.298389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6a21fd31-afb5-4b48-81f7-f18ecba373ea tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '.version_select at 0x7fd35c523820>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:24.327143 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6a21fd31-afb5-4b48-81f7-f18ecba373ea tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-395417161" status: 202 len: 0 microversion: 2.1 time: 0.032678 Aug 30 17:32:24.327840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4183/7952] 10.222.0.47 () {58 vars in 1251 bytes} [Tue Aug 30 17:32:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-395417161 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:32:24.353202 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-883d1a3e-2127-4bac-8fb3-bdec827b24a8 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'create', calling method: .version_select at 0x7fd3347c9310>, body: {"keypair": {"name": "tempest-TestShelveInstance-2068302209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKu1tJtXRdzH7KyadIdcMEnclKBb2YoKNMDV6zswuRQg5vgvcyeLBtZD7CXWqXW4PX9EWLKJVKw7ZDGWBGwvWSC4UNJKiWWgDsjiUWc8/yWiRup9kqd5NmgV43GCS3z2A=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:24.371215 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-883d1a3e-2127-4bac-8fb3-bdec827b24a8 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for project be2dba2127a34ca38d3e387c6f42377d. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:24.382236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-883d1a3e-2127-4bac-8fb3-bdec827b24a8 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for user f423f2d781644f4bb5f8b53225ff587d and project be2dba2127a34ca38d3e387c6f42377d. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:24.412920 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-883d1a3e-2127-4bac-8fb3-bdec827b24a8 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.064168 Aug 30 17:32:24.413862 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3770/7953] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:32:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:32:40.573182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:40.574013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:40.578019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1727704376", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2068302209", "security_groups": [{"name": "tempest-secgroup-smoke-949706300"}], "networks": [{"uuid": "4725cfe8-d47b-4380-bf5d-09cae5e3df21"}], "block_device_mapping_v2": [{"uuid": "7d3cfd9b-190f-4f95-a2c1-71c76bd2b785", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:40.696116 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] validate_networks() for [('4725cfe8-d47b-4380-bf5d-09cae5e3df21', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:32:41.094411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:32:41.094850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:32:41.095446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:32:41.095869 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:32:41.096331 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:32:41.106026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:41.106575 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:41.107035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:41.107776 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:41.108231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:41.108657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:41.136997 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for project be2dba2127a34ca38d3e387c6f42377d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:32:41.142705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Getting quotas for user f423f2d781644f4bb5f8b53225ff587d and project be2dba2127a34ca38d3e387c6f42377d. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:32:41.206069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:32:41.208606 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d3cfd9b-190f-4f95-a2c1-71c76bd2b785',volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:32:41.349043 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a53cfa69-46bb-4f9f-ac9d-3f3413b68024 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777428 Aug 30 17:32:41.349662 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4184/7954] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:32:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:32:41.361663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f9364cf9-72ff-4d19-bc59-c02f9fed9b09 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:41.362359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f9364cf9-72ff-4d19-bc59-c02f9fed9b09 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:41.365216 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:41.366072 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=4 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:41.367760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:41.426211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f9364cf9-72ff-4d19-bc59-c02f9fed9b09 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:41.434736 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f9364cf9-72ff-4d19-bc59-c02f9fed9b09 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1089 microversion: 2.1 time: 0.076825 Aug 30 17:32:41.435465 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3771/7955] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:41 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1089 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:42.461168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:42.462202 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:42.470046 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:42.470696 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:42.471222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:42.472033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:42.472764 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:42.473207 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:42.581855 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:42.590482 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-71319ce8-a5f4-43eb-a18a-d41fb9f782e6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1195 microversion: 2.1 time: 0.135727 Aug 30 17:32:42.594329 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4185/7956] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:42 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1195 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:43.613683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:43.614535 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:43.625476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.626355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.627026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.628194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:43.628904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:43.629643 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:43.796558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:43.807099 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-416278cc-ebdb-42b3-9d11-ba3927154331 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1272 microversion: 2.1 time: 0.197947 Aug 30 17:32:43.807816 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3772/7957] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:43 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:44.358102 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:44.380692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.381811 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.387011 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.426286 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] Creating event network-changed:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:32:44.436347 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-b9fa3a68-654b-47f1-8169-d55fdac9c99f req-122a4ef7-e249-4b6f-9152-f5341bfa53b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088048 Aug 30 17:32:44.437899 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4186/7958] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:44.830986 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:44.831860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:44.839597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.840108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.840621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:44.841397 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:44.841981 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:44.842518 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:45.000651 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:45.010184 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-65d177db-6b8a-425c-b721-b279df096ca3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1272 microversion: 2.1 time: 0.183128 Aug 30 17:32:45.011265 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3773/7959] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:44 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:46.040089 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:46.041140 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:46.049100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:46.049711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:46.050262 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:46.051121 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:46.051673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:46.052277 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:46.208456 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:46.218650 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c0d1ddd4-2d0f-4049-9d31-4707c734aaa3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1272 microversion: 2.1 time: 0.187264 Aug 30 17:32:46.219511 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4187/7960] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:46 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:47.240389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:47.241027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:47.249010 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:47.249523 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:47.249974 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:47.250722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:47.251196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:47.251639 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:47.400849 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:47.410720 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a96f71a-60c4-405e-b911-35fd60fc40b4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1272 microversion: 2.1 time: 0.174373 Aug 30 17:32:47.411318 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3774/7961] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:47 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:48.434858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:48.435688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:48.444447 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:48.445070 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:48.445797 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:48.446700 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:48.447299 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:48.447846 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:48.599920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:48.608423 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-39e60f3d-1d1b-4239-ab2d-41d391d9909a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.179324 Aug 30 17:32:48.609000 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4188/7962] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:48 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:49.630573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:49.631238 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:49.637694 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:49.638191 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:49.638683 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:49.639386 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:49.639860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:49.640307 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:49.777299 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:49.785547 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-75f8110f-71ac-4728-b9f4-e426d77b39e4 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.158942 Aug 30 17:32:49.786127 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3775/7963] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:49 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:50.808534 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:50.809122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:50.816858 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.817364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.817984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.818909 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:50.819436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:50.820479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:50.990515 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:50.999539 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b7472c58-f38f-4468-b1d0-2146737c0100 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.195440 Aug 30 17:32:51.000130 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4189/7964] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:50 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:52.026516 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:52.027159 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:52.029947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:52.036600 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.037099 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.037978 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.039252 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:52.039727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:52.040164 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:52.180908 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:52.189180 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-aeeba366-4bbb-4662-89c0-e1f779e1f03a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.166998 Aug 30 17:32:52.189938 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3776/7965] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:52 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:53.212486 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:53.213141 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:53.215527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:53.216541 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:32:53.222688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:53.223183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:53.223624 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:53.224325 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:53.224787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:53.225216 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:53.367143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:53.376034 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-033ab5da-a525-4a05-b5be-dbe327994d3a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.168540 Aug 30 17:32:53.376628 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4190/7966] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:53 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:32:54.397801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:54.399025 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:54.405597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.406377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.406830 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.407536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:54.407998 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:54.408459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:54.555898 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:54.563791 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c1ca4ba6-6161-4786-81b3-c01a82bf538c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.169950 Aug 30 17:32:54.564415 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3777/7967] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:54 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:55.584581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:55.585134 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:55.592254 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.592740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.593182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.593874 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:55.594361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:55.594794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:55.730984 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:55.738805 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b05d784e-e5af-407b-bced-e8aedf367972 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.158223 Aug 30 17:32:55.739385 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4191/7968] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:55 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:56.762888 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:56.763936 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:56.771720 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.772124 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.772571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.773876 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:56.774375 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:56.774866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:56.911358 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:56.919589 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27db1c9a-c428-454a-83b5-4579c5c0521e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.163094 Aug 30 17:32:56.920184 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3778/7969] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:56 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:57.940919 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:57.941451 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:57.949223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.949717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.950160 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:57.950958 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:57.951353 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:57.951787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.092290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:58.100268 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-080b56fb-3f3b-4ce8-ac46-50ad16cc701e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.163679 Aug 30 17:32:58.101374 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4192/7970] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:57 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:32:58.633620 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "name": "network-vif-plugged", "status": "completed", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:32:58.643292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:58.643793 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:58.644246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:58.655763 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] Creating event network-vif-plugged:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:32:58.661274 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0433781e-961f-479d-970b-a067c0c5c46b req-4cd60891-0195-4766-b81f-51c250d10892 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085647 Aug 30 17:32:58.661903 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3779/7971] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:32:59.122628 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:32:59.123249 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:32:59.130261 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.130788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.131231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.131931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:32:59.132943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:32:59.133381 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:32:59.279462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:32:59.287750 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-bb19cd9e-a0ec-4a57-869e-e739da2a2635 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1260 microversion: 2.1 time: 0.169065 Aug 30 17:32:59.288418 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4193/7972] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:32:59 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:33:00.314703 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:00.315427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:00.322504 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.323005 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.323459 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.324180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.324650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.325092 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.478427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.488521 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-27cc8f14-33a6-4f34-8dfd-9e90b6e19722 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1443 microversion: 2.1 time: 0.178864 Aug 30 17:33:00.489121 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3780/7973] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:00 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:00.510897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:33:00.511595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:33:00.519229 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.519800 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.520307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.521824 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:00.522477 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:00.523104 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:00.675136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:33:00.684872 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-77fc9ede-05b2-48d1-bb95-8f17afedeea3 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1443 microversion: 2.1 time: 0.178484 Aug 30 17:33:00.685471 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4194/7974] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:33:00 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:33:02.777919 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:33:02.788494 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:33:02.788989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:33:02.789437 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:33:02.800856 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] Creating event network-changed:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:33:02.806561 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-d9d9db2a-0bcd-4e37-90af-5b639f61e8a5 req-eb85b80f-2dbd-4647-8a37-40fe9a87a88d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032215 Aug 30 17:33:02.807354 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3781/7975] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:34:57.371595 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.372391 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=58 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.373909 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 17:34:57.374051 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6/action (ip 10.222.0.47) !!! Aug 30 17:34:57.379508 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:34:57.380048 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:57.388659 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.389132 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.389581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.390321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.390784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.391215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.416039 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lazy-loading 'flavor' on Instance uuid 232d987b-f309-4848-9c7f-3cdf926cc2c6 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:34:57.489078 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8facfae1-6b63-4c27-a03c-b2614daa993e tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6/action" status: 202 len: 0 microversion: 2.1 time: 0.119483 Aug 30 17:34:57.489874 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4195/7976] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:34:57 2022] POST /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:34:57.496446 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:34:57.497019 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:34:57.497704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=24 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.498710 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=52 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:34:57.504685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:57.505564 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:57.513967 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.514513 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.514973 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.515722 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:57.516203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:57.516650 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:57.764165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:57.772116 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6f895c0b-1f3b-409d-ad3d-d8e88535eb93 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.278043 Aug 30 17:34:57.772681 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3782/7977] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:57 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:34:58.797271 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:34:58.798009 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:34:58.804359 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.804843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.805281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:58.806038 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:34:58.806849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:34:58.807278 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:34:59.004987 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:34:59.013501 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e3dc5953-5831-4003-a812-8d3cb58f7c06 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.222346 Aug 30 17:34:59.014219 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4196/7978] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:34:58 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:00.035108 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:00.035733 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:00.047034 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.047536 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.047989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.048732 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:00.049198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:00.049641 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:00.053426 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53316. Aug 30 17:35:00.056501 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53318. Aug 30 17:35:00.185860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:00.193901 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a0d6f255-c266-4eaf-af66-07aecaf77060 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.162841 Aug 30 17:35:00.194501 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3783/7979] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:00 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:01.216481 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:01.217130 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:01.224168 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.224652 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.225092 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:01.225783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:01.226238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:01.226697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:01.363286 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:01.372272 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0f46bfa1-a75b-4eeb-bfea-ac14a1eab16c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.159637 Aug 30 17:35:01.372848 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4197/7980] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:01 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:02.393410 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:02.394036 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:02.400893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.401385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.401835 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.403150 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:02.403633 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:02.404330 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:02.540711 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:02.549183 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f430b1ec-e9f0-49ec-932d-bce19a4dbefc tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.159763 Aug 30 17:35:02.549753 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3784/7981] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:02 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:03.569411 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:03.570040 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:03.577525 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:03.578017 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:03.578501 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:03.579186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:03.579640 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:03.580066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:03.713821 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:03.722875 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cbaec27a-15b3-4407-98c9-22388b93ebbb tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.157414 Aug 30 17:35:03.723462 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4198/7982] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:03 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:04.744359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:04.744989 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:04.752236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:04.752730 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:04.753181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:04.753880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:04.754385 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:04.754831 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:04.889079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:04.896899 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a53090a6-f1ea-4dc2-bc0f-a9b5aa16f06d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.156552 Aug 30 17:35:04.897484 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3785/7983] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:04 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:05.919364 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:05.919943 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:05.926758 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:05.927237 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:05.927697 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:05.928379 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:05.928837 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:05.929259 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:06.064842 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:06.072766 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c67f350d-293b-4533-b398-568459c073dd tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.157798 Aug 30 17:35:06.073350 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4199/7984] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:05 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:07.094435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:07.095042 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:07.101983 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:07.102533 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:07.103008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:07.103699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:07.104170 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:07.104615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:07.248047 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:07.255984 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03733a3e-9bfb-42ea-8012-43aeb667e19c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.165777 Aug 30 17:35:07.256561 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3786/7985] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:07 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:08.277233 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:08.277863 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:08.286060 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:08.286599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:08.287047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:08.287753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:08.288221 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:08.288656 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:08.425946 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:08.433919 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ada24646-f03b-4420-ab66-a94ba811c4a9 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.160708 Aug 30 17:35:08.434524 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4200/7986] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:08 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:09.455925 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:09.456468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:09.463935 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:09.464435 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:09.464880 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:09.465582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:09.466046 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:09.466574 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:09.598549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:09.607016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a4a3f739-e06c-4146-b369-8dae3e459b5a tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.154751 Aug 30 17:35:09.608673 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3787/7987] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:09 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:10.629784 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:10.630437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:10.637609 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.638106 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.638580 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.640182 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:10.640657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:10.641096 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:10.783928 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:10.792473 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-8ff8e617-dcdc-4513-8a15-5894db10cdd5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.166514 Aug 30 17:35:10.793056 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4201/7988] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:10 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:11.813727 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:11.814394 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:11.821244 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:11.821744 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:11.822199 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:11.822947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:11.823414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:11.823861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:11.963776 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:11.972023 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c5d7f30c-310e-4ed2-b1fd-d6d52ab6fe3f tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1568 microversion: 2.1 time: 0.163091 Aug 30 17:35:11.972599 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3788/7989] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:11 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:11.993118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:11.993763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:12.002091 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:12.002607 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:12.003078 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:12.003780 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:12.004239 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:12.004705 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:12.035085 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122352) unshelve /opt/stack/nova/nova/compute/api.py:4603}} Aug 30 17:35:12.105591 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d2dd72da-9826-46ca-9416-a0d03f9099b0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "POST /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6/action" status: 202 len: 0 microversion: 2.1 time: 0.116122 Aug 30 17:35:12.110351 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4202/7990] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:35:11 2022] POST /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:35:12.115799 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:12.117260 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:12.122950 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:12.123714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:12.124714 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:12.125779 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:12.126427 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:12.127125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:12.297356 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:12.305172 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e064619c-44af-443d-85ad-53c8599a1b62 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1516 microversion: 2.1 time: 0.193432 Aug 30 17:35:12.305748 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3789/7991] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:12 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:13.094615 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "name": "network-vif-unplugged", "status": "completed", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:13.105849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:13.106354 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:13.106794 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:13.117313 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.compute.server_external_events [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] Unable to find a host for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6. Dropping event network-vif-unplugged {{(pid=122352) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Aug 30 17:35:13.118213 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-c23caaa4-2cfd-41a0-a034-54b768df63ec req-d4925512-9c8b-4031-bacc-40d9b009b200 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027646 Aug 30 17:35:13.118840 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4203/7992] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 17:35:13.325806 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:13.326570 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:13.333933 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:13.334361 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:13.334818 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:13.335558 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:13.336028 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:13.336468 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:13.496114 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:13.504296 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0b6db362-c17e-4ad3-8edf-14ecde1d6575 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1516 microversion: 2.1 time: 0.182668 Aug 30 17:35:13.504878 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3790/7993] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:13 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:14.525974 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:14.526560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:14.534432 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:14.534922 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:14.535361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:14.536053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:14.536509 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:14.536934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:14.683421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:14.692807 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4c5d9826-e5e8-48be-86cc-257ec16297e5 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1516 microversion: 2.1 time: 0.170743 Aug 30 17:35:14.693705 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4204/7994] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:14 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:15.715306 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:15.715946 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:15.723508 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.724015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.724477 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.725194 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:15.725672 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:15.726118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:15.863070 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:15.870853 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3864fe74-0917-42f8-9ff5-37eb03a55d80 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1516 microversion: 2.1 time: 0.159533 Aug 30 17:35:15.871433 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3791/7995] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:15 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:16.896073 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:16.896734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:16.904760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:16.905396 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:16.905847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:16.906576 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:16.907043 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:16.907584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:17.049304 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:17.057785 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c4b36ac9-83c0-4f84-b6c3-15454f5b9fd1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1518 microversion: 2.1 time: 0.165416 Aug 30 17:35:17.057894 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4205/7996] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:16 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:18.079954 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:18.080505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:18.087474 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:18.087965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:18.088412 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:18.089112 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:18.089576 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:18.090016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:18.230809 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:18.239034 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e40a809d-82b3-40f8-88fd-6b1eda283b08 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1518 microversion: 2.1 time: 0.163770 Aug 30 17:35:18.239625 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3792/7997] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:18 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:19.261018 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:19.261770 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:19.269956 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:19.270660 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:19.271180 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:19.271991 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:19.272527 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:19.272969 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:19.407918 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:19.415884 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e1bebd8e-7182-4fd7-8122-78e7e850aa25 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1518 microversion: 2.1 time: 0.158791 Aug 30 17:35:19.416460 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4206/7998] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:19 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:20.437743 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:20.438404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:20.445505 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.446003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.446490 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:20.447196 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:20.447665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:20.448110 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:20.582229 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:20.590445 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-03a7e110-f3b9-4ade-8c6a-5e3ccc4c83bf tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1518 microversion: 2.1 time: 0.157340 Aug 30 17:35:20.591230 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3793/7999] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:20 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:21.612581 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:21.613236 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:21.620905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.621475 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.621914 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.622601 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:21.623726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:21.624718 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:21.778227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:21.787359 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-1b569265-624b-45d9-b26a-91cffabeadd2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1518 microversion: 2.1 time: 0.179880 Aug 30 17:35:21.787950 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4207/8000] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:21 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:22.810276 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:22.811877 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:22.819258 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:22.819716 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:22.820198 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:22.820902 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:22.821368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:22.821841 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:22.965760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:22.973872 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-44fc655f-444b-417c-a4ed-9cfea91c2e92 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.167575 Aug 30 17:35:22.974470 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3794/8001] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:22 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:23.999302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:23.999917 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:24.008014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:24.008504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:24.008944 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:24.009639 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:24.010095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:24.010558 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:24.148539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:24.157814 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9338db1c-9a01-45db-8a8b-774d30006039 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.162424 Aug 30 17:35:24.158589 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4208/8002] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:23 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:25.180860 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:25.181511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:25.189606 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:25.190115 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:25.190594 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:25.191304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:25.191794 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:25.192300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:25.328847 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:25.336591 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-128ad511-1670-43c5-b393-8a95b9c82dda tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.159883 Aug 30 17:35:25.337166 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3795/8003] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:25 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:26.358526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:26.359302 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:26.367985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:26.368616 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:26.369125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:26.370029 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:26.370674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:26.371136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:26.377421 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:26.518479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:26.526263 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-16e10cbf-7a28-49d8-9f80-73d3ca487f72 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.172169 Aug 30 17:35:26.526852 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4209/8004] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:26 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:27.548289 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:27.548863 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:27.551563 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=29 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:27.558130 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:27.558682 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:27.559133 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:27.559840 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:27.560348 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:27.560859 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:27.563582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=85 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:27.708165 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:27.715999 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-537b70ec-f271-40fe-b625-7ab843e18219 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.171952 Aug 30 17:35:27.717321 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3796/8005] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:27 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:28.739178 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:28.739798 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:28.742539 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:35:28.748734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.749222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.749667 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.750415 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:28.750876 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:28.751305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:28.883264 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:28.891369 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f176e930-601f-4687-85ca-9099a2e4086d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.156067 Aug 30 17:35:28.891948 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4210/8006] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:28 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:29.913866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:29.914515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:29.922079 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:29.922671 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:29.923122 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:29.923825 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:29.924292 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:29.924731 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:30.073204 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:30.081991 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-32b8059c-5ccb-492e-91fc-387107cdf0ab tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.172072 Aug 30 17:35:30.082612 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3797/8007] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:29 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:31.103892 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:31.104634 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:31.113241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.113812 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.114273 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.115069 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:31.115589 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:31.116068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:31.261870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:31.272399 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ba237632-3436-4a5c-89c1-5209a9435629 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.172513 Aug 30 17:35:31.273006 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4211/8008] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:31 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:32.297068 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:32.297624 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:32.304652 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:32.305152 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:32.305605 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:32.306332 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:32.306807 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:32.307246 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:32.442355 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:32.450529 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-a9244c86-55c8-4528-a3c2-12819faef115 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.158366 Aug 30 17:35:32.451167 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3798/8009] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:32 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:33.273756 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "name": "network-vif-plugged", "status": "completed", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:35:33.285321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.285905 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.286504 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.299561 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] Creating event network-vif-plugged:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:35:33.305064 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-7f2ab874-8306-46a3-b9e9-e446be00a1bd req-186133ec-f8f0-429c-bbbc-181e4ce6ff25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035011 Aug 30 17:35:33.306017 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4212/8010] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:35:33.472334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:33.472947 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:33.479868 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.480372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.480823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.481531 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:33.482003 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:33.484433 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:33.626283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:33.634032 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-333b212d-0e97-434a-9b89-ab4d43662d1d tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.165742 Aug 30 17:35:33.634635 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3799/8011] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:33 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:35:34.657437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:34.658146 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:34.664720 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.665265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.665843 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.667319 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:34.667862 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:34.668544 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:34.813122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:34.822168 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-e95c8e2c-b844-4d53-9a68-9f0f9bbb08e0 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1574 microversion: 2.1 time: 0.170215 Aug 30 17:35:34.823010 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4213/8012] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:34 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:35:35.845735 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:35:35.846408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:35:35.853304 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.853808 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.854265 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:35.854997 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:35:35.855572 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:35:35.856055 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:35:35.995181 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:35:36.005368 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-bec97942-dc39-44aa-821a-51af8395c171 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1561 microversion: 2.1 time: 0.163580 Aug 30 17:35:36.005955 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3800/8013] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:35:35 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:52.480895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=7 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:52.481673 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=24 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:52.482869 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:36:52.483015 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 (ip 10.222.0.47) !!! Aug 30 17:36:52.483953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=9 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:52.485592 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=29 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:36:52.487200 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:36:52.487581 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:36:52.488896 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:36:52.489032 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.489406 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.489537 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:36:52.490454 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:36:52.490598 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:36:52.498934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.499436 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.499886 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.500596 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.501062 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.501384 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:52.501526 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.516189 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.516689 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.517139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.534153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:36:52.536780 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] Creating event network-changed:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:36:52.544852 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0d306283-a295-4645-a1d8-d7fe17dd0052 req-37b88f2d-9462-4ed8-9a0a-14fdf9435bad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063070 Aug 30 17:36:52.546129 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3801/8014] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:52.623637 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-9f45da4d-84a4-4a7c-bb9a-c9184620a6d6 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "DELETE /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 204 len: 0 microversion: 2.1 time: 0.145167 Aug 30 17:36:52.627727 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4214/8015] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:36:52 2022] DELETE /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:36:52.633597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:52.635174 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:52.646757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.647317 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.647774 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.648546 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:52.649208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:52.650287 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:52.802096 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:52.810877 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-ebbd5ceb-cbea-4b50-8af6-2b0d0580999c tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.181579 Aug 30 17:36:52.811492 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3802/8016] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:52 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:53.832760 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:53.833474 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:53.841568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.842052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.842522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.843214 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:53.843669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:53.844093 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:53.978757 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:53.986830 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-2bdd5575-c8f7-49c3-a63f-d01ada84d549 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1567 microversion: 2.1 time: 0.158788 Aug 30 17:36:53.987447 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4215/8017] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:53 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:54.877206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232d987b-f309-4848-9c7f-3cdf926cc2c6", "name": "network-vif-deleted", "tag": "6b557a37-9ec8-4ad1-baa9-69972c8313ed"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:36:54.891134 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:54.891920 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:54.892438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:54.906247 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] Creating event network-vif-deleted:6b557a37-9ec8-4ad1-baa9-69972c8313ed for instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 on n-h1-830883-28 Aug 30 17:36:54.911741 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-1c3396c3-4c20-443c-aa0e-f0d67d697347 req-369958a3-9e7e-4e13-9c7d-c882fdd7a151 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Aug 30 17:36:54.912357 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3803/8018] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:36:55.009823 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:55.011310 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:55.018839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.018839 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.019209 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.019996 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:55.020452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:55.020889 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:55.091850 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:55.100181 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a2ed54b-0343-4e45-8eff-58d5ffa48e35 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1220 microversion: 2.1 time: 0.094817 Aug 30 17:36:55.100787 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4216/8019] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:55 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:36:56.123377 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:56.124201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:56.130725 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.131221 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.131669 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.132528 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:56.132982 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:56.133413 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:56.206909 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:56.217505 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-dd2db962-9189-4b9b-a569-77e2040b0a85 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1220 microversion: 2.1 time: 0.099521 Aug 30 17:36:56.218439 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3804/8020] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:56 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:57.239123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:57.239897 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:57.248437 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.248934 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.249385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.250126 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:57.250748 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:57.251181 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:57.322114 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:57.331614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-20e68b4b-a04c-49d9-9696-aa3de7ead7d7 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1220 microversion: 2.1 time: 0.096323 Aug 30 17:36:57.332221 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4217/8021] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:57 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:58.356095 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:58.356739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:58.364256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.364772 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.365231 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.365959 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:58.366475 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:58.366927 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:58.436904 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:58.445325 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b5bd4649-38bd-45ae-beb4-8f056b894c12 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1220 microversion: 2.1 time: 0.093725 Aug 30 17:36:58.445939 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3805/8022] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:58 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:36:59.469327 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:36:59.470629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:36:59.482536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.483361 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.484067 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.485227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.485985 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.486743 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.522035 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:36:59.522565 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:36:59.523007 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:36:59.523470 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lazy-loading 'fault' on Instance uuid 232d987b-f309-4848-9c7f-3cdf926cc2c6 {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:36:59.568873 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f423f2d781644f4bb5f8b53225ff587d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be2dba2127a34ca38d3e387c6f42377d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:36:59.577239 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-cf7b58b7-3c47-476b-b5be-44a6c829beb1 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 200 len: 1225 microversion: 2.1 time: 0.114098 Aug 30 17:36:59.577837 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4218/8023] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:36:59 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:00.600685 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.602022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] [instance: 232d987b-f309-4848-9c7f-3cdf926cc2c6] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:00.609953 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.610626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.611177 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.611971 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:00.612541 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:00.616335 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:00.630288 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] HTTP exception thrown: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Request method failure captured: Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 HTTP/1.1 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkiCJxQFGf56O22f1g00EDLypvCjroP17e4YQAmBe4x6pK7PbCgkeBSbFM8CxSzeHBpD8OfFaFxLwQtv0bPKpMo8S2httY9H9LFrX6VG5RukLK9UkZ-VYultoG-aM6v8YG9u09Dz9iD3GIu4LmhAuKbgny1LBcaTyObBHvI7RPdqPQM Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: be2dba2127a34ca38d3e387c6f42377d Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestShelveInstance-1718121814 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/be2dba2127a34ca38d3e387c6f42377d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/be2dba2127a34ca38d3e387c6f42377d"}]}] Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestShelveInstance-1718121814 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: be2dba2127a34ca38d3e387c6f42377d Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestShelveInstance-1718121814 Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestShelveInstance-1718121814-project Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: f423f2d781644f4bb5f8b53225ff587d Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestShelveInstance-1718121814-project Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '232d987b-f309-4848-9c7f-3cdf926cc2c6'} Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:37:00.632137 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Returning 404 to user: Instance 232d987b-f309-4848-9c7f-3cdf926cc2c6 could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-93cf3296-496a-4dcf-8281-ee40e522e1b2 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6" status: 404 len: 111 microversion: 2.1 time: 0.037082 Aug 30 17:37:00.637511 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3806/8024] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:00 2022] GET /compute/v2.1/servers/232d987b-f309-4848-9c7f-3cdf926cc2c6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:37:00.838894 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7f4cde64-6746-4f7c-a5cf-616854e23738 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] Calling method '.version_select at 0x7fd35cdd58b0>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:00.900975 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7f4cde64-6746-4f7c-a5cf-616854e23738 tempest-TestShelveInstance-1718121814 tempest-TestShelveInstance-1718121814-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2068302209" status: 202 len: 0 microversion: 2.1 time: 0.067631 Aug 30 17:37:00.901576 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4219/8025] 10.222.0.47 () {58 vars in 1254 bytes} [Tue Aug 30 17:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2068302209 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 17:37:19.147203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=12 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:19.147970 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=24 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:19.358626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-6bf80989-758c-46ff-b420-21513a53dc82 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Action: 'create', calling method: .version_select at 0x7fd360e07c10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1375478965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+jCK0MW8ITi5L7YRAHzHKIi9oE4N61fvhg9cmqTvi+j06b7EZg1Hyo7ClPWFLBEv+zoI8+HSU4hWEZ36Nc3wi+HEV0l7FQ84SUDoDN1PimhX6CI6lH+/e4cC/P1R6CVQ=="}} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:19.377566 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6bf80989-758c-46ff-b420-21513a53dc82 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:19.386729 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.quota [None req-6bf80989-758c-46ff-b420-21513a53dc82 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for user 101bfc24b22e44a99b12c0d6c9c5b366 and project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'key_pairs'} {{(pid=122351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:19.419766 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-6bf80989-758c-46ff-b420-21513a53dc82 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.279575 Aug 30 17:37:19.420715 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3807/8026] 10.222.0.47 () {60 vars in 1159 bytes} [Tue Aug 30 17:37:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:20.590065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1364981244", "imageRef": "fa129e8e-aca8-4a84-86f6-93dc1b487325", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1375478965", "security_groups": [{"name": "tempest-secgroup-smoke-2142789135"}], "networks": [{"uuid": "8c50f0b5-e5a4-4bfe-9f0a-60cfd395c83b"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:20.601108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:20.601790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:20.729990 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] validate_networks() for [('8c50f0b5-e5a4-4bfe-9f0a-60cfd395c83b', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:37:21.313586 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:37:21.314122 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:37:21.314584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:37:21.315065 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:37:21.315393 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:37:21.325734 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.326246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.326735 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.327452 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:21.327938 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:21.328358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:21.345754 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:37:21.351166 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for user 101bfc24b22e44a99b12c0d6c9c5b366 and project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:37:21.364443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:37:21.366787 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fa129e8e-aca8-4a84-86f6-93dc1b487325',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:37:21.418894 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-69bb02f2-d9dc-4416-95cf-65a7ff74437b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837857 Aug 30 17:37:21.419553 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4220/8027] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:37:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:37:21.431886 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-18ec19c5-c8e3-4aac-8508-0164416efada tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:21.432520 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-18ec19c5-c8e3-4aac-8508-0164416efada tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:21.491371 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-18ec19c5-c8e3-4aac-8508-0164416efada tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:21.499527 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-18ec19c5-c8e3-4aac-8508-0164416efada tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1249 microversion: 2.1 time: 0.073110 Aug 30 17:37:21.500120 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3808/8028] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:21 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1249 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:22.522498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:22.523190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:22.532295 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.532808 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.533255 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:22.533966 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:22.534462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:22.534908 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:22.613291 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:22.623353 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-dab6e7e9-e298-4d65-b9bf-a0c3189aa1c6 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1301 microversion: 2.1 time: 0.106026 Aug 30 17:37:22.624680 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4221/8029] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:22 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:23.644300 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:23.644942 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:23.653604 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.654123 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.654617 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.655346 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:23.655832 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:23.656274 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:23.919088 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:23.929688 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-fa3e957b-cd00-44bf-99bd-1817d7ed37da tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.289186 Aug 30 17:37:23.930953 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3809/8030] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:23 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:24.595564 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:24.609773 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.610272 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.611711 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.624961 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] Creating event network-changed:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:37:24.630289 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-0436addd-fcd5-4d4d-8fc2-be2af9488f36 req-63cf5ea7-522c-41d6-bcc7-dc5a59eab863 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109578 Aug 30 17:37:24.631182 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4222/8031] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:24.952674 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:24.953961 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:24.961236 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.962015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.962562 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:24.963379 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:24.964051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:24.964557 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:25.124839 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:25.132796 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-282710b7-4483-41af-88db-6e6543ba0588 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.184541 Aug 30 17:37:25.133985 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3810/8032] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:24 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:26.156342 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:26.157053 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:26.163305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.163793 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.164241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.165488 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:26.165936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:26.166385 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:26.309617 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:26.318349 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-a355f8a1-3570-4b48-9f89-30ddeb63b07f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.167249 Aug 30 17:37:26.318949 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4223/8033] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:26 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:27.339698 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:27.340334 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:27.347571 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.348075 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.348534 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.349256 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:27.349728 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:27.350176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:27.489211 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:27.498162 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-8ff4e90f-d492-4c98-b0cd-449d1c4d3c7e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.162699 Aug 30 17:37:27.498797 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3811/8034] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:27 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:28.519001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:28.519767 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:28.529315 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.529831 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.530282 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.531026 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:28.531495 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:28.531930 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:28.703847 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:28.712085 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b3e37c67-0c14-4792-be6c-17db856b45fb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.197057 Aug 30 17:37:28.712799 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4224/8035] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:28 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:29.739680 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:29.740283 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:29.748524 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.749030 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.749484 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.750203 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.750702 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.751146 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.849786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "name": "network-vif-plugged", "status": "completed", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:29.862726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:29.863247 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:29.863763 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:29.884512 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] Creating event network-vif-plugged:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:37:29.891234 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-6e02dc39-12af-47f4-97ec-6bc4c9984637 req-e1bdab57-4dc1-4b67-860b-a42b690dc0e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044306 Aug 30 17:37:29.892571 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4225/8036] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:37:29.937616 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:29.945721 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-376be1bb-2566-407b-9ccd-5c146a2ed617 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.211272 Aug 30 17:37:29.946661 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3812/8037] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:29 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:30.968795 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:30.969584 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:30.976013 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.976514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.977031 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:30.977747 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:30.978208 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:30.978678 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:31.118362 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:31.126947 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-4b6af07b-63c8-48b4-8826-5e834770f712 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1375 microversion: 2.1 time: 0.163303 Aug 30 17:37:31.127558 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4226/8038] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:30 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:32.149760 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:32.150426 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:32.152615 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=6 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:32.158069 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.158601 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.159052 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.159762 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.160228 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.160663 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.306753 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:32.314761 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-0d8cd767-819e-4ebb-b8b2-8d3e0f816683 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1559 microversion: 2.1 time: 0.170013 Aug 30 17:37:32.315361 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3813/8039] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:32 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:32.335307 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:37:32.335940 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:37:32.338005 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:32.338702 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:37:32.345483 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.345982 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.346464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.347176 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:32.347641 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:32.348076 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:32.483363 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:37:32.491315 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-441b1f6a-ff9a-4922-a2c2-d9381c81f64f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1559 microversion: 2.1 time: 0.159861 Aug 30 17:37:32.491893 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4227/8040] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:37:32 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:37:34.257821 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:37:34.268467 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:37:34.268958 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:37:34.269407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:37:34.282747 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] Creating event network-changed:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:37:34.287893 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-0d9fae5b-272b-4a80-bbe6-36abff4fd285 req-1cb444cb-3c72-4497-863f-1246af8f1804 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092222 Aug 30 17:37:34.288921 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3814/8041] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:31.536173 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:39:31.537652 n-d-830883-28 devstack@n-api.service[122352]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 17:39:31.538170 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:31.539389 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=36 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:31.546186 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-276574942"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:31.548551 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:31.557387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:31.557879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:31.558344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:31.559052 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:31.559507 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:31.559933 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:31.771618 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-6fad1159-a402-4ece-ae03-61bee6302b9f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "POST /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243/action" status: 202 len: 0 microversion: 2.1 time: 0.236621 Aug 30 17:39:31.772283 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4228/8042] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:39:31 2022] POST /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:39:38.461089 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:39:38.461840 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 17:39:38.462483 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:38.463263 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=32 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:38.560391 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "name": "network-vif-plugged", "status": "completed", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:38.573408 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:38.574149 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:38.574635 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:38.587629 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] Creating event network-vif-plugged:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:39:38.593093 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-83a962f9-f224-486a-adf2-4179185283ba req-4c059d8d-09b3-4fbc-989a-4f7be56b9f93 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133864 Aug 30 17:39:38.593998 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3815/8043] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:45.394003 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:45.394891 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:45.401056 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1616330667", "imageRef": "ded052ea-943d-43f8-b66b-4b534b649170", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1375478965", "security_groups": [{"name": "tempest-secgroup-smoke-2142789135"}], "networks": [{"uuid": "8c50f0b5-e5a4-4bfe-9f0a-60cfd395c83b"}]}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:45.432315 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [d8efbb72-c126-425b-94d2-eea19c4fb9e9] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53828. Aug 30 17:39:45.433345 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] [b270fa46-151b-404a-b97f-19800e7a9f18] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53830. Aug 30 17:39:45.559028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.network.neutron [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] validate_networks() for [('8c50f0b5-e5a4-4bfe-9f0a-60cfd395c83b', None, None, None, None, None)] {{(pid=122352) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 17:39:45.985019 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Flavor limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 17:39:45.985444 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Image limits 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 17:39:45.985955 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Flavor pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 17:39:45.986400 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Image pref 0:0:0 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 17:39:45.986820 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.virt.hardware [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122352) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 17:39:45.997487 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:45.998100 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:45.998568 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:45.999297 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:45.999805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:46.000454 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:46.018622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 17:39:46.024225 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.quota [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Getting quotas for user 101bfc24b22e44a99b12c0d6c9c5b366 and project e19fde802a1b4b5d95d4df3de9f81d2b. Resources: {'cores', 'instances', 'ram'} {{(pid=122352) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 17:39:46.043358 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Going to run 1 instances... {{(pid=122352) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 17:39:46.045870 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ded052ea-943d-43f8-b66b-4b534b649170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122352) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 17:39:46.095791 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d1dc37c9-01b3-42bf-a515-e2b0df1f2611 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704062 Aug 30 17:39:46.096459 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4229/8044] 10.222.0.47 () {60 vars in 1147 bytes} [Tue Aug 30 17:39:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 17:39:46.110648 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-b2dfc13e-4983-447e-9573-211c0c46c5bf tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:46.111366 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-b2dfc13e-4983-447e-9573-211c0c46c5bf tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:46.126806 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53844. Aug 30 17:39:46.144219 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 53846. Aug 30 17:39:46.180511 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-b2dfc13e-4983-447e-9573-211c0c46c5bf tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:46.188654 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-b2dfc13e-4983-447e-9573-211c0c46c5bf tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1249 microversion: 2.1 time: 0.084407 Aug 30 17:39:46.189241 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3816/8045] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:46 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:47.216848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:47.217490 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:47.225848 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:47.226222 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:47.226937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:47.227657 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:47.228125 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:47.228560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:47.305766 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:47.314055 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5d61b3d7-0db7-43d2-aa35-1d957a49b2a7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1309 microversion: 2.1 time: 0.102831 Aug 30 17:39:47.314845 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4230/8046] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:47 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:48.339354 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:48.341581 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:48.353502 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.354479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.355184 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.356171 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.356922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.357582 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.440407 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:48.452089 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-443fb7ab-3200-4ab0-aa17-2ebbaf3b2831 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.119518 Aug 30 17:39:48.453581 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3817/8047] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:48 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:48.480849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "name": "network-vif-unplugged", "status": "completed", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:48.493124 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:48.493895 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:48.494572 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:48.513953 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.compute.server_external_events [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] Creating event network-vif-unplugged:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:39:48.519759 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [req-f00732f1-30fb-4bcd-bf78-27017d75503c req-43d72655-f986-4bc4-9ece-29f68531ef86 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042469 Aug 30 17:39:48.521685 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4231/8048] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:49.484359 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:49.485492 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:49.498100 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:49.499370 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:49.500417 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:49.501924 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:49.503040 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:49.504224 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:49.591051 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:49.609436 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-57fd96c6-462a-40cc-9d6b-fe7c6c2a2b18 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.122962 Aug 30 17:39:49.609436 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3818/8049] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:49 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:50.625989 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:50.628227 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:50.638963 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.639462 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.639903 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.640612 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:50.641068 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:50.641494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:50.728514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:50.737140 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-ed452266-87a1-40c1-a3c0-d32cb5c584b9 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.118377 Aug 30 17:39:50.737735 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4232/8050] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:50 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:51.761245 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:51.761918 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:51.768464 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:51.769180 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:51.769649 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:51.770491 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:51.770979 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:51.771434 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:51.843788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:51.853200 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-4548f69b-279a-4809-8777-f5a276e0c8cd tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.097851 Aug 30 17:39:51.854206 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3819/8051] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:51 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:52.881047 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:52.881865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:52.891693 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:52.892710 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:52.893223 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:52.894446 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:52.894937 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:52.895583 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:52.973265 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:52.989437 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c6eddd84-3acd-43a7-bb5d-93a14f47c220 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.111370 Aug 30 17:39:52.993614 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4233/8052] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:52 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:39:54.014878 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:54.015506 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:54.022890 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:54.023395 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:54.023848 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:54.025704 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:54.026389 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:54.027008 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:54.100290 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:54.108512 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-9a350675-f641-4ebc-ae31-2db162d857f0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.097412 Aug 30 17:39:54.109295 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3820/8053] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:54 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:55.130662 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:55.131498 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:55.138849 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:55.139343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:55.139786 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:55.140497 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:55.140959 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:55.141387 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:55.206672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:55.215401 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-d6a43758-bda5-403f-9804-053757f28a1c tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.089333 Aug 30 17:39:55.215999 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4234/8054] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:55 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:56.237207 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:56.237926 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:56.242965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell0:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:56.248176 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.248734 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.249298 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.250054 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:56.250626 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:56.251132 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:56.323597 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:56.331527 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-f5387745-5d11-42fd-a3bd-5c24c896136a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.098287 Aug 30 17:39:56.332126 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3821/8055] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:56 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:57.352669 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:57.353294 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:57.355373 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:57.356478 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell0:SELECT=6 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:39:57.363753 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.364449 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.364866 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.365692 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:57.366156 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:57.366625 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:57.447179 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:57.455614 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-103d9aca-d25d-4cad-99e7-8023821b8ab0 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1307 microversion: 2.1 time: 0.106923 Aug 30 17:39:57.470328 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4235/8056] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:57 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:58.348162 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:39:58.360281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.360932 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.361452 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.374669 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] Creating event network-changed:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:39:58.380987 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-a695aea1-a90a-4bc6-9488-6f1ae917e233 req-9f5c552e-6603-4b58-b1ef-7de6d01178fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Aug 30 17:39:58.381958 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3822/8057] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:39:58.478343 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:58.478931 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:58.485916 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.486443 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.486954 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.487671 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:58.488136 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:58.488569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:58.821305 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:39:58.829414 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-7550bd42-6cb1-4eb4-a6c4-4b15db73f81b tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.355851 Aug 30 17:39:58.830017 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4236/8058] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:58 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:39:59.854476 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:39:59.855213 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:39:59.861861 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:59.862393 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:59.862855 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:39:59.863565 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:39:59.864029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:39:59.864466 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:00.060015 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:00.068604 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-86a7b063-6f4f-496c-acea-745ec9ae00ac tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.219990 Aug 30 17:40:00.069213 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3823/8059] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:39:59 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:01.090066 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:01.091426 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:01.100001 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:01.100599 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:01.101143 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:01.101939 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:01.102514 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:01.103016 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:01.337133 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:01.346856 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18cf9b67-3d8d-4775-a3f5-60d8ef4f00d7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.260614 Aug 30 17:40:01.347469 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4237/8060] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:01 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 17:40:02.369291 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:02.369921 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:02.377281 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.377785 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.378268 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.379012 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:02.380073 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:02.380515 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:02.528658 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:02.537041 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-e314c5a0-1e12-49f5-9ba2-3874bfd70d1a tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.172672 Aug 30 17:40:02.537631 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3824/8061] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:02 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:03.559499 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:03.560161 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:03.568570 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.569075 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.569523 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.570250 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:03.570740 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:03.571169 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:03.719033 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:03.727761 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-84a86334-edc5-4dca-ab8c-97b2b0d821cb tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.172807 Aug 30 17:40:03.728358 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4238/8062] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:03 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:04.749742 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:04.750421 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:04.758341 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:04.759029 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:04.759479 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:04.760201 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:04.760665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:04.761106 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:04.905823 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:04.914031 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-2df99c45-3e1b-49b8-b647-39555272ed0d tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.168627 Aug 30 17:40:04.914648 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3825/8063] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:04 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:05.935717 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:05.936321 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:05.945108 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:05.945688 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:05.946268 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:05.947404 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:05.948057 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:05.948672 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:06.115587 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:06.124317 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f46c2eef-6fc2-4200-b2fb-7adbe02d3309 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.192439 Aug 30 17:40:06.125046 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4239/8064] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:05 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:06.274836 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "name": "network-vif-plugged", "status": "completed", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:06.289999 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:06.290965 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:06.291637 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:06.303685 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] Creating event network-vif-plugged:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:40:06.308906 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-354d86b3-ce3c-4fce-8bf3-fc70d98f18cb req-c31e2e50-c902-4d1c-8b96-2b209ee9d4b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040034 Aug 30 17:40:06.309524 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3826/8065] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:40:07.147936 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:07.148567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:07.155095 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.155567 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.156014 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:07.156725 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:07.157190 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:07.157623 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:07.309433 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:07.318333 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-79164fcf-0e6d-46af-9b53-7866299354a3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1375 microversion: 2.1 time: 0.176332 Aug 30 17:40:07.318935 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4240/8066] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:07 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:08.341331 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:08.342066 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:08.349382 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:08.349885 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:08.350363 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:08.351080 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:08.351549 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:08.351988 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:08.501739 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:08.504118 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=59 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:08.511803 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-63fc8d58-dbc2-4d39-a742-f8d4074de410 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1559 microversion: 2.1 time: 0.175576 Aug 30 17:40:08.512408 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3827/8067] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:08 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:08.532629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:40:08.533260 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:40:08.541308 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:08.541814 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:08.542281 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:08.543004 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:08.543476 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:08.543913 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:08.683973 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:40:08.692407 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-5dec9971-a359-4a7b-a2da-0536de55f0e1 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1559 microversion: 2.1 time: 0.163443 Aug 30 17:40:08.693039 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4241/8068] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:40:08 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:40:10.396414 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:40:10.402621 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=29 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:40:10.409081 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:40:10.409577 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:40:10.410026 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:40:10.426697 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] Creating event network-changed:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:40:10.432208 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-5b450fc3-56bf-4e47-8315-e9379ae15ab3 req-d2ff0a0b-f29d-4cc0-8661-b30d153f290f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039745 Aug 30 17:40:10.433034 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3828/8069] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:12.444482 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:12.445244 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=70 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:12.446879 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 17:42:12.446879 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a/action (ip 10.222.0.47) !!! Aug 30 17:42:12.448061 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 17:42:12.448232 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a/action (ip 10.222.0.47) !!! Aug 30 17:42:12.449064 n-d-830883-28 devstack@n-api.service[122352]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:42:12.449202 n-d-830883-28 devstack@n-api.service[122352]: Tue Aug 30 17:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a/action (ip 10.222.0.47) !!! Aug 30 17:42:12.454246 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-213001182"}} {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:12.456590 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:12.470851 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.471344 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.471788 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.472494 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:12.472957 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:12.473384 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:12.682667 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-18310e21-2c34-4ba6-a1d0-dc8b8fce36b7 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "POST /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a/action" status: 202 len: 0 microversion: 2.1 time: 0.239910 Aug 30 17:42:12.687074 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4242/8070] 10.222.0.47 () {60 vars in 1278 bytes} [Tue Aug 30 17:42:12 2022] POST /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 17:42:20.937551 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 17:42:20.942674 n-d-830883-28 devstack@n-api.service[122351]: ERROR oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 17:42:20.953022 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=1 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:20.956139 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=3 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:20.957791 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:42:20.958159 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:42:20.961103 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 17:42:20.961255 n-d-830883-28 devstack@n-api.service[122351]: Tue Aug 30 17:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Aug 30 17:42:20.971612 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "name": "network-vif-plugged", "status": "completed", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:21.016866 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:21.017805 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:21.018801 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:21.036844 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] Creating event network-vif-plugged:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:42:21.044501 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-840da963-8331-499c-9e07-0b392d13295c req-0557348a-e44a-4810-af66-5182f7d58b6d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112158 Aug 30 17:42:21.045445 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3829/8071] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:31.743215 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_api:SELECT=2 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:31.744153 n-d-830883-28 devstack@n-api.service[122352]: DEBUG dbcounter [-] [122352] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:31.747127 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:31.749622 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:31.750230 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:31.756218 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_api:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:31.756931 n-d-830883-28 devstack@n-api.service[122351]: DEBUG dbcounter [-] [122351] Writing DB stats nova_cell1:SELECT=2 {{(pid=122351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 17:42:31.764036 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.764546 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.765023 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.765238 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.765529 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.765976 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.766560 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.767037 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.767479 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.782171 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] Creating event network-changed:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:42:31.786254 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [0b6f9a99-ba2e-42a7-8ffe-9f7f469353fd] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54194. Aug 30 17:42:31.789355 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-dfeeb35e-29e9-498e-b99d-6385805cce3e req-9e80a2f1-03e5-4633-aef8-c21ea905c1d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047044 Aug 30 17:42:31.790475 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3830/8072] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:31.811727 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:42:31.902002 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-0a19ff09-92a5-450e-9a7f-c16bf1be4a99 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "DELETE /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 204 len: 0 microversion: 2.1 time: 0.162370 Aug 30 17:42:31.903073 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4243/8073] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:31 2022] DELETE /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:31.912748 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:31.913827 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:31.916820 n-d-830883-28 devstack@n-api.service[122351]: INFO oslo.messaging._drivers.impl_rabbit [-] [882f5fc6-a69d-40a0-a2e8-7d51b1a85a20] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54196. Aug 30 17:42:31.921811 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.922333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.922788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:31.923673 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:31.924372 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:31.924813 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:32.068480 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:32.077235 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-3bb685ea-86ea-4530-9b4f-792276733296 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1682 microversion: 2.1 time: 0.169627 Aug 30 17:42:32.078054 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3831/8074] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:31 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:33.099803 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:33.100522 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:33.108195 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.108699 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.109145 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.109865 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:33.110351 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:33.110790 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:33.359241 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:33.368124 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-c8f28050-170d-43d2-bd13-aec6b42e3004 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1682 microversion: 2.1 time: 0.271831 Aug 30 17:42:33.368717 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4244/8075] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:33 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1682 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:34.188893 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43387e50-6744-4373-a5ce-60f0c121536a", "name": "network-vif-deleted", "tag": "c03296ef-5a17-458b-9f63-dbdd53b0dbb6"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:34.198922 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:34.199498 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:34.200200 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:34.212621 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] Creating event network-vif-deleted:c03296ef-5a17-458b-9f63-dbdd53b0dbb6 for instance 43387e50-6744-4373-a5ce-60f0c121536a on n-h2-830883-28 Aug 30 17:42:34.218127 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-8fe1a901-26ec-4a0f-b116-ca44fa71c995 req-e4e0c3eb-e6d9-4eb6-89b9-73155fd2116e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087174 Aug 30 17:42:34.218818 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3832/8076] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:34.389135 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:34.389772 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:34.396783 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:34.397536 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:34.397978 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:34.399510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:34.399805 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:34.400231 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:34.436352 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:34.437120 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:34.437569 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:34.438028 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.objects.instance [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lazy-loading 'fault' on Instance uuid 43387e50-6744-4373-a5ce-60f0c121536a {{(pid=122352) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 17:42:34.485219 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:34.494091 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-edebd498-823f-4977-ba77-257875b520de tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 200 len: 1339 microversion: 2.1 time: 0.108780 Aug 30 17:42:34.494829 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4245/8077] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:34 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:35.517438 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:35.518062 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: 43387e50-6744-4373-a5ce-60f0c121536a] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:35.524757 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:35.525249 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:35.525699 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:35.526425 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:35.526894 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:35.527333 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:35.541011 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.wsgi [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] HTTP exception thrown: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Request method failure captured: Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: request: GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a HTTP/1.1 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Accept: application/json Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Accept-Encoding: identity Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Connection: close Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Content-Length: 0 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Content-Type: application/json Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Host: 10.222.0.47 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: Openstack-System-Scope: None Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Auth-Token: gAAAAABjDkrJPImRGAcNwVhxO8I__Xvpj_YAQ4BaPwbEPkmnM9CyKYPN4Om_eX4JfZbTrLUokZ1Zr3Ai0QTHHXs-iF47VWPflmKVlS0Q1eFUiaEZsFJ9emi9JjLad10bzyGNRK25vNTA4XeHiZLNz3ST_rypKw-8fX1MoydL40etBnpLg1D0DMY Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Id: None Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Domain-Name: None Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Identity-Status: Confirmed Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Is-Admin-Project: True Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Id: default Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Domain-Name: Default Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Id: e19fde802a1b4b5d95d4df3de9f81d2b Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Project-Name: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Role: reader,member Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Roles: reader,member Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e19fde802a1b4b5d95d4df3de9f81d2b"}]}] Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Id: e19fde802a1b4b5d95d4df3de9f81d2b Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-Tenant-Name: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-User: tempest-TestSnapshotPattern-2026015080-project Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Id: default Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-User-Domain-Name: Default Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-User-Id: 101bfc24b22e44a99b12c0d6c9c5b366 Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: X-User-Name: tempest-TestSnapshotPattern-2026015080-project Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: method: > Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: exception: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: action_args: {'id': '43387e50-6744-4373-a5ce-60f0c121536a'} Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:35.542665 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: ERROR nova.api.openstack.wsgi Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Returning 404 to user: Instance 43387e50-6744-4373-a5ce-60f0c121536a could not be found. {{(pid=122351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-c34c1c08-ea8a-4246-89b4-947b20ed5b33 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a" status: 404 len: 111 microversion: 2.1 time: 0.031929 Aug 30 17:42:35.548016 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3833/8078] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:35 2022] GET /compute/v2.1/servers/43387e50-6744-4373-a5ce-60f0c121536a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:36.871900 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:36.872531 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:36.873125 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:36.880341 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:36.880920 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:36.881464 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:36.882283 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:36.883401 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:36.883929 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:36.886214 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:36.886766 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:36.887206 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:36.899054 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] Creating event network-changed:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:42:36.905895 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-06766ccb-a85a-4d09-8c0c-fcabb6ac32ee req-7a60e244-effc-4ff8-aaf7-e1f2231ecbe2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037155 Aug 30 17:42:36.907173 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3834/8079] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 17:42:36.917629 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Going to try to terminate instance {{(pid=122352) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 17:42:37.002725 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-f37d6e81-e85b-4282-9304-846f25bb382e tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 204 len: 0 microversion: 2.1 time: 0.136033 Aug 30 17:42:37.003440 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4246/8080] 10.222.0.47 () {58 vars in 1239 bytes} [Tue Aug 30 17:42:36 2022] DELETE /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 17:42:37.012939 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:37.014027 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.compute.api [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122351) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:37.021802 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:37.022678 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:37.023208 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:37.024004 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:37.024573 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:37.025091 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:37.167797 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.policy [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122351) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:37.175817 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-881397e9-b13b-4b6c-ba0b-8346ef0bb3e3 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1684 microversion: 2.1 time: 0.167574 Aug 30 17:42:37.176402 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3835/8081] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:37 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:38.198510 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:38.199853 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:38.206779 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.207290 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.207726 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.208424 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.208879 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.209303 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.455545 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.policy [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101bfc24b22e44a99b12c0d6c9c5b366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19fde802a1b4b5d95d4df3de9f81d2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122352) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 17:42:38.465035 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-b42c89bd-fdff-47f9-a323-9b027cf1528f tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 200 len: 1565 microversion: 2.1 time: 0.271644 Aug 30 17:42:38.465632 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4247/8082] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:38 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 17:42:38.508788 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe632a1-c37c-4bbb-b256-520c74838243", "name": "network-vif-deleted", "tag": "4146064f-586a-4ceb-9d3f-eb476d549e4c"}]} {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 17:42:38.518404 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:38.518923 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:38.519368 n-d-830883-28 devstack@n-api.service[122351]: DEBUG oslo_concurrency.lockutils [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:38.531360 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.compute.server_external_events [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] Creating event network-vif-deleted:4146064f-586a-4ceb-9d3f-eb476d549e4c for instance cfe632a1-c37c-4bbb-b256-520c74838243 on n-h1-830883-28 Aug 30 17:42:38.536105 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [req-20d1997a-141a-485f-89eb-c7089d1be67b req-d481ac52-030f-45ae-b143-d2ae78251e96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089770 Aug 30 17:42:38.536710 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3836/8083] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Aug 30 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 17:42:39.487123 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '>' {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:39.487663 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.compute.api [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] [instance: cfe632a1-c37c-4bbb-b256-520c74838243] Fetching instance by UUID {{(pid=122352) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 17:42:39.495183 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:39.495674 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:39.496118 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:39.496810 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Acquiring lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 17:42:39.497274 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 17:42:39.497701 n-d-830883-28 devstack@n-api.service[122352]: DEBUG oslo_concurrency.lockutils [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Lock "5f94f90b-c483-4336-9a70-6afa481bc2ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 17:42:39.511371 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.wsgi [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] HTTP exception thrown: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Request method failure captured: Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: request: GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 HTTP/1.1 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Accept: application/json Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Accept-Encoding: identity Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Connection: close Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Content-Length: 0 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Content-Type: application/json Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Host: 10.222.0.47 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: Openstack-System-Scope: None Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: User-Agent: python-urllib3/1.26.12 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Auth-Token: gAAAAABjDkrJPImRGAcNwVhxO8I__Xvpj_YAQ4BaPwbEPkmnM9CyKYPN4Om_eX4JfZbTrLUokZ1Zr3Ai0QTHHXs-iF47VWPflmKVlS0Q1eFUiaEZsFJ9emi9JjLad10bzyGNRK25vNTA4XeHiZLNz3ST_rypKw-8fX1MoydL40etBnpLg1D0DMY Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Id: None Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Domain-Name: None Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Identity-Status: Confirmed Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Is-Admin-Project: True Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Id: default Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Domain-Name: Default Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Id: e19fde802a1b4b5d95d4df3de9f81d2b Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Project-Name: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Role: reader,member Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Roles: reader,member Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e19fde802a1b4b5d95d4df3de9f81d2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e19fde802a1b4b5d95d4df3de9f81d2b"}]}] Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Id: e19fde802a1b4b5d95d4df3de9f81d2b Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-Tenant-Name: tempest-TestSnapshotPattern-2026015080 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-User: tempest-TestSnapshotPattern-2026015080-project Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Id: default Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-User-Domain-Name: Default Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-User-Id: 101bfc24b22e44a99b12c0d6c9c5b366 Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: X-User-Name: tempest-TestSnapshotPattern-2026015080-project Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: method: > Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: exception: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: action_args: {'id': 'cfe632a1-c37c-4bbb-b256-520c74838243'} Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: {{(pid=122352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 17:42:39.512993 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: ERROR nova.api.openstack.wsgi Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: DEBUG nova.api.openstack.wsgi [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Returning 404 to user: Instance cfe632a1-c37c-4bbb-b256-520c74838243 could not be found. {{(pid=122352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: INFO nova.api.openstack.requestlog [None req-29694200-212e-4ae7-a80c-b10ca80a4490 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243" status: 404 len: 111 microversion: 2.1 time: 0.031386 Aug 30 17:42:39.518252 n-d-830883-28 devstack@n-api.service[122352]: [pid: 122352|app: 0|req: 4248/8084] 10.222.0.47 () {58 vars in 1236 bytes} [Tue Aug 30 17:42:39 2022] GET /compute/v2.1/servers/cfe632a1-c37c-4bbb-b256-520c74838243 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 17:42:39.684315 n-d-830883-28 devstack@n-api.service[122351]: DEBUG nova.api.openstack.wsgi [None req-37f43cb8-1b82-4717-89a6-ad78c44018b4 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] Calling method '.version_select at 0x7fd35e506790>' {{(pid=122351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 17:42:39.708469 n-d-830883-28 devstack@n-api.service[122351]: INFO nova.api.openstack.requestlog [None req-37f43cb8-1b82-4717-89a6-ad78c44018b4 tempest-TestSnapshotPattern-2026015080 tempest-TestSnapshotPattern-2026015080-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1375478965" status: 202 len: 0 microversion: 2.1 time: 0.029485 Aug 30 17:42:39.709073 n-d-830883-28 devstack@n-api.service[122351]: [pid: 122351|app: 0|req: 3837/8085] 10.222.0.47 () {58 vars in 1257 bytes} [Tue Aug 30 17:42:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1375478965 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)